POVS Delphi Study

Welcome to the POVS Delphi Study

Please enter your email to begin reviewing rubric criteria. Your email is used only to validate panel membership and is never stored in plaintext.

Your email is never stored in plaintext. It is immediately hashed using SHA256 and only the hash is retained. This ensures your identity is protected while validating panel membership.
Skip for now — view rubrics without saving

Critical Thinking

The three universal critical thinking criteria: Methodology & Reasoning, Interpretation of Output, and Evaluation & Tool Justification.

When to apply: Critical thinking may not be applied to all POVS assessments. For example, performing an nmap scan to demonstrate a participant can use nmap doesn't require critical thinking criteria. However, if they have to create a custom port scanner in an OT environment where critical medical systems are being managed, that is when this rubric would be added.
References: Paper 1 · Paper 2

Methodology & Reasoning

Whether the approach to the task is planned, sequenced, and justified — not ad hoc. Evidence includes documented steps, ordering rationale, choice of methods or tools explained, and description of how outputs were triaged or filtered.

NOTE: Click any level descriptor to edit it directly. Your edits are saved automatically.

ScoreLevel Descriptor
4Fully articulated approach: every step and choice explicitly justified; sequence is logically motivated; triage or filtering explained; approach is reproducible and complete with no unexplained gaps.
3Clear approach with steps and sequence explained; method choices justified with minor gaps; some triage or filtering described with acceptable rationale.
2Some steps described with partial justification; method choices mentioned but rationale vague or incomplete; triage or filtering absent or unexplained.
1Minimal or no approach described; steps listed without ordering rationale or method justification; no filtering or triage described.
0No approach presented; submission does not describe how the work was performed.

Creativity

The three universal creativity criteria: Originality, Generation & Selection of Ideas, and Value / Usefulness.

When to apply: Creativity may not be applied to all POVS assessments. For example, performing an nmap scan to demonstrate a participant can use nmap doesn't require creativity criteria. However, if they have to write a port scanner, that is when this rubric would be added.
References: Paper 1 · Paper 2

Originality

Novelty of the product or approach — unexpected or inventive use of ideas, structure, or method appropriate to the task.

NOTE: Click any level descriptor to edit it directly. Your edits are saved automatically.

ScoreLevel Descriptor
4Highly unique, incorporating novel ideas and displaying inventiveness. Approach, structure, or method is clearly original and justified.
3Unique, involving some new ideas or improvements or a tentative attempt to find new uses for common ideas.
2Some non-standard choice or structure but without clear rationale, or one plausible original idea stated but not carried through.
1Purely conventional or template-like response with no stated rationale for approach, structure, or choices.
0No discernible approach, structure, or product.

Universal Rubric

All six universal criteria - Critical Thinking and Creativity - applied across every cybersecurity domain.

What this is: The Universal Rubric is the main rubric applied to all assessments across all domains. It combines Critical Thinking and Creativity into a single 6-criteria framework.

Standalone use: This rubric can be used on its own for tasks that do not require domain-specific criteria - for example, a participant demonstrating they can run an nmap scan, locate an event in a log, or run commands in a terminal.

Methodology & Reasoning

Whether the approach to the task is planned, sequenced, and justified — not ad hoc. Evidence includes documented steps, ordering rationale, choice of methods or tools explained, and description of how outputs were triaged or filtered.

NOTE: Click any level descriptor to edit it directly. Your edits are saved automatically.

ScoreLevel Descriptor
4Fully articulated approach: every step and choice explicitly justified; sequence is logically motivated; triage or filtering explained; approach is reproducible and complete with no unexplained gaps.
3Clear approach with steps and sequence explained; method choices justified with minor gaps; some triage or filtering described with acceptable rationale.
2Some steps described with partial justification; method choices mentioned but rationale vague or incomplete; triage or filtering absent or unexplained.
1Minimal or no approach described; steps listed without ordering rationale or method justification; no filtering or triage described.
0No approach presented; submission does not describe how the work was performed.
Saving...