Methodology
Fair Trial checklist
Run every pack, experiment, or shadow benchmark with the same guardrails so your deltas hold up under scrutiny.
Calibrate the lineup
- •Counterbalance order: half of participants start manual, half start with AI.
- •Lock the timebox for each round (e.g., 6 minutes manual, 6 minutes with AI).
Control the inputs
- •Use identical materials, prompts, and evaluation rubrics for both passes.
- •Capture the exact prompt history or template so others can replicate it.
Record verification time
- •Log how long the reviewer spends checking, editing, or rejecting the work.
- •Note any defects or hallucinations so you can compare quality, not just speed.
Related resources
Pair this checklist with the prompt engineering guide and the writing style guide to keep experiments comparable and legible for stakeholders.
Next Steps
Ready to measure your AI impact? Start with a quick demo to see your Overestimation Δ and cognitive load metrics.