Human review workflow
Turn disagreement into an auditable decision
A small synthetic queue demonstrates independent labels, disagreement review and adjudication. Edit the label pairs to see agreement update.
A browser-only review queue for independent labels, disagreement triage, adjudication and agreement statistics.
A small synthetic queue demonstrates independent labels, disagreement review and adjudication. Edit the label pairs to see agreement update.
| Case | Input / output | Reviewer A | Reviewer B | Decision |
|---|
Unweighted Cohen’s kappa is undefined if expected agreement is 1 or there are no jointly labeled cases.
Companion demo for the source repository. The sample prompts and responses are synthetic.