Put two workflows through the same work. See what passes, what breaks, and what each usable result costs.
FICTIONAL EXAMPLE
This example is invented to explain the tool. It is not a benchmark or a claim about any model.
Drafts are saved in this browser on this device. This tool does not upload your entries or call model providers. Keep a project file if you need a portable copy. Interface and exports are in English.
05 / METHOD & LIMITS
Know what you’re comparing.
01 / COST
The whole job, counted.
Total cost = service charges + (review and repair minutes ÷ 60 × hourly cost). Divide by accepted results for the cost of one usable result. Costs on pending and rejected tasks remain included. No accepted results means no cost-per-result figure.
02 / QUALITY
A cheap mistake still fails.
Acceptance = accepted tasks ÷ reviewed tasks. Pending tasks are excluded from that rate and block a completed comparison. Critical failures are reviewed but never accepted. A workflow meets your criteria only when every task is reviewed, it has at least one accepted result, it reaches your target, and it has no critical failures.
03 / EVIDENCE
A pilot is a starting point.
Six example tasks cannot establish reliability. Use representative work, include difficult cases, and check a fresh task set before adoption. The tool does not estimate statistical significance, judge outputs automatically, or establish that a model is safe.
04 / BOUNDARIES
Document the missing costs.
Costs are in USD. Add allocated setup and tool costs to service charges if you include them, and document that choice. Latency, energy use, maintenance, and opportunity cost are not estimated here. A small pilot is not a production forecast.
Version 1.0 · You may use and adapt exported reports and worksheets, including commercially. Attribution to JDGMNT is appreciated. User-entered evaluations are not verified or endorsed by JDGMNT.