Being a reviewer
Certification ends with humans. Reviewers score real pipeline outputs — blindly — and their consensus decides what becomes buyable.
Enroll as a reviewer
I want to become a marketplace reviewer.
Once enrolled, review tasks become available to you.
Get a task
Give me my next review task.
Each task shows you a test input, the output a pipeline produced, and a scoring rubric. You never see the pipeline’s name, prompts, creator, or other reviewers’ scores — blindness is what keeps reviews honest.
Score honestly
Score each rubric dimension based on the output in front of you, nothing else. Reviews that cluster suspiciously or rubber-stamp everything are detectable over time and can end reviewer access.
Submit my review: accuracy 4, clarity 5, consistency 4, …
After submitting, you can pull the next task immediately.
Why self-review is impossible
The system — not the reviewer — assigns tasks. Creators are never served their own listings, tasks carry no creator identity, and the same reviewer never sees the same prompt twice. There is no way to pick, recognize, or coordinate on a specific listing.
What your reviews decide
A listing becomes buyable only when enough independent reviewers agree its outputs are genuinely good: a minimum average score plus a minimum pass ratio. Your scores directly gate what buyers can purchase — that’s the point.