Learn and improve
Build the Rep
Practice a fading judgment on purpose
Design a short repeatable exercise that rebuilds one specific judgment AI has taken over.
Borrowed from research on expert performance by K. Anders Ericsson and colleagues, especially their work on deliberate practice. Read the original source.
One session · An hour or more to set up · Anyone on the team can start it · Start here for this problem
Try this first
One eroding judgment, ten real cases with known answers, twenty minutes, answers revealed at the end.
Use it when
People can no longer do unaided what they could do two years ago, and the only response so far has been to require them to prove it.
Skip it when
It needs a judgment where correctness can be established after the fact. On genuinely contested calls there is no feedback signal and the reps teach nothing.
How to introduce it
Name one thing this team used to be good at and is getting worse at. We are going to build a short exercise around it. Real cases, a right answer, feedback in the moment, and hard enough that people get some wrong. Then it goes on the calendar, because one session builds nothing.
How to show up
Hold the room to one judgment rather than a curriculum. Insist on cases with known answers, because without them this becomes a discussion group. Make sure the first rep runs in the session so the design gets tested.
How long it takes
Half a day to design and run the first rep. Twenty to thirty minutes per rep after that.
What makes it hard
People find it humiliating to be worse than they were, so the first session needs cover from whoever runs the team. Sourcing cases with known answers takes real work and is the step most likely to get skipped.
What it looks like when it's working
Scores improve across sessions and people start volunteering cases. Attendance dropping after the second session means the difficulty was set wrong.
How long until it sticks
Eight to twelve reps before the judgment steadies. Evidence for that number is thin, so watch the scores rather than the count.
How you know it stuck
Reps sit on the calendar like any other recurring commitment and survive a busy quarter.
The idea behind it
Practice only builds skill when it has a right answer and immediate feedback. Hours of doing the work do not qualify if nobody finds out they were wrong.
Where it comes from
Expertise research. When a model does the work, the skill that used to come from doing the work stops arriving. Certification gates catch the erosion and do nothing to reverse it. The team names one judgment that is eroding, then designs a repeatable exercise where a right answer exists, feedback comes immediately, and the difficulty sits at the edge of current ability.
Pairs with
The masterpiece, which is the gate this feeds. The Known-Answer Set, which supplies the cases.