Your stale-correction example is the one I needed. The labels say the judge fails 88% of bad outputs, today's subtler ones only 60%, and the stale correction reports 74% when the true rate is 60%. I'm putting the label date next to the corrected pass rate on my dashboard, so a number built on old labels at least looks old.