Google Research·· 4 h ago
Agile Deliberation: How AI helps humans define the gray areas
Agile Deliberation: How AI helps humans define the gray areas
AI summary
Machine learning models learn to recognize the world around us from examples labeled by humans. Underlying this process is an assumption that the person doing the labeling has a clear and stable definition of the category in mind before they begin.
Selection record
Threshold 60Official, first-handFirst 52Second 52
Not admittedSum of both 104 < twice the threshold 120
- Source tier
- Official, first-hand; this tier's threshold is 60
- Pre-filter
- passed：Google Research提出AI辅助定义主观分类器的框架
A model scores each item twice, independently, against one written standard, out of 100. An item is admitted only when the two scores add up to twice the threshold. The threshold is set per source tier.
Source: Google Research · research.google