Hugging Face releases FairStress fairness benchmark
What happened
On 21 October 2026, Hugging Face published the FairStress benchmark on its blog to measure the group fairness of large language models in decision-making settings such as hiring, lending and healthcare. The benchmark covers the Olmo, Llama, Qwen, Gemma, Claude and GPT model families. Coverage so far reports only the benchmark's release, purpose and the models it covers; no specific evaluation results for individual models have been published.
Written by AI from the reports · updated 3 h ago
Timeline
Follow the reports to see the event from each side.
- Hugging Face BlogFairStress: A deeper evaluation of fairness in LLM decision-making
Today we’re introducing FairStress, a benchmark for measuring demographic fairness in LLMs beyond the choice a model ultimately makes in decisions impacting people. FairStress is available for download, and we’re also building it into Olmo-eval, our open workbench for running and comparing model evaluations.
Heat of this event
Current heat 9·Peak in the comparable range 9（Oct 21 03:00）·Change over 24 hours in the comparable range –
The trend compares only the same accounts observed without a break, so its range can be narrower than the current heat count. Move the pointer or tap the chart to see each hour; with a keyboard, use the left and right arrow keys.