Hugging Face releases FairStress fairness benchmark
What happened
On 21 October 2026, Hugging Face published the FairStress benchmark on its blog to measure the group fairness of large language models in decision-making settings such as hiring, lending and healthcare. The benchmark covers the Olmo, Llama, Qwen, Gemma, Claude and GPT model families. Coverage so far reports only the benchmark's release, purpose and the models it covers; no specific evaluation results for individual models have been published.
Written by AI from the reports · updated 2 h ago
Timeline
Follow the reports to see the event from each side.
- Hugging Face BlogFairStress: A deeper evaluation of fairness in LLM decision-making
Today we’re introducing FairStress, a benchmark for measuring demographic fairness in LLMs beyond the choice a model ultimately makes in decisions impacting people. FairStress is available for download, and we’re also building it into Olmo-eval, our open workbench for running and comparing model evaluations.
Heat of this event
Not enough continuous observations yet to draw a trend.