Ai2's FairStress tests whether LLM decisions hold under pressure
Pardis Sadat Zahraei, a computer science doctoral student who built FairStress during a 2026 research internship at Ai2, helped design a benchmark that tests whether a language model sticks with a well-supported decision under persuasive pressure, and whether it does so consistently across candidates' identities. Ai2's FairStress announcement on Hugging Face, published October 20th, introduces the benchmark and makes its dataset and code available.
评论
?
参与讨论