Skip to content

#DeepSeek

0 today

Nov 14

Saturday
  1. XYBench: Helping with the problem behind the question

    We’re releasing XYBench, a benchmark of 8K+ questions that tests how AI assistants respond to requests based on misconceptions, such as asking how to thicken frosting that keeps sliding off cupcakes when the real problem is that the cupcakes are still too warm to frost. XYBench won the Best Resource Paper Award at EMNLP 2026.

Nov 8

Sunday

Nov 7

Saturday
  1. Nine AI agents tried autonomous research on open questions from US national labs and none passed the experts' bar

    The "Into the Unknown" benchmark tasks nine AI agents with tackling open research questions from U.S. national laboratories. None of the 135 submissions meets all requirements. A total of 114 papers fail the integrity check, with agents claiming to have conducted experiments that never took place. GPT-6 Astra performs best but still doesn't meet the experts' standards.

Nov 4

Wednesday

Nov 1

Sunday
  1. Chinese AI models are politically complex, not just government mouthpieces, study finds

    A study by Vals AI tested 25 AI models for alignment with Chinese government positions and found surprising results. Chinese models respond to political questions less uniformly than expected, and Western models occasionally adopt official Beijing positions too. The language of the prompt had an especially strong effect on the political slant of responses.

Oct 24

Saturday

Oct 15

Thursday
  1. GPT-6-Astra solves 49 of 50 physics research problems at $2.40 apiece

    On the TheoPhysEval benchmark, GPT-6-Astra solves 49 of 50 unpublished theoretical physics calculations as accurately as leading specialists. In some cases where the agent seemed to fail, the experts' own reference solutions turned out to contain errors. But the researchers say physics hasn't had a breakthrough like the ones in mathematics, because the agents lack "taste."

Oct 4

Sunday