Skip to content
Zenteck
Latest
Analysis

When AI Outsmarts the Experts: The Physics Test Humans Failed

ByAlex Silva2 min read0 comments
gpt-6-astra-solves-complex-physics-research
Photo: ZenteckGPT-6-Astra solves complex physics research

Listen to article0:00 / 1:37

According to The Decoder, a new benchmark called TheoPhysEval put top AI agents to the test using 50 unpublished theoretical physics calculations. OpenAI's GPT-6-Astra led the pack, correctly solving 49 of them at an average cost of $2.40 per problem, totaling $116 for the entire test.

Why Expert Oversight Almost Misjudged the AI

When the model appeared to miss answers during evaluation, researchers discovered that the specialists' own reference solutions contained errors. Once those human mistakes were corrected, the AI's answers proved accurate every time, revealing that the model had effectively memorized large parts of complex physics literature.

How the Models Ranked on Complex Tasks

Anthropic's Opus 5.5 secured second place with a 92% success rate, while Google's Gemini 3.8 Flash scored 68%. Weaker models struggled significantly more, with DeepSeek-V4.1-Flash and GLM 5.3 reaching 54% and 42% respectively, often copying outdated formulas blindly.

Vale a pena para a sua rotina?

For routine calculations and junior-level research tasks, these results show that top agents can match specialist output at a minimal financial cost. However, researchers point out that current models still lack scientific 'taste'—the ability to choose which problems are worth asking next.

Sources

  1. GPT-6-Astra solves 49 of 50 physics research problems at $2.40 apiece — the-decoder.com

Frequently asked questions

How much did it cost to run the GPT-6-Astra physics benchmark?
The entire 50-problem benchmark cost just under $116, averaging about $2.40 per individual research problem.
Did internet access improve the AI performance?
Surprisingly, internet access made little difference. Without web search, Astra and Opus still achieved a 92% success rate.

Comments

0 comments

Deixe seu comentário

Your email is required for verification, but will never be published.

Be the first to comment.

RECOMENDADOS

Continue Lendo