Which AI companies will release a SoTA LLM on AidanBench in 2025?

Ṁ11kṀ39k

Jan 1

Google

Anthropic

xAI

Any Chinese Company

Resolved

YES

OpenAI

Each answer resolves Yes if they release an LLM in 2025 that has the highest score on AidanBench at any time in 2025, according to the AidanBench Github.

I may bet on this market.

Market context

Technology

Math

LLMs

Get

1,000

to start trading!

People are also trading

Which company has the best LLM at the end of 2026? (Artificial analysis leaderboard)

Will the most interesting AI in 2027 be a LLM?

79% chance

In Jan 2027, will the top 3 leading AI labs be offering fewer than 15 flagship LLMs between them?

65% chance

There will be one LLM/AI that is at least 10x better than all others in 2027

17% chance

Will the highest-scoring LLM on Dec 31, 2026 show <10% improvement over 2025's best average benchmark performance?

72% chance

There will be a company which offers LLM or AI-based arbitration by 2030

Sort by:

@creator please resolve market

@mods aidanbench has stopped being maintained so none of the remaining options got sota

@creator are you still updating this?

bought Ṁ100 YES

and if so are you going to resolve things YES retroactively? (ig not based on the description, unless aiden bench is updated progressively with each new model tested and they test them in chronological order)

Here's the latest leaderboard, now hosted on AidanBench.com instead of the Github. GPT-4.5 scores highest of all non o-series models, Claude 3.7 scores worse than 3.5 (new), somehow o1 almost doubled its previous score and is back in first, and grok 3 still isn't on the leaderboard since there's no API access yet.