Will a open source pure Mamaba LLM surpass 82 MMLU on MMLU (5-shot) before end of year 2024?
3
Ṁ100Ṁ75resolved Jan 1
Resolved
NO1H
6H
1D
1W
1M
ALL
Will any company release a pure Mamaba LLM that scores over 82 points on the standard full MMLU (5-shot) using https://github.com/EleutherAI/lm-evaluation-harness with open source weights?
This question is managed and resolved by Manifold.
Market context
Get 
1,000 to start trading!
1,000🏅 Top traders
| # | Trader | Total profit |
|---|---|---|
| 1 | Ṁ35 | |
| 2 | Ṁ3 | |
| 3 | Ṁ1 |
People are also trading
Related questions
Will OpenAI release another open source LLM before end of 2026?
70% chance
Will we see an open source LLM model better than Opus 4.5 before the end of 2026?
79% chance
Will a text model achieve 100% performance on the MMLU in five years?
28% chance
MMLU 99% #5: Will SOTA for MMLU (average) pass 99% by the start of 2028?
44% chance
MMLU 99% #4: Will SOTA for MMLU (average) pass 99% by the start of 2027?
8% chance
Will a Russian-developed LLM reach the top 100 on LMSYS Chatbot Arena by end of 2026?
49% chance
Will an open source LLM (Vicuna, Alpaca, etc.) exceed ChatGPT interest by 2030?
59% chance