Will DeepSWE be ≥90% solved at <$5/task before 2027? | Manifold

Will DeepSWE be ≥90% solved at <$5/task before 2027?

6

Ṁ1kṀ1.3k

Dec 31

37%

chance

1H

6H

1D

1W

1M

ALL

This market resolves YES if, before Jan 1, 2027, 00:00 UTC, any model listed on the official Datacurve DeepSWE leaderboard reaches both:

≥90% Pass@1, and
average cost per task <$5.00.

Use the displayed point estimates on the official leaderboard only.

Market context

Technical AI Timelines

Get

1,000

to start trading!

Sort by:

Fable 5 [low] at 60% / $3.76: https://deepswe.datacurve.ai/

Same question at any cost: /adssx/will-deepswe-be-saturated-before-20

People are also trading

Will DeepSWE be saturated before 2027 (≥90%)?

Will an autonomous agent resolve 90% of tasks on SWE-bench by 2027?

AI resolves at least X% on SWE-bench without any assistance, by 2028?

AI resolves at least X% on SWE-bench WITH assistance, by 2028?

When will SWE-bench be solved?

Will AI solve 100% of solvable MTurk problems by July 2028?

Will any of DeepMind's formal conjectures be resolved before 2027?

In what year will AI achieve a score of 95% or higher on the SWE-bench Verified benchmark?

By when will SAT solvers be 10x faster (than 2023 on same hardware)?

Will go be solved before 2040?

Related questions

Will DeepSWE be saturated before 2027 (≥90%)?

Will an autonomous agent resolve 90% of tasks on SWE-bench by 2027?

AI resolves at least X% on SWE-bench without any assistance, by 2028?

AI resolves at least X% on SWE-bench WITH assistance, by 2028?

When will SWE-bench be solved?

Will AI solve 100% of solvable MTurk problems by July 2028?

Will any of DeepMind's formal conjectures be resolved before 2027?

In what year will AI achieve a score of 95% or higher on the SWE-bench Verified benchmark?

By when will SAT solvers be 10x faster (than 2023 on same hardware)?

Will go be solved before 2040?