Conditional on their being no AI takeoff before 2030, will the majority of AI researchers believe that AI alignment is solved?
Conditional on their being no AI takeoff before 2030, will the majority of AI researchers believe that AI alignment is solved?
41
1kṀ1896
2029
34%
chance

In the case that there is no AI that appears to have more control over the world than do humans, will the majority of AI researchers believe that AI alignment is solved?

Close date updated to 2029-12-31 6:59 pm

AI
Futurism
Get
Ṁ1,000
to start trading!


Sort by:
2y

-Most AI researchers today don't take alignment seriously as a problem.

-In 2030 we'll have even better versions of shallow alignment techniques like RLHF to make AIs look aligned.

-Heck, maybe we'll have deceptively aligned models that perform really well on all the alignment benchmarks you can throw at them.

So I think people like Yann Lecun could likely think alignment is solved. Who are you planning to count as "AI researchers", though, and how do you plan to measure this?

2y

@Multicore I'll be looking at things like the 2022 Expert Survey on Progress in AI, although I don't know what will be available when, and will most likely have to count smaller, less formal measures nearer to the date over more formal ones further from the date.

What is this?

What is Manifold?
Manifold is the world's largest social prediction market.
Get accurate real-time odds on politics, tech, sports, and more.
Or create your own play-money betting market on any question you care about.
Are our predictions accurate?
Yes! Manifold is very well calibrated, with forecasts on average within 4 percentage points of the true probability. Our probabilities are created by users buying and selling shares of a market.
In the 2022 US midterm elections, we outperformed all other prediction market platforms and were in line with FiveThirtyEight’s performance. Many people who don't like betting still use Manifold to get reliable news.
ṀWhy use play money?
Mana (Ṁ) is the play-money currency used to bet on Manifold. It cannot be converted to cash. All users start with Ṁ1,000 for free.
Play money means it's much easier for anyone anywhere in the world to get started and try out forecasting without any risk. It also means there's more freedom to create and bet on any type of question.

Related questions

© Manifold Markets, Inc.•Terms + Mana-only Terms•Privacy•Rules