Give Feedback on World's Biggest Problems Quiz

AndreFerretti

Give Feedback on World's Biggest Problems Quiz

AndreFerretti

1 min readOct 18, 2022

Comments 7

Sorted by

New & upvoted

Geoffrey Miller

Andre -- I just did the X risk quiz. It's pretty cool; nice graphics, good resources, seems engaging. Nice work.

AndreFerretti

Hey Geoffrey, I'm a fan of yours on Twitter. I'm glad you liked the quiz! Have a great day :)

QubitSwarm99

I completed the three quizzes and enjoyed it thoroughly.

Without any further improvements, I think these quizzes would still be quite effective. It would be nice to have a completion counter (e.g., an X/Total questions complete) at the bottom of the quizzes, but I don't know if this is possible on quizmanity.

AndreFerretti

Hey Rodeo, glad you enjoyed the three quizzes!

Thank you for your feedback. I'll pass it to Guided Track, where I host the program. For now, there's a completion bar at the top, but it's a bit thin and doesn't have numbers.

I saw that you work in AI Safety, so maybe you can help me clear two doubts:

Do AI expert surveys still predict a 50% chance of transformative AI by 2060? (a "transformative AI" would automate all activities needed to speed up scientific and technological progress).
Is it right to phrase the question above as "transformative AI"? Or should I call it AGI and give it a different definition? I took the "transformative AI" and the 2060 timeline from Holden Karnofsky.

QubitSwarm99

I am not the best person to ask this question (@so8res, @katja_grace, @holdenkarnofsky) but I will try to offer some points.

These links should be quite useful:
- 2022 Expert Survey on Progress in AI
- What do ML researchers think about AI in 2022? (37 years until a 50% chance of HLMI)
- LW Wiki - AI Timelines (e.g., roughly 15% chance of transformative AI by 2036 and ~75% of AGI by 2032)
- (somewhat less useful) LW Wiki - Transformative AI; LW Wiki - Technological forecasting
I don't know of any recent AI expert surveys for transformative AI timelines specifically, but have pointed you to very recent ones of human-level machine intelligence and AGI.
For comprehensiveness, I think you should cover both transformative AI (AI that precipitates a change of equal or greater magnitude to the agricultural or industrial revolution) and HLMI. I have yet to read Holden's AI Timelines post, but believe it's likely a good resource to defer to, given Holden's epistemic track record, so I think you should use this for the transformative AI timelines. For the HLMI timelines, I think you should use the 2022 expert survey (the first link). Additionally, if you trust that a techno.-optimist leaning crowd's forecasting accuracy generalizes to AI timelines, then it might be worth checking out Metaculus as well.
- the community here has an IQR forecast of (2030, 2041, 2075) for When will the first general AI system be devised, tested, and publicly announced?
- the uniform median forecast is 54% for Will there be human/machine intelligence parity by 2040?
Lastly, I think it might be useful to ask under the existential risk section what percentage of ML/AI researchers think AI safety research should be prioritized (from the survey: "The median respondent believes society should prioritize AI safety research “more” than it is currently prioritized. Respondents chose from “much less,” “less,” “about the same,” “more,” and “much more.” 69% of respondents chose “more” or “much more,” up from 49% in 2016.")

AndreFerretti

Thanks for the links, Rodeo. I appreciate your effort to answer my questions. :)

I can add the number of concerned AI researchers in an answer explanation - thanks for that!

I have a limited amount of questions I can fit into the quiz, so I would have to sacrifice other questions to include the one on HLMI vs. transformative AI. Also, it seems that Holden's transformative AI timeline is the same as the 2022 expert survey on HLMI (2060). So I think one timeline question should do the trick.

I'm considering just writing "Artificial General Intelligence," which is similar to HLMI, because it's the most easily recognizable term for a large audience.

QubitSwarm99

Glad to hear that the links were useful!

Keeping by Holden's timeline sounds good, and I agree that AGI > HLMI in terms of recognizability. I hope the quiz goes well once it is officially released!

Comments

More from the author

119

The EA Training Board is now live

AndreFerretti, Cillian_·4y ago·1m read

300+ Flashcards to Tackle Pressing World Problems

AndreFerretti·4y ago·16m read

Pressing News Front Page

AndreFerretti·3y ago·1m read

Curated and popular this week

Counting animals: Stable population size is not equivalent to priority level

abrahamrowe, mal_graham🔸·3d ago·Curated 1h ago·16m read

AI Use Note: Main body text entirely human written. Claude (Opus 4.8) helped develop models of animal life histories in the appendix. Cross-posted from Good Structures. Executive Summary * Animal advocates sometimes make claims like “there are X of this animal...

What would an animal-aligned AI be aligned to?

Aidan Kankyoku, Anima International·2w ago·Curated 6d ago·15m read

This is a crosspost from the new Animal Welfare Alignment Newsletter by Anima International. You can subscribe on Substack if you are interested in following these efforts. Audio reading also available on Substack. The goals of this post are to: 1. Raise a question I see as crucially important to the goal of aligning AI to animal welfare...

138

Let's taboo the V-word

lincolnq·3d ago·8m read

“How long have you been v*g*n?” This is one of the most common icebreakers at animal protection events. It’s a baseline assumption, and it mostly holds true: if you’re out advocating for animals not to be tortured or abused, realistically these days you are v**n, or close. And it makes for good conversation. It seems fairly safe to assume when you meet strangers. But this assumption is hurting the movement in a way which we don’t always notice: someone new comes into the sp...

Recent opportunities to take action

EA Organisation Updates thread: July 2026

Dane Valerie·2d ago·1m read

Applications open for new supported programs on the GWWC donation platform (2026)

Aidan Whitfield🔸, Giving What We Can🔸·1h ago·3m read

Free, client-funded daily 1:1 accountability coaching for people active in the EA ecosystem (GoalsWon)

Guillermo D'Anna·20h ago·1m read

QubitSwarm99

I am not the best person to ask this question (@so8res, @katja_grace, @holdenkarnofsky) but I will try to offer some points.

These links should be quite useful:
- 2022 Expert Survey on Progress in AI
- What do ML researchers think about AI in 2022? (37 years until a 50% chance of HLMI)
- LW Wiki - AI Timelines (e.g., roughly 15% chance of transformative AI by 2036 and ~75% of AGI by 2032)
- (somewhat less useful) LW Wiki - Transformative AI; LW Wiki - Technological forecasting
I don't know of any recent AI expert surveys for transformative AI timelines specifically, but have pointed you to very recent ones of human-level machine intelligence and AGI.
For comprehensiveness, I think you should cover both transformative AI (AI that precipitates a change of equal or greater magnitude to the agricultural or industrial revolution) and HLMI. I have yet to read Holden's AI Timelines post, but believe it's likely a good resource to defer to, given Holden's epistemic track record, so I think you should use this for the transformative AI timelines. For the HLMI timelines, I think you should use the 2022 expert survey (the first link). Additionally, if you trust that a techno.-optimist leaning crowd's forecasting accuracy generalizes to AI timelines, then it might be worth checking out Metaculus as well.
- the community here has an IQR forecast of (2030, 2041, 2075) for When will the first general AI system be devised, tested, and publicly announced?
- the uniform median forecast is 54% for Will there be human/machine intelligence parity by 2040?
Lastly, I think it might be useful to ask under the existential risk section what percentage of ML/AI researchers think AI safety research should be prioritized (from the survey: "The median respondent believes society should prioritize AI safety research “more” than it is currently prioritized. Respondents chose from “much less,” “less,” “about the same,” “more,” and “much more.” 69% of respondents chose “more” or “much more,” up from 49% in 2016.")