This is a special post for quick takes by Cillian_. Only they can create top-level comments. Comments here also appear on the Quick Takes page and All Posts page.
Curated and popular this week
·
Regulation cannot be written in blood alone.
There’s this fantasy of easy, free support for the AI Safety position coming from what’s commonly called a “warning shot”. The idea is that AI will cause smaller disasters before it causes a really big one, and that when people see this they will realize we’ve been right all along and easily do what we suggest. I can’t count how many times someone (ostensibly from my own side) has said something to me like “we just have to hope for warning shots”. It’s the AI Safety version of “regulation is written in blood”. But that’s not how it works.
Here’s what I think about the myth that warning shots will come to save the day:
1) Awful. I will never hope for a disaster. That’s what I’m trying to prevent. Hoping for disasters to make our job easier is callous and it takes us off track to be thinking about the silver lining of failing in our mission.
2) A disaster does not automatically a warning shot make. People have to be prepared with a world model that includes what the significance of the event would be to experience it as a warning shot that kicks them into gear.
3) The way to make warning shots effective if (God forbid) they happen is to work hard at convincing others of the risk and what to do about it based on the evidence we already have— the very thing we should be doing in the absence of warning shots.
If these smaller scale disasters happen, they will only serve as warning shots if we put a lot of work into educating the public to understand what they mean before they happen.
The default “warning shot” event outcome is confusion, misattribution, or normalizing the tragedy.
Let’s imagine what one of these macabrely hoped-for “warning shot” scenarios feels like from the inside. Say one of the commonly proposed warning shot scenario occurs: a misaligned AI causes several thousand deaths. Say the deaths are of ICU patients because the AI in charge of their machines decides that costs and suffering would be minimize
·
This is a transcript of my opening talk at EA Global: London 2025. In my talk, I challenge the misconception that EA is populated by “cold, uncaring, spreadsheet-obsessed robots” and explain how EA principles serve as tools for putting compassion into practice, translating our feelings about the world's problems into effective action.
Key points:
* Most people involved in EA are here because of their feelings, not despite them. Many of us are driven by emotions like anger about neglected global health needs, sadness about animal suffering, or fear about AI risks. What distinguishes us as a community isn't that we don't feel; it's that we don't stop at feeling — we act. Two examples:
* When USAID cuts threatened critical health programs, GiveWell mobilized $24 million in emergency funding within weeks.
* People from the EA ecosystem spotted AI risks years ahead of the mainstream and pioneered funding for the field starting in 2015, helping transform AI safety from a fringe concern into a thriving research field.
* We don't make spreadsheets because we lack care. We make them because we care deeply. In the face of tremendous suffering, prioritization helps us take decisive, thoughtful action instead of freezing or leaving impact on the table.
* Surveys show that personal connections are the most common way that people first discover EA. When we share our own stories — explaining not just what we do but why it matters to us emotionally — we help others see that EA offers a concrete way to turn their compassion into meaningful impact.
You can also watch my full talk on YouTube.
----------------------------------------
One year ago, I stood on this stage as the new CEO of the Centre for Effective Altruism to talk about the journey effective altruism is on. Among other key messages, my talk made this point: if we want to get to where we want to go, we need to be better at telling our own stories rather than leaving that to critics and commentators. Since
·
A friend of mine who worked as a social worker in a hospital told me a story that stuck with me. She had a conversation with an in-patient having a very difficult time. It was helpful, but as she was leaving, they told her wistfully 'You get to go home'. She found it hard to hear—it felt like an admonition. It was hard not to feel guilt over indeed getting to leave the facility and try to stop thinking about it, when others didn't have that luxury.
The story really stuck with me. I resonate with the guilt of being in the fortunate position of being able to go back to my comfortable home and chill with my family while so many beings can't escape the horrible situations they're in, or whose very chance at existence depends on our work.
Hearing the story was helpful for dealing with that guilt. Thinking about my friend's situation it was clear why she felt guilty. But also clear that it was absolutely crucial that she did go home. She was only going to be able to keep showing up to work and having useful conversations with people if she allowed herself proper respite. It might be unfair for her patients that she got to take the break they didn't, but it was also very clearly in their best interests for her to do it.
Having a clear-cut example like that to think about when feeling guilt over taking time off is useful. But I also find the framing useful beyond the obvious cases.
When morality feels all-consuming
Effective altruism can sometimes feel all consuming. Any spending decision you make affects how much you can donate. Any activity you choose to do takes time away from work you could be doing to help others. Morality can feel as if it's making claims on even the things which are most important to you, and most personal.
Often the narratives with which we push back on such feelings also involve optimisation. We think through how many hours per week we can work without burning out, and how much stress we can handle before it becomes a problem.
I do find that
What's the forum etiquette on advertising jobs?
Context: Training for Good is hiring for two exciting roles. I expect a bunch of great applicants to be here, right now, on this forum.
BUT I suspect that top level posts advertising jobs decreases the average user's experience. Maybe that's outweighed by the possibility of TFG reaching a top candidate (but I'm motivated to believe that so don't really trust it). Plus, it feels like a tragedy of the commons type scenario. So I've decided to post it as a
short formquick take instead.___________
Training for Good is hiring for two exciting roles. Come join us as a founding employee
I think job listings are one of the most valuable things on the forum, I'm surprised you're even asking!
There's even a Job listing (open) tag, that you've used in the past with wild success. It was the success story for the forum from the past 6 months.
I personally would heavily encourage people to post more job advertisements on the Forum, and let users vote on them, especially roles at extremely impact-oriented orgs like Training for Good.
Is your experience as a user decreased by the current top-level posts advertising jobs?
I mostly agree with Lorenzo, with caveats.
We've got an official policy on this. From that:
If we end up with a bunch of job listings and/or we start hearing that there are issues due to the job listings, we could change our approach — e.g. by limiting or discouraging listings, limiting where they're shown (more likely), creating separate spaces for them (something I think we should explore), or something else.
The other thing I'd note is that I think job ~advertisements go better (get more engagement, bring value to people not looking for the job) when they're combined with other content/information, like some explanation of why you're hiring, what your strategy is, an update on what you do, etc. This means that people who aren't interested in the jobs could also get something out of the post, and you might also get more applicants because the post gets more karma (so more people will see it) and because some people who come for the content are also interested in the jobs (this is probably truer for some jobs than for others).
(I should caveat that I wrote the above quickly (besides the policy excerpt), and without input from others.)
Just echoing the others that I like job listings - I've often applied for things because I saw them advertized on the Forum (or sent them to others who were looking)