At AI StopWatch, we typically post between two and five times a day, seven days a week. Every evening, we compile the day’s posts — which are low on jargon, high on water cooler discussability (we hope) — into an email-friendly “Daily Digest,” which we also release as a ~10-20 minute audio podcast a few hours later.
I would guess that would be very resource-intensive. How much FTE staff do you have working on this?
Someone really needs to create a course based on Will's EA in the Age of AGI: https://forum.effectivealtruism.org/posts/R8AAG4QBZi5puvogR/effective-altruism-in-the-age-of-agi
Using the term "cult" in in a purported terminology post isn't helpful.
I know it's annoying, but I would have suggested splitting this into two posts, one introducing the terminology in a neutral fashion and another where you use the terminology to make your criticism.
I think I might have previously posted this as a comment on another post, but I'll share here as well:
"Recently I’ve been thinking about how the EA community is not what it used to be and how it’s unlikely to ever be like that again (EA resonated strongly in a social context that no longer exists). But, of course, there’s a saying ‘when one door closes, another opens’. This leads to the question: ’What could EA be instead?’.
“But a community that took twenty years to develop its particular structure of norms and mutual knowledge cannot be regrown in twenty years, because the conditions that shaped it no longer exist. The people are older, the context has changed, and the specific convergance of circumstances that brought those particular individuals together in that particular configuration at that particular time is gone. Communities are path-dependent in the strongest possible sense: their current state is a function of their entire history, and you can’t rerun the history.”
Contexts change and what resonates during one time period is different from what resonates in another.”
I can see two paths forward: • Defining a new vision for where we find ourselves today • Managed decline[1]
The funds we’re donating to are aware of AI’s impact on the world and seem likely to take steps to use AI to improve their outcomes
There is definitely some correlation between current competence and ability to adapt to a changing world, though I suspect that there's also a huge amount of stickiness that undermines this.
All that said, if you think there should be a higher discount, you can apply it, but that doesn’t substantially change the results regarding what goes to AW. Indeed, if you increase the discount to 90%, you don’t get much more to AI (and less overall to GCRs as a whole, likely because the discount also applies to biorisk and nuclear weapons)
Fascinating. Is biorisk depreciating because some of those projects have a long payoff time?
My intuition is that biorisk talent will be more easily redeployable in a world undergoing an AI transition than a lot of the animal talent (more sticky).
I haven't dived into the figures/calculation, but I'm pretty skeptical about donating 46% to regular animal welfare projects given AI progress. Is the AI discount just based on x-risk or does it account for the possibility of AI radically transforming the world in such a way that the impact of current charities becomes moot?
Been thinking about morality recently. Here are my current thoughts, take them with a grain of salt because they aren't battle-tested yet.
There are some strong arguments for utilitarianism, but regardless of what is correct theoretically, in practise utilitarianism doesn't work well without some kind of deontological bars.
Continuing with attempting to develop a pragmatic morality, it then become clear that virtue ethics is important too because a) rules are rigid compared to judgement b) decisions aren't independent but also affect how you'll act in the future[1].
Some folks may be quite tepid in integrating virtue ethics, but my intuition is that the more common fault will be to give yourself too much latitude, so you'll probably want to revive some of your old deontological bars.
I view the next stage after this as introducing a sort of meta-virtue ethics to balance the three components (utilitarianism, deontology and virtue ethics; obviously it would be possible to break this down further). But this likely gives you too much latitude again, so you'll probably want to introduce some kind of meta-deontology to limit how you update the balance.
You could go further than this, but you'd probably be running into decreasing marginal utility.
I would guess that would be very resource-intensive. How much FTE staff do you have working on this?
Is this US only?
80% chance I can add a few comments if someone produces a draft curriculum. (Alternatively, I might be able to join a call).
Someone really needs to create a course based on Will's EA in the Age of AGI: https://forum.effectivealtruism.org/posts/R8AAG4QBZi5puvogR/effective-altruism-in-the-age-of-agi
Using the term "cult" in in a purported terminology post isn't helpful.
I know it's annoying, but I would have suggested splitting this into two posts, one introducing the terminology in a neutral fashion and another where you use the terminology to make your criticism.
There's been a massive wave of AI×biosec programs recently. I uncertain how fast this can be scaled up, then again, this isn't my area.
I think I might have previously posted this as a comment on another post, but I'll share here as well:
"Recently I’ve been thinking about how the EA community is not what it used to be and how it’s unlikely to ever be like that again (EA resonated strongly in a social context that no longer exists). But, of course, there’s a saying ‘when one door closes, another opens’. This leads to the question: ’What could EA be instead?’.
I'll quote from Communities are Not Fungible:
“But a community that took twenty years to develop its particular structure of norms and mutual knowledge cannot be regrown in twenty years, because the conditions that shaped it no longer exist. The people are older, the context has changed, and the specific convergance of circumstances that brought those particular individuals together in that particular configuration at that particular time is gone. Communities are path-dependent in the strongest possible sense: their current state is a function of their entire history, and you can’t rerun the history.”
Contexts change and what resonates during one time period is different from what resonates in another.”
I can see two paths forward:
• Defining a new vision for where we find ourselves today
• Managed decline[1]
Which sounds bad, but sometimes may actually be the best strategy.
How was the 40% figure calculated?
There is definitely some correlation between current competence and ability to adapt to a changing world, though I suspect that there's also a huge amount of stickiness that undermines this.
Fascinating. Is biorisk depreciating because some of those projects have a long payoff time?
My intuition is that biorisk talent will be more easily redeployable in a world undergoing an AI transition than a lot of the animal talent (more sticky).
I haven't dived into the figures/calculation, but I'm pretty skeptical about donating 46% to regular animal welfare projects given AI progress. Is the AI discount just based on x-risk or does it account for the possibility of AI radically transforming the world in such a way that the impact of current charities becomes moot?
Been thinking about morality recently. Here are my current thoughts, take them with a grain of salt because they aren't battle-tested yet.
There are some strong arguments for utilitarianism, but regardless of what is correct theoretically, in practise utilitarianism doesn't work well without some kind of deontological bars.
Continuing with attempting to develop a pragmatic morality, it then become clear that virtue ethics is important too because a) rules are rigid compared to judgement b) decisions aren't independent but also affect how you'll act in the future[1].
Some folks may be quite tepid in integrating virtue ethics, but my intuition is that the more common fault will be to give yourself too much latitude, so you'll probably want to revive some of your old deontological bars.
I view the next stage after this as introducing a sort of meta-virtue ethics to balance the three components (utilitarianism, deontology and virtue ethics; obviously it would be possible to break this down further). But this likely gives you too much latitude again, so you'll probably want to introduce some kind of meta-deontology to limit how you update the balance.
You could go further than this, but you'd probably be running into decreasing marginal utility.
Thanks to Austen Erickson who I first learned this perspective from.