you are supposed to hedge your positions in order to prevent an unexpected situation from tanking the whole fund
It's my understanding that this hasn't been the definition of a hedge fund for some time (ChatGPT agrees). I'm assume that the investors knew that Situational Awareness was not a hedge fund in the sense you're describing one.
Of course, it might still be possible that investors weren't aware of the amount of risks the fund was taking on.
I found the 'founder deployment by end-2026' the hardest to set. It comes a bit as a surprise at the end, as I was already taking into account some considerations before, and the descriptions seem to do as well (e.g. "assets after lockups, taxes, sale timing", and "execution delays").
I'm really excited about you & Sarah starting this! :)
I wouldn’t invest community building efforts in different settings until I was confident this ecosystem was thoroughly supported
It's pretty notable that you're only focusing on North American universities. Do you think this subset of universities is your comparative advantage? Or do you think that most community builders should primarily focus on that subset?
If it's the latter, I'd be interested in hearing your thoughts on why efforts into other top universities (Oxford, Cambridge, Imperial, UCL, ETHZ, NUS, TUM, Melbourne, etc.) should be lower priority.
I generally think it's fine to downvote/disagree without explaining. But if someone wants to share thoughts, we'd definitely be interested (also feel free to DM).
In the UK, the government allocates about $500 million a year to cancer research. At the same time, private individuals can invest an equivalent amount ($500 million) into purchasing a single football club. Which investment holds greater value for humanity?
In the process of the football club changing hands for $500 million, what resources are destroyed?
My sense is that there’s been a significant shift in how much longtermists prioritise non-extinction risks over the last few years. A decade ago people who were trying to ensure the flourishing of the universe trillions of years from now were very often focused on avoiding events that would kill all humans.
I agree that this shift has happened over the past 2 years. But I think 2 to 3 years ago EAs were unusually focused on extinction compared to a decade ago. I remember more discussions back then around positive visions for the longterm.
For what it’s worth, we just announced our first Frontier Biodefense Fellowship at Pivotal, which is more singularly focused on avoiding extinction than most projects within AI safety (including our AI safety fellowship). Obviously the team has a range of motivation to work on Biodefense, but for me weak longtermist arguments are quite central.
What's your explanation for why they attack EAs rather than, say, the AI ethics crowd?
I think there are a few plausible reasons that don't require "undemocratic power-seeking" as the primary explanation:
EAs have been more motivated to & competent at gaining influence through legitimate/standard means
EA policy ideas enjoyed better reception by policymakers, were more aligned with their interests. The opponents might have stronger disagreement with AI ethics ideas, but see them as much less likely to have influence.
EAs compete more directly on their territory. The AI ethics crowd has sufficiently different values and assumptions that they're less of a threat locally. (Kind of a 'narcissism of small differences'.)
I expect that if your ideas are resonating with policymakers and people are getting appointed to relevant roles because they're competent, bad faith opponents will target you roughly the same as if you'd been pulling strings behind the scenes in dubious ways.
Why was SB 1047 so controversial, while other much more onerous AI bills (esp for "little tech") were barely discussed?
Maybe I'm missing something. SB 1047 seemed like a relatively transparent action, that followed the democratic process. Is your point that undemocratic power-seeking actions prior/unrelated to SB 1047 likely explains the stronger opposition to SB 1047?
It's my understanding that this hasn't been the definition of a hedge fund for some time (ChatGPT agrees). I'm assume that the investors knew that Situational Awareness was not a hedge fund in the sense you're describing one.
Of course, it might still be possible that investors weren't aware of the amount of risks the fund was taking on.
I found the 'founder deployment by end-2026' the hardest to set. It comes a bit as a surprise at the end, as I was already taking into account some considerations before, and the descriptions seem to do as well (e.g. "assets after lockups, taxes, sale timing", and "execution delays").
I'm really excited about you & Sarah starting this! :)
It's pretty notable that you're only focusing on North American universities. Do you think this subset of universities is your comparative advantage? Or do you think that most community builders should primarily focus on that subset?
If it's the latter, I'd be interested in hearing your thoughts on why efforts into other top universities (Oxford, Cambridge, Imperial, UCL, ETHZ, NUS, TUM, Melbourne, etc.) should be lower priority.
I generally think it's fine to downvote/disagree without explaining. But if someone wants to share thoughts, we'd definitely be interested (also feel free to DM).
I think you should be much more confused & curious here than you seem to be.
In the process of the football club changing hands for $500 million, what resources are destroyed?
Junior EAs getting advice that helps them grow: "I'm getting reard on"
So you're saying he reard you?
I agree that this shift has happened over the past 2 years. But I think 2 to 3 years ago EAs were unusually focused on extinction compared to a decade ago. I remember more discussions back then around positive visions for the longterm.
For what it’s worth, we just announced our first Frontier Biodefense Fellowship at Pivotal, which is more singularly focused on avoiding extinction than most projects within AI safety (including our AI safety fellowship). Obviously the team has a range of motivation to work on Biodefense, but for me weak longtermist arguments are quite central.
I think there are a few plausible reasons that don't require "undemocratic power-seeking" as the primary explanation:
I expect that if your ideas are resonating with policymakers and people are getting appointed to relevant roles because they're competent, bad faith opponents will target you roughly the same as if you'd been pulling strings behind the scenes in dubious ways.
Maybe I'm missing something. SB 1047 seemed like a relatively transparent action, that followed the democratic process. Is your point that undemocratic power-seeking actions prior/unrelated to SB 1047 likely explains the stronger opposition to SB 1047?