BLUF:
* To determine whether AI is ‘improving exponentially’, ‘hitting the wall’, or any other claim which involves a quantity or magnitude (e.g. ‘This model was a big leap/small increment’). We need a good y-axis: an interval scale of AI capability which means +1 unit always represents the same degree of ‘how much better’, in the same way +1 degree Celsius is always the same amount of ‘how much hotter’.
* Yet there is no good y-axis for AI capability. All our...
Public service announcement
1. Applications are now open for our first ever round of the Charity Entrepreneurship Incubation Program dedicated exclusively to animal welfare. Learn more about what’s different this round here and apply...
TL;DR
* The Long-Term Future Fund is closing down, and EA Funds is launching the Transformative AI Fund with a new full-time team.
* The fund's primary focus is technical AI safety and AI governance (including post-AGI governance), as well as supporting fields such as field-building and forecasting. We'll also consider non-GCR implications of transformative AI such as flourishing futures and digital...
I am less convinced than the median around here that donating to AI safety research organizations is the most important thing to do, and I'd like to share some of my unfiltered thoughts and ask for feedback.
I shared your intuition about the second one. But the number is from 2017 and a lot has changed since then - if anyone is still parroting "less than 100 people", please ask them to stop.
In that post I ended up guessing that safety is maybe twice as large as it looks, but also maybe only 1.1x larger. Ben Todd (the source of the old claim) responded here and I agree with him.
Thanks for your research and the comment(s) there - I heard that number this year.
I also replied to one of the comments there here.
Agreed. I don't have a particularly clear or solid argument against it; at this point just a sort of yucky feeling when someone claims that the best possible use of money is to give it to someone as a really big salary to motivate them to leave their other really big salary role.
You agree that the salaries roughly track skill level though?
I actually share the ugh, but it seems way more important to maximise the competence we're bringing to the problem than to minimise bad optics.
(I'm responding to "Agreed", which implies endorsement of the yucky feeling. Ignore if not endorsed)
One needs to consider that instead of hiring X people at Y salary, one could have hired 2X people at Y/2 salary. My factual claim is that whether many of the "best people" take the deal does not depend as much on their salary as on how helpful they imagine the work environment to be for their output, and (more cynically) how prestigious they perceive the institution to be.
In fact, support by an environment of 2X (vs. X) researchers may be a stronger incentive than being paid Y/2 salary (vs. Y) is a disincentive, if these 2X people are actually more supportive.
Considering the ratio of Google researcher salary and median PhD student salary, I factually believe that basing salaries on need, rather than the tech market* - and allowing/encouraging people or groups to be from/in cheaper places, like India, the CIS or even Europe - would result in higher-quality output. Especially considering that people from these places move to the Bay Area to get these sorts of jobs even if they would have preferred to stay where they are.
*Of course, once expectations of salaries are set, people will get angry if these are decreased. So decreasing current salaries may be different.
Roughly speaking, I think so.