OscarD🔸

1712 karmaJoined Working (0-5 years)Oxford, UK

Posts
22

Sorted by New
36
44
¡ ¡ 1m read
95
¡ ¡ 5m read
15
¡ ¡ 4m read
94
¡ ¡ 1m read
15
¡ ¡ 2m read

Comments
267

If these people weren't really helping the companies it seems surprising salaries are so high?

I think I directionally agree!

One example of timelines feeling very decision-relevant is for people who are looking to specialise in partisan influence, you might want to specialise far more in Republicans the larger your credence in TAI/ASI by Jan 2029. Whereas for longer timelines on priors Democrats have a ~50% chance of controlling the presidency from 2029, so specialising in Dem political comms could make more sense.

Of course criticism is only a partially overlapping set with advice, but this post reminded me a bit of this take on giving and receiving criticism.

I overall agree we should prefer USG to be better AI-integrated. I think this isn't a particularly controversial or surprising conclusion though, so I think the main question is how high a priority this is, and I am somewhat skeptical it is on the ITN pareto frontier. E.g. I would assume plenty of people care about government efficiency and state capacity generally, and a lot of these interventions are generally about making USG more capable rather than too targeted towards longtermist priorities.

So this felt like neither the sort of piece targeted to mainstream US policy folks, nor that convincing for why this should be an EA/longtermist focus area. Still, I hadn't thought much about this before, and so doing this level of medium-depth investigation feels potentially valuable, but I'm unconvinced that e.g. OP should spin up a grantmaker focused on this (not that you were necessarily recommending this).

Also, a few reasons govts may have a better time adopting AI come to mind:

  • Access to large amounts of internal private data
  • Large institutions can better afford one-time upfront costs to train or finetune specialised models, compared to small businesses

But I agree the opposing reasons you give are probably stronger.

we should do what we normally do when juggling different priorities: evaluate the merits and costs of specific interventions, looking for "win-win" opportunities

If only this were how USG juggled its priorities!

Yes, this seems right, hard to know which effect will dominate. I'm guessing you could assemble pretty useful training data of past R&D breakthroughs which might help, but that will only get you so far.

Clearly only IBBIS should be allowed to advertise on the job board from now on, impeccable marketing skills @Tessa A 🔸 :) 

Yeah I think I agree with all this; I suppose since 'we' have the AI policy/strategy training data anyway that seems relatively low effort and high value to do, but yes if we could somehow get access to the private notes of a bunch of international negotiators that also seems very valuable! Perhaps actually asking top forecasters to record their working and meetings to use as training data later would be valuable, and I assume many people already do this by default (tagging @NunoSempere). Although of course having better forecasting AIs seems more dual-use than some of the other AI tools.

Load more