Mjreard

Legal AI Governance Field Building
1649 karmaJoined Working (6-15 years)Washington, DC, USA
matt-reardon.com/

Bio

Building out research fellowships and public-facing educational programming for lawyers

Comments
75

Thank you for praising my new hobby, Ozzie. 

As an expansion on point 7: consistent, legible, self-motivated output on topics that matter is just a huge signal of value in intellectual work. A problem with basically all hiring is that the vast majority of people just want to "get through the day" in their work rather than push for excellence (or even just improvement). Naturally, in hiring, you're trying to select for people who will care intrinsically about the quality*quantity of their outputs. There are few stronger signals of that than someone consistently doing something that looks like the work in their personal time for ~no (direct) reward.

Also, if you're worried you're not good enough, you're probably right, but the only way to get good is to start writing bad stuff and make it better. I wrote the first post of my meh blog on this topic to keep me going. It's sort of helped. 

Mjreard
2
0
0
60% disagree

So much big picture, so few details

Tons of overlap in how the vlogbrothers think about their impact and EA. Great to see. 

In particular, there was one episode of their podcast recently (I think it was "The Green Brothers are Often Wrong"), where they got comically close to describing themselves as EA; remarking that John was the heart (who cared a lot about people and "what was most important") and Hank was the head, being really concerned with science and truth and progress and reasoning. 

They are of course aware of EA via large EA participation in their PFA donation drive, but I believe they have a distant, caricatured view of the community itself. I heard of a livestream where they were asked about it and John said something to the effect of "there's a lot of harm you can do if you only think of people as objects of analysis for you to intervene on when you should be dealing with them directly and empowering them in the ways that they decide they want to be empowered." 

My view is that it's worth it, because there is a danger of people just jumping into jobs that have "AI" or even "AI security/safety" in the name, without grappling with tough questions around what it actually means to help AGI go well or prioritising between options based on expected impact.

 

I appreciate the dilemma and don't want to imply this is an easy call. 

For me the central question is all of this is whether you foreground process (EA) or conclusion (AGI go well). It seems like the whole space is uniformly rushing to foreground the conclusion. It's especially costly when 80k – the paragon of process discourse – decides to foreground the conclusion too. Who's left as a source of wisdom foregrounding process?

I know you'e trying to do both. I guess you can call me pessimistic that even you (amazing Arden, my total fav) can pull it off. 

Thanks Vanessa, I completely agree on the meta level. No one owes "EA" any allegiance because they might have benefitted from it in the past or benefitted from its intellectual progeny and people are of course generally entitled to change their minds and endorse new premises.

Your comment *is a very meta comment though* and leaves open the possibility that you're post hoc rationalizing following a trend that I see as starting with Claire Zebel's post "EA and Longtermism, not Cruxes for Saving the World," which I see as pretty paradigmatic of "the particular ideas that got us here (AI X-safety) no longer [are/feel] necessary, and seem inconvenient to where we are now in some ways, so let's dispense with them."

There could be fine object-level reasons for changing your mind on which premises matter of course and I'm extremely interested to hear those. In the absence of those object-level reasons though, I worry! 

I'm still trying to direct the non-selfish part of myself towards scope-sensitive welfarism in a rationalisty way. For me that's EA. Others, including maybe you, seem to construe it as something narrower than that and I wonder both what that narrow conception is and whether its fair to the public meaning of the term "Effective Altruism."  

If your AI work doesn't ground out in reducing the risk of extinction, I think animal welfare work quickly becomes the more impactful than anything AI. Xrisk reduction can be through more indirect channels, of course, though indirectness generally increases speculativeness of the xrisk story. 

Some combination of not having a clean thesis I'm arguing for, not actually holding a highly legible position on on the issues discussed, and being a newbie writer. Not trying to spare people's feelings. More just expressing some sentiments, pointing at some things, and letting others take from that what they will. 

If there was a neat thesis it'd be:

  • People who used to focus on global cause prioritization now seem focused on power accumulation within the AI policy world broadly construed and this is now the major determinant of status among all people who used to focus on global cause prioritization
  • This risks losing track of what is actually best for the world
  • You, reader, should reflect on this dynamic and the social incentives around it to make sure you're not losing sight of what you think is actually important, and push back on these when you can. 

Admin posted under my name after asking permission. It's cool they have a system for accommodating people like me who are lazy in this very specific way

Great write up. I think all three are in play and unfortunately kind of mutually reinforcing, though I'm more agnostic about how much of each. 

I think OP and grantees are synced up on xrisk (or at least GCRs) being the terminal goal. My issue is that their instrumental goals seem to involve a lot of deemphasizing that focus to expand reach/influence/status/number of allies in ways that I worry lend themselves to mission/value drift. 

Load more