Sorry for a quick comment: Is there any evidence that computer vision systems can reliably do the QA step? what is the accuracy and precision like compared to traditional testing? 

Seconding this!!

I donated to the donation election fund. Just wanted to add a note here about why, in the hopes of encouraging others. (1) I want to encourage more posts during Giving Season, and I expect that a larger pool of money in the donation election fund would incentivize this; (2) I expect that the vote will allocate donations to high impact donation opportunities that are approximately as cost-effective as the donations I counterfactually allocate on my own; (3) there is at least one reason to expect the community vote to yield better donations than my own independent choice (something something Condorcet Jury Theorem).

Edit: Just seeing that Toby has a nice and more thorough post on the value of donating to the fund here, for those who missed it.

Thanks for the write-up! As a donor to the fund, it's really nice to see these reports. I occasionally wonder if I could obtain more cost-effective results by donating independently without the overhead of a managed fund. These reports reassure me that I almost certainly could not. Really grateful to the team for finding these incredible funding opportunities.

Thanks for the comment. I was clearly too quick with that opening statement. Perhaps in part I let my epistemic guard down there out of general frustration at the neglectedness of the topic, and a desire to attract some attention with a bold opener. So much harm could accrue to nonhuman animals relative to humans, and I really want more discussion on this. PLF is -- I've argued, anyway -- a highly visible threat to the welfare of zillions, but rarely mentioned. I hope you'll forgive an immodest but emotional claim.

I've edited the opener and the footnote to be more defensible, in response to this comment.

I actually don't believe, in the median scenario, that AIs are likely to both outnumber sentient animals and have a high likelihood of suffering, but I don't really want that to be the focus of this piece. And either way, I don't believe that with high certainty: in that respect, the statement was not reflective of my views.

Some of this discussion reminds me of Mill's in his super underrated essay "Utility of Religion". He proposes there a kind of yangy humanistic religion, against a backdrop of atheism and concern about the evils of nature. Worth a read.

Thanks for the comment!

I agree that there's a mixed case for political tractability. I'm curious why you don't find the argument compelling about the particular people who have influence on AI policy being more amenable to animal-related concerns? (To put it bluntly, EAs care about animals and are influential in AI, and animal ag industry lobbying hasn't really touched this issue yet.)

I like the analogy to cage-free campaigns, although I think I would draw different lessons from the analogy. I don't really think that the support for cage-free campaigns comes from support for restrictions that help individual animals rather than support for restrictions that restrict the total number of farmed animals. Instead, I think it comes for support for traditional and "natural" ways of farming (where the chickens are imagined to roam free) rather than industrialised, modern, and intensive farming methods. On this view, cage-free campaigns succeed because they target only the farming methods that the public disapproves of. This theory can also explain why people express disapproval of factory farming, but a strong approval of farming and farmers.

I think PLF is a politically tractable target for regulation because, like cage-free campaigns, it targets only the type of farming people already dislike. When I say "End AI-run factory farms!", the slogan makes inherently salient the technological, non-natural, industrial nature of the farming method. Restrictions here might not be perceived as restrictions on farming, they'll be perceived only as restrictions on a certain sinister form of unnatural industrialised farming. (The general public mostly doesn't realise that most farming is industrialised.) To put this another way: I think the most politically tractable pro-animal movements are the ones that explicitly restrict their focus to Big Evil Factory Farms, and leave Friendly Farmer Joe alone. I think PLF restrictions share this character with cage-free campaigns.

And we know from cage-free campaigns that people are sometimes willing to tolerate restrictions of this sort even if they are personally costly.

I basically fail to imagine a scenario where publishing the Trust Agreement is very costly to Anthropic—especially just sharing certain details (like sharing percentages rather than saying "a supermajority")—except that the details are weak and would make Anthropic look bad.

Anthropic might be worried that the details are strong, and would make Anthropic look vulnerable to similar governance chaos to what happened at OpenAI during the board turnover saga. A large public conversation on this could be bad for Anthropic's reputation among its investors, team, or other stakeholders, who have concerns other than longterm safety, or might think that Anthropic's non profit-motivated governance is opaque or bad for whatever other reason. To put this another way: Anthropic is probably reputation-managing, but it might not be their safety reputation that they are trying to manage. It might be their reputation -- to potential investors, say -- as a reliable actor with predictable decision-making that won't be upturned at the whims of the trust.

I would expect, though, that Anthropic's major investors know the details of the governance structure and mechanics.

 

I'm in the early stages of corporate campaign work similar to what's discussed in this post. I'm trying to mobilise investor pressure to advocate for safety practices at AI labs and chipmakers. I'd love to meet with others working on similar projects (or anyone interested in funding this work!). I'd be eager for feedback.

You can see a write-up of the project here.

• Frankenstein (Mary Shelley): moral circle expansion to a human created AI, kinda.
• Elizabeth Costello (J M Coetzee): novel about a professor who gives animal rights lectures. The chapter that's most profoundly about animal ethics was published as "The Lives of Animals" which was printed with commentary from Peter Singer (in narrative form!).
• Darkness at Noon (Arthur Koestler): Novel with reflections from an imprisoned old Bolshevik, reflecting on his past revolutionary activity. Interesting reflections on ends vs. means reasoning, and on weighing considerations of moral scale / the numbers affected vs personal emotional connection in moral tradeoff scenarios.