I don't really understand this perspective. Let me try to make sure I'm understanding you. 

(1) Anthropic wrote a company policy/governance document that claimed something
(2) This document was the foundation of much of the communities and companies perspective on how to think about and interact with AI safety, including making major donations and career choices. There are large irreversable path dependencies here. 
(3) the document always felt quite dubious to you, to the point where it felt like it wouldn't hold the whole time, whether purposely or due to a lack of clarity on anthropics part (I agree completely!)
(4) While this wasn't all 100% predicatable write when rsp was written, it surely has become increasingly obvious to anthropic leadership for months at this point. Nothing that has happened in the last 6 months is all that surprising and in fact basically right on trend, and dario has stated this himself many times. Yet anthropic continued to wait, taking in significantly more funding and increasingly roping in huge swaths of this community, and only when it was literally the case that they were about to violate their own document (or already had), they change it. 
(5) This makes you feel better than if they kept lying/decieving/whatever more charitable word that could be used here. 

is this approximately your perspective? Obviously I'm throwing my own biasing perspective in here and apologies if I'm misinterpretting.

I mean sure in a trivial sense I feel better about them doing 5. Taking a step back, it really barely matters and is beside the point. Them admiting 5 It's just a natural segway for us to discuss 1-4. Nothing they say about their own commitments matter anymore really. Incentives matter. 

FWIW though I am still highly confused on if anthropic is net positive or negative and quite open to despite all of this thinking we should still be throwing our weight completely behind them. 

What someones #1 focus should be is a really complicated question that involves values, interests, etc. For the movements part, there is no official list. 

That being said It's reasonable to argue against democracy preservation as a good use of EA (or specfic peoples) time, but neglectedness alone would only be a part of that story. 

Yes I think you mostly captured it and quite well. But I think there is something a little more too, which is that EA meme actually is more epistemically humble than you think. There is EA the meme and EA the group. The EA meme has leaked into much of mainstream policy and economics. It's in the water. The EA group has not. 

Let's say (referring to your other comment here), you do get a rich funder to fund work on applying alternate moral systems, in a ratio such that we, we being the current people and groups who you think compose ea (who is that?), in tandem with this new funding, are riding the perfect part of the curve where the marginal efficiency of exploration and exploitation (of our moral values) is equivalent. 

Taking a specific example, let's say this founder funds EA of biodiversity. Based on some (evolving) metric of biodiversity, this new group finds the best interventions for preserving biodiversity. Let's say their current best cause areas after all of this debate are saving the coral reefs and preserving indigenous languages and culture. 

In what sense are they any longer part of EA? Would you expect this subgroup to then post to the EA forums and go to EAG? More likely is they just become their own thing or the people get absorbed into the existing biodiversity or climate movements. 

So then are we still properly exploring/exploiting? or do we now need a new group? Again, who is we? 

We is some effort-status-capital-talent weighted aggregation of all the people who care to engage in the spaces and network of other people who would self describe as ea. It's a very ephemeral thing driven by subliminal status games and hidden incentives. 

I'm definitely not sure this is futile. I still try to push towards you vision, and others have too. 

However the question isn't can it be done, but is it the best path. I now lean in the direction that it is better to just start a new movement. I have tried to flesh parts of generative visions.

Spot on in your analysis but I don't know if it's fixable. I have suggested many times on this forum that we need to bake moral anti-realism into the core of the movement (which as you state probably does nothing). Ironically I think one of the core (but maybe not so novel) lessons of uppercase EA is that decentralization breeds fanaticism in a social movement if it financially exists in a larger extremely unequal society (even if the members are insanely thoughtful and bayesian). Some form of centralization is required to conform evolutionary value drift into something closer to ideal reflection. 

There are many paths, but unfortunately all of them require state capacity and culture. We would need some sort of political system to enforce the financial regulations that stops the gravity of the wealth-weighted dominant aesthetics from consuming the meta idea of ea (lower case ea). And probably a bunch of other things. But this is hard, there are 3 camps of main resistance. 

(1) the pure

Those who believe counting is not politics but math. 

(2) the pragmatic

Those who believe decentralization is good for the movement

(3) the de jure

Those who believe decentralization is good for their career, usually because it continues the default out status quo of who current has power

Together this coalition is sizable. I'm not sure exactly how much and maybe a vocal minority but I'd reckon at least 30%. Let's assume the rest of the movement is at least weakly in favor of centralization. But I think that 30% is more like a 50-70 percent in the hubs of oxford, dc, sf (just speculating here). These parts of the movement have not just money but better organization as well. The remaining 70% are spread throughout the world and It's not clear how they might at current coordinate to force some sort of constitution. 

Your functional path 5s are good ideas, but again who exactly is doing or paying for them? maybe you can convince someone rich right now, or maybe you can go build these projects, but there is nothing legally or politically forced and the Egregore will eat it up all the same. Anything short of a real politically binding set of laws and delineation between members and non members seems like window dressing to me. But increasingly I think even if this would get passed I wonder if the ea infra is best left as is and new young people try to just start a more functionally agnostic version of the movement. That's at least some of the essence of post-rats, though they never meant for that to be a big tent idea. 

I feel mixed about ai-writing detection for a few reasons. I have very few issues with someone putting the bullet points of their argument into ai and then reading/editing/discussing a few times the response and letting the ai write it. I also think there is value in just putting your messy thoughts out as you have them and not having everything polished, but it depends on the situation.

Also separately I'm worried ai-writing detector proliferation will just speed up "immunity".  I don't think there is something deep and fundamental that stops ai from writing e.g. exactly what I have written to this point.  You can already download all your writing, ask ai to summarize it, make a text file that precisely describes your style and then ask the ai to write something in your voice. I've done this and yes they still have a bit of that vanilla llm feel but if there is actual market demand for solutions it doesn't seem like this is an insurmountable problem. 

I think people should say when they used ai and to what degree and there should be an expectation that just because polished writing is cheaper than it used to be you will not pollute the forum with things that you have not thought an appropriate amount about. 

FWIW I went to the best (or second best lol) high school in Chicago, Northside, and tbh the kids at these top city highschools are of comparable talent to the kids at northwestern, with a higher tail as well. More over everyone has way more time and can actually chew on the ideas of EA. There was a jewish org that sent an adult once a week with food and I pretty much went to all of them even tho i would barely even self identify as jewish because of the free food and somewhere to sit and chat about random stuff while I waited for basketball practice. 

So yes I think it would be highly successful. But I think you would need adult actual staff to come at least every other week (as brian mentioned) and as far as I can tell EA is currently struggling pretty hard w/organizing capacity and it seems to be getting worse (in part because as I have said many times, we don't celebrate organizers enough and we focus the movement too much on intellectualism rather than coordination and organizing). So I kind of doubt there is a ton of capacity for this. But if there is it's a good idea. I'm happy to help you understand how you could implement this at CPS selective enrollment schools if you want to help do it yourself. 

Thank you for doing this, love to see some data. 

I don't have high familiarity with METR but I think it is probably not great data for this type of analysis. Few issues or clarifications would be needed (and anyone who understands METR better bear with me/or correct me on my mistakes plz). 
 
1.  How does METR handle context windows? Are we doing a rolling window? Compact? something else? 
How much of this inverse quadratic relationship is just caused by longer tasks having a larger used context window for the back half of the run? How much is caused by a lack of a default information management system that persists?

2. What is the exact harness(es) METR is using? 

Harness/enviornment engineering/information management might control more of the cost of long running SWE projects than iq (past a point). 

3. Does METR allow repo forking? routing? 
In the future no 180 iq ai is building the ORM and buttons for a crud app. They are either forking a boilerplate or routing it to a cheaper model. 

etc. 

It is said that the current iteration of models suffer from retrograde amnesia. Whether or not this will get bitter lesson pilled is a separate question, but for this class of memento models, version control, information management, context management, and the meta process of improving and routing through the best versions of these combos for a specific task is not some side quest but in fact the main route to making long tasks cheaper. Even as we enter the next paradigm of models that don't have such profound short term memory loss, a huge part of cost reduction will come from the orchestrator meta planning about how much to explore the space of options/build out the software factory / vs actually starting the work. 

I’m not denying the core question OP is raising — costs could plausibly be rising and could matter a lot. I’m just not convinced this specific curve cleanly isolates “AI economics” from “how expensive a particular scaffold/set of arbitrary constraints makes long-context work.”

yea doesn't arc leaderboard have somewhat opposing trends? https://arcprize.org/leaderboard

might want to check out this (only indirectly related but maybe useful). 

https://forum.effectivealtruism.org/posts/zuQeTaqrjveSiSMYo/a-proposed-hierarchy-of-longtermist-concepts
 

Personally don't mind o-risk think it has some utility but s-risk ~somewhat seems like it still works here. An O-risk is just a smaller scale s-risk no?
 

What do people think of the idea of pushing for a constitutional convention/amendment? The coalition would be ending presidential immunity + reducing the pardon powers + banning stock trading for elected officials. Probably politically impossible but if there were ever a time it might be now.