My opinion is that AIS groups should:
- Have an application form
- to (1) filter and (2) get people to commit early (as opposed to an interest form, where the applicant doesn't need to conciously commit). 1 gets you better fellows, 2 gets you more-committed fellows
- Make it short.
- You should test it out yourself (or better yet, get a friend to do it). Make sure it's under 10 minutes (preferably 5).
Make it informative, even if it's short.
- Mainly, you want people to just write a few short sentences about the questions you think matter. Restrict the response to just a few sentences, and you'll be able to quickly tell certain qualities without taking much of their time (or yours!)
- "Short yet extracts useful info" is best explained by an example IMO; see Penn's application. Also see real examples of short-yet-good-and-informative responses to "What currently most concerns you about AI?" below
- Good response that you can tell is good even though it's just a few sentences #1: "I'm most concerned with the gap between how fast AI is growing and how slowly the regulatory frameworks are being developed. It interests me that there is no government agency or sector dedicated to regulating AI, and that's something I'm very open to learning more about and discussing further."
- Good response #2: "I think what most concerns me about AI is the existential risk, not necessarily of rogue AI but governments using it to fight each other and that leading to death and destruction."
- Good response #3: "At the moment, I am most concerned about the application of AI in the natural sciences. I believe that AI can accelerate the pace of discoveries but can also lead to more mal-intended use and exploitation of AI to create more existential risks such as engineered pandemics or even physical and chemical weapons."
- You'll notice that response 1 isn't familiar with existential rilsk but they seem to (1) geniunely hold a belief in the/a risk of AI, and (2) that risk seems very relevant to the fellowship. That's all you need! And a very short application gets you that.
- Most bad responses are always just people mascrading or trying-too-hard at explaining why they care. When people ask me, "how do I get into the fellowship!" I tell them, "just write few simple sentences about why you care; let me ask you now: why do you care?" and whatever answer I say, "Exactly! Just write that. Write what you think, like literally your inner-voice, word-for-word, give or take or whatever." Some will make up reasons for why they care, and you can spot insincerity from just a few sentences. Others have concerns that are not super-relevant, and then it's your choice if you have capacity to include people that the fellowship isn't exactly for.
(Also, if you have thoughts on structuring short applications, I'd love to hear them!)
You're probably right that your impact and funders' theory of change comes from the most capable and engaged people, but those people are often also busy or have many interests. An underrated cost of applications is just that they add friction, which selects for people who have time and motivation to fill out applications. You mention "intimidation" but it also just takes time and activation energy to fill out an application without a clear payoff.
The main costs or risks from reducing friction are if the group becomes so large and low engagement as to distract from the intended content.
(I started an EA group at UIUC when I was a student 5 years ago. On summer logic I didn't run a "fellowship" structure at all, against the advice of CEA, and instead spent their money on food to run weekly meetings themed around brief slides and discussion aligned to attendee interest. At least two out of <20 regular attendees work full time on AI safety, though I'm not sure what the counterfactual was.)