For my SPAR project, which is to help improve the hiring process for new AI Safety organizations, and after the last couple of weeks having several interviews with hiring managers, there is an urgent bottleneck needed to resolve this. All these organizations are actively growing and hiring, and will continue on this trend into the near future.
I have focused my SPAR project to helping founders and hiring managers at new AI Safety organizations, typically small teams of <7 full time employees who are expected to grow 5x within the next year.
The reason why my focus is with these organizations, is because I see the greatest pain in their hiring process (usually broken or none existent) and if resolved, will allow these organizations to have the greatest impact in improving their hiring process, not only with matching them efficiently with the ideal candidate, but also allowing them to overcome these barriers of hiring, and returning to continuing their main focus work on AI Safety. I believe that these smallest and newest organizations have not only the most growth potential in terms of their project's impacts, but the new people that they hire can help accelerate this work, greater than at a more established organization.
These new AI Safety organizations are dealing with two issues that my research indicates that are contributing to this hiring and growth bottlenecks. These are:
The biggest issue I have discovered with my interviews of hiring managers of new AI Safety organizations, is that there is a discrepancy on who writes the tests, who scores them, and can the review tell a good work for merely OK work?
I’ve conducted numerous interviews, and one interview with a hiring manager was very insightful. In fact, the most insightful to date. We spoke about the use of “outside experts” that are brought into the hiring process, and in particular for specialized roles, such as Operations, HR managers, Legal Council, and even Communications/PR leads.
Interestingly, 80,000 Hours and twelve other organizations are actively hiring for the General/Legal Council. This indicates to me that there is a trend in AI Safety organizations expanding from their researcher roles to the need for more operational roles needed to grow.
These experts should be sourced from outside the AI Safety community, as they require individuals who have multiple years of experience, and have built organizations from 3 people to 50 or 100 full time hires.
I see the role of these outside experts as assisting with the specific role work tests (designing with real-world examples from actual work activities), interviewing and assessing and validating the codex scoring of candidates.
This approach not only allows the AI Safety organization to demonstrate credibility when interviewing candidates for these specialized roles, but also allows for trusted experts who have multiple years of experience in these roles to understand the difference between candidates with OK or good skills and exceptional skills.
The hiring teams can still test with interviews, applications and work tests for a candidate's alignment to their organization's mission, culture and AI Safety alignment and cultural fit, that may be more generalized to an individual organization's fit.
The importance of finding trusted experts from other fields is something that as a Founder, must be something that requires a continuous search, and using your connections of other founders, advisors and boards to discover outside your network, the industry experts to connect with. Also, expanding your network connections as a Founder outside of the AI Safety community, offers other benefits, such as Ambassadors/support of your project to larger communities, additional funding opportunities and even undiscovered talent and resources.
What this means in practice, is that these outside experts should be compensated for their time, and especially since hiring the right people into this business operational roles can have the greatest impact for growth of the organization, and therefore, the highest usage of your capital for a return on investment (ROI).
One of the ways that I can help these hiring managers is to provide best practices and resources to help improve their hiring processes. Use of the “out-side expert” is just one part of this.
The Hiring Framework Playbook, which will be my deliverable for these hiring teams at the conclusion of my SPAR project (Dec 2026) will address these questions and include these sections:
As I continue working on this Hiring Framework Playbook, I want to also conduct a couple of Quick tests with a couple of small AI Safety organizations who are currently hiring for specialized roles (non-researchers), such as Legal Council, Communications/GTM Leads, or CFO roles.
My untested theory is that I want to verify if providing an “outside expert” to assist in conducting interviews, if it will improve the success of higher skill quality candidates.
If you’re a hiring manager or founder who is currently or about to start the process to source and hire for a specialized role - specifically for a Legal Council, Communications/GTM Lead, or CFO role, I would like to help you.
Also, my intent is to continue to improve this process and Hiring Framework Playbook with practical hiring processes for the AI Safety community, and specifically, for the new organizations that I believe have the greatest impact if they solve their hiring bottlenecks and allow them to focus on their projects and research.
If I have mis-stated or missed important steps to include this process, I want to hear from you, or comment. Please feel free to reach out to me at: [email protected]
Hi Alison,
I think this is a really valuable project, and I'll be interested to see how the playbook develops.
Including external experts in recruitment processes where staff dont have expertise is a good suggestion. This is particularly relevant when organisations start to hire for specialised roles, without perhaps having fully defined what the role will do, what competencies are required to do the job well, how these competencies should be assessed, and how to made tradeoffs when candidates dont meet all the ideal selection criteria.
What seems to happen is that organisations use similar or the same selection criteria and processes for these specialist roles as they've used for their core team selection. Then the organisation and candidates are both frustrated when this doesnt translate smoothly to specialist roles.
Including an outside expert when conducting interviews could be helpful, since it provides an expert perspective on how to score and rank candidates' technical abilities. However, I think including the outside expert from an earlier stage would be even more valuable - including defining the TORs and the competencies for the role, taking into account best practices for that professional role (eg assessing the organisation's first accountant based on how accountants are normally selected and hired, rather than how the AI safety organisation has previously hired their researchers).