Hi everyone thank you for your time and thoughts here.
Can you weigh in on work tests? I have done ~4 work tests now, and a role was posted that I was excited about that required a 7 hour (!) paid work test, and it's really diminished my motivation to apply there. I have my own opinions as a 15 year professional, but would love to get other views - both from hiring managers and job seekers. Full disclosure.... that 7 hour thing is hot on my mind and doesn't represent the typical length I've seen (more like 4). Also I value work tests - for both sides - everything below is about course correction for efficient interview effort vs hiring satisfaction, not direction changing away from work tests.
1 - 80k's book cites a big study where correlation between selection test and job performance is 0.54 (1st place) for Work Sample Tests, and 0.51 (3rd place) for Interviews (structured) - IQ test is 2nd. Not a huge gap, and neither very impressive overall. I understand prioritizing the best, but it seems an immense amount of priority is placed on tests vs interviews. Both employer and candidate put a ton of collective work into work test sampling - creating, doing, and assessing.
2 - I appreciate the payment that comes with most tests. I am lucky enough to be a) fully employed and b) not care too much about work test payment, and care more about my time. But 7 hours.. I'm kind of like jeesh... If you have a full time job (me) or a family (me) or just a lot going on in your life (everyone), 7 hours is two free nights, or a whole weekend day. It just seems overkill as a screening method, or even after a single screening call which is mostly what I see.
3 - I've never experienced work tests outside the impact space, but I also know that my (corporate non-impact) org which does a great job recruiting capable folks also does not use them - instead a combination of personality tests (which I have yet to see in the impact space) and interviews. Not saying it wouldn't improve with work tests being added in, but it seems like it can be effective without.
To me - emotionally - it just feels like some orgs are taking work test duration too far and dissuading capable folks from applying. Maybe it's meant as a scarecrow for the uncommitted. It has a flavor to me of SAT-testing elitism a little bit (which I admit isn't totally fair - these aren't standardized tests you can hire a tutor for) where it's a signal of seriousness. Could there be a university/academia-testing bias, given the impact space's educated demo? Or do experienced hiring managers really see efficient value in beefing up work tests like this? Or is there some unique challenge going on in impact work that requires this kind of selection? Is this different when it's an internal hiring team vs. consultant-driven? What about those of you that hire without work tests?
This may read as complaining, but I imagine there's a good case for cutting way down on work test duration and getting equivalent performance results out of your selected hire for less effort on everyone's part. Love to hear your thoughts!
I’ve noticed that candidate-review sites (e.g. Glassdoor) show a surprisingly high share of negative interview feedback for several EA orgs (GiveWell sits around ~40 % “negative” responses), which is higher than what you typically see for reputable private employers (Google, BCG, etc.). My own interviews at these Fortune 100 firms have been demanding but still felt transparent and fair, whereas many reviewers describe EA hiring as opaque:
Curious to hear perspectives from recruiters and anyone who has tried to improve this within their org. Thank you for doing this!
Hi Saramago, thanks for the question and sorry that it got missed initially! This made me curious about how Open Phil compares on this metric to the companies you mentioned, and it turns out we're actually pretty similar to Google and BCG (slightly fewer positive and negative responses, slightly more neutral responses). We also keep an internal candidate survey which shows a broadly similar picture. So I think we're doing some things right, but I agree there are pain points as well:
Finally, I would love to hear if you or anyone else has been put off from applying to Open Phil by perceptions about what the hiring process will be like, either due to Glassdoor or otherwise – this kind of data is extremely valuable and really hard to get!
This is a really interesting question! (flagging that I wrote this comment hastily and didn't edit much—lmk if it would be helpful to clarify anything.)
Bottom line: If you look at Glassdoor applicant reviews and sort by recency, you'll note that in the last ~year and a half, GiveWell has only received 2-3 negative reviews, which is about 10% of the total reviews. I think that's a departure from years prior, in which we received many more negative reviews.
I spent a lot of time thinking about Glassdoor shortly after I joined GiveWell (IIRC I was thinking about this in late fall 2023?). My diagnosis was that we were doing a pretty bad job of informing candidates about what to expect from our hiring processes, we were moving too slowly with candidates, and our communications were weak. Here are a few specific things that I think contributed to the improvement in our reviews:
I also echo much of what @PhilZ said in his response to your question, especially: It's very difficult to get information about the extent to which Glassdoor (or similar) reviews deter strong candidates from applying. This is painful; I wish we had better information.
Last thing—wanted to quickly note current Glassdoor data (which I think is somewhat different than what you describe):