Note, the author is Eva Vivalt from AidGrade. They have a new blog post here saying they have new data and papers coming out over the next few weeks.
From the post:
We have a lot of new results coming out over the next few weeks – watch this space!
First up: updated data in the meta-analysis app. Data on 10 new interventions were added: >contract teachers; financial literacy; HIV education; irrigation; microhealth insurance; >micronutrients; SMS reminders; performance pay; rural electrification; and women’s >empowerment programs.
There is also an updated working paper of “How Much Can We Generalize from Impact >Evaluations?” on Eva Vivalt’s site.
Next up: working papers on each of the topics covered to date.
It'll be interesting to see the working papers on each of the topics (especially the microhealth insurance).
What a great study! I read through it and if I understand the PRESS statistic correctly, if you have a meta-analysis of impact evaluations, their average effect size predicts 33% of the variation of the next study run on the topic. So that’s not as great as I expected, but given the huge variations between countries and charities, it makes sense.
My takeaway is that since studies aren’t as generalizable as I would like, I should weight a study done on the charity I’m supporting much higher. This makes GiveDirectly a much stronger choice because it has a study run on it itself.
Another takeaway - studies done on studies are EA badass.