(Cross-posted by request, always happy to do so if something is of sufficient interest.)
I’ve been thinking a bunch about this study (direct link) of CBT-style techniques used to try and get criminals onto a better life path in Liberia that showed what looks like spectacular results, curious if anyone wants to share thoughts. If it would replicate seems like it crosses the EA-worthiness threshold.
I’ve been thinking more about the topic of this post, which is the cash transfer study in Chicago. That worked out less well. It seems that small cash transfers to those in need here in America made them feel worse and maybe even actually makes them worse off somehow? (paper)
This prediction seems very reasonable, and I think I would have agreed with it if I’d thought about this in advance. My model would have said that obviously cash is good and cash is helpful, in the short term getting some of it will be helpful. In the long term I’d expect some positive impact from the wealth effect. And in some cases, that money will have a particular jam that it solves or opportunity it enables (e.g. fix your car, security deposit on a new apartment, maybe even give opportunity to start a small business). In those cases it would have a permanent impact, so I would predict some overall positive impact. But in my experience there are enough implicit taxes and poverty traps for such people, and such a cultural lack of the idea of hanging onto money, that it is tough to hang onto funds, so mostly they’d be back where they started.
It looks like within about three weeks the money was mostly gone for both groups. That is not what would happen for an economically rational agent, unless they had a lot of opportunities for very high return on capital or they were paying down debt.
Elizabeth had a similar reaction to mine.
There’s something very interesting in this graph. The three groups have completely converged by the end of the 180 day period, but the average bank balance is now considerably higher. They all started out with ~$200 and now they have ~$400. That feels like a meaningfully different average amount.
This happened during Covid, so I am guessing that this is due to the Covid checks or other similar factors. This certainly complicates the experiment.
Those are pretty different things to happen. If you spend the money on bills, that’s paying down debt. It makes sense that this should happen right away. Spending on food and drink in a way you wouldn’t have otherwise is true consumption, the opposite of that.
Note of course this is ‘what they intended to do’ with the money, not what actually happened. Gambling money tends to end up bigger than expected and all that.
I’d ask less ‘what do poor people spend money on?’ and more ‘what do poor people spend more money on when they get a windfall?’
This tells a very clear story. The control group is spending a lot on groceries, but the treatment groups are spending less. I don’t think they are splurging all that much here, more like they are spending money there anyway and money is fungible. This makes sense, this is smart.
Where they are spending it is on bills, utilities (more bills), and especially on housing. Also small on general debt, education and clothes.
Notice that non-durable household goods spending is stronger in the control group, and durable household goods spending is stronger in the treatment group.
Note that it’s not easy to spend only $500 or even $2000 on housing, in a way that you weren’t already spending it, other than paying debt. So my guess is the bulk of this is ‘was behind on rent or mortgage’ and now they aren’t, but the size of this shift says that perhaps some of them did use this to get a new place.
So I interpret this as these people’s balance sheets are shot and they used the money to shore up their balance sheets and mostly didn’t spend the money beyond that.
But that turns out not to match what we find in the next chart.
My understanding is that this has been oriented such that higher numbers are always good and lower numbers are bad. So giving people money caused them to have more debt, less income, be less happy and in worse mental health, get less sleep and have less food security.
This didn’t merely backfire, it backfired completely. People’s financial situations actively got worse, both subjectively and objectively.
This is true, but everything got worse, so it’s thin. It makes sense they felt more burdened by the needs of others but their own needs felt like they got worse too. Again, even food security.
The paper is long, but there’s certainly good reasons to consider reading it.
Comparisons to Other Programs
Comparing this grant to the one in Kenya by GiveWell, in Kenya the typical grant is $1,000, and median monthly income is $76, so that’s a little over a year’s income. The median income in Chicago is about $34,000, so $2,000 is good for about three weeks for the median earner, although the paper says it was actually more like two months. This was a poor group. I am still skeptical this is the right comparison, as the earnings in this group sound pretty depressed from normal.
Or, as Sarah puts it:
I wouldn’t have expected this to be life changing money very often, but I would have expected some positive outcome some of the time and the average values to go up rather than down.
Here’s a first-hand report of a similar spot.
Bank balance being higher and bills being covered still counts as better in my book.
The small size of the grants makes it very difficult to say that there is something structurally different going on in these two situations. It is highly plausible that in Chicago $2,000 simply wasn’t enough money to escape the poverty trap and allow investment, whereas $1,000 in Kenya often was enough. The PPP gap alone makes the grants in Kenya functionally bigger.
It is also quite plausible that financial engineering and the nature of debt makes a big difference here. It’s also less concentrated giving, so the recipients can’t serve as customers for each other, the people around you still have needs that fall upon you and there is no cultural expectation that you must ‘make something of’ this opportunity.
Unhints: Need Versus Perception of Need
The thing that I couldn’t stop thinking about was the idea that getting resources increased scarcity because people ‘became more aware of all the needs they cannot address.’
This is a fundamental mismatch or confusion somewhere. Are needs changing, or are needs staying the same?
If needs are changing, then this isn’t about being aware of your needs so much as the gift changing your needs. People (your family or otherwise) see you get a windfall, they expect you to step up, increasing your needs. It’s not about being aware of the new needs so much as them existing.
If the needs aren’t changing, then what changed was both your level of needs (slightly better off) and your awareness of your additional needs (better information, which is a mixed bag). You might feel worse off, but you are actually better off other than the feeling and the resulting stress. Is ignorance bliss?
Increasingly it seems like these two things are being conflated, in many contexts. IN this model, you have a problem if and only if you are aware of the problem.
This explains why people think things are so much worse in America today than ever, along dimensions where this plainly isn’t true. But it is true if you only consider the problem to be the gap between reality and expectations, or alternatively the gap between reality and what is considered acceptable.
In the excellent Schrodenger’s Cat Trilogy this is referred to as the revolution of rising expectations, except in the trilogy the timelines where times were good meant everyone adjusted and had high expectations and this led to good outcomes, whereas in the timelines where times were bad everyone adjusted, lowered expectations and became small and petty. That is certainly another important dynamic, but here it is the thing where (and I need to formalize this more another time) our expectations are rising faster than our reality, and also shifting in ways incompatible with maintaining that reality, causing the reality to break down as people forget how nice our things are and cut out the ways in which those things are created and maintained.
This is an underestimated general problem in the world.
It seems plausible that in Chicago people’s marginal consumption options are things they’d like to consume but not things that one cannot do without, whereas in Kenya marginal consumption is considerably more vital - by comparison even poor people in Chicago are vastly richer and have much higher consumption. Structurally, I am also guessing their problems are much less likely to be primarily caused by lack of funds, as opposed to other structural problems including lack of human or social capital.
Anyway, the dilemma here is that by shifting from no money to temporarily some money, people suddenly are forced to be aware of their financial doom and needs, and this ends up making them feel worse. It does this to such a large extent, in this theory, that such people end up overspending the endowment, which we know because their debt levels increased. One might hope this was due to buying real estate (a few people buying a house or apartment goes a long way in an average) but the other context makes this seem unlikely.
Reading the paper, I find it interesting that almost everyone had previously gotten a payment for $500 from the same organization, which potentially caused strange expectation setting.
All participants had previously applied to the organization for COVID-19 relief funds (and thus, presumably needed money). The ways in which people learned about and came to apply to the non-profit varied, with some being referred by municipal agencies (e.g., housing authorities) or social service agencies, and others conducting internet searches. About 43% of our participants (2,237 people) received funds from the non-profit before the trial began. The overwhelming majority (99%) of these participants received $500, with a median of 243 days between a participant’s pre-trial payment and the start of the trial. Less than 1% (45 participants) received a payment in under four months of when they began the trial.
It also is a big selection effect. Applying to an organization for Covid-19 relief funds means you are probably in need, sufficiently that it is highly unlikely a few thousand can solve your problems. It also means that you responded to that need by applying for relief funds. One could argue it means you’re more likely to be on the edge of disaster, but the flip side is that anyone with the wherewithal to apply successfully probably isn’t as likely to end up with a true disaster. That is a particular mentality and approach, that suggests a lack of hope for transformational effects. It even suggests potential substitution effects with other sources of funds.
There is also the dynamic where getting the money made people work less hard and less effectively. That makes sense, and is one easy way for this to backfire. Especially during Covid it makes sense that those with the option to work less would do so, but they also quickly spent all the money and there wasn’t much there to begin with. Also especially with a group that applies for funding assistance, which suggests differentially doing labor to get dollars in response to a shortage of dollars.
Additionally, I wonder if the very act of taking the surveys helped force awareness of financial problems.
Copenhagen Once Again
That all takes us back to the Copenhagen Interpretation of Ethics. Not interacting with a problem means the problem can be ignored. Most of the financial problems of people in modern society are a combination of long term doom (which can of course be happily ignored, often for an arbitrarily long time, before the music stops) and the problem of rising expectations and wanting things (in the sense that a properly Buddhist attitude would largely help, whether or not that would be wise or possible).
So ‘don’t look at it, maybe it’ll go away’ is a less stupid strategy than it appears. Stressing about money is painful, and perhaps is a large percentage of the cost of being short of money, so one can hope not to realize it by not interacting with or not noticing one’s ‘needs’ aren’t being met, even if they are indeed needs and even if that need is ‘not eventually running out of money.’ And also choices are bad even in good times in good spots, it’s that much worse with no good answers.
This matches my experience. On reflection it is totally plausible that help that is actually helpful, but not adequate and that forces attention and choice, could end up being a net negative in practice, even if it would be very good in theory if the choice got taken away. This could be an argument for some sort of in-kind benefit, but if that freed up capital in turn because money is fungible then it doesn’t help either.
We can contrast this with the stimulus checks and the expanded child tax credit. It seems very clear, with comparisons to Europe and by looking at people’s experiences generally, even without a control group, that these checks did quite a lot of short term good for the people who needed them, regardless of the unfortunate side effects of the extra spending or disincentives towards work. And both took place during the pandemic.
Yet the stimulus checks and expanded credit were similar in size to the $500 or $2,000 payments. Does anyone think people would have not been worse off (again, in short term) without those checks? The child tax credit in particular seems to have been very effective at relieving child poverty (although perhaps we should verify the extent to which this is a number versus a real effect?).
Thus I go back to being reasonably confused by the whole thing. I see all the cute arguments, but if money actually was harmful then a better full explanation is required. These stories of how it might backfire aren’t nothing, but they aren’t much.
Another thing I’m wondering about is whether there are long term positive benefits to being forced to confront your needs, if that is indeed what is largely happening. One could tell a story where this has a very positive effect, including on earnings, which would be the opposite of what the data shows.
Explanations that come to mind there are that people, especially during the pandemic but increasingly so in general, have lost the core belief that the future exists and is real and matters and you can change it, which makes windfalls greatly reducing of effort in ways that are bad in the long term, and also that a windfall teaches people that life is arbitrary and doesn’t reward work or punish lack of work, so they work less.
And maybe grants of different sizes with different contexts send people very different messages, and we need to take the importance of such messaging more seriously.
Future Expectations
As I’ve been making an effort to explore and model how voters think, I’ve noticed that polls are useful, but focus groups have been vital to being able to build models that make any sense. You need true ‘market contact’ that isn’t about taking numbers, but actually looking at individual data points. My guess is the way to understand the situation better is to try and actually interview people in depth.
The experimenters are next going to try $500/month for a few years. That’s still not on the level of the GiveWell grants in Kenya, but it is a big step up in size. I don’t expect transformational effects but I do expect a noticeable and positive one. If that still lacks a positive effect, I would be very confused.
How much did this make me less excited about giving people money writ large? Somewhat, but not too much because I don’t expect the salient alternatives to offer better prospects. The hope might be that in-kind offerings don’t increase people’s perception of need in the same way as cash, but they do that mostly by not being fungible and also not being what is actually desired. If there were public goods options that were already almost good, the observations here might push them over the edge by comparison but in practice I don’t find such decisions are that likely to be close.
Mostly I conclude that small one-time transfers are likely to get offset due to a combination of poverty traps, including perception of need but centrally hyperbolic discounting. When you give a one-time payment or even simply have money in the bank at all, most cultural norms involve acting richer than you are, and heavy pressure to spend, usually not efficiently. There isn’t proper appreciation for how much that money will be worth to you when things get tough again, but then again that is only valuable to you to the extent you can resist the pressures to spend. Part of the trap is that once you’re in the trap trying and failing to get out of it doesn’t help you much, so traits that would help in abundance don’t have a hill they can climb.
Thus, one wants to focus on either giving people money continuously, in ways that don’t create a false wealth effect that causes overspending, or to give them enough at once to outright escape the trap. Either way seems plausible.
This also makes it that much more likely that the stimulus checks got spent and acted as proper stimulus, but also didn’t do as much good for those who got them as we might have liked.
”the problems of the world actually will just not support giving at that scale in a super cost-effective way”
Policy makers use both fiscal and monetary policy to improve domestic welfare:
Why would the state make concessional loans and lose money? Why not loan at market rates? For this would have no additionality, the state would just be another lender. These concessional loans pay for the service that banks provide to the state. What is the service? Banks find companies that will perform well, so that the state is not in the business of ‘picking winners’.
Analogously, policy makers use both aid and development finance to improve foreign welfare:
Like central banks, development banks also give loans to poor countries' governments, like the World Bank’s International Development Association, which offers concessional loans to poor countries.[5] These concessional loans have the benefit of feeling altruistic, creating strategic alliances, or spurring (global) growth.
The later (growth-friendly spending) is mostly through IMF and World Bank loans for countries that they need to pay back (analogous to impact investing), whereas aid is analogous to donating to nonprofits. The great thing about loans is that you need to pay them back with interest and so only if you’re certain you’ll create growth and a multiplier, you will take them, loans are the most direct way to subsidize business activity. They’re also very scalable. Sure you can subsidize the latest thing like chickens or therapy or whatever, but even Blattman admits money for entrepreneurs is best, so why not add skin in the game and make it a loan and go directly to the source of the problem (lack of growth)?
There is an allure to policy coherence and optimizing for several objectives at once, finding an intervention that has the best of both worlds, but it would be a suspicious convergence if the best poverty reduction methods happened to be the effective at creating growth and entrepreneurship as well. Giving directly to the poorest at scale AND having a high fiscal multiplier i.e. making people productive to create growth. The Tinbergen Rule is a basic principle of effective policy, which states that to achieve n independent policy targets you need at at least n independent policy instruments. And so people want microfinance to work at scale for poor people in poor countries, and think UBI will create many entrepreneurs and you get massive productivity at scale and a massive fiscal multiplier, but some European welfare states have de facto UBI and cuddly capitalism hasn’t created crazy growth. Not saying it’s bad for welfare reasons.
If you want anything outside this continuum, then I’d be more excited about subsidizing highly scalable, zero marginal cost (global) public goods. These could even be for entrepreneurship, like Moskovitz & Collison subsidizing Asana and Stripe Atlas for poor countries—that'd be really effective.
I find this surprising. Why don't the treated individuals stay on a permanently higher trajectory? Do they have a social reference point, and since they're ahead of their peers, they stop trying as hard?
Before I read about the results of the study, my a priori assumptions were that the money wouldn't help because of bills but that some kind of benefit must come out of it.
Without a reliable source of income, even if they did not have many bills, it is hard to see how even $2,000 could help in the longterm.
To me, it seems that an unconditional cash transfer that helps temporarily but not in a longterm way might make people feel worse by perception of the counterfactual of being better off becoming more vivid. The $500 or $2,000 unconditional cash transfer brings them somewhat closer to the reality of being better off, but not close enough.
I wonder if there is a minimum length of subsistence that can be established for unconditional cash transfer so that it helps people universally, regardless of the wealth of their country.
Can you clarify what you mean by this? I didn't follow you after you wrote "so traits that would help in abundance don’t have a hill they can climb."
Can you clarify what you mean by this? I didn't follow you after you wrote "so traits that would help in abundance don’t have a hill they can climb."
I think maybe you meant that appreciation of the worth of money is valuable only until you fall into the trap of spending too much of it. Once you fall into that trap, appreciation of its worth won't helpful to you.