I evaluate biological language models for general capabilities and safety risk. PhD candidate in Mohammed AlQuraishi’s lab at Columbia. Incoming MATS fellow with Fourth Eon Bio, current Pivotal Frontier Biodefense Fellow, former Center for Health Security fellow.
I think it’s a real conflict. I think the situation with BAIMs is different: current models don’t seem to generalize very well at all, and the consensus seems to be that it’s because we don’t have enough publicly available data right now. So in this way, it’s not clear if “the genie is out of the box.”
At the same time yes, actually stopping data collection is both unrealistic and will have major repercussions to a lot of serious improvements to human health in the short term. I think tiered access can mitigate some of that, not all.
I do think Biosecurity is very different than cybersecurity so unfortunately the same interventions won’t work, and we will need different thinking. The whole field is a lot more decentralized, there are ostensibly no security practices to patch against potential attacks. Chris Rodriguez described it better than I could here.
That is true. I’m a part of a team building a genome language model. It’s really unclear even to us which models are the best models! and a lot of these fundamental questions can also guide model design.
In that way, if we do it right, and thoughtfully, it’s possible to both become a resource for model construction and improve their safeguards and security.
I would advise against. It is too likely to be used for terror purposes and be directly counterproductive. There is plenty of evidence as Hamas is not shy about it. Hamas has historically taxed anything coming into Gaza (especially through the tunnels). It also repurposed aid for military use many times (it has a propaganda video where it digs up pipes installed by the EU and used them as rockets). Today, Ismail Haniyeh, the head of Hamas, called for a “money Jihad” where people donate to Gaza so that Hamas can keep waging war. Generally the exact number is unknown but it is estimated Hamas used billions of dollars in aid to purchase and smuggle arms, and many of its leaders also embezzle much of the money. In addition there is already a backup of hundreds of trucks with humanitarian aid waiting to arrive in Gaza, so aid is not the bottleneck. All we can hope for is that the fighting finishes as soon as possible. So I think there are 2 options: I believe I saw an initiative to set up aid airdrops over Gaza. It was by Ahmed Alkhoutib at the FDD I believe? Maybe there is a way to support it. Additionally, Donating to rebuild Gaza afterwards though (specially after most of the world has moved on to the next thing) could be valuable.
I have a million arguments against this post and maybe in the past I'd have engaged with each of your points and arguments more thoroughly but I lost my patience for these things. I'll just say this: know that this post (as well as the comments), how they are completely ignorant of the emotional and economic ramifications of unplanned pregnancies, how they completely ignore self-autonomy, are the last straw. I've been in this movement for seven years, modeled my career after it, but especially in light of recent events it made me realize I just can't keep justifying the direction it's taking. This is the tip of the iceberg of why this movement is so male-dominated. And no, I am not outraged of this because it's not 'woke' to discuss these things, or because it's taboo. These things never bothered me. It's because by adopting this perspective you consider to be more encompassing you're really just falling to the same pitfall as the majority of people in human history and ignoring half of us, whether we currently live or will live in the future. Signing off.
This hurts but it checks out.
Okay I'll address the rest of the argument. You're also not giving a lot of context. It's hard to understand but based on your whole comment I can also see it being possible that you bumped into situations where people were trying to sort out interpersonal issues privately, and you got wind of it and tried to make it public.
There is a world of difference between those situations and situations where people are not intellectually honest, which is most of the situations OP describes and discusses.
And it makes the last part of your comment even more uncalled for.
I'm sorry I just disagree. We are an applied ethics movement. Maybe the only one in the world. We should hold ourselves to the highest ethical standards. And yet we benefitted from a scheme that, legal or not, ruined a lot of people's lives. Utilitarianism or not, we need to do everything we can to atone. If we don't, it could ruin our psyches, our ethical standards, our perception and our trajectory.
(1) Effects of cybersecurity on geopolitics, or individual privacy. These are two different areas and they seem to me like one bad actor can cause a lot of suffering or lead to suboptimal futures, but I don't know of any EAs who looked deeply into it.
(2) Reproductive health and the costs of childbearing, possibly from a policy angle. I think as a community we decided to bite the bullet and become total utilitarians, and I see some discussions on how it should play out in terms of contraception and choosing to have more children but all of these come across to me as not very well-informed. There are only 2 posts I found about it are by isabel and they touch very specific topics. So I think an analysis of why people are having fewer children, what policies will help people choose to have more children, and a thorough analysis to settle all the discussions around contraception and abortion, including an attempt to quantify the suffering and counterfactual involved in childbearing and childcare, would be appreciated.
I don't think this post made the strong assumptions about population ethics you assume.
More unplanned pregnancies does not necessarily equal larger population. In fact, at the very beginning the post highlights that there are twice as many abortions as unplanned births and more unsafe abortions than unplanned births. Including the still births, that is a lot of preventable human suffering. Is it worth those unplanned births?
I also think it's a bit ignorant to deny sub-Saharan Africa a technology we enjoy - would you also be against birth control use in the US?
Probably not, because the introduction of birth control and family planning did a lot of good - it allowed women to take a lot more control over their lives, some of it translated into the flood of women entering the workplace in the 60's. Roe vs. Wade alone was correlated with a much reduced crime rate in the US. Without contraception, I would have never dared to pursue a PhD and dedicate my career to EA. Is a world where half the population can't plan their futures a better world?
Additionally, more birth control does not equal fewer children. Israel has more access to birth control and legal abortion than many western countries, and it has a higher birth rate than the global average. Secular women in Israel alone have a higher birth rate than any other OECD country. Similarly, Eastern Europe has a lower birth rate than Western Europe despite having more strict control over abortion and birth control.
So the counterfactual does not mean fewer live births necessarily. And maybe it's wiser to try and shape a culture to be more pro-natalist rather than rob people of their choices. With the longtermist framework in mind and the timeframes of childbearing and raising we have the time to do these things, rather than reach for interventions that maximize the single metric that is population size in the short term but could have negative implications on culture and suffering.
I think in order to be against an intervention that gives people more choice you need to make a very strong argument. I also think that you're probably reaching this conclusion because you're underestimating the burden of childbearing. There is a reason why so many women choose to have unsafe abortions rather than give birth.
I actually have given artificial wombs a little thought. I do think they'd be great: they could eliminate a very common suffering, give more options to LGBTQ people, aid in civilizational resilience, and definitely increase the number of wanted children people have in practice. They make sense within many different ethical frameworks.
I also think we're very, very far from them. I'm a systems biologist in a lab that also ventures into reproductive health, and we ostensibly know very little about the process of pregnancy. My lab is using the most cutting-edge methods to prove very specific and fundamental things. So at the same time, I am skeptical we will see it in our lifetimes, if ever.