• Home
  • Start Here
  • Podcast
  • Investing
  • Writing & Arts
  • About
    • Mirror Man
    • Thinking Bigly
    • Yellow Gentlemen
    • Places in Between
    • Meet-up
    • Investment Aphorisms
    • Angel Investing
    • Mingle (old)
    • Arts
    • Investing
    • Newsletter
    • Theatre
    • Poetics
    • India (1997)
    • Indonesia (1998)
    • Unconference (Chatham House)
    • Grants
    • Privacy
    • Disclaimer
    • Contact
  • Search
Menu

Then Do Better

Street Address
City, State, Zip
Phone Number

Your Custom Text Here

Then Do Better

  • Home
  • Start Here
  • Podcast
  • Investing
  • Writing & Arts
  • About
  • Archive
    • Mirror Man
    • Thinking Bigly
    • Yellow Gentlemen
    • Places in Between
    • Meet-up
    • Investment Aphorisms
    • Angel Investing
    • Mingle (old)
    • Arts
    • Investing
    • Newsletter
    • Theatre
    • Poetics
    • India (1997)
    • Indonesia (1998)
    • Unconference (Chatham House)
    • Grants
    • Privacy
    • Disclaimer
    • Contact
  • Search

Alex Petropoulos: Europe 2031, AI, Power, and the Future We Actually Want

October 18, 2026 Ben Yeoh

What happens if Europe gets AI wrong? Alex Petropoulos is Chief of Staff at Arq Foundation and one of the authors of Europe 2031, a speculative story imagining Europe's technological, economic and political future in a world of transformative artificial intelligence.

We start with the predictions behind Europe 2031: from severe shortages of AI computing power to the possibility that compute becomes abundant and today's infrastructure investments lose much of their strategic importance. Alex explains why he and his co-authors chose speculative fiction rather than another policy paper, and the power, and danger, of making people feel a possible future rather than simply understand it intellectually.

Can Europe compete with the US and China? Or should it concentrate on its own comparative advantages: industry, data, infrastructure and supply chains, while accepting continued dependence on American AI?

Alex argues that Europe's deeper problem may be institutional. Its commitment to democracy, consensus and constrained power is part of what makes it worth defending. Yet those same processes can make change painfully slow. Which European values really matter? What trade-offs should we be prepared to make? And can politicians offer a positive vision of the future that brings people along?

We explore the opportunities and catastrophic risks of AI, including why scientific progress might accelerate dramatically in mathematics and other verifiable domains, while biology, clinical trials and the social processes of science remain more difficult. If intelligence becomes abundant, what becomes scarce?

Alex also explains why he has changed his mind about a publicly funded European frontier AI laboratory, the challenge of sustaining successive generations of increasingly expensive AI models, and what we can learn from institutions such as ARIA and the Institute for Progress. We discuss scientific moonshots, tolerance for failure, and why we urgently need better measurement of AI's capabilities and effects.

We then turn to some of Alex's more personal interests. What did captaining a successful university Overwatch esports team teach him about teamwork, learning and comparative advantage? How does he use AI as a thinking partner? And why does writing remain such a painful process?

In our overrated/underrated round we cover recursive self-improvement, universal basic income, AGI, compute taxes, open-source AI, prediction markets, effective altruism and science fiction.

We finish by imagining an ordinary Tuesday in a better future. For Alex, it involves friends, a bakery, a park, good health, affordable travel, meaningful work and perhaps a little whimsy and mischief.

A useful reminder that the point of economic growth, technological progress and better institutions is to make possible lives we actually want to live.

Key takeaways

  • Europe's greatest risk may be institutional, not technological. Individually sensible decisions can produce collective failure when incentives, bureaucracy and political processes are poorly adapted to rapid change.

  • AI sovereignty is not the same as AI self-sufficiency. Europe will probably continue importing American AI. The important question is how to retain influence, resilience and bargaining power.

  • Comparative advantage matters more than winning every race. Europe's factories, industrial expertise, data and infrastructure may provide more realistic opportunities than attempting to replicate every frontier AI laboratory.

  • Values require trade-offs. If Europe wants to preserve what makes it distinctive, it needs to decide which principles are essential and which existing practices can change.

  • AI progress will be uneven. Mathematics and other verifiable domains may accelerate rapidly. Clinical trials, physical experiments and the social organisation of science could remain substantial bottlenecks.

  • Publicly funded AI labs need a sustainable model. A government might fund one frontier model, but competing over successive generations requires an economic and organisational structure that can keep going.

  • Measurement is badly neglected. Confident predictions about AI are often built on unreliable benchmarks or inadequate evidence. Better policy needs better information.

  • Competitive gaming can teach surprisingly useful lessons. Teams can outperform by leaning into unusual strengths rather than trying to approximate an idealised strategy.

  • The ultimate test of technological progress is human flourishing. A better future should mean more agency, more opportunity, better health, stronger relationships and lives that young people can look forward to.

Further reading

  • Europe 2031 — the speculative scenario, including an audio version.

  • Arq Foundation — research on preparing Europe for transformative AI.

CONTENTS, TRANSCRIPT AND PODCAST LINKS BELOW

  • Listen: Spotify, Apple or wherever you get podcasts

  • Watch: YouTube

Contents

00:00 Meet Alex Petropoulos
00:28 Europe 2031: Which predictions might come true?
01:32 The compute crunch — and a world of abundant compute
04:01 Why speculative fiction can change policy
06:46 Is Europe waking up to transformative AI?
10:53 European values and difficult trade-offs
14:47 Is AI a normal technology or a national security issue?
16:14 Where Europe could have a competitive advantage
20:09 Can Europe move faster without sacrificing democracy?
25:24 Catastrophic AI risks: Loss of control and misuse
29:52 AI optimism and breakthroughs in science
33:29 What becomes scarce when intelligence is abundant?
36:53 Why Alex changed his mind about a CERN for AI
40:12 Institutions that work surprisingly well
43:01 ARIA, moonshots and funding ambitious science
45:16 Risk tolerance, failure and feedback loops
47:09 What should ordinary people ask about AI?
48:14 Bottlenecks, comparative advantage and better measurement
50:40 What Overwatch teaches us about leadership and teamwork
54:55 Video games, strategy and recommendations
57:24 Writing, creativity and thinking with AI
01:01:22 Overrated / Underrated
01:06:24 Imagining a future worth wanting
01:11:18 Future projects, writing in public and final advice

Transcript

AI-assisted transcription; errors are possible.

Ben: Hey everyone. I'm super excited to be speaking to Alex Petropoulos. Alex works on AI science and the institutions we need to make progress. He's chief of staff at Arq Foundation and one of the authors of Europe 2031. A speculative story about Europe's technological future. Alex, welcome.

Alex: Thank you Ben. Very, very good Greek pronunciation for me.

Ben: I've been practising! Of all the things you imagined in Europe 2031, what do you think is most likely to be true by 2031?

Alex: This is a difficult question because already some things in Europe 2031 have come true. Or rather, small versions of them have come true. You know, we sort of predicted access controls and predicted the US cutting off access. And a small version of that did happen with the Department of War, Anthropic and Mythos. Although I would say it's a hint at what could come as opposed to an actual thing coming true. And the other thing that makes this question difficult is that, in general, when I talk about the predictions we make in Europe 2031, I'm like: don't index on any one particular prediction.

We're not necessarily trying to get them exactly right date-wise. In fact, we fudged dates in, [I ] in order to keep things working in a way that would keep the reader happy, especially certain audiences that we had in mind when we were writing it.

I would say the prediction that I think is still looking to be on track is that we will hit a compute crunch. Compute capacity will just be incredibly constrained. And especially if you hit a capability threshold, people often say that data chips are depreciating in value, but actually in many cases chips have appreciated in value because the AI models have gotten better, which only just keeps pushing demand up and up and up.

And so if we suddenly got a big capability breakthrough, demand could go through the roof and we could be in an even more compute-constrained world than we are now.

Ben: And you can see that in some market prices, particularly upstream of compute. So the bottlenecks you need to make compute are still, I mean, they flip-flop a bit, but they're still going crazy.

Well, I don't know if this will be an easier question on the other side, but what's probably wrong by 2031 or maybe even not the date, but directionally wrong, but still really useful to consider?

Alex: I'm going to be very cheeky and I'm going to give the same answer, which is the compute predictions. In general, I think people should internalise that we might not be compute constrained forever or that compute is important.

The reason we focus on compute is because we talk about ways countries can be important on AI. And normally, to do all this really difficult R&D, you have to spend billions. You have to compete in capitalism, it's difficult. You probably will lose by default. Or you could build a data centre and suddenly you're important.

And so you are, you've got the lowest-hanging fruit possible for becoming important on AI and having some sort of relevance. Great, we should do it. However, we should also remember this relies on compute being constrained. And there are worlds in which even in five years time compute isn't a constraint.

Like Elon could have massive breakthroughs with SpaceX. The cost per kilogramme of launch capacity could come down sufficiently. There could be a couple breakthroughs and suddenly we have orbital data centres and all of your ground-based compute doesn't matter anymore. And all this investment that you did and you're like, 'We're fine.'

We've got the compute, but it doesn't matter any more because now it's all being made redundant.

Ben: That seems like a good idea. Look at, in some ways, the left tail and the right tail: compute is really cheap and abundant anywhere, or there's a crunch and you can't do anything about it. Those seem to be quite useful extremes to speculate about.

And I'm interested, so there is a horizon scanning future scenario-type industry and academic literature out there. But I was interested in what made you think speculative fiction or say scenario planning seemed to be a better way to examine this and potentially examine this for European policymakers rather than just another white policy paper, 40 pages.

I'm going to give you part of the answer already, that no one really reads apart from three people in a little room before it gets shelved. But anyway, speculative fiction: is it a better way, and how did you come to this?

Alex: I mean, in one sentence, you want people to feel the AGI, you want to create an emotional response.

I sort of talk about what we did as wielding a very dangerous tool using scenario writing to create buy-in to a problem that you think exists is epistemically impure. You are violating some of these, I don't know, purist rationalist norms. When you sort of wield this weapon, you have to be really, really confident that your take is correct and that you want to achieve.

And I think that we were confident enough that we're like, 'We're going to do this.' But the point is that it makes people feel something, you know? We had hundreds of people messaging us, having read it, people who said that they were lying in bed, listening to it, and they started crying when they got to the end. We had a mother who messaged us saying my daughter is three years old. There's no way in hell that she's going to wait, be eight years old in the world that you described, what can I do to stop this happening? And so as a side effect, you have this virality, but we never really intended it to go viral. The theory of change behind it was. Convince or sort of be heard by the 2000, 3000 most important people within a country that the elites basically. And that would've been sufficient. I think that it sort of reached an order of magnitude or a few more people than that. But that's the basics of why we chose to use this dark, magic, forbidden weapon.

I would look at it in that sense.

Ben: That's an interesting theory of change. I think there's quite a lot of truth to that from my way of thinking. Obviously you have to feel 110% that you're going to be correct, but on big moments in human history, maybe just taking the last a hundred to 200 years, I always think about the movement, which where society overall went from being pro-slavery or slavery in society to being anti-slavery and the anti-slavery movement started small and had to do these things to convince people otherwise.

But obviously you're going against the majority grain. So if you're wrong, you can do a lot of damage. So it's kind of interesting. So maybe taking some of your premises within that. I guess in my mind the paper argues Europe has been making several misjudgments around how fast AI is advancing.

Maybe we could say almost everyone is making these misjudgments also misjudging its impact and the ability for Europe or maybe even countries overall to catch up. We also make the point that a lot of people on the frontier of say policymaking and government or even the person in the street is not actively using frontier models.

They're not solving Millennium Prize Problems. They're not solving [ ]. So we're a little bit behind the curve because the curve, or the frontier, is going so fast and we are ahead. [ ] I'd be interested to think, has anything happened in the last few weeks, few months since you've written the paper, which has made you change your mind on any of that?

Or if anything, has this emphasised the arguments that you were making? Speculatively, even if the dates are wrong or at least in the direction of travel.

Alex: A couple of things. On the high level, people sometimes ask me, 'Are you optimistic, Alex? Are you pessimistic?' And you know, we wrote quite a doomy scenario. It's doomy for me under the assumption that we do nothing. And I've never believed that we will do nothing. I've always believed, we like to wake up and smell the coffee.

The question has always been: how quickly do we, how fast do we sort of viscerally internalise what is going to come or what might come and then act in accordance. And so I think there has been this visceral reaction faster than I would've expected it. So, bullish. You know, Ursula von der Leyen in her state of the Union, this is the EU version of the US State of the Union.

She gave it to me on Wednesday. She talked about recursive self-improvement and the possible risk that this could bring. And the fact that our enemies might have this technology and we won't. If you told me a year before that she'd be talking about that, I would've, I would've laughed at you.

That being said, I think that, you know, that there are these three assumptions that we talk about, right? Miscalibrating how fast it's moving, how important it'll be, how well positioned we are. But then there's this third meta level thing, which is at play, which is at every step in the scenario, everyone takes what feels like to them, the sort of locally rational action.

They sort of act within the limits that they perceive themselves to have. And the incentive structures within, like the bureaucracies within the institutions are set up in such a way that people aren't able to take the correct action. And not much of that has changed there.

Things that would make me maybe be more optimistic would be people who really get it, choosing to go into government, choosing to put themselves into these positions of power and next to the people who take the decisions to help inform them. And then also like broader reforms to how these institutions work.

And this is, this is by and large why I'm more bullish on European member-state policy than EU policy, if that makes sense.

Ben: Yeah. We can come to that maybe Europe has to be a tiny bit less consensual in terms of getting all member states around and have, well, what I would say is perhaps a tiny bit less democracy even though there's this strange paradox where in order to defend democracy, maybe you have to be a little bit less democratic.

And I see some analogies with climate movements, maybe even within COVID pandemic, particularly within climate. It's interesting, if you go back 20 years, the median, in fact even maybe 10 years, the median scenario was looking at perhaps a four degree world. And today we're looking at between a two and three degree world and still on a downward trajectory you can argue about speed.

So that's one of the really tricky things. Because humans generally moving at speed is not our default scenario, but actually we've done quite a lot within climate and certainly within climate have now taken out a lot of the negative tail risks. I mean, there's not exact analogy because of the tail risk in AI, so I kind of get a little bit cautiously optimistic around that given some of our other complex wicked problem type things.

Bringing it back to Europe, I was interested if you think it, well, for Europe it should not really become simply a slightly worse version of America or China. That seems to be, again, what the paper's suggesting. It can't really be America or China in terms of compute or frontier labs and things like that.

So I'd be interested now also a few months after the paper, what do you think Europe should optimise for or Europe should be doing if it can't be America or China? Or do you think it genuinely should try and catch up in certain domains?

Alex: So, on catching up, I think it has to just be really realistic about where it can and where it can't catch up. And then you maybe take a calibrated bet and say, I'm going to put a bet on this moonshot. I'm going to put some amount of money. Maybe it'll work, maybe [ ]. By default it won't.

You should be aware that it's like a big risk. What should Europe try to emulate? I think that Europe needs to have like a conversation with itself about like what makes Europe great and then how is that a threat and how is that at risk? And I think in general, I sit in the position of why care.

I guess that's a question one might ask, which is why are we even talking about Europe? Why do we care about Europe? And one reason I care about Europe beyond the fact that my friends live here and my family live here is the fact that I think the US have a set of values and these values are quite good and Europe has a set of values and these values are also quite good.

But I think that regardless of whose values are better, I think there is some weighted combination of both of those values that is superior to either. And I would like to see a world in which those values are represented into the future, if you want to say that, or at least represented within AI systems and within the way we develop this technology.

And so then you should be really okay, you're, you need to do a better job of exporting your values. But then the question is which values are you willing to give up? Which values are you willing to import? So it's sort of like a question of what do you want to take from the us?

Like what actually matters where are your trade-offs going to happen? And I think that for all the talk that people in Europe do about values, I think it's quite an immature conversation still because there's never any conversation about trade-offs and what they'd be willing to give up. Like where, what is the ranking order?

You can't value them all equally. That doesn't work because you're going to lose them all. A bit of a fluffy answer. But I think it's like a prerequisite to actually be oh, why do we care about this? What model are we going to follow? What should we do? We can still be good at many things.

Ben: I, in some ways that echoes just overall thinking around industrial plans. Like should you have them, you've got to figure out, you can't do them for everything. You need to figure out where you are good or not. But specifically for AI. But I guess one, if you're quite purist about some of these things from say a market or say your anti industrial plans at all, you'd maybe argue why can't Europe simply just be very good at using American AI or Frontier AI?

I guess I already think of one of the counters because of what's happened with defence or defence pacts recently. But you could maybe say, well, we become really great at something else. We keep mostly European values and we just import American AI and that's it. Spill below has happened that way. Is that not a cogent argument because of all the other European values, things that we need to maintain or argue for.

And also, I guess, the specific different industries and values that different countries have.

Alex: So I think it's first important to acknowledge that some version of that will be the version we end up in. There is no world in which we don't import American AI just as there's no world currently where we don't import part of the US security umbrella, right?

Europe isn't independent, Europe isn't sovereign. It shouldn't pretend that it's totally sovereign. And so I think it's silly to pretend that we could get there on AI within 10 or 20 years anyway. I think that there are like two stories that I tell when I talk about, AI policy.

The first is like if AI timelines, the pace of AI progress is sufficiently long. If AI is a sufficiently normal technology, whatever that means nowadays then what you should be doing is basically just copy progress studies and just look at what, like the [Rhine Group] people, look at what Mario Draghi is doing.

Do the Draghi report. Listen to Patrick Collison probably, like read Works in Progress. And just do all of that. And you'll probably be fine. And that's like your normal baseline. If AI were a normal technology, if timelines are really long, you have your adoption, you have your market effects just like unfuck the European economy, great.

I think the disagreements in AI policy come from okay, but AI isn't necessarily like perfectly normal technology. First, it might be very important. It might be securitized and treated as a national security asset and there might be a US administration which isn't operating in a perfectly positive sum view of the world or you know, willing to take very negative-sum trades with partners, even allies.

And two, if AI progress moves really, really quickly, these reforms take five to 10 years to kick in. So you need things to bridge that gap. And so you have to be thinking about okay, I'll do these reforms, I'll fix my economy, I'll be fine in 10 years maybe. But what are you doing over the next 10 years to make sure that you're relevant?

Make sure that you're not slapped about by the US or China.

Ben: And what do you think European countries should do, either as a European blob or you could choose one or two countries, UK or Greece or, maybe one of the bigger ones like Germany and France. I get the reading from the paper. There's some suggestion that potentially industrial AI, whatever that might mean, might be an area or robotics or some other part of applied AI.

But then I was wondering, is there a European comparative advantage in any of that compared to American or Chinese companies capturing most of that value. But I guess Europe has got to place some of its bets somewhere within that. So I'd be intrigued if there are any suggestions that you feel Europe can explore or is it still at that higher level where they have to just figure out what it is they're not sure and they're just too slow and figure that out.

Even if they don't get all eight correct things, if they get two correct, that's going to be much better than where we are now.

Alex: Yeah. So three things. First, you got to do the reforms to make sure you can actually do all this properly. You got to set the groundwork such that a trillion dollar European company can be created in the future.

That's your long-term play. Get that out of the way. Second, I think that some of these things you mentioned are up there. There are some competitive advantages. It seems like Europe does actually have quite a good data advantage. There are just like European data sets. We have big European companies, we have industry.

We still are, we haven't completely deindustrialised. We still have lots of factories. So there are lots of places where we are strong and have valuable things to offer. I guess the question is can you use that well enough to ensure that you are, that if access is what you are worried about, ensure that you retain access.

I guess an example is: make yourself the person that produces and builds things for the Americans. If you think the Americans will get to do powerful AI systems very quickly, we can be the ones with the factories, right? It is a version of that world. But then the third thing I will say is Europe 2031 is a, go, to go back to the analogy like we use the dark magic. We dabble in ideology. We point all of these faces and attention towards a problem. It is an exercise in problem defining. There is some amount of work and we've done our best to think about solutions.

But I will just say the field of people solving this problem, there are two bottlenecks and one of those bottlenecks is ideas and just people, like a community of people thinking about solutions. I don't think we have very good solutions at the moment. I think our solutions are, to be honest, crap.

And I would like to see more people, more ideas flooding in about what we can do. Because I think that, yeah, we just haven't had enough tokens on it, so to speak.

Ben: I think you're going to make a very good policymaker or politician because that is a three-point plan, right? They like that. I think there may have to be an odd number, like a seven-point plan or 11-point plan, but that's not quite as sexy as a three-point one.

So we need more people thinking about this. Not enough people. Because we can see that not enough ideas at the moment might be happening. I feel the vibes are there, but I guess we're a little bit slow. Europe may have some comparative advantages though. We have to think about that. Maybe supply chain into America, something like that.

And then the long term reform, which is kind of win-win. Even if you think this AI stuff, they've just gone completely crazy. Yeah. What are they doing? Well, this just, you should have it found foundationally. And actually it's an interesting edge, just the glass half full is because Europe can potentially unlock that more than say, some places in the US and potentially unlocks maybe more easily.

There's a, there's a chance that it can actually jump up. Like some parts of America can't actually deregulate that much more. They've reached the frontier of that. Whereas I don't think you could claim the same in Europe. But it's interesting on that first and third point, maybe to some degree there seems to me a little bit of a tension in terms of, and I mentioned this before, the argument essentially is Europe's consensus and procedures are somewhat too slow that needs unpicking speeding up more people in it.

But part of the European values of all of that seems to me that they have this: liberal democracies constrain power. Now you can see that's tipped too far and Works in Progress are very good on this, where you've seen like it's really reasonable for the fire department to say we need access for our ladders to go into the buildings.

But when each individual stakeholder does that, it means you can't build any buildings, or they're not really suitable or are very expensive. So I'm interested is at that higher level, do you think there is this throughput where we can become dramatically faster, we can get more people within this new industrial AI policy or long-term reform without destroying enough of these European liberal values that actually we so and I got the impression from your answer earlier, is that yes, there might be some trade-offs within those values, so we do need this hard conversation.

But if you come with a call, I'm going to make it up to 10 or 20 of them, you know, a good eight to 15 of them survive and that still feels sufficiently European that's what we should do. Is that the right way of thinking about it and that there is a tension there? Or actually is there some other through line that we could pursue here?

Alex: I think there is a tension. And if you don't do this right, you fail. An example is look at the way that the US have done their data centre policies. And they've had this laissez-faire approach and now they have this massive backlash. And so this is an opportunity for Europe. Because Europe hasn't built as many.

They've imported a little bit of the US data centre politics, but it's still very nascent. We can take a lot of lessons, we can learn how can we do it well? So you bring people along so that you are actually making sure that the communities benefit from the data centres being built, that they get some of the tax revenue that the data centres are building in electricity production and not using water even though that's, you know, made up. But in general, I think this touches on what you said, which is glass half full. I'm an optimist. I think you have to take many of these things and frame them in the optimistic sense. There is a world in which you can say, Tyler has this saying, you know, what is it the Europeans are so culture, they can tell you about porcelain.

They can tell you about all this and that, but if the world was run by them, negative 1% growth rate and we have all these bottlenecks and if AI sort of becomes so important, the bottlenecks means Europe is doomed. And, then that's the reason to freak out. It's like also, ah, if we get rid of all these bottlenecks, Europe has so much to gain.

Like there is quite a strong compelling win-win of oh, we can get the growth in the short term from doing the deregulatory stuff or, and whatnot. And then we get like the AI growth in the long term. Or maybe the AI growth kicks in first and the long-term reform. So there are some interesting political economy packages that you can put together.

I think the ultimate question is, are you presenting a compelling vision of the future that is positive, and that you can bring people along with, because I think it's fair to say that people, I think most politicians have failed at this and, most politicians are like failing to rise to the challenge of like presenting a vision to the people of the future. And saying, this is how your life is going to be better because of this thing. I think this is especially true with young people. And they sort of have this negative-sum view of the world. Because the world has been negative-sum towards them. Now you have to do politics. There's like the difficult stuff.

And find ways to create your coalition to take, pick the set of policy choices that give you wins and give you win-wins across the board. Make some trade-offs. I think that's possible. I think I've seen a way that you can do that. I don't think necessarily politicians are catching up to this quite yet, but I think that there's a festering, I think something's festering in regard to youth politics and disenfranchisement and that this will extend and sort of blow up around AI. And so I think if you don't sort of get on this early as a politician, it will sort of consume you.

Ben: We

Alex: Need, or how does that relate? Yeah,

Ben: I say we need the storytellers back. Well we need in some ways like the force, the Jedi side of the force because you're probably going to dabble in these dark arts. So yeah, you might fall the way of the Sith with these very charismatic storytellers, but you are going to have I guess the Yoda-like characters hopefully coming through and saving us.

Well perhaps zooming out. I mean we can come to other policy bits if they occur to you or come up. And I do wanna talk about the opportunity side as well as the risk side, but maybe touching on the risk side first and zooming out because I think that's what, a lot of things came very cogently in 2031.

I still think we need some good positive speculative futures and I know people are trying, but we're just not coming towards it. I don't know why. Maybe, maybe humans are just inclined to look at dystopian sci-fi more readily. But in any case opportunities and risks. Maybe on the risk side I tend to hear two different categories of catastrophic risk arguments.

So one goes, we create intelligence vastly beyond our own and we can't control it. It's like we are humans or, and they are mice or I prefer to think like octopus and you just can't understand it. Like the mice don't know what's going on and they just all disappear because humans don't really care about them.

And it'd be the same for this vastly superior intelligence. That seems quite sci-fi to a lot of people that I know. Some people take that argument seriously. The other which seems more cogent to sort of everyone is that you just get a very powerful AI tool, say, and it gives certain humans, maybe quite a few humans who may want to do harm or some version of evil, much greater capabilities at much lower cost.

And they can simply just do that. So you don't even need to get super intelligence of any form to just kind of see okay, that could be quite a bad risk. And so that comes in a cluster of manmade pandemics or all of these other things that you could do with super intelligence. I'm interested, do both of those categories of risk worry you?

Does one of them worry you more? Should we be thinking about that in the AI risk world? Do they worry about certain things too much? But how should we be thinking about AI risk and what some people would call X risk or existential risk?

Alex: Maybe I should start with an epistemic status. I don't think about this maybe as much as I should in terms of I'm quite pragmatic and I think about things through the lens of what could Europe do? But I'll, I'll like to indulge the question. And I think on like the first and octopus risk if you wanna call it, I think it would be foolish not to hold some amount of huh, we should think about this. That I'm not confident that this is impossible. I think I'm more optimistic in the sense that I can definitely see or smell like technological pathways that lead to good outcomes there, right?

it is not like I'm oh, any possible version of like super intelligence or like powerful different intelligence you build will always, do you, I think that you have a lot of agency over like the direction of the technology that you, build, but you have to exercise that agency and you have to be really cognizant of it.

These are like my priors and I sort of see like most of my takes, like informed by tweets that I see, but it seems that we have taken decisions in different directions that have been both negative and positive in terms of our ability to shape these intelligences in the way that would be desirable.

And the misuse risk, I think this is basically a force multiplier to possibly other misuse risks. Like if you're already worried about bio risk, many of your friends who were worried about bio risk, they're now just really, really worried about bio risk.

I think it's something that we should clearly pay attention to. I think maybe the thing that should make you worried is the pace and whether or not you feel like your governments are sort of on the ball and whatnot. But, you know, in this State of the Union address that the president of the European Commission did, she talked about how she opened her AI section talking about risks and talking about loss of control.

The equivalent of the Secretary of State for technology of the EU has talked about loss of control multiple times before. I think they think about this, they think they care about it alongside a bunch of other things they care about. The question is what can Europe even do about that?

And that sort of gets you towards I guess some of the things that we work on and whatnot. But that's, I sort of employ some of these like mental tricks in terms of I don't think about the fastest possible takeoff scenarios because there's nothing Europe can do about those takeoff scenarios.

So it's not useful for me to think about that. And I sort of limit the amount I think about certain risks because I'm more focused on what is within the realm of pragmatic and the possible within this operating theatre that I exist in.

Ben: Sure. What is tractable? What you can only control what you can control, even if you can distantly control it.

I mean, I remain pretty optimistic on that. Part of it is because actually we've had pretty terrifying capabilities for quite a while. And actually, I don't wanna give too many hints, but you could think about it and you, if you wanted to do evil, evil people could have actually done quite a lot more devastating things in the last 10 or 20 years than even that they've managed to achieve.

And they haven't for a complicated set of reasons, which I think should still hold. But maybe let's flip to the other side. So, AI optimists, and the opportunity side. What do you think AI optimists are getting most right, or what should we be hopeful about? And there's a lot we could cover.

Everything, I think around science is pretty good. Second order things. I actually think that because I do some work a little bit in climate and health, all of the climate people are underestimating what kind of gains this could give us in solving some climate things. The health people actually are beginning, they're actually already beginning to see it, so I'm not sure they're underestimating it.

They're kind of seeing it and not sure where that goes. But I'd be interested in your view, what are AI optimists getting right? I guess you can lean to Europe if you but it could be anything in the world that you are seeing.

Alex: I come from a maths background, so I'm just like incredibly excited about everything happening in maths at the moment.

It's just: wow, what a time to be alive. Right? We're like solving all of these. I mean, we solved the (I can't remember the name) the [Millennium Prize Problem], Navier–Stokes. We solved Navier–Stokes. There's like rumour that two and a half other ones have already been solved.

Ben: P versus NP or whatever it's called.

Alex: P versus NP. Yeah. You know, like register your predictions now. You don't have much time left. So incredibly exciting time, to just be a nerd like mathematics. And sort of you can extrapolate along. I do sort of hold this opinion, you know, like the verifiable areas will move faster than anyone thinks they will.

And then the non-verifiable stuff will move slower. So I think on like the, health side and on the biology side, I think all of this really sort of annoyingly just reinforces like how important all the other sort of science reforms you're going to make will be of like our clinical trial reform now actually is like a lot, lot, lot more important because you could do so much more with it, but it's still going to be the bottleneck. And so I'm curious where the bottlenecks end up arising in science. physics will pop, like maybe with physics we'll also see some crazy progress. But I sort of have an ongoing debate with colleagues and friends about how much transfer you will get from the non-verifiable domains.

And I think even in, even within mathematics, it's interesting because there are branches of mathematics that have easier to formalise than others, essentially like it within Lean. It was written by algebra people. It's written in a way that makes algebra very easy to formalise. I have friends who are like graph theorists who are this is very annoying.

I can't write my stuff in Lean because it's written by people who speak like a slightly different language. It's it's like your alphabet was written in French and you're Italian, you are like Greek or something. And you're trying to use the programming now because you're well I don't speak Italian or French.

And so I'm paying attention to will the AI model solve problems in those? Like the AI models have been trained in French for maths. Will they solve problems in Greek as well for maths? And this is like a thing that I'm  paying attention to. And maybe I'll get a hint of whether that happens then I'm way more excited about the future of science.

Ben: I think there's something with that point in particular, I agree, they, the AIs, the code will have to, I think, invent the French. So they'll have to do their own version of lean, which isn't for algebraic things, but I think they're now fully capable of doing it. Even my sense, this is just vibe really, but if GPT-6, [Astra'] has already trained seven to be able to do Navier–Stokes and we've got some self-recursive, then it seems to me that seven or eight is going to be able to build those things.

But I'm then interested just to dig one level deeper. So if AI is really good at these verifiable domains as you call them, and if intelligence becomes really abundant, what becomes scarce or what do you really think are the bottlenecks? So we, you've kind of blobbed it as non verifiable, and I'm going to expand that to say some of this, what I guess the economists or social scientists would call tacit knowledge.

Some of it is called Polanyi knowledge. So these are things like how a carpenter builds or all of the things you get in a meetup as opposed to what's written in code. I guess all that goes into Polanyi-type domains is the type of stuff which becomes scarce. And I guess the bottlenecks, if we talk about clinical trials, I as yet don't quite see how you're going to get around putting the drugs into humans to make sure they are safe.

And actually some of this efficacy and clinical trials are quite a big bottleneck, although I do think we should be substantially faster. Clinical trials take on average eight to 10 years from first in humans, six to eight years should be, I mean, should be a no brainer. And we should have already gotten there in one to two years.

Seems to me like a very big jump, which is where we ought to go. But I'd be interested if you've had any thought when you've seen about that, about emerging bottlenecks or because your bottleneck is still, ah, we haven't got enough people in policy thinking about this. This might not be a domain you've thought about too much, but interested in bottlenecks or what becomes scarce in a high intelligence world.

Alex: Yeah, I have a colleague who's thinking about this. I should talk to her more often. I think even though you talked about this like tacit knowledge, I think even the non-verifiable stuff is stuff you are just trying to learn about like biology and stuff and you have to prepare everything.

Like you don't have a fully self-driving lab. Even within, like, I am still deeply confused about recursive self-improvement and whether that's actually happening and whether you've cleared the bottlenecks. Because I'm not convinced that you haven't cleared all the bottlenecks and there might still be some bottlenecks.

But on science itself, I am.

I think that, and maybe this is just from like a metasciencey direction, but there's a lot like the way that. Scientific information is communicated between scientists and the way that the social dynamics of science that seem like hard to replace and hard to get that serendipity from.

But maybe we'll get there. I sort of find myself often thinking oh, I'm so grateful that my job is safe because all I have to do is talk to people all day or have face-to-face conversations. AI's not going to take my job.

Ben: Yeah, communications. I actually think humanities in some ways should be less worried than they are.

I mean, they're, they're really not going to disintermediate theatre for instance, or albeit not many people actually make that much money in theatre. And yes, maybe you will speed up some aspects of script writing, but people really don't like that. I mean it is half of art, or at least some bit of art is all of the tacit knowledge, which comes with the artist and everything around that.

That's let alone before we get into questions of or style and taste on that, about whether it can do that. And even when it matches that, I think human audiences will not find that as satisfying. But I'm interested then also in what you maybe changed your mind about, we could do this on any level. Because I think you're involved in this proposal for a type of CERN for AI and institutions and kind of how institutions work and then subsequently you've kind of moved away from that form of thinking. So perhaps specifically on that, what changed your mind and then anything else over the last two or three years that you think that you've changed your mind about or as they say in some communities updated your priors on, but anything you've changed your mind on.

Alex: Yeah. I changed my mind so many times, like the whole CERN for AI journey. Like the main one is like any sort of publicly supported effort, needs to answer, answer the question of okay, you train like GPT-N, what's the plan for GPT-N plus one? Because you can corral all this public funding.

You know, in the most recent transformative AI strategy for the EU that a bunch of these experts, some of my colleagues included, published, they're to train a competitive model to get to the frontier now would cost 780 billion euros. Okay, you spend the 780 euro billion, now what?

Because do you have a competitive company? Are you going to create like the revenue loop that OpenAI, Anthropic have to train the next model? It just all falls apart if you are trying to directly compete at the frontier. So then the idea evolved more and I think the CERN idea evolved more into like what sort of R&D areas you could work on that could still be quite important.

That could still be quite important for resilience and still be quite important for competitiveness. And I think there are versions of these ideas that I'm still standing behind and still keen to push and you know, I'd be very keen for the EU to do something like a DARPA, maybe.

Other things that changed my mind on that. Just like priors around like centralization of power. I used to think within the terms of like one big AI, like the big super intelligent AI and I'm much more like actually that's like there's a cognitive bias that you're employing there when you think about that.

Like it doesn't have to be that we don't have to build the technology in that way. We could have multi-agent systems and have lots of different personalised AI. And so that's like another place I think. I think I've softened and nuanced my opinions about governments and bureaucracy and there are good people within the government who are trying very hard, but incentive structures that allow them to do the things they want to do.

And then there are also some people with just some horrendously outrageously wrong opinions. And if I was a dictator, I'd send them to [ '] or whatnot. But, so people contain multitudes.

Ben: Yeah,

I heard Tyler Cowen recently somewhat defend bureaucracies, which was quite interesting.

He was taking the other side of the view and said, well, maybe they're doing something that we don't know about it. I think this was more like in America saying, well actually, the fact you've got to fill in a lot of bureaucratic forms means that some aspects of fraud go down. Because if you want to claim benefits and you're on the margin, you're not going to put all of that effort in until you're really doing it.

I mean, I guess that was on a, on a different level and we spent quite a lot of time, I guess, softly critiquing institutions and bits by that not understanding your little softer aspect or some good people working on that. But maybe taking the flip side is there any institutions or organisations that you've accounted for that you think work surprisingly well and can we learn anything from that?

I mean, and on the other side, I do think institutions have been surprisingly robust or even anti-fragile in this current world of geopolitics that we've seen that, not many of them have imploded. Not as many of them as I thought could have done. I'm not sure whether that says that they're good, but they certainly seem to be somewhat resilient.

But I'm, I'm interested if, yeah. Do you think anything has worked really well and can we learn from that?

Alex: Be really bad if I didn't have an answer.

Ben: It might be you've not really come across one, which has worked super well. I mean, I guess in governments, people sometimes say Singapore or Estonia. I think they have advantages of working really on a small city state level. So that's kind of interesting.

And then some other organisations tend to have been maybe shorter lived or more nimble or specific small institutions. And I think it's interesting that I've detected actually, I guess from some of these foundations, which are actually being funded with AI money that they're starting to do institutions, which are just tackling one particular subset area.

I can't even remember the areas, but it's something just health data or that's it. They wanna solve Alzheimer's, so they're not going to do anything else, but they're going to start an institution and foundation just on that because they've thought that those sort of more time limited, purpose-driven, mission-driven, driven, but with a more well-defined mission have gone well.

Although I do think you can still critique that, I'd be interested. Have you seen anything?

Alex: I think that my interactions with the Greek state have been like much better. Everything's been digitised. You can get every form online. Previously you'd have to go to some dusty office.

You'd have to go to the thing. no, you need this form. You have to go to another office, the other side of Athens to get this form. And then go back and no, you also need this form. Spend hours and hours going back and forth. There was a minister, Pierrakakis, who championed a lot of these digitization reforms.

And now he's the governor of the European Central Bank, I think. And so, yeah, they can make your life better, make the burden on your life less bad. Another example is, is it Taiwan that have little lottery tickets on receipts so people hold onto the receipts?

Alex: Is it cheating if I just fanboy about the Institute for Progress for like 30 seconds? 

Ben: You can do that.

Alex: Sure. I just think they seem to have just been insanely impactful and both in sort of very short term, let's do a thing. And in these like long term bets and building something of like over five years that has been really, like long lasting and has moved the needle in a really positive direction. I sort of look at them, and I'm like, 'That's ambitions for what we could be doing in like five years.

And then yeah, so I think that they make me bullish that you can do things that are like sort you know, they're, they're, they're basically an extra branch of government and, whatnot. A meta branch of government. And then there are things within the focus research organisation space.

Like ARIA has good vibes. I don't know if it has more than good vibes, it's like it's still too early to tell. In some sense,

Ben: You've got to start with the vibes, you've got to start from somewhere. Yeah. I mean even, exactly. Even if they all fail. And in some ways, I think actually it'll be fine if every single one of their projects fail at the meta level.

Just saying we are going to actually try some moonshots and things is, I think, I think good. And I also do think they've taken Economics 101 and they are funding things that private markets basically can't fund as in private capital. They still won't be that. So I think if every single one of those fails are that, and also I know people complain, but actually in the grand scheme of things, it isn't actually even that much money.

Alex: Marginal.

Ben: Yeah. People really struggle with hundreds of millions and billions. It, you know, we're fine in the thousands of pounds and even tens of thousands and whatever, but once we get into the millions and billions people just, that's one thing that investors and markets do have a sense for, because we have to wrap our heads around billions and now actually trillions.

But it's a completely different scale of things.

Alex: Yeah. I am also an ARIA fanboy but I, you know, I will say the vibes are immaculate and one should be careful as to whether that is, how much of that is motivating your enthusiasm.

Ben: Yes. That's true. But I also think, so this is, some, so, you know, I've had a podcast with Alec Stapp and we talked about startup things, and I've also had a podcast with Stian Westlake who's talked about funding and how you make decisions and actually Michael Nielsen on metascience and how to make decisions.

So putting all of that together, one of my things is that people claim they do high risk things and then they go, oh, look, two thirds of these projects worked out. Actually, that must mean that your first statement was wrong. Because if you have even moderately high risk, then you cannot be more than a one out of 10 success, which you can see in biopharma and you can also see in VC.

So I do think that most of those projects should actually fail, or at least only advance a little bit. So I think maybe we will only have vibes to go on, but at least as we said, the vibes are good.

Alex: And it's so weird when you get to politics. Because if you're like a political operator, nothing is guaranteed, right?

You have to hedge, hedge, hedge, hedge hedge. You try like a bunch of things. You put in all this effort and it fails and you put on. So in some sense, like people working in bureaucracies, people working in politics, are operating in this high risk environment where lots of things fail and only few things succeed.

But they seem to have internalised it in the wrong direction. I haven't thought enough about what's going on there. But you would think that. That it would maybe go in the opposite direction.

Ben: Yeah. I think in my mind there's a mismatch on the timing of when you get feedback. So Mm-hmm.

The thing about at least shorter term R&D projects, or even within biopharma, which I know quite well, and this is your whole point about what is verifiable or not, your trial fails after a year. So you get quite good feedback quite quickly in the political cycle. Not only would you maybe not know within your political cycle, but your KPI might not be that clear.

So you start something you vaguely think you want GDP to go up. I'm going to slightly make it up, but you have no idea really what your intermediate KPI was pointing in that direction. In any case, we've been talking for a while like people who spend far too much time thinking about AI and policy. Maybe my pivot question should be to the person in the street who probably maybe doesn't even particularly care too much about AI or policy or any of this stuff. What should maybe be one thing or something that they should be thinking about here?

Alex: Interesting. Because the person on the street now comes up to me and asks me about AI safety and I went, I was in my dad's office the other day and they're like, 'Is AI going to kill us?'

And I went to a wedding and two people asked me, is AI going to kill us? So that's the wrong question.

Ben: And what data? The wrong water and data centres is also the wrong question. So what are the and that's what, and that's what obviously the mainstream media or even not even the mainstream media, media is all around that.

So yeah, we get a chance to communicate maybe one or two things that they could be thinking. And I also, I would quite like it to be not, oh my god, they're going to take on jobs as well, which I don't think is helpful. I'm not quite sure why they focus so much on that. You might not have anything, but if you do, what, should the person in the street maybe be thinking?

If it isn't worrying about data centres, isn't AI's going to kill us or take our jobs?

Alex: I think it's bottlenecks and sort of reiterating this thing of if something is automated, it just moves to the bottleneck. Please think in terms of bottlenecks and start thinking about where the bottleneck is, and it's sad that you have to do this. Because the government shouldn't have to be thinking about where the bottleneck is because that means the system's broken normally. Like the market does that. But, I digress. So bottlenecks are probably one comparative advantage. And this notion that even if AI is much better at you than something like at everything, if it's much, much better than you at something else, it will only do those other things, right?

And so, comparative advantage of countries and different countries should do different things. And then finally like we are not measuring enough, like nearly enough. Like everyone, everyone who's talking to you about AI's going to do this, AI's going to do that. Like we have no numbers.

We don't know, like we don't know how many jobs, all vibes, like taking away all vibes. It would be great if we had some numbers. But we don't have any numbers on the safety front, numbers on like the employment front numbers on like even the capability front. I don't know if you saw how Epoch AI did a benchmark.

They basically evaluated, meta, evaluated a bunch of benchmarks. And more than 50% of the top benchmarks are dubious and 20 to 50% of them have false positives and false negatives. The answers flipped the wrong wave round. Like there's data contamination so we're operating with a bunch of bunk numbers or could be better numbers.

Ben: Yeah, what's the aphorism? You only manage what you measure but if you're not measuring it right. But we've got this whole thing because the UK has just come out with new data from our statistical agency and it turns out productivity wasn't quite as bad as we thought for all sorts of reasons. And they don't even really know what's happening in the job market.

So there's definitely something on the measurement front and I like the comparative advantage, which I guess is Economics 101, but with this split between the tacit knowledge bit or the non-verifiable bit, which humans are still going to be somewhat good at to maybe very good at. And there's definitely going to be a comparative advantage versus AI and other people.

Great. Well I'm going to pivot to maybe some more personal thoughts or personal creativity thoughts before then going to a more quick fire round and rounding up. So you were also Cheese Lord, captain of Warwick's Overwatch team. So, yes. Why Overwatch? Why not Valorant? And what do you learn from being in competitive video games and being a captain?

Is there anything we could learn apart from the fact that it seems to be fun or maybe stressful?

Alex: Fun and stressful and very rewarding. Valorant hadn't come out, up until that point, but I really don't like Valorant. I really dislike games that require you to stand still while you have to shoot.

It's just a very, there's something about me that's no, why am I standing still? I want to be jiggling left and right. What's the, where's the fun in that? I quite enjoy games with movement. And so that's why I guess Overwatch drew me and I had to be, it was again one of those things where a friend would be you have to play this game.

You would love it. You have to play this game.  I ignored them for so long. They eventually bought me the game just so I'd play it and I was oh, I love this game. On like the esports side ka there's like this whole like video games and being good at like competition teaches you a lot about starting in a domain, being really shit at a domain. Starting off and being like bronze or silver or gold and slowly you'll kind of like platinum and then diamond and masters and Grandmasters and maybe you'll now like top 500, you say I am one of the top 500 people in my country, in my region. And you have this very clear reward signal and that I think you can generalise out from that and be ah, I can like get better at things.

There's also a lot around it like team competition and being able to. So I think what's really nice about university esports is the fact that you play with what hand you're given, right? You have a bunch of students that show up. You have to find the best that you can get, and then you get like a freaking Roadhog one-trick, and you get a Symmetra one-trick, and you're like, 'What the fuck am I going to do with this?' And you make it work. And I think that we were very successful. We went back to back years. And what made us successful was playing to these strengths and being a really weird team that was very okay with the fact that we are not playing perfectly. We wouldn't be world champions, but we can be good enough to beat every other student team by leaning into these weird niches.

And I think that in games and in life, if I'm, if I dare to philosophise, briefly, like the people haven't explored the space of ideas nearly enough and haven't sort of tapped into the market's not efficient. They haven't tapped into like all the alpha and how far you can take an idea and how far you can stretch and optimise something. So have you just tried winning?

Ben: Yeah. It's amazing that I'm going to loop together so many of our thoughts with that because leaning into your team is essentially leaning into your comparative advantage. If you've got some oddball technique, which I, that's they're the best at two things.

They can't do anything else, but you're going to have to lean into that. So that's really interesting. And I only discovered a few years ago that Elon Musk, for instance, still plays a load of video games. I was seeing him play the recent Diablo game, which isn't even that complicated game. And then I don't, there was something else, which I thought was really fascinating.

And I do think generally I've, I've got a bit old, so in my youth, the first-person shooter was Doom came on. It was like the first thing within that and it seemed so incredible, but it's gone down a little bit. But parents still, I think, fear too much about children in gaming because they are learning an amazing amount of things, particularly if they're just something on like Minecraft that they're doing all of this stuff.

Yeah. We haven't pushed the frontier of this. So, I was listening to a philosopher who was making some very, leaps of faith arguments around what can speedrunning games teach you. Mm-hmm. Because you're losing all of these. I never, I'm, you are obviously we would know, but people who speed run these Mario games or these quite complicated games where.

A standard person would take a standard, really good gamer should take days to play through these like hundreds of hours and they cut it down to four hours using these like crazy methods of which we're definitely not on the frontier of what all of that. So I think that's all really fascinating.

So, I mean, maybe putting it together, what, any games that you would, you, like playing now or you would say, oh, if you, if you've never really thought about video games, this is, something that maybe you should, you should trial. And maybe while you're thinking about that, because I think games is another aspect where we don't have to be that worried about AI.

I mean, AI [is] kind of solved chess and go, or in the sense that they are now much better at chess and go than the very best human. And chess is at an all time high in terms of people playing. I mean, people didn't play that much go, but I'm sure AI is much better. I mean, obviously it can control other, other things.

If you had an AI bot it would be better at the shooting game. So that's not why we're going to play shooting games. But anyway, any games on your mind at the moment or anything we can learn.

Alex: A few different directions. It feels more like a puzzle person. Like another thing I put in a variant of Sudokus in my free time because I don't do enough maths-y logic-style stuff.

So I just like to sit and I play my Sudokus. They're very satisfying. There's this YouTube channel called Cracking the Cryptic. They blew up in the pandemic. There's a game called Blue Prince, which is like a puzzle game, if you like puzzles at all. It's an, it's a phenomenal game. I'd recommend it.

I think as I've got less time,  older and I can't, I don't have time to be good at muscle memory or grind away. I'll play more strategy games on my phone or whatever. My vice is Clash Royale, but I would not recommend that there's a game called Super Auto Pets, which is an auto battler.

It's a bit like chess. I still think Overwatch is fun as like a competitive game. I think that there are games like Civ VII or like Age of Empires. I can't play those games anymore because, you know, I stopped playing them and I recently picked up Civ again. I played it for a day. I was oh, I'd love this game.

Why haven't I played this? And then after like 14 hours of sitting in my chair, I realised why I don't play that game anymore.

Ben: Yeah, more addictive than anything else. That's a bit dangerous. Yeah. I, in general, there's I think there's a lot you can explore whether you wanna explore like the pure one-v-one nature of there is no outside force that I can blame for this.

Alex: This is either my skill difference or your skill difference. Versus like the team based games where it is like, you enter with a suboptimal hand and it's, 'How do you play this suboptimal hand?' And lean into the comparative advantages, like you were saying.

Ben: Yeah. That's all great.

So maybe thinking about your own personal creativity. So you wrote this 2031 with a team of, maybe it's about eight of you. I can't quite remember the count eight in total.

Alex: Yeah.

Ben: So, and

Alex: Many reviewers and many people behind the scenes supporting.

Ben: So do you write, so there's no correct answer to this at all, but are you a morning writer, an evening writer?

Do you write in bursts, do you think in the shower or in a coffee shop? Or do you think best through a conversation? Do you feel like you have to write it all down? Do you write long hand? Do you write straight onto the computer? Do you even voice type? How? Yeah, I'm thinking about what makes you productive or creative and, how you think about your own processes.

Alex: So I definitely enjoy a long ramble to Claude or like put Wispr Flow up. It's like working in an office. I'm able to do this less. It's quite annoying. But I usually like being able to ramble about a difficult topic for like 15 minutes to Claude and then have it chug away and process that and think through.

I've made big progress on difficult problems before doing that. So big fan of that. I'm someone and that's

Ben: Because Claude is prepared to listen to you more than a natural person or can also digest what you actually said in a more legible form back to you, which probably an ordinary human can't.

Alex: Many things. One, you're just able to provide so much more, and richer context.

Ben: Yeah.

Alex: Like the amount of context you can provide 15 minutes spoken to Claude is and it's like

Ben: Days.

Alex: Yeah. An hour. Yeah. An hour of typing at least. And you wouldn't spend an hour typing your prompt.

Maybe it would. So first context is just like so much better second, yeah. Through the process of talking. You know, you talking is a version of thinking. It's like prompting is a version of thinking. So it's more like a rubber ducky or a thought partner. And you're able to iterate on the thoughts.

While I'll sometimes talk through a problem or and, through the process of talking through it, I'll end up with a skeleton in my head. But the process of writing itself I was actually on a writing retreat recently in Barcelona. I sort of have close fresh experience.

It's laborious and painful for me. It's excruciating. Maybe it's because I get distracted all the time, but like,

Ben: And it's not just being in Basel. Too boring. Yeah. I'm just joking. Sorry. Basel, Swiss people.

Alex: No, that's really funny. I was in Barcelona, not Basel.

Ben: Oh, okay. All right. Oh, that Barcelona, you can't, you can't blame for being unfun except that the vibes I get is that they don't want any more tourists coming in, so, yeah.

Alex: Yes.

Ben: So definitely. Sorry Basel and sorry Barcelona. But anyway,

Alex: Beautiful architecture as well. But, there is, it is useful, like the pain is useful, both in terms of informing: is this actually a tweet, not a blog post. But also in terms of why is it painful? Like what is the idea that I'm trying to articulate that's like struggling to be, born.

And. I think I'm, the one thing stuck with me was there's like this curve of like enthusiasm about an idea. And you got to start writing about it at a very specific point on the curve. Because if you start too late, you're going to be fall off the curve. But if you start too early, like you haven't had the process.

So being able, like if you have the flexibility to clear time, you're like, 'At this point in the curve, I'm going to write about it now.'. Otherwise you ends up in like draft jail. Yeah, but the writing retreat was great. I showed up to it thinking I was going to write about Europe and AI and ended up writing about my feelings.

So yeah.

Ben: That's great. I like your sense of that curve. It's a little bit similar when I do playwriting in some respect, which is if you show it or try and edit it too early, you definitely kill it. But also if it's too late, sometimes it's bored, like you said. Well we might touch on the end about feelings about what we might think an ordinary Tuesday might look like or what the future might hold. But we'll do maybe a little section of overrated, underrated, and then finish with a Mm-hmm. Couple of questions. So, you can go overrated, underrated, you can even go correctly rated. You can give a little thought on it. You also don't have to. We can, we can pass. So we're going to go overrated, underrated recursive self-improvement,

Alex: Overrated.

Still might happen, but everyone is way too confident. I don't know how they know. You're not in the lab, you don't see what's happening. You don't know what the bottlenecks are. Have good epistemics.

Ben: Yeah, that seems fair. I think a little bit of it's happening, but way, no, over, like I would not put it over 50% at all.

Like probably 5% or, something like that. Great. Universal basic income. UBI overrated or underrated?

Alex: Overrated. I used to be in the Yang Gang. But I think the political economy of it breaks. You know, a new politician comes in and says, I will raise it. I will raise it. I would be happy if we could magically fix it at the optimal threshold.

I mean, I don't think you can do that.

Ben: Yeah. Not protect from politicians. Also the latest small trials haven't been quite as good as we thought they were. So disappointing, but, okay. Overrated. So, AGI, although I guess we don't even know what it is, but say artificial general intelligence or I guess we could do ASI artificial super intelligence.

Either one of those, some something like that. Overrated or underrated?

Or no

Alex: Rating. I have conflicted views. Overrated in the sense that I think that there are some wrong—overrated in the way that most people talk about it. Like constrained to the set of people who talk about AGI and ASI overrated because too confident about certain ideas, too confident about like the nature of intelligence and whatnot.

Underrated in the sense that not enough people are talking about this and everyone, everyone should be talking about this if this is even remotely possible.

Ben: Yes. I think that's fair. I have the same view on expected value. The people who think about expected value think about it way too much and apply it to too many areas of their life, but an ordinary person doesn't think about it at all, and so they need to think about it a little bit more so it becomes both overrated and underrated.

Okay. The idea of taxing compute or taxing tokens underrated or overrated?

Alex: Super overrated. I think it's a terrible idea. I think we should just tax consumption and tax land in Alex's utopia we tax both these things we're fine. Maybe, we're fine ongoing debate, but I think the burden is on the tax compute people to really rebut why we can't do those other two taxes first.

And why their taxes are better than those.

Ben: Sure. Consumption taxes. Pigouvian taxes. Very classical Economics 101, right. They still argue for that. Hasn't been put in. Great. Open source AI. I guess this could also be open-weight, open tokens, but open source AI overrated, underrated.

Alex: I think that the people who boost them are overrating them. I think the reason they're doing that is because they haven't realised just how much they are at the whim of the direction of technology. Like the people who want open source to be prolific the most for that world to exist, we have to develop a bunch of technologies that improve resilience, that improve safety, that make this open stuff deployable.

And these people are the ones who are least caring about this stuff. Guys, come on.

Ben: Yeah, that's fair enough. Prediction markets overrated, underrated. I mean, I guess you can, normal markets are forms of prediction markets, but I guess overall prediction markets.

Alex: Does sports betting count?

Ben: Yes.

You could put sports betting in that. So you could do a sub, but I, this is more, I guess, political and other betting Manifold or Kalshi and things like that.

Alex: Yeah. Without the sports betting underrated. With the sports betting overrated.

Ben: Yeah. We don't need more sports betting. We have all of that.

Great. Final couple, I guess, effective altruism has a probably slightly bad rap at this very moment in time, which is where September 2026. But generally, do you think overrated or under—

Alex: Overrated. Definitely within the European continent. Like the version of EA, the sort of continental EA, which is, a specific shape of EA that I, that I think we need to move past and, build something else to replace it.

Ben: Yeah. Overrated. Great. And then last one, science fiction. I guess you could do science fiction as policy, but science fiction. Overrated or underrated?

Alex: Saying underrated because I've been, I've been reading some Harry Potter fan fiction recently and I've been enjoying them.

Ben: Yeah, it's got to be underrated, right?

Anything which makes us think more broadly. Although I do think we do need to shift as I was, we talked earlier about to the Jedi light side rather than any more dystopia. But I guess, we'll have, we have something, we've got to have our villains as well as our heroes. Great. So, we spend a lot of time imagining a future Europe, particularly a future Europe, that we should avoid.

What's the future that Alex actually wants?

Alex: Vending machine on every street corner. No, I think the future I want is one where young people can like look into their own future and be ah, this is a future that I'm excited about. This is a future that I want to live in. And for that to happen, we got to radically restructure the way that society and the social contract has been like playing out.

We've got to get a bunch of things right on technology, because this is like the most important thing that is important for young people's futures, but also government in the way that government has like stacked the book against them. And so I think about the future, like within the frame of what would an a, would an 18-year-old Alex be happy to live in like 20 years from now or 30 years from now?

And currently, no. Because I don't think 18-year-old Alex would be happy to live in like right now. And we keep going in the wrong direction then, but we're going to fix it and we're going to we can fix it and I believe we have to fix it. Sorry for vague bursting.

Ben: Yeah,

no, I'm optimistic on that as well.

Well, maybe I'll push them one. Maybe you could think about a detail. So we assume we have fixed it into, I don't know, 2050, or you can go even further if you want 2100 sometime in the future. And we can forget GDP and compute and geopolitical power. We've somehow solved that at least. To Europe's somewhat satisfaction, we've, we've got to somewhere.

What does an ordinary Tuesday in that future look like? What are two or three things that ordinary Alex, 18— So this is a really interesting dilemma because it's your future self, but you're back at 18 years old. So what does, what does that look like?

Alex: I think it doesn't look too much different from today in the sense that that Alex wants to wake up, wants to go to the bakery, wants to walk to the park, wants to see his friends there, and bump into his friends on the way to the park and the bakery and then they go to the park and they eat their croissants or whatever. And in this future Alex has received a magic like engineering shot that makes him able to consume lactose and he is able to enjoy his croissant in the park. And he feels safe. And then maybe like he's then able to hop on a really fast train and pop over to London for the day and visit all his friends there. And it's really cheap. And he's able to have that lifestyle and I think that lifestyle is just like ludicrously out of reach and then live close to where you want to work. And I think that life and your friend, that lifestyle is likely out of reach today that feels like fantasy.

Ben: Yeah, good health.

Good health. Being with your friends. I guess just on that one you mentioned in that, do you still have a meaningful job in this? Was it just a choice that people will want to have to pursue to what sort of meaningful job for them and therefore they have the opportunity space that if they want that they can pursue it?

I guess I speak to a lot of young people who feel that is diminishing. So that, you know, that is of now, there's only a small segment which have the right opportunity space to kind of do the meaningful work they do, which is kind of interestingly why medics are still quite popular and also teachers and some others.

I guess the small niche of policy, also people going into it and, things like that. But I think this is one of the bits that some of the UBI enthusiasts have also got wrong is that they don't understand that people actually jobs have always been meaningful for humans. And it might not be this artistic creative job where you sit around and paint all day or even make video games, which will be a portion of it, but it's actually something else connected with human flourishing.

But I'd be interested if you think you've still got this meaningful job and actually what your 2050 meaningful job for 18-year-old Alex would be, assume you've solved policy, although I guess policy will never be solved. Maybe you're still in policy, but you'll, you have to do something else.

Alex: Yeah, I have two, two senses of like what 18-year-old Alex wants.

It's like part of me wants to have agency over my own future and over like the collective future of society and humanity and be able to meaningfully improve and contribute to that future and make it marginally better. I don't know, send me up, on the space elevator. I want to go supervise asteroid mining Belt 12.

Another part of me really just wants to create whimsy and joy for other people and see smiles in their faces and just have lots of bits. And lots of like stupid jokes. And pull a bunch of pranks on people all day. And that also sounds quite nice. I would be miserable without either of those.

Ben: They sound like two great things to have. Great. Last couple of questions then. Anything you are working on now, current projects or future projects that you'd like people to know about?

Alex: Yeah. I don't know like when this will be ready, but I can tease it. I talked about how we, don't have ideas.

Our ideas suck. So we want to fix this. So we're, we're doing an essay competition or writing competition or something of that sort. Basically okay, you read Europe 2031 or something else. You care about this problem now you want Europe to be prepared for transformative AI, whether it's for its resilience or it's flourishing or its agency what you're going to do about it. What should we do about it? Write a letter to someone who has have like an audience or recipient and outline your idea of how we should get out of this mess. I don't know when that will go live. Probably not for a while, but you can already start thinking about your solutions.

Ben: That sounds like a good idea.

I do think you need to get a celebrity to front it. So I've seen a couple of writing ideas, this year. In fact, there's one which has Neal Stephenson and Gwern on GPU. 

Alex: So there's, you've got to write a story It has to be AI-generated.

Ben: Yeah. Or no. I think

Alex: The Gwern one has to be an AI-generated piece of literature, I think.

Ben: Does it have to be AI? I thought you just had to disclose it. 

Alex: I think it, I think it has to be fully AI-generated. [Ed: No, only disclosed]

Ben: Interesting. But regardless, so that had some publicity. So when you do send it out, that would be my, but I think it is quite interesting. I do think we need to incentivise the storytellers to be involved.

For sure. And so then the last question is, do you have, I guess we have given quite a lot of advice out for listeners, both the ordinary person or the person being involved in policy and you have a big call to just get involved and do more thinking on that. But any other advice that you wanna leave for listeners? It could be, what character they should choose in Overwatch or more general life or career advice or any final thoughts that you want to leave

Alex: Arq Foundation/careers we're hiring.

Ben: That's a good one.

Alex: We also have referral bonuses. So if you find someone we should hire, we'll pay, we'll give you a thousand euros.

Maybe it'll be more my generic career advice. Write, please have a Substack. Even if there are only three posts on it, I want to see the way you think. I think the agents would also appreciate seeing the way you think. I think people need to be founding new things. And you don't necessarily have to have a good idea. There are [fuders / organisations] that can bring you money. So, don't let that shy you away from founding something cool and impactful.

Ben: That's great. So do build, write in public, check out Arq Foundation. Apply if that's a good job or make your friends apply even better, and get a bounty.

And with that, Alex, thank you very much.

Alex: Thank you.



In Arts, Podcast, Science, Politics Tags Alex Petropoulos, Ben Yeoh Chats, Europe 2031, Artificial Intelligence, AI Policy, AI Governance, AI Safety, European Technology, Future of Europe, Technological Sovereignty, Industrial Policy, AI and Science, Scientific Progress, Institutional Reform, AI and Society, Human Flourishing

Deena Mousa: How Much is a Life Worth? Effective Philanthropy, AI for Good & Global Health ~ Podcast

January 2, 2026 Ben Yeoh

How do you put a price tag on a human life? It sounds like a cold question, but for grant makers, it is the necessary calculus of doing good.

"Every time you choose whether to take a more dangerous job at a higher wage... or choose a house that's closer to environmental toxins but is a little cheaper, you are implicitly putting a price on how much you value a year of your life."

In this episode, Ben sits down with Deena Mousa, a grant maker and thinker at Open Philanthropy and Coefficient Giving. Deena takes us inside the difficult decision-making frameworks used to allocate finite resources—from the "Coefficient Dollar" to the complexities of measuring pain.

"In high-income countries, the question is 'Will AI replace radiologists?' But in a lot of low-resource settings, the question is not whether AI will replace the radiologist, but whether you can access a radiologist at all."

We also dive into the role of AI, why government procurement might be the world's most underrated problem, and, on a lighter note, Deena’s specific writing habit regarding white noise.

We cover:

  • The Calculus of Altruism: How philanthropists use "revealed preference" to value a year of life.

  • The Pain Paradox: Why standard health models struggle to account for chronic pain and suffering.

  • AI for Good: Why the risks of "AI washing" in nonprofits are real, but the potential for capacity building is massive.

  • Systemic Bottlenecks: Why fixing boring government procurement processes might be more impactful than flashy new policies.

  • Life Advice: Why you should probably ignore the advice that resonates with you most.

"Often, the people listening to a piece of general advice are exactly the group of people that should be doing the opposite. They are already leaning too far in that direction."

Summary contents, transcript and podcast links below. Listen on Apple, Spotify or wherever you listen to pods. Video above or on Youtube.

Contents

  • 00:00 Introduction

  • 01:17 Valuing Life and Health

  • 05:46 Challenges in Measuring Pain and Health Outcomes

  • 13:32 Creative Process and Research Methodology

  • 18:38 Journey and Early Experiences

  • 22:23 Debate on International Aid and USAID

  • 29:20 Impact of AI in Global Health and Development

  • 36:25 Overrated or Underrated

  • 44:59 Exciting Projects and AI for Good

  • 46:14 Balancing Cause Areas and Funding Decisions

  • 58:31 Advice for Aspiring Philanthropists and Innovators

Transcript (This is AI assisted, so mistakes are possible)


Ben: Hey everyone. I'm super excited to be speaking to Deena Mousa. Deena is a grant maker and thinker on global health and development, as well as thinking on innovation and progress. Deena, welcome. 

Deena: Thanks so much, Ben. It's great to be here. 

Ben: Your work at Open Philanthropy and Coefficient Giving and really in Global Health overall requires making decisions about where to direct finite resources.

So at the heart of that, you have to grapple with the question of how do you value life and health? What is the value of life? How do you think about that and even begin to approach that question? 

Deena: Yeah, it's a really great question and it's a hard one to answer in large part because it is so personal and there are so many different ways of approaching it.

There are. Fortunately, some studies and research that we can ground some understanding in. So there are two broad literature on this. One is on stated preference, which is where you ask a group of people or survey participants in a lot of different ways how much they value in monetary terms a year of health.

and this can be by asking them, for example, how much they would pay for a particular drug or treatment, how much they would pay to avert a particular outcome, how much they value particular aspects of their health. And these kind of converge on. one form of the answer, which is, what do people say when you ask them how much they value health?

Then there's another literature that is focused on revealed preferences, which is what we actually do and how much we actually pay when we have to make the choice. So every time that you choose whether to walk home or get in a car, every time you choose whether to take a more dangerous job at a higher wage premium or choose a house that's closer to some environmental toxins but is a little bit cheaper, you are implicitly putting a price on how much you value a year of your life.

And so there are quite a few papers that take a lot of these decisions and try to back out of them, how much people, implicitly care about their life in monetary terms based on the actions they take. And this sort of leads to another cluster of answers. and by looking at a combination of these two research studies, you can get to a triangulation of what is approximately right.

This is of course a very hard question because when people make decisions, they're not necessarily explicitly factoring in all of these effects, and they might not necessarily be accurately diagnosing them. And similarly, in the stated preference, it's quite hard to know exactly what decision you would make when it comes down to it.

So there is quite a bit of uncertainty around that, but that gets you at least to some estimate of how people feel and react in real life. 

Ben: And so in the US when you are thinking about this, either thinking about grant making or in your research, do you have a range in your head that you're thinking about?

I'm aware that it'll probably be different in us, say to Italy, say Nigeria. but do you have a range on what, let's call it a statistical life, year of life or a life year to differentiate it from some other thinking? What do you say? 

Deena: Yeah, absolutely. So one, upfront clarification is that different institutions have different numbers for this and in large part because they're doing different things.

So the value of a statistical life, quote unquote, that is used for example, in the United States when deciding on, health insurance or, healthcare issues is different from the one that you might use in a different country. But that in turn is a pretty different question from the one that we are answering, which is how to allocate our finite resources across interventions that mostly target health and ones that mostly target income.

So we, when we calculate, the value of a particular grant. We have a metric we call Open Philanthropy dollars or coefficient giving dollars now. And that is used to equalize health and income gains. so that allows us to basically compare across health and income increases to figure out how much you should value one versus the other. Though of course the metric of coefficient giving dollars isn't necessarily comparable outside of the institution. It's, not like a, objective dollar metric, if that makes sense.

Ben: Sure, yeah. You can't compare it to what the US government is saying about anything to do with dollars. But even within that, do you think your order of magnitude is about right when you're using this a hundred thousand and, spreading it, they say, that's within plus or minus 20%, That's the sense I have.

Or do you think there's a risk that you are completely wrong on that? And maybe we can think about that because you had a really, interesting essay on thinking about pain and I think pain's a really interesting thing to think about because on the one hand you could think for minor pits of pain we use say aspirins and things and they're really cheap and we don't seem to value it very much.

And another aspect actually, if you ask doctors and you think, oh, this person's in pain, we've got cheap medications, or they're out, it often doesn't. Get into their calculus that much because we think, pain or maybe acute pain is this is not life-threatening at the moment. You'll get round it.

On the other hand, if you speak to some people, it could be, really valuable to try and avoid or chronic pain is, different and it comes in enough and it's also more nebulous because there's some part of it which is psychologically based, some part which is maybe biologically based and they interact.

So I was interested in, whether you've got your reflections on how you've been thinking about pain and, whether this is the type of metric which could be used at all with this, or whether we should really be thinking about something else. 

Deena: Yeah, absolutely. It's, a really good question because I think pain is an area where DALYs get a lot harder.

In large part because it is quite possible, if not likely, that a DALY is not a DALY in all circumstances. You might care significantly more about alleviating a marginal quote unquote DALY's worth of pain. The more acute pain that you are in. For example, and there was one study, that I referenced in Japan that implied that this might be the case.

That the more serious the injury or illness, proposed to individuals, the more that they were willing to pay to avert the same amount of additional pain. And so we don't necessarily think of pain or negative health outcomes as linear. but we might have all sorts of different curves for how much we value amounts of health at different points in our life and at different, levels of discomfort.

so I think this is, an area where yeah, certainly the model and here is six we are using might be a little bit blunt. With that said, it is, like you said, it's such a hard question to answer because a lot of people might have quite divergent beliefs and feelings about what that, what the shape of the curve is for them individually and It would be quite prohibitively hard, I think, to apply that sort of differentiated DLI metric, especially depending on the disease. And looking at how it affects different people in to different orders of magnitude and so on. 

Ben: So does that mean we just have to be really cautious with these type of models and thinking when we come across something like pain or is it a kind of this is the best we have, so even if we're a little bit unsure, it's gonna give us some sort of answer?

Deena: Yeah, I definitely think it's, a good reason to be cautious and a good reason why. The quantitative answer is not necessarily the be all, end all, it's a good heuristic. It's a good guide to break down a problem. But for example, with with chronic pain or with, areas where the DALY figure that is given appears to be a little bit questionable or potentially a little bit too high or low one thing we often do is compare it to the DALY burden we've used for other diseases and just think conceptually about whether this is reasonable.

So for example, we might say, the DALY burden associated with cluster headaches is x. Now let's compare it to the DALY burden that we've used previously for o other quite, painful diseases, for example, is it significantly higher or lower? and this can help us triangulate a little bit, what are we really saying when we're using this multiplier for this disease?

Ben: Sure. And when you were looking into pain and, doing your research on that, was there anything which surprised you around that? Or do you think is actually, this is really misunderstood, we should really clarify this more. 

Deena: I was very surprised by the degree to which we don't really fully understand pain.

We think of pain as a direct response to the magnitude of an injury we receive. you stub your toe, you feel some amount of corresponding pain, but that's not necessarily always the case. The amount of pain we feel can be very disproportionate, either higher or lower to the actual damage that our body has felt.

And so it is like a much more complicated and psychosocial, fa thing and phenomenon that we experience as well, which I think I underrated to some degree. And for example, also our understanding of like chronic pain and how chronic pain comes about, is quite limited. Our understanding of, phantom limb pain and why it only impacts some people and not others is, similarly a bits body.

So I think I, I underestimated the degree to which there are a lot of open questions around the biological components of pain and how pain literally works. 

Ben: Yeah. Particularly in chronic pain. I think the scientists call it heterogeneous. We really don't know some of the causal aspects. So you might present with these same type of symptoms, but the underlying can be completely different.

And we might not even have that big of a clue. And it's interesting maybe making a segue into something where we might think we have clearer numbers around, maybe thinking about the UK or any system which has got a constrained budget. How would you deal with funding for extra money, for instance, for a diabetic versus perhaps a preterm baby or maybe say a rare genetic disease at birth or something like that.

So the overall disability life years, the dalis come out at maybe 20, 30,000 pounds, maybe a little bit more in dollars for the diabetic. So you go, oh that's really good in terms of, life, but the preterm baby is coming into hundreds of thousands of dollars. Same with genetics.

So we could be talking half a million up, up to a million, million or more. And that under kind of pure thinking, just cost benefit or say this. First or the utilitarian kind of goes, it's the diabetic all the time. But then when you ask people, and here in the UK we try and ask people, although we argue about whether this is it, people end up saying no, we think the baby should be worth a chance.

Or, particularly with the genetic and then there's arguments around that. How do you think we should think about that? And do you actually fall on one side of the fence around, how we should make that decision? 

Deena: Yeah, it's a really, it's a really hard question and an important one. I definitely won't presume to be able to give a particular answer or say, necessarily what the government should do in a circumstance like this.

It's an impossible one. But I will say that, the, allocation methods that I'm talking about are. Something that's like quite useful for us in our context as a philanthropic funder who are, have a particular pool of money. We are allocating it across cause areas we are explicitly going into it being cause agnostic and impact maximizing.

So we know that is our approach and aim going in. Whereas a government is in a very different position to an individual donor or a philanthropic funder. And they ultimately are tied to a social contract with their citizen. They're democratically elected, they're intended to serve the voice of their people.

And to a large degree, I think the sort of bare utilitarian calculus needs to also incorporate what people believe, how they feel what their opinions and perspectives are on how funding should be allocated and what the priorities of the government should be. 

Ben: Excellent.

Perhaps you could talk about your creative process or your research process. Say you're picking up a new topic like AI in health or you're doing some of this research within pain. How do you go about thinking about that? And also you've had a journalist background, so you've been interested in stories and the narrative around that.

So I'd be interested if you've got any particular creative process or anything you'd like to share around that. 

Deena: Yeah, absolutely. I picked up freelance journalism, in large part as a forcing mechanism. I thought it would be a really interesting way to. Create a structure for myself to get myself to explore the questions that came up day to day that seemed confusing or potentially interesting to me.

so it, I think has been quite good in that it has given me another lens such that when I read something that is, seems a little bit contradictory or seems a little bit unexplained or intention with something else that I know I have a mechanism by which I can say, okay, I, actually wanna get to the bottom of this.

and I'll go and interview several people and I'll, if it starts to look like an actual story, put together a pitch to an editor who will then, be able to act as like a little bit of a scaffold for me as I go off and explore the question and distill what I what I believe in writing.

And that has been quite helpful in large part because I, have this strong belief that, writing is thinking and, in order to. Be able to understand something very clearly. You just have to be able to write about it very clearly in a way that someone else will understand. and that process I think has allowed me to dive, shallowly into a lot of different areas that I find somewhat interesting.

And, so I'm, really glad that I've that I've been doing that over the past couple of years. I think it's been a really enriching process for me, in thinking about the world. Yeah, I've, oftentimes the topics that I'm looking at intersect somewhat with the topics that, I'm thinking about in a professional setting.

but it's a quite different lens on them than doing, research or making grants. And so I think it's quite complimentary in my experience. 

Ben: And do you like making notes as you go? Do you read and write? Do you write two three hour chunks in the morning? Are you an evening person? There seems to be 1,001 ways of doing it, but I'm interested in your actual process.

Do you write by hand or you, straight on computer, or is it just all completely random? 

Deena: I tend to type and I usually do all of my interviews first and get a good picture of what I think the story is in my head, and then tend to write the draft all at once. I usually like to leave it for about 24 hours and then come back to it fresh and do the editing then, because I often think that you're a bit too close to it when you've just written it for the first time.

So yeah, that tends to be my process and I like to reserve Saturday, Sunday mornings to, write for a few hours each week, which I think has been helpful for, forcing some cadence and consistency. But certainly everyone has their own sort of writing habits and patterns that I think they're so personalized and individual that, I'm not sure anyone's, writing habits would work necessarily perfectly for anyone else.

Ben: I think there's been a book looking at this. And if you look at people who, are thought to be really great, you can find, they work at every single different hour of the day with every single different habits. Although there's maybe at the meta level some quirky things about them, which seem to have a, pattern, although the actual individual quirk is hard to know.

Do you ever listen to music or things or is it like music or, no. And is there anything about your process you think is perhaps a little bit quirky? Like you don't write with a pet crocodile beside you or anything, or? Really, a lot of people seem to be, at least in humanities creators, a lot of them seem to be high on drugs or alcohol or whatever when they write.

But I'm assuming you are not, but, yeah. Anything quirky or do you think you're just normal? 

Deena: Unfortunately, nothing's so out there. I, I can't listen to music with lyrics while I write. otherwise I think the words will distract me quite a bit. But, I do often put on white noise particularly like the sound of rain, I think is helpful for, just being a little bit more focused and concentrated.

No, I can't think of anything particularly weird. I'm a bit, I'm a bit more of a night owl than most people. And so I think often my in spite of plans usually to finish something early in the morning, usually my, most productive writing comes quite late at night. so that maybe is, is slightly quirky though.

I think that's a bit common with writers. 

Ben:  I think not having lyrics is maybe somewhat common, but actually wanting brain music or white noise is perhaps a little bit more uncommon. So that's that's an interesting note. Maybe that's a good segue into your journey as to where, how you've got here.

Because if I read it correctly, you were a teenage medical inventor of some sort, or at least a kind of social entrepreneur back where you grew up and then you did a little bit of a consultancy gig and then have come into that. I dunno, what did you learn growing up being kind of social entrepreneur like, and, any thoughts of that in terms of how you went from there to here?

Deena: Yeah, I grew up, so I was born in the us and I grew up between upstate New York and Cairo. I spent my summers in Cairo. So usually about three months of each year, I would be there. And I grew up with, yeah, a family of much older siblings who I think, really shaped a lot of how I think about things.

And, I think just being constantly exposed to, adult conversations and like around the dinner table. I think to some degree, shaped my upbringing a little bit. I did work with my sister on a solar energy social enterprise in, in Egypt that distributed solar water panels that, heated water for households and also for organizations, around the country.

So I think that was a particularly valuable experience. given the fact that, like you mentioned, I worked at McKinsey as a consultant and now at Coefficient giving as a grant maker, getting some exposure to implementation and to operations was incredibly valuable because I think it gave me a taste of how.

Unintuitive difficult. It is, in many ways actually getting something done on the ground is quite hard and quite hard in ways that are almost impossible to predict at the outset. so in each particular circumstance, something will come up, but you don't know what it is until it happens.

And, yeah, often things take a lot longer than you project they will at the beginning. And I, so I think, that, that's been a really important perspective for me to have as I've, consulted people from mile High and also given grants to operators to be able to understand a little bit, of what they're going through.

Ben: I guess that will tilt you into thinking about impact if you've done social entrepreneur things as a teenager. Is there anything you've changed your mind about then over the years in thinking about it? you hint at one in the sense of actually implementing things always seems harder than the paper because unexpected things always come up, but, any grand ideas where you think, I used to think this, but now I think.

Really it's that. 

Deena: Yeah, it's a great question. I think that is certainly one of them that you mentioned, that, operations is much harder than it looks. and that strategy often, di dilutes the nuances of the details of actually getting something done. I think in consulting, for example, I went in half wondering whether this this common refrain that consultants are just risk management, might be true.

it seemed shocking just because of the sums that, fortune 500 organizations pay for consultants. But I actually think I, I came out of it more positive about the value of consulting, if that makes sense. I think one thing that surprised me is how. Integrated, a lot of our consulting teams were with the organizations where we worked and how almost over time essential we became.

And I think that the scope and scale of that across, industries, across organizations, big and small, across sectors, I think was quite surprising to me. So I guess I came out a little bit less cynical about consulting than I went in, which I I think might be the reverse of what, what happens to a lot of other people.

Ben: it's good because you actually did go into consulting. 'cause otherwise some people would've said, don't do consulting at all. Go straight to making actual impacts. So I'm glad you got something out of it at the high level, I'm interested in a couple of systems piece. So there's been a lot of debate on, for instance, US Aid or even just international aid in general.

And on the one hand you could say we lose usaid. There's definitely some projects which had high value impact. Those are not happening and there's that is negative versus having it right in that world. That counterfactuals definitely negative. I guess some people would though say that there are some projects which maybe not higher return, and we really wanna build on local infrastructure and local projects for people, because there's a whole set of examples when, foreigners go in, try and give money, with good aims and have essentially messed it up.

It's gone to the wrong people. They haven't understood these things, the unexpected has happened. And so that money has not only been wasted, has been wasted, but has been actively poor. And there's examples like that. I don't think there's a consensus answer with within that aggregation. But I'd be interesting from in your reflection this mean that actually it's more important the work that you guys do in terms of philanthropy, because there's a little bit less international aid philanthropy from the government level, or is just this whole idea of aid has perhaps been a little bit more down rated, so it's making your life harder.

I'd be just interested in any reflections on whether USAID was any good pros and cons and how it's affected your work. 

Deena: It's a very timely question. I think there is a very reasonable argument that usaid would have benefited from reform. there, there is a group of people that is or a sort of line of thinking that is, the bureaucratic nature of foreign aid in the US and in other large countries has overwhelmed, the institution and it needed a significant overhaul.

I think I sympathize with some aspects of that argument, and I think it is re reasonable to say that, even a pretty heavy handed, overhaul of USAID could have been good. There is a version of that could have been, very net positive. I think a version that, some have talked about since of, like massive slashes to foreign aid, that are indiscriminate or, just go across the board pretty heavy handedly are.

certainly not the version of, the overhaul that I think, would have been most effective. And I think that is something to note, which is like, there is a, there is a, good and a less good version of reforming usaid, if that makes sense. And I think in a, just the magnitude of funding that comes through foreign aid, in global health and development is staggering.

And losing a large proportion of that really would, significantly alter the field. regardless of the sort of spread of projects. And maybe you can say that the range of cost effectiveness that, happens within institutions, it is just so much funding that it, inevitably leaves a massive gap and a massive hole.

I do think that makes our work as philanthropic funders, more important and more sorely needed. And often opens up, more opportunities for us to do cost effective work. Though it is also of course much more difficult when a lot of USAID programs were supporting foundational infrastructure that then enabled us to build, for example, on top of them.

when that infrastructure goes, in some cases there isn't an actor who is well positioned to fill the gap. 

Ben: So net, net, although reform of usaid, a reasonable person could have argued for that. What we have now in practice is probably net negative because of the absolute levels of, funding cuts and this issue of some infrastructure with no credible stakeholder or actor being able to do that.

So those, not only those first order projects have gone, but a whole infrastructure layer has been, withdrawn, made, life difficult. Was that a fair summary of thinking around that? 

Deena: I think that sounds right. yeah, there is a version of USAID reform that, that could have been certainly net positive, but I think, a combination of magnitude of the cuts and the way in which the cuts were decided, if that makes sense.

In terms of how to prioritize projects and how many people opined on that and how long that process took, I think, resulted in, in less than optimal implementation. And therefore, I definitely do think it was net negative. 

Ben: Another systems piece. Perhaps this is wider in, in thinking around cost benefit type of analysis or at least simple utilitarian thought.

I still think with suffering in the ecosystem around some of the effects that F-D-F-X-F-D-X and SBF had on thinking about that partly because of funding and partly because they were so explicitly we now think naively utilitarian around their thinking. Do you think there's still an echo of that and do you think I, mean I guess this is on some of this, but I think it's wider philanthropy in general.

And we are probably a little bit younger and a little bit more apart from it maybe. Has it made your thinking around that systems piece change or been influenced at any way? 

Deena: it's a good question. much of the fallout of that happened before I joined coefficient giving, and I was very much looking at it from the outside in.

I think coming into my role, I am less of a sort of hard line utilitarian than maybe some say SBF or pure rationalist or pure effective altruist. And so I think I was already coming from, a little bit of an outside in view, and a bit of a sort of more, more sort of mixed perspective, if that makes sense.

I definitely do see it as having shaken up a lot of the effective altruist or rationalist community and a lot of the thinking around it, I think, a lot of people reflect it after that. Which I think is quite healthy sometimes. For sure. 

Ben: Yeah, I'm definitely an outsider looking in.

I think one of the things I reflected on was, what would they call it? Normy stuff. So I now really understand why you just have a regular independent board if you can do it well, because this is the things which gives you distance over some of the things. And when I see things which don't have that, which I mean there's no guarantee, right?

A lot of those things go wrong. But I now understand why those boring, normal measures are put in and maybe there's too much bureaucracy with some of those. But you can see now the counter examples where they failed because you just went on high trust with a couple of individuals with no oversight accountability.

So it was a, win for normal boring covenants. which is which is weird, which is an interesting meta layer. Meta layer thing. Maybe thinking about a meta layer thing. You've done some work on technology and particularly ai, which within say health or climate or a lot of global development is potentially an enabling layer.

Yes, AI in itself might settle certain projects, but maybe it's more importantly is going to enable a lot of other things. So I'm interested in what you think is actually happening within ai. I think global development and health, you wrote a really interesting essay on sort of radiologists, how it hasn't, for instance, there are still a lot of radiologists.

In fact, we don't have enough radiologists, even though. AI is doing that very well, and that's in a narrow thing, but it looks like it could be supporting quite a lot of a infrastructure layer and then into global development in general. has this altered your kind of thinking, and does this mean we should be in investing more in a metal layer, or at least in transforming that metal layer into something practical?

Or is it really the kind of, yes, this is a new technology, but our old models and our old ways of thinking? Just incorporate that and that will just be the same, but with different measurements. I don't know Your thoughts on ai. 

Deena: Yeah, it's a big question right now. maybe I'll start with some things that worry me and then some things that I'm excited about in the area.

So a few concerns I have upfront. One is this idea of using benchmarks to determine how much AI can do in the field or in practical terms. for example, looking at AI performance on a benchmark, or a test related to a particular job. And then to say this means that AI can replace.

87% of people who do this job, oftentimes the map is not the territory with benchmarks. And so there's quite a big difference between the questions on a benchmark and the true process of actually doing a job or doing a role. And usually it is quite hard to come to a like detailed and nuanced understanding of what it really means to do a job and how people spend their time in that role and what are the long tail outcomes that are, come up very infrequently, but are actually quite important to get right.

So I think that is one worry I have with ai. another, I have with AI in development in particular is incentivized AI washing. people are very excited about. Potentially implementing AI in a lot of new contexts and settings, which I think is, great. And I'll, also get to that in a moment.

But I worry about setting upfront too much this idea of we would really like to fund AI related projects. So we really like to invest in AI related projects. And then encouraging, nonprofits, organizations that are doing great work by default to feel pressured to incorporate AI where it doesn't necessarily make sense or it isn't necessarily adding much impact so that they can then say, yes, we are AI enabled, we, qualify for this particular program or this particular incubator.

I think there is always a danger with technology of, implicitly shoehorning it into processes where it is not quite the right fit, because it is the next really exciting thing. and I think, in part, in particular, we wanna be careful as funders in terms of how we are shaping the field in that way, and whether we are driving incentives in a negative direction in that sense.

But with all that said, I think this is quite, AI and development is quite nascent, and this is a really exciting moment for it. and I am quite excited by the potential for AI to increase capacity and throughput at, almost every level of development. I think often, human capital is a constraint for a lot of different fields from everything from, do you have enough doctors to do you have enough people to run the government properly?

And if AI can act as a multiplier on people's time, for example. Increasing diagnostic throughput for every doctor by making them a few seconds faster with each patient. Then I think it could have, significant positive effects in low and middle income countries in particular where, that is really the key blocker.

You mentioned, a piece I wrote about radiology, that was really focused on high income country settings, where the question was will ai, replace radiologists and therefore make, radiology interpretation much cheaper and much faster? But in a lot of, low resource settings, the question is not whether AI will replace the radiologist, but whether you can access a radiologist at all and whether AI might act as a sort of better than the default standard of care option for you.

So I do think the questions are quite different in low and middle income countries, and I'm very excited about, the potential for AI to increase capacity in lower resource settings. 

Ben: So that sounds like we should move quite fast and hope not to break anything as opposed to moving very fast and breaking lots of things.

Deena: that's a very good question. I think I mean I think that there is also obviously a reason for caution in particular because there, there is a sort of paradigm in which if you believe that AI as a technology will get significantly better in the next, let's say one to three years, implementing a, very imperfect solution Now could, this is an example, but could, lead to mistakes that therefore eliminate trust in AI that will then be very hard to win back. Even if in say, three years the models that you're working with are significantly more accurate or significantly better in a healthcare setting, for example.

So I think that is like one consideration, which is that, when you're introducing a new technology, you are setting the terms of people's impression of that technology. and in a lot of cases right now, AI is people's, most people's interaction with AI in some countries is simply as a tool that spams use to send them a lot of, scam text messages on WhatsApp and scam phone calls.

And I think it is important to consider like the. The relationship that you're creating between the technology and the people and to a, I think to some extent the more that you force technology in where people do not organically see a need for it, the more you can sort of risk creating this negative impression and those impressions can be sticky long after the technology itself has changed significantly.

so I think that's, maybe one reason for caution, particularly right now. 

Ben: Sure. I hadn't thought about that. It's very hard to recover from a bad first date is what you're saying. 

Deena: Exactly, yes. 

Ben: And I guess we also potentially move through some one-way doors, as in you do X and it's quite hard to row back from X, but maybe there might be some two-way doors.

I find it's really interesting that the technologists have a. There are different clusters of them, obviously, but they have a different view, from what a lot of the economists and sociologists think around this. And it's really interesting that they're so far apart. But yeah, when you don't have that consensus, it is a little bit tricky.

Maybe we should do a little short round on overrated and underrated. So I'm gonna give you like a little topic. you can pass or you can say neutral but you can say, yeah, I think this ideal concept is underrated or overrated, or we should have more of it, or less of it or something like that.

Yeah. Are you good? 

Deena: Yeah. Happy to do it. 

Ben: Yeah, let's do it. Okay. so the comedy one, malaria nets underrated or overrated. 

Deena: I would say in general, underrated, still, underrated 

Ben: even though we've been going on about them for so long. 

Deena: I think so. I think we are in a bit of a bubble in that, within the world that I'm in and that to some extent that you are in as well.

people take for granted this idea of malaria nets are the canonical, reliable, cost-effective intervention. But I think one that's not necessarily really like common knowledge beyond this sort of corner of the world. And two, there is still quite a lot of need for it. Like it is still, an intervention that can absorb more funding.

And I think, until we reach equilibrium with that, I guess by nature or almost mechanically, I would say underrated. Yeah. 

Ben: So hundreds of millions of dollars of capital could still flow to mal nets and we're nowhere near, reaching that. Okay. Interesting. Good. Climate net zero. Underrated overrated.

Deena: It's a good question because this is such a polarized one. you have almost, I guess in the US at least about half the country feels extremely negative about this and about half the country feels very positively about this. And I don't know, I would almost say as it nets out neutral yeah, I think when I think about each half, I would say, has been overrated maybe in the past 10 years, but in the last, like year or two, I think that has, like the pendulum has swung and it's pretty sharply corrected.

So maybe I'll say neutral on this one. Okay. 

Ben: What, so your, observation is that the US or the world is neutral in it, but are you yourself now neutral or, actually you were saying that maybe the pendulum has swung. Too far. although the world is maybe balanced that actually because of where the pendulum sung, it's a little bit underrated.

Deena: I think. I think, where the pendulum has swung recently, maybe, makes it underrated, if that makes sense. 

Ben: Yeah. It's, definitely a tricky one. I would probably say it's overrated for environmentalist and it's underrated for the average person in America, but, yeah, that's, the difficult one.

Universal basic income. Overrated. Underrated. 

Deena: Wow. Such a good question. I would say almost. Not discussed, if that makes sense. Really, it's gone. I thought this was 

Ben: the Californian solution to everything. I've obviously been misled. 

Deena: I think it disappeared. it had, it's had its moment in, the, presidential campaign a few cycles back.

But I, my understanding is recently, like UBI as a policy proposal has fell out of the popular zeitgeist. I suspect as we think more about AI, labor market disruptions solutions like UBI will have their day in the light again. and I'm quite interested to see how different the reaction is this time around.

So I guess I would say, yeah, perhaps for our current like labor market structure and where we are literally today, slightly overrated, but for potential AI labor market disruptions in the future, potentially a little bit underrated in that yeah, there's not, there's, there aren't a lot of, concrete policy proposals around that yet.

and I'm, I think I'm excited to see more thinking around it. 

Ben: That's very, well hedged on that one. It's interesting to see that it's actually completely di disappeared from the debate from what you said, or in which case, that would make me think it's a little bit underrated, even if it might have been overrated before.

I was reading that in Ireland, they're gonna do a small version of this, aimed at artists. So if you can get on this list, there's a few thousand artists which will have a small artist, UBI. And to your point about job disruption, maybe this is the offset about, okay. Put all of your work illegally into l and s because it's out on the internet, but maybe we'll give you a UBI instead.

Okay. Long-termism or thinking maybe about the very, very far future, is this overrated or underrated? 

Deena: I think in non rationalists and effective ultra spaces, as in for the average person? I think somewhat underrated. I think it's just very instinctively much more salient to think about things that are impacting us today.

Even if, when you truly consider it and when you think about, future generations of, the people you know and your family, you would care significantly more than you do today. I think the average person likely might care significantly more than they do today. if like properly framed about longer term impacts, if that makes sense.

Ben: Yes. But the rationalists themselves maybe think about it a little bit too much. 

Deena: Yeah, I think, it's a a concentrated dose of something that is, not popularly considered in, in most of the rest of the world. 

Ben: Sure. I think they might just go too far. They just, maybe if you get us to think about 100 to 200 years or 500 years, that's something useful.

Once you go out to say a million, all of the math seems to get really screwed because when we're very, not very good with large numbers anyway. Definitely. But very good. Yeah. Okay. Overrated, underrated direct giving. So this is direct giving of cash transfers. 

Deena: Oh, good question. I, guess I would have to say similar to my mechanical answer on bed nets underrated.

Yeah. Build demand in general use. Exactly. still lots of demand and, and not enough supply. So I'll say underrated. 

Ben: Great. Okay. AI existential risks. So a GI risk. Do you think this is overrated or underrated? 

Deena: it's really interesting, like some of the other questions, it depends radically on who you talk to.

I think, if you spend a few weeks in the bay, it will feel like there's almost nothing else happening in the world. Whereas, if you spend a few weeks. Many other places in the country it's a non-issue or not barely something that's even regularly discussed. So I guess I would say, I wish it were more evenly rated.

If that makes sense. 

Ben: Sure, that makes sense. Okay. And Cairo, do you think that's an underrated or overrated place? 

Deena: I would say underrated. I think yeah, often, people don't don't manage to get out there themselves, but I think it's, a city with so much rich, with rich history and on top of that it is a city that is just incredibly alive.

It reminds me a lot in some ways of New York and I'm biased because I've spent, quite a bit of time in both cities, but it is one of the few cities that I think compares in terms of sheer, like volume of people and energy and, like the idea of the city that never sleeps and the 24 hour city.

Ben: Yeah, very intense. I was there once for a little while to go to a friend's wedding, and it did ha it did actually have that New York vibe of everything happening all at once everywhere. yes. and last one on this philanthropy in general, do you think it's overrated or underrated? 

Deena: Yeah, I, again, am biased, but I will have to say underrated.

You go, you're gonna have to say 

Ben: that otherwise you're in the wrong career. 

Deena: Yeah, absolutely. but I truly believe it. when you think about the volume of charitable giving each year compared to, for example, like pledges that have been taken or the amount of money people, intend to give, I think it is quite low.

And yeah, I think it's underrated and I think I am excited over time to see more. Very high salience and very visible and easy, ways of giving charitably for people who, maybe are stopped by a form of decision paralysis or uncertainty. but who would like to give, which, I suspect is, is, quite a few people.

Ben: I'd accept that effective philanthropy is definitely underrated, but I still think it's a potentially a bit more of an open question than I was hoping for about overall giving, which seems to have, a little bit more of a, more patchy history. Although I guess that's why places like co giving and open philanthropy come about.

And so any current projects that you're working on that you're particularly excited by, or things that you have granted to or looked at and when these are really great projects and have now come by because you are, because you've been working on them. 

Deena: it's a good question. one thing I really love about my job is over the past year I've been able to look at such a wide variety of cause areas.

I think I started the year thinking about antimicrobial resistance and, I'm, ending the year thinking about AI for good and I've hit, many, cause areas in the middle. I think I'm, I am quite excited about the potential for AI, for Good. In particular, I think it's a very nascent field and one where it's possible that a lot of the problems that implementers have are shared even across verticals.

whether you're doing AI for health or. AI for agriculture or weather forecasting? I think there are maybe some common needs and challenges. And I'm excited about, continuing to learn a little bit more about the field and thinking about ways in which we might be able to support that, though, that's quite uncertain right now, so I don't, wanna make any particular promises around.

we, don't have an existing program in the area yet. 

Ben: Sure. And so how do you balance out between looking at something like, antibiotics, a MR and. Climate and AI or systems, pieces and things. And you said that the own internal sort of metric is this a hundred thousand in coefficient dollars, which you, seem to be able to, go to, and I guess you're looking for 10 x, five x, a hundred x, that type of, that type of return.

And I guess that's it. You just have to, whatever area you are doing somehow bring it back to these are the inputs and the costs and get to those sort of figures or how do you think about weighing it up and at the strategic level, I guess you've gone development health, ai, also existential risk and some other elements where you're talking about maybe not, some other people aren't looking at it so much and have ideas about tractability or other, but I'm interested in how your own thinking is shaped about what should we work on and then when we work on it, how are we really thinking about whether this is a good idea to fund.

Deena: Yeah, it's a great question. in large part because by nature our time is limited, which means that we can't investigate every cause area. And so making prioritization decisions based on relatively little information upfront, is quite difficult, but a necessary part of the process. I think we often try to split the process of investigating an area into, parts that will allow us to pivot quickly and frequently.

So we might start, for example, with a two day investigation into an area that focuses on one particular crux that could basically suggest that we shouldn't look into it at all. So for example, if there's an area where. It seems really important and really neglected, but we're quite worried that there are basically no solutions and therefore it is totally in intractable, in which case we shouldn't do a full investigation.

we might just spend two days specifically looking at tractability and solutions. so I think that helps quite a bit. And then in terms of prioritizing cause areas, for funding, we do rely quite a bit on this framework of disability adjusted life years and percent increase in income as the sort of north star metrics or heuristics.

and we try to consider three factors, importance neglected is and tractability. So importance represents the overall magnitude of the problem and how many people it impacts. so this can often be dollies in terms of, health issues, for example. but might, go by other metrics depending on the area.

neglected is a measure of how many other funders are working on it and how many dollars are chasing the problem with some sort of adjustment for, what in particular they're working on. And tractability usually focuses on a few specific things that we could hypothetically fund if we were to enter the area.

So we'll try to do direct models of the impact per dollar spent on a few hypothetical grants that we might make in the area to understand whether they might be comparable to the rest of our portfolio. so that is, often how we try to make comparable judgments across very different cause areas, though, of course that is very tricky and there's a lot of, uncertainty there.

Ben: That's a really detailed level of analysis. Do you think it's worth, if you are an organization or even a startup thinking of applying to funders or even thinking of submitting to you guys that they already start to think a little bit in these terms? Or is it just more useful for you to do the analysis on what they would give you and not necessarily say that they've already started to try and translate it into a market size or impact size or a probability of success?

Is it actually helpful if they've already tilted it into your language and thinking, or is it. Better for them to just do their purpose and their things and you do the analysis on top. 

Deena: Yeah, certainly the vast majority of grantees we work with, will not have used exactly our model or not be thinking about things in exactly the same way we are.

So I think that's something that we understand. And so therefore, it's quite important for, us to be able to convert even very different materials into something that makes sense within our framework. I think it is often useful, when, organizations have thought about things in, somewhat similar ways though, if that makes sense.

When they've thought about, this is a really big problem. here, we know the shape of the field and what other funders are doing. we know why we think what we're doing is particularly, effective at solving this problem relative to other potential solutions.

things like that doesn't necessarily have to be. very, quantitative terms or in exactly our language. But I think the general mode of thinking of, here's why we think what we're doing is quite effective is, often helpful for us to know. 

Ben: Great. And couple of final questions leading into the end.

If you are the Ben benign dictator of the United States or the world, you can think about this globally or the us. what one thing, or I guess if you've got loads of ideas, you could do two or three things, would you implement in the world today? 

Deena: Very hard question. As in, any sort of like law or regulation.

Yeah. You're 

Ben: the ruler of the world, so I guess it'd be a law regulation more than more than anything else. But yeah, you can make this law and let's assume people are gonna even follow it or policy. or maybe you could, go the other way, right? You could take away a policy which you think is so bad that actually the, most net benefit we'll get is if this thing disappeared rather than this thing came in.

Deena: Yeah. Is it, too niche and boring to say I would fix government procurement processes in the US and in other sort of high income countries? 

Ben: No, but I guess the, challenge then is, so you think government procurement A is not a, is first of all probably a pretty bad, but b would probably have an impact which is much larger than the average person might think.

Deena: let me caveat that with saying I've certainly not done a cost effectiveness analysis and I've, definitely not even it was just a thing that immediately jumped to mind. I'm certain there are many other much more cost effective things you could do if you were a dictator of the world.

So this is like quite a small petty thing to be considering. But yeah, in large part, I think our ability to, 

Ben: I mean in some ways the US government did have this in mind ish. When they came up with Dodge, they thought, there's something going on here. I know that was only a part of it, so not completely crazy.

Deena: I think it's, certainly at the core of a lot of our ability to get things done. And, maybe this is also maybe again, I'm, biased here 'cause it's something that I personally experienced. For example, when you take public transit and you think about that the magnitude of the budget of the MTA and yet how expensive it is to do any particular project or process to improve the subway system.

and I think this goes not only for transit, but for things like construction, for for almost anything that the government, procures or does or has an RFP for. I think it's a wide ranging problem that impacts a lot of different sort of verticals that we experience day to day, if that makes sense.

Ben: yeah. So when you talk about procurement, it's not just buying supplies it's the building side of things as well. 

Deena: Yeah, exactly. So any sort of like contractor agreements or RFPs. 

Ben: Yeah, I guess that doesn't have a single bullet to it in a way that say if you propose a global carbon tax might or something.

So if you had 10 minutes with the president and they were gonna do the thing, you would implement that, this is the thing you would say, you'd go fix your procurement, fix your building. 

Deena: Yeah. I, don't know. I think it's in part a sort of a funny answer. and in part something that I think is like quite important.

I don't know how much that I would stand by, if I spent 10 minutes thinking about it, which I certainly hope that I would, if I, were, to be dictator for. For a day. I'm not sure that's what I would come out with, but I, do think I do stand by that. It's quite an important problem.

Ben: Yeah, no, I think that, I'm surprised you didn't go for health though, but you won't. Procurement maybe maybe health is even too complicated. Not as tractable 'cause it's too many bits to it. Okay. I'm gonna ask the question in another way, but bring it rather than at the policy government dictator level.

If I give you a billion dollars, which actually might sound like a lot, but actually we know is not a huge amount in the context of the world. And I say, you have to spend this, by the end of the call you have to decide how are we going to do this billion, what would you what would you allocate it towards?

You've got a billion and you can do anything with it. But it disappears unless we use it. So we can't like invest it and save it and do something even better in 10 years time. But what would we do now? 

Deena: Yeah, it's a good question. It's a hard one in large part one because often the answer might be divided into many little grants, but of course if one person is trying to think about how they would spend the funding, then you really just have to pick a few organizations or just a handful of, places to direct the funding. and then the second problem comes in of you get pretty, potentially pretty strong diminishing returns as you give the extra marginal dollar to the same organization, if that makes sense.

so the first, a hundred million, they might spend extremely cost effectively, but the further you go, the further down of the list of projects they have goes and, the more you start hitting constraints, sometimes thinking about like these very scalable opportunities I think there are certainly some organizations that that could take a large chunk of that billion and use it well.

again, bias, but organization, give, I think, would definitely be on the list. give directly thinking about, Gavi, for example. that could use a huge amount of funding. yeah, thinking about like organizations that are, Able to take a quite a large budget and have limiting diminished return as they move down the next dollar.

so I think ideally I'd split it up to at least five or 10 organizations, but I think something like that. 

Ben: Sure. The effective giving organizations like your own and, but then if you had a pet project, so you're not allowed to give it to an organization. And maybe this would be a smaller amount of money and maybe this isn't first order the most effective thing.

What sort of project or areas would you fund about? I think about this a little bit because one of the criticisms around some of this line of thinking is it never really works on the systems level. Although we've slightly negated that with AI and policy and, the things that they're like and sometimes I talk about, or I think about where we've had great social progress, like over hundreds of years progress, Slavery, women's rights, disability rights have come from this systems level change. And this is my art or your storytelling hat on. Because if you don't have a storytelling narrative for some of this, then you don't have that enabling layer at all to get change. But then, maybe that isn't that effective and we have to do it in a different way.

But I'd be interested in your thoughts of that. And did you have any other smaller pet project that you would want to fund? 

Deena: Yeah, it's a, good question. I think abstracting away from. My day-to-day role here a little bit. I think one area that we've looked at this year that I think has seemed quite timely and important is health system strengthening.

And in particular helping, low and middle income country governments allocate their health budgets and their budgets more generally as effectively as possible. I think this is particularly important now given, the perspective aid cuts and potential reductions in budgets for a lot of these countries.

And so it feels quite salient. But I do think there is a lot, of potential benefit in allocating those budgets a bit more cost effectively. And also in terms of, helping with budget execution, for example, ensuring that the budget can be spent, and can, and the money can get out the door each year which is almost an interesting and opposite challenge.

Ben: Excellent. Okay, last question. Would you like to give, any advice to people, listening? So this could be life advice or people thinking about how to give money or perhaps thinking about going into a career, either in terms of innovation research or grant making research, or your thoughts on where you've got to today.

life advice from Deena. 

Deena: Another tough question, I don't know that I could presume to give personal advice. I guess I will say one meta observation that has been interesting and helpful for me is that often some subset of people listening to a piece of general advice, should take that piece of advice and sub subset actually need to take the exact opposite.

Okay. and often it's reverse correlated with who is hearing it. usually the listeners of a particular, or the readers of a particular outlet are quite similar to. The person giving the advice. And so they have like similar inclinations. And so they're exactly the group of people that should be doing the opposite.

They're already leading too far in that direction. So maybe my, meta piece of advice is try, to collect advice from pretty disparate sources and from people that you maybe don't necessarily normally interact with and from different bubbles of the world. I think, it's very easy to end up in like a sort of, relatively small intellectual circle that thinks relatively similar in relatively similar ways.

But, I think one benefit I found of living in New York is that I am constantly exposed in a way that I might not have been in SF or DC to people who are in completely different industries who, have never, heard about a lot of the things that, that I spend my days thinking about, but vice versa have a lot of pretty interesting and pretty different robustly different experiences.

Ben: Excellent. So that sounds like if you are looking for the advice you want, you should actually ignore it and go the other way. 

Deena: Yeah, in some cases I think that's right. 

Ben: advice is overrated. Great. on that note, Deena, thank you very much. 

Deena: Thanks so much, Ben. It was a lot of fun.

In Podcast, Arts, Life Tags Philanthropy, Effective Altruism, Deena Mousa, Open Philanthropy, Artificial Intelligence, AI for Good, Grantmaking, Public Policy, Economics, Social Impact, Global Health, Decision Making, Government Procurement, Nonprofits, Coefficient Giving
Follow me on LinkedIN
Contact/Support