Skip to content
Humanopia
Risk and safety

Catastrophic risk: how seriously should we take it?

A sober look at the arguments, the probabilities and the uncertainty.

vinznsk · Jul 29, 2026 · 2 min read

It is easy to talk about AI as if it were weather, something that simply happens to us. It is not. It is built by people, bought by people and regulated by people, and each of those choices can go more than one way.

The people most affected by these systems are often the least consulted. Workers, patients, students and artists rarely sit in the rooms where products are designed and policies are drafted.

The question

Philosophers have argued for centuries about what makes a mind. Those arguments used to be thought experiments. Now they have practical consequences for law, work and how we treat each other.

  • What remains uniquely human
  • What can be undone, and what cannot
  • Who benefits, and who pays the cost
  • Who gets a say in the decisions

Where we are now

There is a version of the future in which AI takes on the drudgery and people spend more time on care, craft and conversation. There is another in which it hollows out the parts of life that gave us meaning.

Technology is neither good nor bad; nor is it neutral.

Melvin Kranzberg

Every powerful technology redistributes something: time, money, attention, power. Artificial intelligence is no different. The interesting question is not whether it changes things, but who gets to decide how.

Illustration for this sample story.

What history suggests

Caution is not the same as fear. Asking hard questions about a technology is a sign of taking it seriously, not of rejecting it.

The most honest answer to many of these questions is that we do not know yet. That is a reason to keep watching, keep testing and keep talking, not to stop.

Stay ahead without
living inside the feed.

Get our weekly newsletter with the most important AI news, practical guides and thought-provoking essays, curated for curious, forward-thinking people.

Weekly, not daily Curated and practical No spam, ever