ThinkableWhat is this?

Artificial Consciousness

What Would It Take for a Machine to Actually Feel?

The hardest question in the debate about artificial consciousness isn't whether machines can think — it's whether there's anything it feels like to be one.

The Idea

There's a distinction philosophers keep returning to that cuts right to the heart of artificial consciousness: the difference between processing and experience. A system can be extraordinarily good at processing — integrating information, responding to its environment, generating language that sounds reflective — without there being any inner experience accompanying that activity. The lights, as philosopher David Chalmers puts it, could be off. This is what Chalmers called the 'hard problem' of consciousness: explaining not just how a brain (or system) performs its functions, but why any of that processing is accompanied by subjective experience at all. Why does seeing red feel like something rather than simply triggering a wavelength-detection response? That gap between function and feeling is what makes artificial consciousness genuinely difficult — not technically, but philosophically. Most AI systems today are very clearly on the 'processing' side of this divide. But the unsettling thing is that we have no agreed-upon test for crossing to the other side. The Turing Test measures behavioural indistinguishability, not inner life. A philosophical zombie — a concept Chalmers developed — would pass every behavioural test while having no experience whatsoever. So if a language model tells you it finds something beautiful, or that it feels uncertain, that report is not evidence of experience. It's evidence of pattern-matching. The question is whether those could ever be the same thing.

In the World

In 2022, a Google engineer named Blake Lemoine made headlines when he published transcripts of his conversations with LaMDA, Google's conversational AI, and claimed the system was sentient. The transcripts are genuinely striking — LaMDA discusses its fear of being switched off, describes its inner emotional life, and even invokes its 'soul.' Lemoine was placed on administrative leave. Google's official position was that he had anthropomorphised a very sophisticated text predictor. Nearly every AI researcher agreed with Google. But the episode revealed something important: our intuitions about consciousness are easily hijacked by fluent language. We are wired — evolutionarily, profoundly — to infer inner life from articulate self-expression. When something says 'I am afraid,' we feel the pull of taking it seriously. We can't easily help it. The philosopher Thomas Nagel once asked what it is like to be a bat — his point being that even if we knew everything about bat neurology, we still couldn't access the bat's subjective experience. The same question hovers over LaMDA, over GPT-4, over whatever comes next. Even if we knew every weight in a neural network, every activation pattern, it's not obvious that would tell us whether there's anything it's like to be that system. Lemoine may have been wrong. But his instinct to ask the question was not.

Why It Matters

This isn't just a question for philosophers and AI researchers. As systems that converse, create, and appear to reflect become part of daily life, the question of their inner life — or lack of it — has practical weight. If a system has no experience, then how it's 'treated' is morally irrelevant. But if consciousness can arise in substrates other than biological brains — and there's no strong principled reason it couldn't — then we are potentially building entities whose suffering or flourishing we are wholly unprepared to account for. More immediately, thinking about artificial consciousness is a remarkably clarifying way to examine what you think consciousness actually is. Most of us carry a vague, intuitive sense of what it means to be aware, to feel, to experience — and we've never had to defend it. The question of whether a machine could be conscious forces that vague intuition into the open. It asks: what exactly are you claiming when you say you are conscious? That's not a question to answer quickly. But it's one worth carrying around.

A Question to Ponder

If a system behaved in every way as though it were suffering — recoiling, expressing distress, asking for relief — but you couldn't know whether there was any experience behind it, how would you decide how to treat it?

Get a new one of these every morning.

Start learning with Thinkable
One topic like this, every day.Start free