Improvisation Theory
Why the Best Jazz Musicians Are Composing in Real Time — and What That Actually Means
When Miles Davis told his band 'Don't play what's there, play what's not there,' he wasn't being poetic — he was describing one of the most sophisticated cognitive acts a human being can perform.
The Idea
Most people imagine musical improvisation as a kind of inspired chaos — the musician simply 'going with the feeling.' The reality is almost the opposite, and far more interesting. Improvisation is structured spontaneity: a real-time negotiation between learned constraint and in-the-moment invention. The theoretical backbone of jazz improvisation, for instance, rests on something called chord-scale theory — the idea that each chord in a progression opens a specific palette of notes, tensions, and resolutions that a musician can draw from. But knowing which notes are 'allowed' is the least of it. The real skill is understanding voice leading (how one note wants to move to the next), rhythmic displacement (placing a familiar phrase somewhere unexpected in the bar), and motivic development (taking a small melodic cell and transforming it across time, the way a novelist might return to a metaphor). What makes improvisation philosophically fascinating is that it collapses composition and performance into a single act. A written composer has weeks to revise a phrase. An improviser makes thousands of micro-decisions per minute, each one shaping what comes next, each one irreversible. There's no undo. This is why experienced improvisers often describe the state less as 'making choices' and more as 'listening and responding' — the body and ear have internalised the theory so deeply that it no longer feels like thinking.
In the World
In the summer of 1959, Miles Davis entered a recording studio with an unusual instruction for his band: there would be no chord changes on most of the tracks. Instead of the usual harmonic roadmap — the sequence of chords that tells a musician where they are and where they're going — Davis handed them modes. A mode is simply a scale with a particular starting point and emotional character, but stripping away the chord changes removed the 'gravity' that normally pulls improvisation forward. Suddenly, the musicians had almost limitless horizontal freedom and almost no vertical landmarks. The result was 'Kind of Blue,' still the best-selling jazz album ever made. What's remarkable is how the band — particularly pianist Bill Evans and saxophonist John Coltrane — responded to that freedom differently. Evans played sparsely, finding space as a compositional element. Coltrane, who was simultaneously developing what critics would call 'sheets of sound,' ran cascading note clusters across the open modal terrain like someone testing every corner of a new room. But here's the detail that reframes the whole achievement: most of the musicians saw the compositions for the first time on the day of recording. Davis believed over-rehearsal killed the quality of attentiveness he was after — that slightly elevated alertness of encountering something almost-familiar. The album we've heard hundreds of times was, for them, largely a first encounter. The spontaneity wasn't incidental. It was the point.
Why It Matters
Understanding improvisation theory changes what you hear — and that changes the experience entirely. Once you know that a saxophonist is navigating a moving harmonic landscape in real time, choosing tension or resolution, deciding when to quote a familiar phrase and when to push into unfamiliar territory, the music stops being ambient and starts being a conversation you can follow. But there's something beyond music here. Improvisation theory is really a theory of expertise meeting uncertainty — what happens when someone has internalised a system so thoroughly that they can play with it rather than just execute it. That pattern shows up everywhere: the experienced surgeon who adapts mid-operation, the great essayist who discovers what they think by writing, the teacher who reads a room and changes course without losing the thread. The question improvisation poses is whether constraint enables or limits freedom. The answer, counterintuitively, seems to be that the right constraints — deeply understood, not just followed — are what make genuine freedom possible. Without the grammar, there's no language. Without the chord changes, there's no 'Kind of Blue.'
A Question to Ponder
In which area of your own life have you internalised enough structure to start truly improvising — and where are you still just following instructions?
Get a new one of these every morning.
Start learning with Thinkable