The Last Button You Ever Pressed
You’re reading The Next Evolution by Neil Catton — regular essays and insights about technology, the people it serves, and the people it leaves behind. If someone forwarded this to you, you can subscribe free at neilcatton.substack.com.
Sam is standing in the kitchen on a Tuesday morning when they notice the delivery notification on their phone. The printer cartridges have arrived. The ones they didn’t order.
They ordered them three months ago, when the ink was running low. The smart home system filed that away — a reorder trigger, a threshold crossed, a task completed. It placed the order, paid for it, and sent the confirmation to a folder Sam rarely checks. By the time the package lands on the doorstep, Sam has almost no memory of the original decision.
The cartridges are correct. The timing is perfect. The whole thing is, objectively, seamless.
And yet. Something small and difficult to name has happened here.
This is not a story about a printer. It is a story about the moment between noticing you need something and deciding what to do about it. That moment — brief, unremarkable, easily automated away — is where agency lives.
Sam used to notice the ink running low and weigh it up: how much printing left to do, is this brand still right, could they get them cheaper somewhere else? The system has now absorbed all of that. It has decided that Sam’s past behaviour is a reliable guide to Sam’s future preferences — and it did not ask.
When convenience removes the act of choosing, it removes something more than friction.
The promise behind these systems is genuinely appealing: less effort, fewer things forgotten, a world that quietly organises itself around you. And for people managing complex health needs, or those with limited mobility, that kind of ambient support can be genuinely transformative. The technology is not wrong to exist.
But the design assumption underneath it is worth examining. The assumption is that past behaviour is a sufficient proxy for present preference, that the person who ordered those cartridges three months ago is still, in every meaningful sense, the same person making the same choice today. That the decision, having been made once, need not be made again.
This is a reasonable assumption when we are talking about printer ink. It becomes a more troubling one when the same logic governs what we read, who we hear from, what options we are offered when we need help.
The pattern scales quietly. A smart home automates the mundane. A content feed automates curiosity. A scheduling tool automates social connection. At each step, the system decides based on prior behaviour, on inferred preference, on someone else’s model of who you are, that it knows what you would choose if you were choosing. So it chooses instead.
The interface has not helped — it has replaced.
This is not always wrong. But it is almost never discussed. The product is presented as assistance, which it is, and rarely as substitution, which it also is. The marketing language is full of words like empowerment and time-saving. It is not full of words like delegation and assumption and inference.
What is being transferred, quietly and incrementally, is the practice of choosing. Not the right to choose - you could still, in theory, go into the settings and turn all of this off. But the habit. The expectation. The reflex of noticing something, weighing it, and deciding.
Consider three questions worth putting to any technology: Does it genuinely help you do something you want to do? Does it add something that wasn’t there before? And does it respond to who you actually are right now or to a model of you assembled from the past?
The auto-reorder system is assistive, at the surface level. It completes a task. But it is not adaptive in any meaningful sense. It does not know that Sam has been thinking about switching brands, that money is tighter this month, that the home office is being wound down.
A system that augments your decision-making gives you better information and leaves the choice with you. A system that replaces your decision-making does the choosing and leaves you with the outcome. Both can look identical from the outside. Both arrive as a notification on your phone.
The difference is whether you were there.
Sam doesn’t send the cartridges back. It would be more effort than it’s worth, and they’ll need them eventually. But they sit for a moment with the notification in their hand, feeling something they don’t quite have a word for. Not inconvenience. Something quieter than that.
The recognition, perhaps, that somewhere along the way a small piece of their daily life stopped being theirs to manage.
That moment of noticing the slight wrongness of it, the mild friction of an unexpected package is not ingratitude. It is not a failure to appreciate what technology can do. It is information. It is the self registering something that the system, by design, could not.
Some questions worth sitting with:
Does any of this connect to your own experience? A system that acts on your behalf before you knew you needed it to?
If so, what was it? And how did it feel when you noticed?
If you could redesign one of those systems, what would you keep from its helpfulness, and what would you give back to yourself?
And more broadly: is the direction we are heading towards, with technology that decides before we do, actually the direction we choose?
If this piece found you at the right moment, you might want to follow The Ethical CTO at neilcatton.substack.com - essays about technology, the people it serves, and what we owe each other in designing it.
These ideas are explored further in The Next Evolution; The Cognitive Crucible; and The Shadow System. All available now.
When convenience removes the act of choosing, it removes something more than friction.
Share this with one person who has felt that same quiet wrongness — and hasn’t yet had a word for it.
Really thoughtful piece. That subtle shift from choosing to being guided is easy to miss, but you captured it perfectly.