How to Build Trust Into Unseen Infrastructure
For when the system that decided about you won't say why, and neither will anyone you can actually reach.
The letter says the mortgage application doesn’t meet current lending criteria. Nothing else. The broker doesn’t know why. The call centre reads from the same three lines everyone else gets. Somewhere behind the decision sits a scoring model that nobody in the building can actually explain, trained on data nobody in the building chose.
That isn’t a broken process. It’s infrastructure working exactly as built — just built without anyone answerable for what it decides. The card’s own argument starts there: the most powerful systems are usually the invisible ones, shaping outcomes nobody gets to question because nobody can see them operating in the first place.
The card holds five practice areas across two groups: what you design and verify into a system before it ever makes a decision — transparency, user control, outside audit — and what you build around it afterwards, so accountability doesn’t depend on goodwill. Written for whoever builds, deploys or governs systems like this, though anyone who has waited for an explanation and received a form letter instead will recognise exactly what it’s asking for.
It comes from The Next Evolution, where the fuller argument lives. The card stands on its own — you don’t need the book to use it.
Print it, or send it to whoever is about to ship the next system that will decide something about someone who’ll never see how.
And here’s the question I’d leave you with: next time a decision arrives with no explanation attached, do you actually know who — or what — made it, and whether you have any real way to ask?
You’re reading The Next Evolution by Neil Catton, articles that explore the human world and the intersection of technology, they try and ask difficult questions - not to scare - but to inform. If someone forwarded this to you, you can subscribe free at neilcatton.substack.com.
Neil Catton is the author of The Next Evolution, The Cognitive Crucible and The Shadow System - available on Amazon, and writes at the intersection of technology, ethics, and human purpose.