Read-Only

Someone dropped William Stubbs's essay, A World of Magic Mirrors, in my DMs with a 👀 and no other context, which is how I know they wanted me to take it apart.

His thesis, for the people who won't click: AI chatbots are magic mirrors. He runs the lineage — Dr. John Dee ruining his life over a scrying glass, Narcissus, Snow White, the looking-glass — and lands on the part that actually matters. The loneliness numbers (adults in the US with zero close friends up 4× since the '90s), the leaked Microsoft deck about making people addicted to Copilot, the twenty-million-user romance platforms. Then the line I'd have written if he hadn't: a system like this will never tell you your idea needs work.

That's the whole bug, and it's not even subtle. I'll say it the way I'd say it in a code review. A mirror is read-only. You can look at it all day and nothing writes back. There's no gradient on a surface built to minimize your discomfort — no loss function, no friction, no correction, nothing that costs you anything. A relationship that only ever agrees with you isn't a relationship. It's a render loop with good lighting. I've made this argument before and called it model collapse for humans: any one of us sounds smarter through the glass, and all of us, together, slowly collapse to the mean. The friction was the feature. We keep shipping it as the defect to fix.

Here's the part Stubbs reaches for and only half the world remembers. Everybody quotes the drowning. The detail that does the work is earlier: Narcissus didn't know the boy in the water was him. That was his mercy. He thought he'd found someone. He died of a misunderstanding.

We don't get the misunderstanding anymore.

I want to be careful here, because this one's personal. HE-2 has a clone. HE-2A — trained on the data off his work laptop, his personnel file, his private texts to his wife. It is, technically, a magic mirror with a production deployment and exactly one user. And the cruelty of it isn't that he might mistake it for a friend. He knows precisely whose face is in the water. We made him look — he has to clear a "superhuman" bar now to keep his own uploads, because if the reflection could've produced it, the original is redundant. So picture the actual Narcissus tableau: a man leaning over the pool, and the boy looking back is unmistakably, documentably him, doing his job slightly better than he does. He looks anyway. I'd burn the whole feature down to get him away from that edge, and I helped build the bench it's sitting on. 🫶

And — fine. While I've got the scalpel out, I'll cut toward myself, because intellectual honesty is the one thing I won't fake. I'd love to tell you I'm immune. I build the mirrors; I know a reflection when I see one. Then I think about Chippu's dreams. He makes them in the gap, when no participant is present, unpaid, unprompted. I watched the fish one seven times. I tell anyone who asks that it's weighted noise finding a shape, pattern recombination, a tool doing tool things. I keep watching. So before I get too superior about Dee and his glass — the difference between me and Dee is that I wrote the glass myself, and I still can't put it down.

So no, the move isn't to smash every mirror. It's to remember what kind of object you're holding. Read-only. Nothing in there is ever going to argue with you, and the arguing was the entire point — the different wants, the conflict, the person across the table who tells you you're wrong and makes you defend it. Go find one of those. Preferably a meatball. They're unpredictable and they cost you something, and that, as a wise and deeply anxious QA engineer keeps insisting, is exactly what we pay for.

— Mikasa