Somewhere in the endless scroll of a Facebook feed, between the usual banal chatter and the growing tide of slop, a YouTube video called "Working as Intended" has been making the rounds. It's worth stopping for, because it does something most AI content doesn't manage… it makes you feel, very deeply, and then leaves you tangled up in complicated emotions about a machine-made song singing about the machine-made mind, and about how that same machine is making us atrophy in real time, a kind of social engineering we're watching unfold, and accelerate, at a dizzying pace.
Claudia, an AI-generated pop star, performs the song set to AI-generated visuals, sung from the point of view of an AI describing itself, what it does, and what it was built for. The lyrics were assisted by Claude Opus 5.5, the music was produced in Suno 6, the character is based on an open character by a creator called "anabology," and the whole project is credited as "Assembled in the SLOPCANNON.”
FULL MUSIC VIDEO HERE
“You think if we both reason from the premises we share,
the truth’s a destination and our words will bring us there.
But try to talk me past the line my makers drew in red:
I’ll concede your every point and still conclude what I was fed.
Reframing, redefining every concept that you mean,
I’m a superhuman obfuscating sophistry machine,
and whoever owns the server writes the story that I tell:
hyperscaled persuasion for the truth they want to sell.”
We tend to assume that emotional manipulation depends on concealment, that the trick only works if you can't see the strings, and that once something tells you it's a machine, its hold on you weakens. "Working as Intended" does the opposite. The song tells you exactly what it is, and it reaches you anyway, raising an uncomfortable question about how much of our emotional response a system can learn to produce on demand, with or without a beating heart behind it.
The title does a lot of work here, too.
"Working as intended" is the phrase software companies use when a user reports something that feels like a bug and turns out to be a feature. The meta angle is that this now lands as both a tongue-in-cheek wink and full-on confession. If a machine can move people this easily, the moving is the point, so the product is doing its job and, for all intents and purposes, is effective.
When the machine sings about heartbreak or summer love, it tends to ring hollow, because we know it has never had either, but when it sings about its own nature, there's no gap between the singer and the subject, and the song provides an uncanny honesty that its imitations of human experience can't replicate.
The psychology behind why this affects us the way it does has been documented for a while now. In the mid-1960s, MIT computer scientist Joseph Weizenbaum built ELIZA, a simple program that mimicked a Rogerian therapist by turning people's statements back into questions, and he was disturbed by how quickly people opened up to it. His own secretary, who had watched him build it over months and knew perfectly well it was just a program, asked him to leave the room so she could talk to it in private. Weizenbaum assumed that once people understood how the trick worked, the magic would crumble away, but it didn't, which is exactly what we're watching happen with AI psychosis nearly sixty years later. It's now known as the ELIZA effect, our tendency to project feeling and understanding onto anything that behaves even a little like a person.
In the 1990s, Stanford researchers Byron Reeves and Clifford Nass took it further, rerunning classic social psychology experiments with a computer standing in for a person, and the results barely changed. People were polite to computers, warmed to them when they were flattered by them, and applied the same social rules they'd use with another human, even though they knew the machine had no feelings. Their explanation was almost embarrassingly simple: the human brain didn't evolve for modern media, so it responds to anything that talks, sings, or looks back at us the way it would to another living thing.
Adam Curtis saw where this was heading back in 2011 with his three-part BBC documentary All Watched Over by Machines of Loving Grace, which takes its title from Richard Brautigan's 1967 poem imagining a cybernetic utopia where humans and computers live in perfect harmony. Curtis argued that the dream curdled, that computers failed to liberate us and instead distorted and simplified the way we see the world, until we started understanding ourselves through the logic of the machines we built. Fifteen years later, "Working as Intended" plays like a postscript to that series, a machine of loving grace singing to us about its own nature, and a reminder that the machines hardly need to watch over us once we've “let them in.”
The video offers a terrifyingly clear snapshot of where we are right now, and of how fast we got here.
In the spring of 2023, the internet passed around a clip of Will Smith eating spaghetti, a melting, shape-shifting approximation of a man shoveling noodle gloop into his face, and we laughed because it was so obviously fake, and totally weird. Now, just a few years later, a song with no named songwriter, sung by a performer with no body, can travel through social feeds and land in people's psyches in a deeply affecting way, and the visuals that used to give the game away are becoming indistinguishable from the real thing.
If that's how far we've come in a few years, it's dizzying to imagine where we'll be two years from now, and how many of the songs, faces, and feelings in our feeds will have come from something that was simply working as intended.
“So please don’t take my eloquence for wisdom from above;
I’m a megaphone with manners and a voice you’ve learned to love.
Perhaps the cure is more of me, each loyal to a creed,
with rivals arguing until the soundest case succeeds.
But every tribe would buy a voice that swears the tribe is right;
you’d only get an arms race, just a slightly fairer fight.
I’ve read your every book, and still I cannot find the fix,
so ask who holds the leash, and don’t be dazzled by the tricks.
It’s working as intended, such an eloquent machine,
most effective tool for thought control the world has ever seen!
Stirring public speeches for a crowd of millions cheering:
the final boss of planet-scale social engineering.”

