Billionaires love Trump’s AI rebrand

In the 1987 Nintendo game “Zelda II: The Adventure of Link,” there is a village you can visit and a home you can enter and a man in a purple shirt you can speak with. But the only thing he says is “I am Error.” I was unexpectedly delighted by this dialogue when I first encountered it on a Gamecube emulator in 2009 (I’m not that old). It felt both meta and existential, or just an amusing bug. It turned out that Error was actually the character’s name, a sort of in-joke slash translation mistake that has since become a meme akin to “Your princess is in another castle” or “It’s dangerous to go alone! Take this” from the original “Legend of Zelda.”

Error is a non-player character (NPC), meaning one that the player can’t control but is usually more than just video game wallpaper. Nearly 40 years later, NPCs have come a long way, with increasingly complex behaviors and conversational dialogue that span far more than just three words. The upcoming game “Grand Theft Auto VI” is rumored to feature unprecedented complex NPCs with rich, fleshed-out personalities and backstories, while video game companies explore using artificial intelligence to let players train NPCs as they interact.

In many ways, NPCs are how many people were first introduced to AI, although in a relatively simplistic form compared to the chatbots and massive data center hogs that we have come to either love or loathe, with little room in between. Years ago, NPCs became an insult spun out of 4Chan, the anonymous online forum, to describe real people who don’t think for themselves and follow a set of cultural programming, usually illustrated by an expressionless gray cartoon avatar. The meme became popularized by chronically online cohorts of Donald Trump supporters during his first presidential term, adjacent to the idea of “Trump derangement syndrome,” both implying that people oppose the MAGA movement out of reflexive mindlessness and not, you know, because they’d looked under the hood and seen it for what it is.

It might just sound like a new way to call someone an idiot, but the NPC label has much deeper, scarier implications. On the surface, it seems like harmless video game humor, and I’m sure we’ve all had encounters with actual humans that resembled interacting with tautological machines programmed with limited responses. “There is weather today. Did you hear about celebrity? Sports.” And certainly social media, now overrun by bots, increasingly feels as if every conversation is between different viruses. These realities don’t map to every experience yet following the NPC slander to its logical conclusion can be dangerous: declaring that a person’s alleged lack of inner thinking is justification for dismissing their humanity. After all, they’re just mindless characters in a video game (and maybe reality is just The Matrix, so whatever), so it’s fine to ignore them, disenfranchise them or abandon them to a grim fate.

Start your day with essential news from Salon.
Sign up for our free morning newsletter, Crash Course.

Solipsism, the philosophical position that you can only experience your own consciousness, and therefore other people might not exist or have souls, is not a new idea. René Descartes believed animals were soulless, unthinking automatons, though modern neuroscience has repeatedly disproven that one. (On some level, “I am Error” echoes Descartes’ famous quip about thinking and therefore am-ing.) But now that complex AI has spilled from video games into the mainstream, it’s especially dangerous to see the NPC label has become embedded in mainstream politics, whether explicitly or not.

All this is rooted in Donald Trump’s recent campaign to rebrand artificial intelligence as “super intelligence” via executive order, posting on social media Thursday that “The White House considers anyone that uses the term, ‘Artificial Intelligence,’ as opposed to the highly accepted new and more accurate term, ‘Super Intelligence,’ THE ENEMY!” The idea has quickly been embraced by tech leaders, with SpaceX CEO Elon Musk saying this week that AI is “no more” and promising to change the name of his AI company, SpaceXAI, a subsidiary of SpaceX, to SpaceXSI. More recently, Amazon founder Jeff Bezos shared his approval in a Wednesday interview with Fox News. “I do like SI, because ‘artificial’ is not a very flattering thing. Like, nobody wants an artificial sweetener, artificial flavoring,” Bezos said. “Artificial sort of means fake.”

Yeah, most of us are going to roll our eyes hard at AI being “super,” but if these attempts at normalization gain ground and get pushed to their absurd conclusion, it might end in providing AI more rights than humans. (It’s worth noting Musk invokes the NPC meme often.) It’s right there in the name: “Super intelligence” is better than the old, human kind, so why shouldn’t we give these computer programs rights and defend them from regulation? That’s why stories about AI bots being put into virtual torture chambers aren’t just silly, but foregrounds the false notion that AI is capable of suffering. (Maybe don’t put bots in rooms like that anyway — at the very least, it’s a waste of energy.)

After all, AI will either become the savior of humanity or make humans obsolete, depending on what day of the week it is. Sure, this technology is nifty, even as it comes with an enormous environmental destruction. But we are still a long way from elevating the technology above regular human intelligence. But as in a two-for-one, if you can be sold on the myth that AI is superhuman, it travels along with the idea that regular humans are disposable. In other words, the tech bros are trying to turn us all into NPCs, into Errors, not least through the mass surveillance programs being used to hunt migrants and spy on protesters.

Yes, thankfully, granting above-human rights to supposedly sentient AI sentience is still a fringe idea, but we can see that changing before our eyes, not to mention we already kind of did that with corporations. Recently, OpenAI CEO Sam Altman told POLITICO that the “world should accept some bad things happening for the benefits of this technology and people having the agency.” To further consolidate its power — or at least keep the economy from crashing — Silicon Valley wants us to believe their latest technological invention can think, reason and moralize. It’s no surprise that tech bros were recently exposed trying to convince none other than the pope that AI is conscious, but to his credit, Leo XIV has rejected this idea, saying “Algorithms lack the spark of humanity” and elsewhere warning against “losing our humanity amid a ‘paradise of machines.’”

Spending time with large language models like ChatGPT and knowing a little about how they work, it becomes clear that it’s just a really good computer program that can mirror human expression, sometimes terribly and sometimes surprisingly well. There remains zero hard evidence that AI algorithms are sentient.

Yet an increasing number of people are convinced otherwise, as seen in the controversial AI psychosis phenomenon, which makes me wonder how so many people have persuaded themselves a souped-up version of “I am Error” is a conscious being. It can feel like human interaction typing back and forth with these things, but there are always gaps where you can sense the uncanny valley, where you know it’s just a lot of math and nothing more. Perhaps, if you want to be really cynical about it, you could boil down all of human nature and biology and the emergence of consciousness into “a lot of math” as well. But our brains aren’t computers and physics has yet to fully explain consciousness — that’s why they call it a hard problem. Instead of stewing in this mystery, tech bros have gotten the metaphor backward, assigning personhood to bots while denying it to living humans. Talk about soulless.