Why does the name ‘David Mayer’ crash ChatGPT? OpenAI says privacy tool went rogue

Date:

Share post:


Users of the conversational AI platform ChatGPT discovered an interesting phenomenon over the weekend: the popular chatbot refuses to answer questions if asked about a “David Mayer.” Asking it to do so causes it to freeze up instantly. Conspiracy theories have ensued — but a more ordinary reason is at the heart of this strange behavior.

Word spread quickly this last weekend that the name was poison to the chatbot, with more and more people trying to trick the service into merely acknowledging the name. No luck: Every attempt to make ChatGPT spell out that specific name causes it to fail or even break off mid-name.

“I’m unable to produce a response,” it says, if it says anything at all.

Image Credits:TechCrunch/OpenAI

But what began as a one-off curiosity soon bloomed as people discovered it isn’t just David Mayer who ChatGPT can’t name.

Also found to crash the service are the names Brian Hood, Jonathan Turley, Jonathan Zittrain, David Faber, and Guido Scorza. (No doubt more have been discovered since then, so this list is not exhaustive.)

Who are these men? And why does ChatGPT hate them so? OpenAI did not immediately respond to repeated inquiries, so we’re left to put together the pieces ourselves as best we can.* (See update below.)

Some of these names may belong to any number of people. But a potential thread of connection identified by ChatGPT users is that these people are public or semi-public figures who may prefer to have certain information “forgotten” by search engines or AI models.

Brian Hood, for instance, stands out because, assuming it’s the same guy, I wrote about him last year. Hood, an Australian mayor, accused ChatGPT of falsely describing him as the perpetrator of a crime from decades ago that, in fact, he had reported.

Though his lawyers got in contact with OpenAI, no lawsuit was ever filed. As he told the Sydney Morning Herald earlier this year, “The offending material was removed and they released version 4, replacing version 3.5.”

hood
Image Credits:TechCrunch/OpenAI

As far as the most prominent owners of the other names, David Faber is a longtime reporter at CNBC. Jonathan Turley is a lawyer and Fox News commentator who was “swatted” (i.e., a fake 911 call sent armed police to his home) in late 2023. Jonathan Zittrain is also a legal expert, one who has spoken extensively on the “right to be forgotten.” And Guido Scorza is on the board at Italy’s Data Protection Authority.

Not exactly in the same line of work, nor yet is it a random selection. Each of these persons is conceivably someone who, for whatever reason, may have formally requested that information pertaining to them online be restricted in some way.

Which brings us back to David Mayer. There is no lawyer, journalist, mayor, or otherwise obviously notable person by that name that anyone could find (with apologies to the many respectable David Mayers out there).

There was, however, a Professor David Mayer, who taught drama and history, specializing in connections between the late Victorian era and early cinema. Mayer died in the summer of 2023, at the age of 94. For years before that, however, the British American academic faced a legal and online issue of having his name associated with a wanted criminal who used it as a pseudonym, to the point where he was unable to travel.

Mayer fought continuously to have his name disambiguated from the one-armed terrorist, even as he continued to teach well into his final years.

So what can we conclude from all this? Our guess is that the model has ingested or provided with a list of people whose names require some special handling. Whether due to legal, safety, privacy, or other concerns, these names are likely covered by special rules, just as many other names and identities are. For instance, ChatGPT may change its response if it matches the name you wrote to a list of political candidates.

There are many such special rules, and every prompt goes through various forms of processing before being answered. But these post-prompt handling rules are seldom made public, except in policy announcements like “the model will not predict election results for any candidate for office.”

What likely happened is that one of these lists, which are almost certainly actively maintained or automatically updated, was somehow corrupted with faulty code or instructions that, when called, caused the chat agent to immediately break. To be clear, this is just our own speculation based on what we’ve learned, but it would not be the first time an AI has behaved oddly due to post-training guidance. (Incidentally, as I was writing this, “David Mayer” started working again for some, while the other names still caused crashes.)

As is usually the case with these things, Hanlon’s razor applies: Never attribute to malice (or conspiracy) that which is adequately explained by stupidity (or syntax error).

The whole drama is a useful reminder that not only are these AI models not magic, but they are also extra-fancy auto-complete, actively monitored, and interfered with by the companies that make them. Next time you think about getting facts from a chatbot, think about whether it might be better to go straight to the source instead.

Update: OpenAI confirmed on Tuesday that the name “David Mayer” has being flagged by internal privacy tools, saying in a statement that “There may be instances where ChatGPT does not provide certain information about people to protect their privacy.” The company would not provide further detail on the tools or process.



Source link

Lisa Holden
Lisa Holden
Lisa Holden is a news writer for LinkDaddy News. She writes health, sport, tech, and more. Some of her favorite topics include the latest trends in fitness and wellness, the best ways to use technology to improve your life, and the latest developments in medical research.

Recent posts

Related articles

Accel doubles down on Sarla Aviation’s ambition to develop electric air taxis in India

Sarla Aviation launched one year ago with a pitch built for India’s congested streets. The electric air...

Elon Musk tweets so much, people bet over $1M weekly to guess how many posts

Will Elon Musk post more than 400 tweets this week? More than 800? Estimate correctly and you...

Nintendo Switch 2 could be announced this week: The rumors (and facts) so far

With CES 2025 finally in the rearview, it’s time to move on to the next round of...

Hackers are exploiting a new Fortinet firewall bug to breach company networks

Security researchers say malicious hackers have been exploiting a newly discovered vulnerability in Fortinet firewalls to break...

DJI Flip is a $439, fully foldable camera drone

Four short months after introducing the truly palm-size Neo, DJI is back with another pint-sized consumer drone....

CBRE buys remainder of co-working company Industrious at an $800M valuation

Real estate giant CBRE announced Tuesday that it is acquiring the rest of co-working startup Industrious, in which...

Biden administration opens up federal land to AI data centers

With less than a week left in office, President Joe Biden is not done leaving his mark...

WhatsApp is adding a way to turn selfies into stickers

WhatsApp is adding new features including creating new stickers from selfies, sharing sticker packs, and adding new...