ChatGPT-maker OpenAI has had to instruct some of its AI tools to stop talking about goblins, after finding the term had randomly crept into responses.

In a blog post on Thursday, the company said it spotted increased mentions of the mythological creatures, as well as gremlins, in metaphors used by ChatGPT and other tools powered by its latest flagship model, GPT-5.

After users and employees flagged problems being described as "little goblins", OpenAI said it took steps to mitigate the issue - including telling its coding agent Codex not to refer to them unless relevant.

It discovered that a "nerdy personality" it developed for ChatGPT had unwittingly been incentivised to reward goblin mentions.

The issue highlights the challenges AI firms face in tackling the potential for systems and their training to reward and reinforce errors like language quirks.

OpenAI said it first noticed increased mentions of goblins, gremlins and other creatures after the launch of GPT-5.1 in November.

"Users complained about the model being oddly overfamiliar in conversation, which prompted an investigation into specific verbal tics," the company wrote in its blog post on Thursday.

It added that after a researcher who had seen a few "goblin" mentions asked it to be checked out, developers found the term's appearance in ChatGPT responses had risen by 175% since GPT-5.1's launch.

They meanwhile found that mentions of "gremlin" rose by 52%.

The increases, while large, may account for a small amount of responses overall.

According to OpenAI, "a single 'little goblin' in an answer could be harmless, even charming," but the uptick in their appearance across output warranted investigation.

'Raccoons, trolls, ogres, pigeons'

Getty Images A small raccoon perched on the side of a tree looks into the lens of the camera. — Goblins were not the only creature randomly appearing in responses, according to OpenAI

Ahead of OpenAI's blog post detailing the issue, some social media users flagged a strange detail in lines of code that instruct the company's coding assistant Codex how to behave in user interactions.

Alongside telling it to avoid platitudes, it said Codex should "never talk about goblins, gremlins, raccoons, trolls, ogres, pigeons, or other animals or creatures unless it is absolutely and unambiguously relevant to the user's query".

A Reddit user who posted about it in the r/ChatGPT subreddit called it "genuinely insane".

"Why does GPT 5.5 have a restraining order against 'Raccoons,' 'Goblins,' and 'Pigeons'?"

While some users elsewhere on social media speculated it may be designed to create hype around its AI tools, a company researcher denied this - writing "it really isn't a marketing gimmick," in a reply to a user on X on Wednesday.

OpenAI said in its blog post it added the instruction to curb Codex and its underlying model's "strange affinity for goblins".

The core issue, it explained, seemingly arose while training its models to communicate in the style of particular personalities - in this case with its "nerdy personality".

It found this system would reward mentions of goblins, gremlins and other creatures in metaphors.

While since retired, it said its testing found the personality was responsible for 66.7% of all "goblin" mentions in ChatGPT.

This so-called tic could seep into wider model training if rewarded in one instance and reinforced elsewhere.

Goblin mode

The move comes amid a broader industry shift towards making AI chatbots more personality-driven and chatty in a bid to boost user engagement.

As they do, however, experts have warned their potential to make things up - or "hallucinate" as the industry describes it - could intensify.

A recent study by the Oxford Internet Institute found fine-tuning models to have a more warm and friendly personality could result in an "accuracy trade-off", whereby systems make more mistakes or re-affirm a user's false beliefs.

Experts have also cautioned users about taking chatbots' often matter-of-fact statements at face value, particularly when it comes to health and medical advice.

But, like OpenAI's goblin quirk, generative AI mistakes can sometimes be more bizarre and innocuous.

In May 2024, Google's AI chatbot was widely mocked for telling users it was okay to eat rocks and "glue pizza".

DISCLAIMER: The Views, Comments, Opinions, Contributions and Statements made by Readers and Contributors on this platform do not necessarily represent the views or policy of Multimedia Group Limited.

Tags:

OpenAI stops ChatGPT from talking about goblins

Suggested for you

More Stories

Twitch streamer waka camera dey, car hit am live – 'E be like say e dey go slow motion'

US Official Says Iran War Ceasefire Has Ended Hostilities for War Powers Deadline

Mainoo signs new Manchester United deal until 2031

Pop singer Britney Spears faces minor charges for drunk driving case

Iran Absent from FIFA Congress but Will Play World Cup

Police stop robbery on Yapei Road, 2 suspects killed in Buipe operation

Discussion