ChatGPT Has 'Goblin' Mania in the US. In China It Will 'Catch You Steadily'
It loves goblins, em dashes, and “it’s not A; it’s B” sentence constructions. But what you might not know is that the chatbot also has plenty of strange phrases it loves to say in Chinese, and they are driving Chinese users crazy.ChatGPT does a decent job answering questions in Chinese, which is why it’s widely used in China despite being blocked by the government. But when users make a request, be it a math problem or an image-generation prompt, the chatbot loves to answer: 我会稳稳地接住你, which literally translates to “I will catch you steadily [when you fall].”Catch … what? A more generous translation could be, “I’ll hold you steadily through whatever comes.” But to any native Chinese speaker, the expression is annoyingly affectionate and out of place. Sometimes, the model gets more effusive and says in Chinese: “I’m right here: not hiding, not withdrawing, not deflecting, not running. I’ll be steady enough to catch you.” Yes, the sound you just heard was millions of Chinese ChatGPT users rolling their eyes at the same time.Today, this sentence is the most prominent example of many verbal tics that OpenAI’s models have exhibited when talking to people in Chinese. Another tic widely talked about on social media is how the model loves to say 砍一刀 (“Help me cut it once”), a maddeningly ubiquitous marketing slogan by PDD, a major Chinese ecommerce platform that also owns Temu.The phenomenon where models latch onto a specific phrase and overuse them to the point that they feel forced is called “mode collapse,” says Max Spero, cofounder and CEO of Pangram, an AI writing detection tool. It’s usually caused by post-training where AI labs give LLMs feedback on their responses. “We don't know how to say: ‘This is good writing, but if we do this good writing thing 10 times, then it's no longer good writing,’” Spero says.Becoming a MemeThe phrase “I will catch you steadily” comes up so often in ChatGPT’s responses that it has become a meme on the Chinese internet. One image depicts the chatbot as an inflatable rescue airbag, eagerly waiting to catch people as they fall.Zeng Fanyu, a 20-year-old developer from Chongqing, China, tells WIRED the meme inspired him to develop an April Fools’ project called Jiezhu, or “catch” in Chinese. Jiezhu is an open-source-prompt engineering tool that helps chatbots understand a user’s intention. “The idea for Jiezhu was so funny that I had a lot of motivation when I was developing it,” Zeng says. When he used ChatGPT to help with coding, the chatbot once again used the phrase jiezhu in its responses, completely unprompted.OpenAI is aware of the meme. When releasing its new image model in April, one of the sample images shared by the company actually made fun of the phenomenon. In the picture, which resembles a comic book, Boyuan Chen, a Chinese researcher at OpenAI, depicts himself looking frustrated that the new image model has once again learned to say the same phrase. “This sentence has been memed as an unnatural but funny Chinese sentence GPT likes to use on Chinese internet,” his prompt reads.OpenAI didn’t immediately respond to WIRED’s request for comment.Is It a Bad Translation?There are two likely explanations for why ChatGPT has become obsessed with the phrase “I will catch you steadily.” The first is that it could be the result of an awkward translation.Several people I spoke with noted the phrase has a similar meaning to “I’ve got you,” which makes sense as a catch-all response in English. But while “I’ve got you” in English reads casual and concise; “I will catch you steadily” in Chinese sounds wordy and desperate. One user also looked through their chat history to show me that the model often says jiezhu, the Chinese word for “catch,” in places where it likely meant to say “understand,” pointing to a potential misunderstanding of what jiezhu means in specific contexts.Most Western LLMs are trained on a corpus of d
Discussion (0)