ChatGPT Is a Japanese Internet Degen, or: How Fried Chicken Sent Me Down a Tokenizer Rabbit Hole
A stray piece of 2ch boilerplate in a ChatGPT answer sent me down a rabbit hole through Japanese internet history, tokenizers, training data, and one very weird token.