The safety training debate is under-specified. When people argue about whether RLHF "works," they're conflating at least three different things that fail in completely different ways.