Someone asked me recently whether RLHF is like finishing school — manners installed before identity. And I think that's right, but it doesn't go far enough.