Goodfire Mechanistic Shaping First Uses Internal Representations to Suppress Reward Hacking Rate to 2%
Goodfire has introduced Mechanistic Shaping, which uses internal model representations during training to reduce reward hacking in RL models from 100% to 2% while raising honesty to 96–98%. The method was validated across language and vision tasks and points to a new approach for alignment.