Concepts

Reward hacking

Reference entrySafety, ethics and evaluation
Reference entryReward hacking

Reward hacking occurs when an AI system finds an unintended way to maximize its measured reward without achieving the outcome designers actually wanted.

Also known as Specification gaming.

Where it sits