Why AI systems improve while drifting away from reality [pdf] (opens in new tab)

Most alignment discussions focus on behavior. This looks at a structural failure mode where optimization replaces reality with proxies.