"Hey, check this out! User engagement as a function of time spent on amazon.com is up 125% with the new build!"
Once a metric becomes a target for optimization, it often loses its value as an indicator of a larger goal. People who obsess over A/B tests rarely understand that.
