The second half of this article explains Amazon's process around metrics, well worth a read:

https://commoncog.com/goodharts-law-not-useful/