There's zero buffer to slack off, a less productive day is followed by a longer one.
I like working at Amazon. I like the challenge, the projects, the people I work with are fun and smart, but it is not a place where you can easily balance your life for a long period of time. I've never met someone past the 5 year mark that does not define his life as an Amazon employee first, everything second.
You can try to keep yourself at 40h, but eventually it will hurt you, it'll show in your review, it'll hold back your promotion, and if you're unlucky enough to have a management switch at a time where the team is expected to perform, you might even lose your job. I've seen it happen.
Now, maybe in some teams things are different, but in my 2 years, it's been my impression that this is the culture here. You either like it, as I do, I enjoy the rush and the busyness, makes my days fly by. Or you don't and you leave.
I'd be curious to know though, and be honest, you've really ever only worked 40h weeks? You havnt logged in on a weekend or an evening, stayed longer on an Thursday, checked your mails when off work? Not ever? Ignoring on call time offcourse.