"the internet never forgets things" is more of an caution than a promise.
Don't say stupid things that will look even worse in 10 years or sometimes fairly mainstream things that will look terrible in 40 years, because the internet never forgets.
But, you still need to archive stuff you want to reference later. Even if it's still out there, it might be much harder to find.
