That's a common misconception but all the things that it relates to SI units are themselves redundant. There's an entire parallel system of constants and units built around it which only exists for legacy reasons, as well as people's desire to avoid very big and very small numbers.
If we started from scratch, Avogadro's number would be a simple exact power of 10 or nothing at all and we'd just tolerate extreme numbers the way computer people tolerate terabytes and electronics people tolerate picofarads. There's nothing natural or fundamental about it.