Everywhere was not an infinitesimal point, if the present Universe is infinite (as it seems to be). In this case, the Universe was already infinite at the very first meaningful instant of time.

To be more pedantically precise:

The big bang was not like a firecracker that went off in pre-existing, infinite flat space-time...