The idea is that if Sweden and Finland are not members of NATO, their airspace would be closed to NATO air forces in a NATO–Russia conflict. Then the only way to reach Baltic airspace would be flying past Kaliningrad.
Also, as far as I understand, the combat radius fighter jets is quite short. It's something like 500 to 1200 km, depending on aircraft type and weapons load. Having bases 100 or 200 km closer is already a significant advantage.