In reality there are limits; there's no reason to think technology can improve indefinitely. We may still be far from those limits, as e.g. Drexler's books show, but fundamental rules such as "Effort requires energy input" are unlikely to ever change, and it's equally unlikely that most modern scientists would regard limit-tech as being magic.
As for the average guy on the street, he probably considers computers to be magic...