Any java performance test is generally done against a warmed up VM - which would be representative of the 99.99% of the time the app is running. With or without spring boot.
A java application should be able to start in seconds. An inability to do so is the surefire litmus test for pulling in too many dependencies.