"Stimulant drugs do improve the ability (even without ADHD) to focus and pay attention. One function, which is reliably improved by stimulant medications, is sustained attention, or vigilance. Stimulants improve sustained, focused attention, but “selective attention” and “distractibility” may be worsened, possibly because of a drug induced increase in impulsivity."

And that seems to contradict your point.