It slows down beginners needing to make the hard jump, since romaji is never used except for signs in real life, and it just becomes a distraction to the material for anyone who is not a complete beginner. Furigana is helpful to the intermediate learner, romaji just becomes harder to read at that point.