Would not suggest vinyl for kids. That's a needle on the record player, it scratches everything up. Not easy to aim the arm to the beginning of the track.

Tapes are more foolproof. If you put them in the wrong way, the player won't close. And even though you can damage the actual tape part by mishandling it, you're not all that likely to do so.