I like the idea of vinyl for kids too, because of how tactile it is, but man, begin with a cheap player and cheap records. No matter how old they are, they will play with it like a toy.
The good news is my father's old slightly warped prog rock records are finally getting a lot of use.