Absolutely! Boys do the same with their dolls. :) I spent countless hours crafting physical things (block forts, mostly) and fantastical backdrops for different generations of "action figures". From 9-10 my go to was an elaborate mythology developed around Micro Machines and dinosaur figurines. Something about dead race drivers reincarnating as sentient dinos in an alternate universe, IIRC.
I was never very good at drawing, but evidence shows I did scribble a lot.
My son loved to draw, and is still pretty good but seems less interested since his early teens. He, too, spent long hours with his different dolls, in addition to the video games.
I'd say so the same things as for a girl, honestly. Provide opportunities to draw/paint/sculpt/make noise. They will do so. :)
I think it's more around school ages that things change more. And puberty, or course.