It seems you can on Android. Just close the video and start playback from the drop-down notification. I get audio only but I don't remember if I did that before I started paying for YT.