For a Linux guest, I just forward the host's pulseaudio socket over ssh.
ssh -R /run/user/1000/pulse/native:/run/user/1000/pulse/native -X the-vm the-audio-using-command
I use this VM for occasional video watching and for video conferencing and haven't had any audio problems.