Might not be exactly what you are looking for but I use an extenstion [0] to open videos in an external video player (mpv). That way the controls are consistend and playback does not depend on where I browse.

mpv uses youtube-dl (or yt-dlp) to fetch the stream URLs and that supports many sites.

[0] https://addons.mozilla.org/de/firefox/addon/send-to-mpv-play...