> my Youtube consumption is via youtube-dl run on my server via cron job, with the videos then synced from there to the relevant devices

Crazy -- I have the exact same setup. Good to know other people out there have solved this issue in the same way. Having to watch things on actual youtube is such a terrible experience compared to the downloaded media.