Seeing it not work in Microsoft Edge made me think it was a problem with windows. I searched and found this article. https://answers.microsoft.com/en-us/windows/forum/all/videos-wont-play-until-i-restart-the-windows-audio/cafaad32-997f-4212-a485-301eae7a0861
I ran the windows audio troubleshooter and it updated my audio driver and videos started playing. Going to try shutting down and turning on to see if I still get the issue.
EDIT: That appears to have fixed this issue. It was an issue with my audio drivers not Brave. Thanks for the help though!!