Downloads of any file always keep stopping midway and Brave doesn't even auto resume

Downloads keep getting stopped for any file downloads with the error “Failed-Network Error” even if my internet is good and I have to manually resume it, brave doesn’t auto resume. Upon resuming manually it just continues downloading normally until it stops again after sometime.

It seems to stop more often when I watch an youtube video or do something in the background and it never stops if I just browse.

OS: Windows 10 64bit
Brave Version: Version 1.41.96 Chromium: 103.0.5060.114 (Official Build) (64-bit)

Does the issue persit when working in a private window (hold CTRL+SHIFT+N)?