High memory usage when idle or downloading

This seems to be a common issue for me, I have tried the basic troubleshooting steps and none of it seems to fix this, and I have no addons running in the background. It happens when I either leave the browser running the background or if a file or torrent is being downloaded. It uses anywhere from 1GB to 16GB of ram, I have 32GB of ram on my computer. How can fix this, also brave rewards is hot garbage.