Brave taking time at first launch because of GPG

When starting Brave, it takes around 30 seconds to launch. During this time, nothing (visually) happens. Then, a Brave window opens and I’m prompt to enter my passphrase for GPG. After this, if I close brave and reopen it, it is instant, without getting prompt by GPG.

If I restart my computer, it happens again.

I assume this first starting time is due to GPG. How can I check this? If this is true, how to fix it?