I think this is the intended behavior — icons appearing in this area (as I understand it) are active in some way, and not all extensions run/need to run in the background. Even if you have Brave set to Continue running background apps when Brave is closed, there may not actually be anything running which would explain why it appears when you enable certain extensions.
I have reached out to confirm that this is in fact the behavior.