Permissions USB-Devices on Websites

Hello,
I have got the new Chrome/Brave update. But now everytime i try to use my hardware wallet on the same website it asks me multiple times to allow the the connection to the usb device.

I went to the settings but there is only the possibility to “Ask” or to “Block” the connection. There is no possibility to “allow” it constantly. (Like with many other options)
I understand the securtiy aspects but this way brave gets unusable for me to do transactions with my hardware wallet. And that is in my opinion the most unsecure thing at all if i have to use a different browser i do not trust, just to make transactions which need a lot of trust…

How can i change this Setting to always “allow” a connection if a certain site asks for it?

Thanks and best regards.
Iceberg