Description of the issue:
I am trying to mimic a browser to access the following test URL in curl.
I opened a new private window in Firefox to access the following URL, then copied the curl command and run it. But it retrieved a page saying “Checking your browser before accessing etf.com.” However, the same request in Brave can retrieve the HTML content without any problems.
curl ‘https://www.etf.com/KOMP’
-H ‘Connection: keep-alive’
-H ‘Upgrade-Insecure-Requests: 1’
-H ‘User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.54 Safari/537.36’
-H ‘Accept: text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,/;q=0.8,application/signed-exchange;v=b3;q=0.9’
-H ‘Sec-GPC: 1’
-H ‘Sec-Fetch-Site: none’
-H ‘Sec-Fetch-Mode: navigate’
-H ‘Sec-Fetch-User: ?1’
-H ‘Sec-Fetch-Dest: document’
-H ‘Accept-Language: en-US,en;q=0.9’
–compressed
This seems to be related with a cipher suite issue.
Does anybody know how get a more comprehensive curl command so that it exactly mimic what the browser does include cypher suite?
How can this issue be reproduced?
See above
Expected result:
See above
Brave Version( check About Brave):
It doesn’t matter.
Additional Information:
NA.