Add GOOGLE_ABUSE_EXEMPTION cookie

[ArshansGithub]

added feature for GOOGLE_ABUSE_EXEMPTION cookie which bypasses the captcha presented by google when passed into search query (optional feature)

[opsdisk]

Hi @ArshansGithub - thanks for submitting the PR. The GOOGLE_ABUSE_EXEMPTION header is interesting...I haven't run into that before. Can you provide some more background on how they are collected/scraped? Are they part of a paid Google API offering?

[ArshansGithub]

Hey @opsdisk
Whenever google forces a captcha (to prove you're not a robot) when you solve the captcha it places the GOOGLE_ABUSE_EXEMPTION cookie into the browser to be used in further google searches. By harvesting this cookie we can place it in the scraper and further minimize rate limits, etc. No this isn't part of a Google API offering.

[opsdisk]

Appreciate the background @ArshansGithub - give me a few days to review the PR.

[ArshansGithub]

Any updates?

[ArshansGithub]

Any updates?

[opsdisk]

Apologies it took longer to get this one. Appreciate the PR @ArshansGithub!

[ArshansGithub]

Awesome stuff, thanks for the approval.