Obviously scraping is problematic to search engines and other high quality sources, but the irony here!
Google has upped its anti-scraping measures over the past year by fingerprinting clients.
- JS required
- Fingerprints Desktops using
navigator.userAgentData.getHighEntropyValues - Fingerprints mobile by evaluating touch metrics
- Basically if you switch user agents, your browser needs to behave like that user agent