Hi,
I have been using Web Scraper for a few years and never come this problem. I have built a simple scraper for Trustpilot, but it neither collects data nor does the pagination work. I have tried it on a single page as well and it does not collect that data.
Is this a problem with my site map? Or have Trust Pilot somehow managed to block this? I saw someone managed to solve a similar problem with Firefox but for the moment I am restricted to Chrome. Any help, even if it's just why Trustpilot doesn't work would be much appreciated.
Url: https://uk.trustpilot.com/review/www.sosandar.com
Sitemap:
{"_id":"boohoo_trustpilot","startUrl":["https://uk.trustpilot.com/review/www.boohoo.com"],"selectors":[{"id":"pagination","type":"SelectorLink","parentSelectors":["_root","pagination"],"selector":".pagination-container a:nth-of-type(n+2)","multiple":true,"delay":0},{"id":"review","type":"SelectorElement","parentSelectors":["_root","pagination"],"selector":"article","multiple":true,"delay":0},{"id":"rating_and_date","type":"SelectorHTML","parentSelectors":["review"],"selector":"div.review-content-header","multiple":false,"regex":"","delay":0}]}
Thanks,
Henry