Hello - I'm new to this and trying to collect a list of agencies from this search result which has 13 pages of data:
url: https://clutch.co/us/agencies/ppc/amazon
I have two issues:
- I can't get the scraper to collect more than one row of data event when I use the "multiple" selection and use a parent/child selector setup
- I can't get the scraper to pull data from all the pages
The data I'm try to collect on each agency: name, location, rating, number of reviews, service focus, PPC focus and website URL
Sitemap:
{"_id":"clutchpagination","startUrl":["https://clutch.co/us/agencies/ppc/amazon","https://clutch.co/us/agencies/ppc/amazon?page=1"],"selectors":[{"id":"pagination","parentSelectors":["_root","pagination"],"type":"SelectorLink","selector":"a[data-page]","multiple":true,"linkType":"linkFromHref"},{"id":"collector","parentSelectors":["_root","pagination"],"type":"SelectorElement","selector":"ul.directory-list","multiple":true},{"id":"name","parentSelectors":["collector"],"type":"SelectorText","selector":"a.company_title","multiple":false,"regex":""},{"id":"location","parentSelectors":["collector"],"type":"SelectorText","selector":"span.locality","multiple":false,"regex":""},{"id":"childrating","parentSelectors":["collector"],"type":"SelectorText","selector":"span.rating","multiple":false,"regex":""},{"id":"reviews","parentSelectors":["collector"],"type":"SelectorText","selector":"a.reviews-link","multiple":false,"regex":""},{"id":"servicefocus","parentSelectors":["collector"],"type":"SelectorText","selector":".directory-main-bar .chart-label > span","multiple":false,"regex":""},{"id":"ppcfocus","parentSelectors":["collector"],"type":"SelectorText","selector":".directory-secondary-bar .chart-label > span","multiple":false,"regex":""}]}
Appreciate any help on how to properbly set up the sitemap. Thank you!