URL: https://cloud.withgoogle.com/partners/?regions=EMEA_REGION
Problem 1:
I want to scrape a set of information for each Google Partner (eg name, bio description, expertise, specialization, location), but my link element sometimes just doesn't work. I can run the scrape like 10 times and it only works about 2/10 times.
Problem 2:
I can't get any scrape to work when I add a click element on the "Load more partners" button at the bottom. I've tried all the various options and moving the selectors to different parents etc. I want to scrape the info for all 3007 links. Thank you!!!!!
Sitemap:
{"_id":"googlepartnersv3","startUrl":["https://cloud.withgoogle.com/partners/?regions=EMEA_REGION"],"selectors":[{"id":"partner","type":"SelectorLink","parentSelectors":["_root"],"selector":"a.card__box","multiple":true,"delay":0},{"id":"Partner name","type":"SelectorText","parentSelectors":["partner"],"selector":"div.detail-hero__title","multiple":false,"regex":"","delay":0},{"id":"specialisations","type":"SelectorText","parentSelectors":["partner"],"selector":"div.detail-section__box:nth-of-type(2)","multiple":false,"regex":"","delay":0},{"id":"Expertise","type":"SelectorText","parentSelectors":["partner"],"selector":"div.detail-section__box:nth-of-type(3)","multiple":false,"regex":"","delay":0},{"id":"Bio description","type":"SelectorText","parentSelectors":["partner"],"selector":"div.detail-description","multiple":false,"regex":"","delay":0},{"id":"Locations","type":"SelectorText","parentSelectors":["partner"],"selector":"div.detail-locations","multiple":false,"regex":"","delay":0}]}