Hi all, it's my first time using Web Scraper. I'm trying to make a very simple bot that will scrape a single text element from a page, then click a link to the next page, scrape the same text element, and so on.
The starting URL is:
https://ebird.org/species/massal1/
If I just include the text selector (no link selector), it works just fine:
{"_id":"ebird","startUrl":["https://ebird.org/species/massal1/"],"selectors":[{"id":"Name","type":"SelectorText","parentSelectors":["_root"],"selector":"h1.Media--hero-title","multiple":false,"regex":"","delay":0}]}
If I include both the text and the link selector (with both made children of both root and the link selection) then the linking works just fine, but it no longer scrapes any data:
Sitemap:
{"_id":"ebird","startUrl":["https://ebird.org/species/massal1/"],"selectors":[{"id":"Next","type":"SelectorLink","parentSelectors":["_root","Next"],"selector":"a[data-specieslistnext]","multiple":false,"delay":0},{"id":"Name","type":"SelectorText","parentSelectors":["_root","Next"],"selector":"h1.Media--hero-title","multiple":false,"regex":"","delay":0}]}
I think I must be doing something very basic wrong. Would anyone be able to help me?
Many thanks!