Hi All,
I am trying to scrape search results from this website, but the pagination fails to click through more than 2 pages. I have the strange feeling that they somehow are preventing scraping. Am I right?
Doesnt go beyond 3rd page in the above link.
Sitemap:
{"_id":"swedish2","startUrl":["https://www.hemnet.se/bostader?expand_locations=2000&item_types[]=bostadsratt&location_ids[]=898472&page=1&rooms_min=2"],"selectors":[{"id":"next page","type":"SelectorElementClick","parentSelectors":["_root"],"selector":"a.next_page.button.button--primary","multiple":true,"delay":"7000","clickElementSelector":"a.next_page.button.button--primary","clickType":"clickMore","discardInitialElements":"do-not-discard","clickElementUniquenessType":"uniqueText"}]}