Web Scraper Sitemap Closes Without Scraping – Need Help

How to?
#1

I created a sitemap, but it closes without scraping when used on the following webpage:
https://lasvegas-directory.cosmoprofnorthamerica.com/newfront/marketplace/exhibitors?pageNumber=1&limit=12

I haven’t faced this issue with other websites using the same method.

Below is the sitemap I created:

{"_id":"cosmoprofnorthamerica","startUrl":["[https://lasvegas-directory.cosmoprofnorthamerica.com/newfront/marketplace/exhibitors?pageNumber=1&limit=12"],"selectors":{"id":"Scroll","parentSelectors":["_root"],"type":"SelectorElement","selector":"div.MuiGrid-grid-md-8","multiple":true,"scroll":true,"elementLimit":0},{"id":"Exhibitors","parentSelectors":["Scroll"],"type":"SelectorLink","selector":".css-ob69bz","multiple":true,"linkType":"linkFromHref"},{"id":"Weblink","parentSelectors":["Exhibitors"],"type":"SelectorLink","selector":".css-1dckhbe a","multiple":false,"linkType":"linkFromHref"}]}

Please help check if there’s anything wrong with the sitemap setup or if the page has dynamic elements causing the issue.

#2

Hi, yes, it appears that the scroll selector is having difficulties loading the full element list. Please try the workaround below:

{"_id":"cosmoprofnorthamerica","startUrl":["https://lasvegas-directory.cosmoprofnorthamerica.com/newfront/marketplace/exhibitors?pageNumber=1&limit=12"],"selectors":[{"elementLimit":0,"id":"scroll","multiple":true,"parentSelectors":["_root"],"scroll":true,"selector":".MuiGrid-item","type":"SelectorElement"},{"elementLimit":0,"id":"scroll2","multiple":true,"parentSelectors":["_root"],"scroll":true,"selector":".MuiGrid-item","type":"SelectorElement"},{"id":"link","linkType":"linkFromHref","multiple":true,"parentSelectors":["_root"],"selector":"a.css-ejewf1","type":"SelectorLink"}]}