Pagination + image issue

Hi everyone :slight_smile:

Having a couple of issues with a sitemap on a property website.

1: Can only extract 1 image (despite being configured for several).

2: Pagination of pages (Working but not scraping the data)

Tried hundreds of times over past few months but still no success.

Have even contacted webscraper directly and have redirected me here for assistance.

If any of you wiz's out there could please take a look it's very much appreciated indeed.

Kind regards,

Site to be scraped: www.daft.ie

Current Sitemap:

{"_id":"daft-test","startUrl":["https://www.daft.ie/kilkenny/property-for-sale/"],"selectors":[{"id":"links","type":"SelectorLink","parentSelectors":["_root"],"selector":"div:nth-of-type(n+3) a.PropertyInformationCommonStyles__propertyPrice--link","multiple":true,"delay":0},{"id":"Title","type":"SelectorText","parentSelectors":["links"],"selector":"h1","multiple":false,"regex":"","delay":0},{"id":"price","type":"SelectorText","parentSelectors":["links"],"selector":"strong.PropertyInformationCommonStyles__costAmountCopy","multiple":false,"regex":"","delay":0},{"id":"address","type":"SelectorText","parentSelectors":["links"],"selector":"h1","multiple":false,"regex":"","delay":0},{"id":"eircode","type":"SelectorText","parentSelectors":["links"],"selector":"div.PropertyMainInformation__eircode","multiple":false,"regex":"","delay":0},{"id":"bed","type":"SelectorText","parentSelectors":["links"],"selector":"div.QuickPropertyDetails__iconCopy","multiple":false,"regex":"","delay":0},{"id":"bath","type":"SelectorText","parentSelectors":["links"],"selector":"div.QuickPropertyDetails__iconCopy--WithBorder","multiple":false,"regex":"","delay":0},{"id":"overview","type":"SelectorText","parentSelectors":["links"],"selector":"div.PropertyOverview__propertyOverviewDetails","multiple":false,"regex":"","delay":0},{"id":"Des","type":"SelectorText","parentSelectors":["links"],"selector":"p.PropertyDescription__propertyDescription","multiple":false,"regex":"","delay":0},{"id":"img1","type":"SelectorImage","parentSelectors":["links"],"selector":"img.PropertyImage__mainImageLarge","multiple":false,"delay":0},{"id":"cli1","type":"SelectorElementClick","parentSelectors":["links"],"selector":"img.PropertyImage__mainImageLarge","multiple":false,"delay":0,"clickElementSelector":"img.PropertyImage__mainImageLarge","clickType":"clickOnce","discardInitialElements":"do-not-discard","clickElementUniquenessType":"uniqueText"},{"id":"cli2","type":"SelectorElementClick","parentSelectors":["links"],"selector":"div#pbxl_right_arrow","multiple":false,"delay":0,"clickElementSelector":"div#pbxl_right_arrow","clickType":"clickOnce","discardInitialElements":"do-not-discard","clickElementUniquenessType":"uniqueText"},{"id":"clicktel","type":"SelectorElementClick","parentSelectors":["links"],"selector":"button.ContactForm__secondaryButton","multiple":false,"delay":0,"clickElementSelector":"button.ContactForm__secondaryButton","clickType":"clickOnce","discardInitialElements":"do-not-discard","clickElementUniquenessType":"uniqueText"},{"id":"tel","type":"SelectorText","parentSelectors":["links"],"selector":"button.ContactForm__secondaryButton","multiple":false,"regex":"","delay":0},{"id":"pag","type":"SelectorLink","parentSelectors":["_root","pag"],"selector":".paging a","multiple":true,"delay":0}]}

Url: http://example.com

Sitemap:
{id:"sitemap code"}

The URLs do change consistently with each new page, so you can use the Specify multiple URLs with ranges method. No need to create your own paginator.

1 Like