"LOAD MORE" does not load the subsequent pages

How to?
#1

Good morning,

I can't proceed with the extraction because LOAD MORE is set incorrectly. The data extraction is perfect but it stops only at the results of the first page of the search results because LOAD MORE does not load the subsequent pages. Can anyone help me make this work?

THANK YOU

Below my Sitemap:
{"_id":"8genn","startUrl":["https://annunci.secondamanoitalia.it/annunci/annunci-cat/auto-e-moto/"],"selectors":[{"clickActionType":"real","clickElementSelector":"button.btn-lg","clickElementUniquenessType":"uniqueText","clickType":"clickOnce","delay":2000,"discardInitialElements":"do-not-discard","id":"Pagination","multiple":true,"parentSelectors":["_root"],"selector":"div.directorypress-container-fluid","type":"SelectorElementClick"},{"id":"Link","linkType":"linkFromHref","multiple":true,"parentSelectors":["Pagination"],"selector":"article:nth-of-type(n+3) h2 a","type":"SelectorLink"},{"id":"Titolo","multiple":false,"parentSelectors":["Link"],"regex":"","selector":"h2[itemprop='name']","type":"SelectorText"},{"id":"PubblicatoDa","multiple":false,"parentSelectors":["Link"],"regex":"","selector":"p.author-name","type":"SelectorText"},{"id":"CategoriaFull","multiple":false,"parentSelectors":["Link"],"regex":"","selector":".directorypress-field-type-categories span.field-content","type":"SelectorText"},{"id":"Categoria","multiple":false,"parentSelectors":["Link"],"regex":"","selector":"span:nth-of-type(1) a","type":"SelectorText"},{"id":"SottoCategoria","multiple":false,"parentSelectors":["Link"],"regex":"","selector":"span.directorypress-label:nth-of-type(2) a","type":"SelectorText"},{"id":"Prezzo","multiple":false,"parentSelectors":["Link"],"regex":"","selector":"span.symbol-left","type":"SelectorText"},{"id":"Email","multiple":false,"parentSelectors":["Link"],"regex":"","selector":".directorypress-field-type-email a","type":"SelectorText"},{"id":"Telefono","multiple":false,"parentSelectors":["Link"],"regex":"","selector":".field-phone-content a","type":"SelectorText"},{"id":"Condizioni","multiple":false,"parentSelectors":["Link"],"regex":"","selector":".directorypress-field-type-select span.field-content","type":"SelectorText"},{"id":"Descrizione","multiple":false,"parentSelectors":["Link"],"regex":"","selector":"[itemprop='description'] p","type":"SelectorText"},{"id":"CAP","multiple":false,"parentSelectors":["Link"],"regex":"","selector":"[itemprop='address'] span:nth-of-type(3)","type":"SelectorText"},{"id":"CittaRegione","multiple":false,"parentSelectors":["Link"],"regex":"","selector":"[itemprop='address'] span:nth-of-type(2)","type":"SelectorText"},{"id":"Indirizzo","multiple":false,"parentSelectors":["Link"],"regex":"","selector":"[itemprop='address'] span:nth-of-type(1)","type":"SelectorText"},{"id":"IndirizzoFull","multiple":false,"parentSelectors":["Link"],"regex":"","selector":".directorypress-field-type-address span.field-content","type":"SelectorText"},{"id":"FotoPrincipale","multiple":false,"parentSelectors":["Link"],"selector":".slick-current .slide-link img","type":"SelectorImage"}]}

#2

here is a sitemap.... I suppose there are too many clicks should be done. and Webscraper stops without any results after 20 minutes of scraping... I added a smaller category to be scraped and it was performed effectively... Have a try...

{"_id":"8genn","startUrl":["https://annunci.secondamanoitalia.it/annunci/annunci-cat/auto-e-moto/"],"selectors":[{"clickActionType":"real","clickElementSelector":"button.directorypress-show-more-button","clickElementUniquenessType":"uniqueCSSSelector","clickType":"clickMore","delay":2000,"discardInitialElements":"do-not-discard","id":"Pagination","multiple":true,"parentSelectors":["_root"],"selector":"body","type":"SelectorElementClick"},{"id":"Link","linkType":"linkFromHref","multiple":true,"parentSelectors":["Pagination"],"selector":"h2 a","type":"SelectorLink"},{"id":"Titolo","multiple":false,"parentSelectors":["Link"],"regex":"","selector":"h2[itemprop='name']","type":"SelectorText"},{"id":"PubblicatoDa","multiple":false,"parentSelectors":["Link"],"regex":"","selector":"p.author-name","type":"SelectorText"},{"id":"CategoriaFull","multiple":false,"parentSelectors":["Link"],"regex":"","selector":".directorypress-field-type-categories span.field-content","type":"SelectorText"},{"id":"Categoria","multiple":false,"parentSelectors":["Link"],"regex":"","selector":"span:nth-of-type(1) a","type":"SelectorText"},{"id":"SottoCategoria","multiple":false,"parentSelectors":["Link"],"regex":"","selector":"span.directorypress-label:nth-of-type(2) a","type":"SelectorText"},{"id":"Prezzo","multiple":false,"parentSelectors":["Link"],"regex":"","selector":"span.symbol-left","type":"SelectorText"},{"id":"Email","multiple":false,"parentSelectors":["Link"],"regex":"","selector":".directorypress-field-type-email a","type":"SelectorText"},{"id":"Telefono","multiple":false,"parentSelectors":["Link"],"regex":"","selector":".field-phone-content a","type":"SelectorText"},{"id":"Condizioni","multiple":false,"parentSelectors":["Link"],"regex":"","selector":".directorypress-field-type-select span.field-content","type":"SelectorText"},{"id":"Descrizione","multiple":false,"parentSelectors":["Link"],"regex":"","selector":"[itemprop='description'] p","type":"SelectorText"},{"id":"CAP","multiple":false,"parentSelectors":["Link"],"regex":"","selector":"[itemprop='address'] span:nth-of-type(3)","type":"SelectorText"},{"id":"CittaRegione","multiple":false,"parentSelectors":["Link"],"regex":"","selector":"[itemprop='address'] span:nth-of-type(2)","type":"SelectorText"},{"id":"Indirizzo","multiple":false,"parentSelectors":["Link"],"regex":"","selector":"[itemprop='address'] span:nth-of-type(1)","type":"SelectorText"},{"id":"IndirizzoFull","multiple":false,"parentSelectors":["Link"],"regex":"","selector":".directorypress-field-type-address span.field-content","type":"SelectorText"},{"extractAttribute":"href","id":"img_1","multiple":false,"parentSelectors":["Link"],"selector":"#images a","type":"SelectorElementAttribute"},{"extractAttribute":"href","id":"img","parentSelectors":["Link"],"selector":".slick-track .slide-link","type":"SelectorGroup"}]}
1 Like
#3

Thanks a lot! I will try today if it will work. :slight_smile: