Element Click Pagination - I cannot extract data

How to?
#1

Goodmoarning,

I am tring to use Element Click in order to extract some information from dinamic pagination. I need to extract contact information from a farm's webisite (email, phone etc.).

https://www.campagnamica.it/venditadomicilio/fattorie-agricole-siciliane-associate/

I cannot understand why, after 2 iteration my sitemap end the job without extracting any data.
I have seen differet other posts around the forum but I cannot find the answer for my case.

Could you please help me?

Thnaks :slight_smile:

Sitemap:
{"_id":"campagna_amica","startUrl":["https://www.campagnamica.it/la-nostra-rete/le-fattorie/"],"selectors":[{"id":"click-pagination","type":"SelectorElementClick","parentSelectors":["_root"],"selector":"div.text","multiple":true,"delay":"0","clickElementSelector":"a.load-next","clickType":"clickMore","discardInitialElements":"do-not-discard","clickElementUniquenessType":"uniqueCSSSelector"},{"id":"produttore","type":"SelectorLink","parentSelectors":["click-pagination"],"selector":"parent","multiple":true,"delay":0},{"id":"nome","type":"SelectorText","parentSelectors":["produttore"],"selector":"h1","multiple":false,"regex":"","delay":0},{"id":"email","type":"SelectorText","parentSelectors":["produttore"],"selector":"a[itemprop='email']","multiple":false,"regex":"","delay":0},{"id":"contact","type":"SelectorText","parentSelectors":["produttore"],"selector":"span[itemprop='member']","multiple":false,"regex":"","delay":0},{"id":"city-state","type":"SelectorText","parentSelectors":["produttore"],"selector":"div[itemprop='addressRegion']","multiple":false,"regex":"","delay":0},{"id":"phone","type":"SelectorText","parentSelectors":["produttore"],"selector":"li:nth-of-type(4) span[itemprop='telephone']","multiple":false,"regex":"","delay":0}]}

#2

Someone can help me, please? :slight_smile:

#3

Try this, it will take some time initially to click all the Load More:

{"_id":"forum-campagna_amica-may","startUrl":["https://www.campagnamica.it/la-nostra-rete/le-fattorie/"],"selectors":[{"id":"click-pagination","type":"SelectorElementClick","parentSelectors":["_root"],"selector":"article[class^='box']","multiple":true,"delay":"3500","clickElementSelector":"a.load-next","clickType":"clickMore","discardInitialElements":"do-not-discard","clickElementUniquenessType":"uniqueCSSSelector"},{"id":"produttore","type":"SelectorLink","parentSelectors":["click-pagination"],"selector":"a","multiple":false,"delay":0},{"id":"nome","type":"SelectorText","parentSelectors":["produttore"],"selector":"h1","multiple":false,"regex":"","delay":0},{"id":"email","type":"SelectorText","parentSelectors":["produttore"],"selector":"a[itemprop='email']","multiple":false,"regex":"","delay":0},{"id":"contact","type":"SelectorText","parentSelectors":["produttore"],"selector":"span[itemprop='member']","multiple":false,"regex":"","delay":0},{"id":"city-state","type":"SelectorText","parentSelectors":["produttore"],"selector":"div[itemprop='addressRegion']","multiple":false,"regex":"","delay":0},{"id":"phone","type":"SelectorText","parentSelectors":["produttore"],"selector":"li span[itemprop='telephone']","multiple":false,"regex":"","delay":0}]}

#4

Hi all,
I t seems that I am having similar issue . scraping end after 50 iterations.
Could you help me ? I have initially revised it based on the response above.
{"_id":"cilss","startUrl":["https://agrictrade.net/trade-data/"],"selectors":[{"id":"page","type":"SelectorElementClick","parentSelectors":["_root"],"selector":".container_wrap_first div.container","multiple":true,"delay":"3500","clickElementSelector":"a.next","clickType":"clickMore","discardInitialElements":"discard","clickElementUniquenessType":"uniqueCSSSelector"},{"id":"table","type":"SelectorTable","parentSelectors":["page"],"selector":"table","multiple":true,"columns":[{"header":"collection id","name":"collection id","extract":false},{"header":"Product","name":"Product","extract":false},{"header":"Animal","name":"Animal","extract":false},{"header":"load point","name":"load point","extract":true},{"header":"Country of Origin","name":"Country of Origin","extract":false},{"header":"collection point","name":"collection point","extract":false},{"header":"means of transport","name":"means of transport","extract":false},{"header":"collection country","name":"collection country","extract":false},{"header":"unloading point","name":"unloading point","extract":true},{"header":"Country of Destination","name":"Country of Destination","extract":false},{"header":"Date of collection","name":"Date of collection","extract":true},{"header":"Number of packs","name":"Number of packs","extract":false},{"header":"Unit price per pack","name":"Unit price per pack","extract":false},{"header":"Weight per pack","name":"Weight per pack","extract":false},{"header":"cost of transport","name":"cost of transport","extract":false},{"header":"number of big","name":"number of big","extract":false},{"header":"price of big","name":"price of big","extract":false},{"header":"number of medium","name":"number of medium","extract":false},{"header":"price of medium","name":"price of medium","extract":false},{"header":"number of small","name":"number of small","extract":false},{"header":"price of small","name":"price of small","extract":false},{"header":"Unit","name":"Unit","extract":false},{"header":"other fees","name":"other fees","extract":false},{"header":"total value FOB","name":"total value FOB","extract":false},{"header":"total value CAF","name":"total value CAF","extract":false},{"header":"CPC Regime","name":"CPC Regime","extract":false},{"header":"customs passage","name":"customs passage","extract":false},{"header":"declaration number","name":"declaration number","extract":false},{"header":"currency","name":"currency","extract":false},{"header":"Association","name":"Association","extract":false}],"delay":0,"tableDataRowSelector":"tbody tr","tableHeaderRowSelector":"thead tr"}]}