Pagination AJAX /JAVA(static URL) HELP!

How to?
#1

Hi! I don´t know how to build a sitemap to scrape data from a website that works with AJAX,I mean that the URL do not change while pagination.
Now I achieved to scrape data succesfully but only in the first page.I can´t move forward in pagination to extract the other data.

I know that I have to use the tool "click on element" but I don´t know how the sitemap needs to be built with this tool to work properly.

Could anybody send me or explain me how to build a sitemap to do the job?

Thank you for your attention

#2

Hello
give us you sitemap to see more about you problem.
Thank's

#3

Hi!
This is my current sitemap,with this I can scrape only the first page:

{"_id":"lubricantesdscomponentes","startUrl":["http://www.dscomponentes.es/web/articulo/familia.php?id=77"],"selectors":[{"id":"Links","type":"SelectorLink","selector":"div.pr_imagen a","parentSelectors":["_root","next"],"multiple":true,"delay":0},{"id":"Elemento","type":"SelectorElement","selector":"div.fichaart","parentSelectors":["Links"],"multiple":true,"delay":"2000"},{"id":"Referencia","type":"SelectorText","selector":"div.REFERENCIA","parentSelectors":["Elemento"],"multiple":true,"regex":"","delay":0},{"id":"Precio","type":"SelectorText","selector":"div.precio","parentSelectors":["Elemento"],"multiple":false,"regex":"","delay":0},{"id":"Titulo","type":"SelectorText","selector":"div#descPP","parentSelectors":["Elemento"],"multiple":false,"regex":"","delay":0},{"id":"next","type":"SelectorElementClick","selector":"div.numerosProductos:nth-of-type(5)","parentSelectors":["_root"],"multiple":true,"delay":0,"clickElementSelector":"div.numerosProductos a:nth-of-type(2)","clickType":"clickMore","discardInitialElements":false,"clickElementUniquenessType":"uniqueText"}]}

Thank you so much for replying!

#4

Hi!
This is my current sitemap,with this I can scrape only the first page,see when you paginate manually on products page the URL remains static:

{"_id":"lubricantesdscomponentes","startUrl":["http://www.dscomponentes.es/web/articulo/familia.php?id=77"],"selectors":[{"id":"Links","type":"SelectorLink","selector":"div.pr_imagen a","parentSelectors":["_root","next"],"multiple":true,"delay":0},{"id":"Elemento","type":"SelectorElement","selector":"div.fichaart","parentSelectors":["Links"],"multiple":true,"delay":"2000"},{"id":"Referencia","type":"SelectorText","selector":"div.REFERENCIA","parentSelectors":["Elemento"],"multiple":true,"regex":"","delay":0},{"id":"Precio","type":"SelectorText","selector":"div.precio","parentSelectors":["Elemento"],"multiple":false,"regex":"","delay":0},{"id":"Titulo","type":"SelectorText","selector":"div#descPP","parentSelectors":["Elemento"],"multiple":false,"regex":"","delay":0},{"id":"next","type":"SelectorElementClick","selector":"div.numerosProductos:nth-of-type(5)","parentSelectors":["_root"],"multiple":true,"delay":0,"clickElementSelector":"div.numerosProductos a:nth-of-type(2)","clickType":"clickMore","discardInitialElements":false,"clickElementUniquenessType":"uniqueText"}]}

Thank you so much for replying!