Pagination help please :)

How to?
#1

Hi, Newbie here just trying to get my head around continuing to scape on additional pages. Below is link & I'm not sure how to do it.

Does 1 solution fit all or does it depend how pages are created in the 1st place?

Thanks in advance.

Url: http://www.domayneonline.com.au/electronics/home-appliances/

My Sitemap so far:
{"_id":"domaynehomeappliances","startUrl":["http://www.domayneonline.com.au/electronics/home-appliances/page-5/"],"selectors":[{"id":"Item","type":"SelectorLink","selector":"a.product-title","parentSelectors":["_root"],"multiple":true,"delay":0},{"id":"Model","type":"SelectorText","selector":"small.product-id","parentSelectors":["Item"],"multiple":false,"regex":"","delay":0}]}

#2

Hello
test this solution:

{"_id":"domayne","startUrl":["http://www.domayneonline.com.au/electronics/home-appliances/"],"selectors":[{"id":"link","type":"SelectorLink","selector":"a.product-title","parentSelectors":["_root","pagination"],"multiple":true,"delay":0},{"id":"Model","type":"SelectorText","selector":"small.product-id","parentSelectors":["link"],"multiple":false,"regex":"","delay":0},{"id":"title","type":"SelectorText","selector":"h1.product-title","parentSelectors":["link"],"multiple":false,"regex":"","delay":0},{"id":"element","type":"SelectorElement","selector":"form.cm-disable-empty-files div.well","parentSelectors":["link"],"multiple":false,"delay":0},{"id":"price","type":"SelectorText","selector":"div.price-group-wrap div","parentSelectors":["element"],"multiple":false,"regex":"","delay":0},{"id":"pagination","type":"SelectorLink","selector":"div.push-out li:nth-of-type(n+3) a.cm-history","parentSelectors":["_root","pagination"],"multiple":true,"delay":0}]}

1 Like
#3

Thank you so much @chefas

That appeared to have worked

Really appreciate it.

#4

As a matter of interest, is pagination dealt with the same way on any site or does it depend on how a site is set up?

#5

Hello, my experience about this subject is that standards exist but sometimes developers deviate by adopting different methods of programming pagination that make difficult or impossible scraping with this tool.