Data scraping kings 4x4

How to?
#1

ive tried for a few hours to try and scrape this page with zero luck

{"_id":"4x4","startUrl":["https://www.4wdsupacentre.com.au/specials/combo-deals.html"],"selectors":[{"id":"wrapper","parentSelectors":["_root"],"type":"SelectorElement","selector":"div.items-1IC","multiple":true},{"id":"title","parentSelectors":["wrapper"],"type":"SelectorText","selector":"div:nth-of-type(1) .name-1QF a","multiple":false,"regex":""},{"id":"rrp","parentSelectors":["wrapper"],"type":"SelectorText","selector":"div:nth-of-type(1) div.priceLine-1H-","multiple":false,"regex":""}]}

please help, I need to go into each page and grab RRP, Title and saving

#2

try this sitemap:

{"_id":"4x4","startUrl":["Home Page - Adventure Kings[aria-label='move to the next page']","clickElementUniquenessType":"uniqueCSSSelector","clickType":"clickMore","delay":4000,"discardInitialElements":"do-not-discard","id":"wrapper","multiple":true,"parentSelectors":["_root"],"selector":"div.root-2fi","type":"SelectorElementClick"},{"id":"title","multiple":false,"parentSelectors":["wrapper"],"regex":"","selector":".name-1QF a","type":"SelectorText"},{"id":"rrp","multiple":false,"parentSelectors":["wrapper"],"regex":"","selector":"div.priceLine-1H-","type":"SelectorText"}]}

Note: It will scroll through all 196 pages before any results are viewable

#3

abnormal situation.... there is much easier way to scrape what is desired:
use page range:
https://www.4wdsupacentre.com.au/specials/combo-deals.html?page=[1-3]
for first 3 pages... and no clicks on more.....
Get some knowledge....

#4

Did you actually try that method? If you did, you’d see it doesn’t work.

#5

This post was flagged by the community and is temporarily hidden.

#6

I wasn't the one asking the question,I provided a solution that works fine and handles all the clicks and pagination without any issues. Plus, I did it without any condescension.

#7

that link does not work btw

#8

this dosent even scrap properly btw, data does not link up

#9

It was deleted after a week by file.io...

#10

2352 links from 66 pages were collected in less than 5 minutes...
https://files.fm/u/ztxr6hhhys

The rest should be done by your own...

#11

everytime i tried to scrape the data off this page its not brining in the RRP that's on each just brings it in as $41.80 for every single line

#12

wait got it working

{"_id":"kings4x4","startUrl":["Home Page - Adventure Kings a","type":"SelectorText"},{"id":"wrapper_for_rrp_desc","multiple":true,"parentSelectors":["_root"],"selector":"div.root-2fi","type":"SelectorElement"},{"id":"per off","multiple":false,"parentSelectors":["wrapper_for_rrp_desc"],"regex":"","selector":"div.savingsPricePill-1Mf","type":"SelectorText"}]}

but its not scrolling and selecting next page