Web Scraper only take first 10 link

How to?
#1

Can anyone help me? I am trying to scrap the data from all the pages but the scraper only takes the first 10 item from 1st page

Url: https://www.tokopedia.com/search?navsource=&ob=3&srp_component_id=04.06.00.00&srp_page_id=&srp_page_title=&st=&q=food%20container%20stainless%20steel

Sitemap:
{"_id":"Tokopedia","startUrl":["https://www.tokopedia.com/search?navsource=&ob=3&srp_component_id=04.06.00.00&srp_page_id=&srp_page_title=&st=&q=food%20container%20stainless%20steel"],"selectors":[{"id":"Links","parentSelectors":["_root","Pages"],"type":"SelectorLink","selector":".css-uwyh54 a.pcv3__info-content","multiple":true,"linkType":"linkFromHref"},{"id":"Rating","parentSelectors":["Links"],"type":"SelectorText","selector":"p.css-vni7t6-unf-heading:nth-of-type(2)","multiple":false,"regex":""},{"id":"Pages","parentSelectors":["_root"],"type":"SelectorLink","selector":"button.css-bugrro-unf-pagination-item","multiple":true,"linkType":"linkFromHref"}]}

#2

you can change pages range in start URL in this part: page=[1-10]

{"_id":"Tokopedia","startUrl":["https://www.tokopedia.com/search?navsource=&ob=3&page=[1-10]&q=food%20container%20stainless%20steel&srp_component_id=04.06.00.00&srp_page_id=&srp_page_title=&st="],"selectors":[{"id":"Links","linkType":"linkFromHref","multiple":true,"parentSelectors":["_root"],"selector":"div[data-ssr=\"contentProductsSRPSSR\"] a[class*=\"info-content\"]","type":"SelectorLink"}]}
1 Like