hello, new to webscraper
Describe the problem.
Use https://www.webscraper.io/test-sites/e-commerce/more/ as example, i can get the pagination working with no issues. But what if prices are not shown on subcategory page, instead, one have to click into each product link to scrape price? how would i make pagination work? eg. how do i add pagination to sitemap below?
Hello Everyone, i am also new to all this things. I could scraper the rest of test sites but i have the same problem related. I need to enter in each link and also press more button. I have tried a lot but i can not make it run. Could you please help us?
I think i could get it; i dont know if it is the best option but it seems to work.
{"_id":"test","startUrl":["https://www.webscraper.io/test-sites/e-commerce/more"],"selectors":[{"id":"category","type":"SelectorLink","parentSelectors":["_root"],"selector":"ul#side-menu.nav > li > a","multiple":true,"delay":0},{"id":"item","type":"SelectorElementClick","parentSelectors":["subcategory"],"selector":"div.caption","multiple":true,"delay":"2500","clickElementSelector":"a.btn","clickType":"clickMore","discardInitialElements":false,"clickElementUniquenessType":"uniqueText"},{"id":"subcategory","type":"SelectorLink","parentSelectors":["category"],"selector":"a.subcategory-link","multiple":true,"delay":0},{"id":"link","type":"SelectorLink","parentSelectors":["item"],"selector":"a.title","multiple":true,"delay":0},{"id":"title","type":"SelectorText","parentSelectors":["link"],"selector":"h4:nth-of-type(2)","multiple":false,"regex":"","delay":0},{"id":"price","type":"SelectorText","parentSelectors":["link"],"selector":"h4.pull-right","multiple":false,"regex":"","delay":0}]}