I'm having trouble figuring out how to pull data from an individual product link, while still running the pagination on the original product results page.
I.e. For the example I've shown below, I'd like to be able to select all the washroom faucets (using pagination), pull some initial data from the product list such as description, model, image AND THEN pull in additional data by clicking on each product and extracting more data from that individual product page.
As of now, I've figured out a way to either drill down into each product page and extract the data (but only for the first 40 product results) OR to pull data only from the product results page (all 280 results, using pagination). I want to be able to do both at once. Please help!
https://www.moen.ca/bathroom/faucets/sink-faucets
Sitemap:
{"_id":"moenbathtest2","startUrl":["https://www.moen.ca/bathroom/faucets/sink-faucets"],"selectors":[{"id":"item","type":"SelectorElementClick","parentSelectors":["_root"],"selector":"a.tile","multiple":true,"delay":"2000","clickElementSelector":"div.row button.button","clickType":"clickMore","discardInitialElements":true,"clickElementUniquenessType":"uniqueText"},{"id":"desc","type":"SelectorText","parentSelectors":["item"],"selector":"p.product-tile__name","multiple":false,"regex":"","delay":0},{"id":"model","type":"SelectorText","parentSelectors":["item"],"selector":"p.product-tile__sku","multiple":false,"regex":"","delay":0},{"id":"image","type":"SelectorImage","parentSelectors":["item"],"selector":"img.product-tile__image","multiple":false,"delay":0}]}