Hello everyone,
I'm trying to get information about the products from https://www.mepcontent.com/en/bim-files/ . I'm looking for product name, description, image and manufacturer name and logo. The problem is that manufacturer information is extracted from another link (within product link), which can repeat on multiple products. The result I get is only one product per manufacturer is scraped. How do I get all the products even if the manufacturer is the same?
Url: https://www.mepcontent.com/en/bim-files/
Sitemap:
{"_id":"mepcontentwithpagination","startUrl":["https://www.mepcontent.com/en/bim-files/?qtm=1546957817351&page=27"],"selectors":[{"id":"ProductLink","type":"SelectorLink","parentSelectors":["_root"],"selector":"figcaption.details-hover a.overlay-link","multiple":true,"delay":0},{"id":"ProductName","type":"SelectorText","parentSelectors":["ProductLink"],"selector":"h1.page-title","multiple":false,"regex":"","delay":0},{"id":"ProductDescription","type":"SelectorText","parentSelectors":["ProductLink"],"selector":"div.col-md-8 div.row:nth-of-type(1) div.col-xs-12","multiple":false,"regex":"","delay":0},{"id":"ProductImage","type":"SelectorImage","parentSelectors":["ProductLink"],"selector":"div.overlay-container img.center-block","multiple":false,"delay":0},{"id":"ProductManufacturerLink","type":"SelectorLink","parentSelectors":["ProductLink"],"selector":"span.partial-content div.row:nth-of-type(1) a","multiple":false,"delay":0},{"id":"ProductManufacturerName","type":"SelectorText","parentSelectors":["ProductManufacturerLink"],"selector":"h1.page-title","multiple":false,"regex":"","delay":0},{"id":"ProductManufacturerImage","type":"SelectorImage","parentSelectors":["ProductManufacturerLink"],"selector":"figure img.img-responsive","multiple":false,"delay":0}]}