Https://www.bestprice.in/

How to?
#1

Describe the problem.
Problem is while scraping it is missing some mrp, sometimes name, and sometimes other fields

Url: https://www.bestprice.in/

Sitemap:
{"_id":"bestprice","startUrl":["http://bestpricewholesale.co.in"],"selectors":[{"id":"Category","type":"SelectorLink","selector":"li.l2:nth-of-type(n+4) > a","parentSelectors":["_root"],"multiple":true,"delay":0},{"id":"SubCategory","type":"SelectorLink","selector":"li.mtc-block li.mtc-block a.mtc-a","parentSelectors":["Category"],"multiple":true,"delay":0},{"id":"Items","type":"SelectorElement","selector":"div.bucket_left","parentSelectors":["SubCategory"],"multiple":true,"delay":0},{"id":"ProductImage","type":"SelectorImage","selector":"img.mtb-img","parentSelectors":["Items"],"multiple":true,"delay":0},{"id":"ProductName","type":"SelectorText","selector":"h4.mtb-title","parentSelectors":["Items"],"multiple":true,"regex":"","delay":0},{"id":"MRP","type":"SelectorText","selector":"label.mtb-mrp span.sp_amt","parentSelectors":["Items"],"multiple":true,"regex":"","delay":0},{"id":"ItemNo","type":"SelectorText","selector":"div.sku","parentSelectors":["Items"],"multiple":true,"regex":"","delay":0},{"id":"PPrice","type":"SelectorText","selector":"label.mtb-ofr span.sp_amt","parentSelectors":["Items"],"multiple":true,"regex":"","delay":0}]}

#2

Hello,

can't help you because it needs a login ...

Have you got a login + psw for testing ? if so Can you send it

Thanks

#3

UserName 8303699990
Password @#kritika2010

#4

Hello,

At the end of the tree, for Product, MRP, price ... don't select the multiple option.

For you SubCategory use a "Element scroll down selector".

{"_id":"test","startUrl":["http://bestpricewholesale.co.in"],"selectors":[{"id":"Category","type":"SelectorLink","selector":"li.l2:nth-of-type(n+4) > a","parentSelectors":["_root"],"multiple":true,"delay":0},{"id":"SubCategory","type":"SelectorElementScroll","selector":"div.bucket_left","parentSelectors":["Category"],"multiple":true,"delay":0},{"id":"link","type":"SelectorLink","selector":"a:nth-of-type(1)","parentSelectors":["SubCategory"],"multiple":true,"delay":0},{"id":"ProductImage","type":"SelectorImage","selector":"div.zoomPad img.product-largimg","parentSelectors":["link"],"multiple":false,"delay":0},{"id":"ProductName","type":"SelectorText","selector":"div.ctl_aboutbrand h1","parentSelectors":["link"],"multiple":false,"regex":"","delay":0},{"id":"MRP","type":"SelectorText","selector":"span.productmrp","parentSelectors":["link"],"multiple":false,"regex":"","delay":0},{"id":"ItemNo","type":"SelectorText","selector":"div.rightpane div.sku","parentSelectors":["link"],"multiple":false,"regex":"","delay":0},{"id":"PPrice","type":"SelectorText","selector":"span.offer span.sp_amt","parentSelectors":["link"],"multiple":false,"regex":"","delay":0}]}

#5

this script only scrap 800 data while website is having 6000+ data and also image links for just 50

{"_id":"best","startUrl":["https://www.bestprice.in"],"selectors":[{"id":"Category","type":"SelectorLink","selector":"li.l2:nth-of-type(n+4) > a","parentSelectors":["_root"],"multiple":true,"delay":0},{"id":"SubCategory","type":"SelectorLink","selector":"li.mtc-block li.mtc-block a.mtc-a","parentSelectors":["Category"],"multiple":true,"delay":0},{"id":"subCat","type":"SelectorElementScroll","selector":"div.bucket_left","parentSelectors":["SubCategory"],"multiple":true,"delay":0},{"id":"link","type":"SelectorLink","selector":"a:nth-of-type(1)","parentSelectors":["subCat"],"multiple":true,"delay":0},{"id":"ProductImage","type":"SelectorImage","selector":"div.zoomPad img.product-largimg","parentSelectors":["link"],"multiple":false,"delay":0},{"id":"ProductName","type":"SelectorText","selector":"div.ctl_aboutbrand h1","parentSelectors":["link"],"multiple":false,"regex":"","delay":0},{"id":"MRP","type":"SelectorText","selector":"span.productmrp","parentSelectors":["link"],"multiple":false,"regex":"","delay":0},{"id":"ItemNo","type":"SelectorText","selector":"div.rightpane div.sku","parentSelectors":["link"],"multiple":false,"regex":"","delay":0},{"id":"PPrice","type":"SelectorText","selector":"span.offer span.sp_amt","parentSelectors":["link"],"multiple":false,"regex":"","delay":0}]}

#6

Increase Delay (ex 4000 ) for the selector : Element scroll down