Hi,
I am trying to scrape data from the Indian stock market website - BSE India. I want to scrape several values of various indices here (such as market value, PE ratio etc). The data of various indices is available at this link. basically, there are 56 indices available at this site (pls see the heat map boxes). I want to scrape data from each of theses indices/ boxes.I tried by creating several sitemaps but was able to scrape data of only 14-15 indices. What can I do to scrape the data from all the indices/boxes pls.
Sitemap:
{"_id":"third_try","startUrl":["https://www.bseindia.com/markets.html"],"selectors":[{"id":"Index","multiple":true,"parentSelectors":["_root","pages"],"selector":".active .boxred a","type":"SelectorLink"},{"id":"index","multiple":false,"parentSelectors":["Index"],"regex":"","selector":"h2","type":"SelectorText"},{"id":"PE_ratio","multiple":false,"parentSelectors":["Index"],"regex":"","selector":"td.ng-binding[align='left']","type":"SelectorText"},{"id":"PB_ratio","multiple":false,"parentSelectors":["Index"],"regex":"","selector":"div.whitebox:nth-of-type(3) td.ng-binding:nth-of-type(2)","type":"SelectorText"},{"id":"Dividend Yield","multiple":false,"parentSelectors":["Index"],"regex":"","selector":"div.whitebox:nth-of-type(3) td.ng-binding:nth-of-type(3)","type":"SelectorText"},{"id":"pages","multiple":true,"parentSelectors":["_root"],"selector":".carousel-indicators a:nth-of-type(n+2)","type":"SelectorLink"}]}
Looking forward to your kind response.
Thanks and regards,
Arvind Gupta