Hello,
I am trying to scrap pricing and related plan (term) information for cell phones from a provider in Canada. I have started my search (my starting URL) right at the page where the devices are listed. It would seem as simple as creating a link selector that will click on each device, and then text selectors for title, price, and term, but I am not always receiving pricing or term information.
Am I missing something basic? TIA!
Url: https://www.bell.ca/Mobility/Smartphones_and_mobile_internet_devices
Sitemap:
{"_id":"bell_mobility","startUrl":["https://www.bell.ca/Mobility/Smartphones_and_mobile_internet_devices"],"selectors":[{"id":"device","type":"SelectorLink","parentSelectors":["_root"],"selector":"a.rsx-product-hotspot","multiple":true,"delay":0},{"id":"title","type":"SelectorText","parentSelectors":["device"],"selector":"h1.rsx-bell-font","multiple":false,"regex":"","delay":0},{"id":"price","type":"SelectorText","parentSelectors":["device"],"selector":"div.rsx-price","multiple":true,"regex":"","delay":0},{"id":"term","type":"SelectorText","parentSelectors":["device"],"selector":"p.rsx-txt-size-18","multiple":true,"regex":"","delay":0}]}
