Scrape is not pulling links on this site (SOLVED)

Hi,

I have tried every parent and child combo I can find but the scrape never seems to find the links to the individual product pages. There are no errors generated so have I am having trouble diagnosing the problem. Any help would be appreciated.

Site is:https://www.verizonwireless.com/smartphones/

Sitemap:
{"_id":"verizon_test","startUrl":["https://www.verizonwireless.com/smartphones/"],"selectors":[{"id":"link","type":"SelectorLink","parentSelectors":["_root"],"selector":".NHaasTX75Bd","multiple":true,"delay":0},{"id":"data","type":"SelectorElement","parentSelectors":["link"],"selector":"div.tile_container","multiple":false,"delay":0},{"id":"device","type":"SelectorText","parentSelectors":["data"],"selector":"h1","multiple":false,"regex":"","delay":0},{"id":"monthly","type":"SelectorText","parentSelectors":["data"],"selector":".border_black div.pad8","multiple":false,"regex":"","delay":0},{"id":"full_price","type":"SelectorText","parentSelectors":["data"],"selector":".border_grayThree span","multiple":false,"regex":"","delay":0},{"id":"promo","type":"SelectorText","parentSelectors":["data"],"selector":".offersPad > div","multiple":false,"regex":"","delay":0}]}

Site is using randomly generated classes so it is better to manually write selectors in this case. Here is the updated sitemap:

{"_id":"verizon_test","startUrl":["https://www.verizonwireless.com/smartphones/"],"selectors":[{"id":"link","type":"SelectorLink","parentSelectors":["_root"],"selector":"div.brand-price-div a","multiple":true,"delay":0},{"id":"data","type":"SelectorElement","parentSelectors":["link"],"selector":"div.tile_container","multiple":true,"delay":0},{"id":"device","type":"SelectorText","parentSelectors":["data"],"selector":"h1","multiple":false,"regex":"","delay":0},{"id":"monthly","type":"SelectorText","parentSelectors":["data"],"selector":".border_black div.pad8","multiple":false,"regex":"","delay":0},{"id":"full_price","type":"SelectorText","parentSelectors":["data"],"selector":".border_grayThree span","multiple":false,"regex":"","delay":0},{"id":"promo","type":"SelectorText","parentSelectors":["data"],"selector":".offersPad > div","multiple":false,"regex":"","delay":0}]}

1 Like

Awesome possum! :mouse: