Site blocking webscraping?

How to?
#1

Hey guys,

I know I'm on here kind of a lot. Right when I think I get it, I apparently don't. I'm trying to scrape the wine site below, and I've been trying for like 2 hours and nothing works. I looked at the errors and I see an error. It kind of looks like it blocked an ad, but also looks like it blocked the selector? Can anyone tell me what this error is saying? I pasted it below. And if it is blocking the scraper, is there anyway around it? I already downloaded Ghostery as suggested by another user here. I don't think it's the way I set up the scrapper because I copied the same settings on another site and it worked perfectly.

{"_id":"wine-comparison_binnys_white_chicago-downtown","startUrl":["https://www.binnys.com/wine/white-wines"],"selectors":[{"id":"item","type":"SelectorElementClick","parentSelectors":["_root"],"selector":"ol.products li.item, div.toolbar:nth-of-type(5)","multiple":true,"delay":"2000","clickElementSelector":"div.toolbar:nth-of-type(5) li.item.pages-item-next","clickType":"clickMore","discardInitialElements":false,"clickElementUniquenessType":"uniqueHTML"},{"id":"name","type":"SelectorText","parentSelectors":["item"],"selector":"a.product-item-link","multiple":false,"regex":"","delay":0}]}

gtm.js?id=GTM-MFJ6ZVN:661 GET https://www.googleadservices.com/pagead/conversion_async.js net::ERR_BLOCKED_BY_CLIENT
ib @ gtm.js?id=GTM-MFJ6ZVN:661
S @ gtm.js?id=GTM-MFJ6ZVN:730
(anonymous) @ gtm.js?id=GTM-MFJ6ZVN:740
xc @ gtm.js?id=GTM-MFJ6ZVN:676
h @ gtm.js?id=GTM-MFJ6ZVN:691
(anonymous) @ gtm.js?id=GTM-MFJ6ZVN:628
(anonymous) @ gtm.js?id=GTM-MFJ6ZVN:693
(anonymous) @ gtm.js?id=GTM-MFJ6ZVN:692
ue @ gtm.js?id=GTM-MFJ6ZVN:700
a.push @ gtm.js?id=GTM-MFJ6ZVN:701
(anonymous) @ gtm.js?id=GTM-MFJ6ZVN:701
setTimeout (async)
I @ gtm.js?id=GTM-MFJ6ZVN:662
od @ gtm.js?id=GTM-MFJ6ZVN:688
fi.Yd @ gtm.js?id=GTM-MFJ6ZVN:784
(anonymous) @ gtm.js?id=GTM-MFJ6ZVN:785
(anonymous) @ gtm.js?id=GTM-MFJ6ZVN:787
content_script.js:24 multiple different element selection disabled

#2

It's not blocking anything but I can't quite figure out the pagination. However, there is a work-around using url ranges.

Since I can see every time you change pages, the URL changes, we can use then by changing the start page to include a range .

In this case

https://www.binnys.com/wine/white-wines?p=[1-139]

Then all we need to do is change the element-click selector to to a plain old element select and we have our solution. Scrape away

{"_id":"forum-site-blocks-webscraper","startUrl":["https://www.binnys.com/wine/white-wines?p=[1-139]"],"selectors":[{"id":"item","type":"SelectorElement","parentSelectors":["_root"],"selector":"div.product-item-info","multiple":true,"delay":""},{"id":"name","type":"SelectorText","parentSelectors":["item"],"selector":"a.product-item-link","multiple":false,"regex":"","delay":0}]}
#3

That worked! Thanks for your help