Can anyone help with this scrapping? Is there a way to scrap all the business contact info from this site? I cannot find a way to get the scraper to click these link elements because they are JS, is it possible?
I've tried the element click selector but cannot pick the links. Am I dumb or can this not be done?
Hello,
Martin said:
Currently Web Scraper can handle this kind of navigation:
Link navigation <a href="http://example.com"> (Link Selector)
JavaScript popup navigation window.open("http://example.com") (Popup Link Selector)
Ajax pagination when the page isn't reloaded (Element Click Selector)
There are some sites that use JavaScript to redirect to a different link or do a form submit. Web Scraper currently cannot handle this kind of site navigation.
How to detect when the site uses redirect/form submit navigation:
Click the pagination button. If the page is being reloaded but the URL doesn't change then the site uses form submit navigation
Click the pagination button. If the page is being reloaded and the URL changes. Right click on the button and choose inspect element. If the button isn't a link with href attribute (<a href="http://example.com">) which contains a link then it's a redirect button.
Please post links to sites that use this kind of navigation.
I'm trying to scrape this page:
https://www.newegg.com/Case-Fans/SubCategory/ID-573
I think the pagination is JS, and the page reloads when you click the links, but they're not choosable with the link selector. Is there a way to make the element click selector work here?