Redirect / Form submit navigation

Currently Web Scraper can handle this kind of navigation:

  • Link navigation <a href="http://example.com"> (Link Selector)
  • JavaScript popup navigation window.open("http://example.com") (Popup Link Selector)
  • Ajax pagination when the page isn't reloaded (Element Click Selector)

There are some sites that use JavaScript to redirect to a different link or do a form submit. Web Scraper currently cannot handle this kind of site navigation.

How to detect when the site uses redirect/form submit navigation:

  • Click the pagination button. If the page is being reloaded but the URL doesn't change then the site uses form submit navigation
  • Click the pagination button. If the page is being reloaded and the URL changes. Right click on the button and choose inspect element. If the button isn't a link with href attribute (<a href="http://example.com">) which contains a link then it's a redirect button.

Please post links to sites that use this kind of navigation.

4 Likes