Pagination page selector

How to?
#1

I want pages 1-26 to be scraped but it is also including the "next" button in the multi-select and won't allow me to de-select it. Because of the inclusion of the next button the Pagination isn't working.

What can I do?

Url: Products Archive - Simulaids

#2

If you're facing issues with web scraping due to the inclusion of the "next" button and it's affecting pagination, follow these steps:

  1. Check your scraping tool's selection area to exclude the "next" button.
  2. Use browser developer tools to find unique identifiers for the data you want to scrape.
  3. Review and adjust your pagination settings in the scraping tool.
  4. Customize your scraping script to skip the "next" button if necessary.
  5. Consider manually downloading data from page 26 and combining it with the rest.
  6. Contact the tool's support for specific guidance if needed.

Always ensure your web scraping activities comply with legal and ethical standards.

#3

Hi,
Thanks for your reply.

I am very new to this so please could you explain how i can make the script skip the "next" button?

Any help would be massively appreciated.

Thanks

#4

don't use Pagination at this particular case....
you URL will look like:
https://simulaids.co.uk/shop/?jsf=epro-archive-products&pagenum=[1-26]

that's it...

#5

its not collecting any data. not sure why not