Describe the problem.
After running through the "load more" sequence, how do you scrape from inside the individual product page?
Url: http://example.com
Sitemap:
{id:"sitemap code"}
There is already a very good tutorial for "Load More" from the WS team at:
The "Load More" bit actually starts around 5:12, but you should really watch it all the way from the beginning 'cos it explains important concepts such as
wrapper elements, element selection, child selectors, etc.
BTW, this same video also covers "Infinite Scroll" at around 3:25.
Is there any way to say hey "scrape everything on the 1st page then click this button to load more and scrape the page again" because instead of a load more button on the website there is a next page button and so it removes everything off the first page and so everything is basically new on the second page.