This is on a site where I have to log in so I can't share a public URL.
The page is a *.php page and the content is dynamic.
I have everything working on the default 30 rows that show up when the root page loads, but I need to somehow have the scraper click the "Next" button to get the next 30 rows to appear, and so on.
Any suggestions?
Here is my current site map:
{"_id":"Avantlink","startUrl":["AvantLink Dashboard a","multiple":true,"linkType":"linkFromHref"},{"id":"Merchant","parentSelectors":["Merchant-Link"],"type":"SelectorLink","selector":"tr:contains('Merchant:') a","multiple":false,"linkType":"linkFromHref"},{"id":"Name","parentSelectors":["Merchant-Link"],"type":"SelectorText","selector":"tr:contains('Contact:') td:nth-of-type(2)","multiple":false,"regex":""},{"id":"Email","parentSelectors":["Merchant-Link"],"type":"SelectorText","selector":"tr:contains('Contact Email:') a","multiple":false,"regex":""},{"id":"Program Description","parentSelectors":["Merchant-Link"],"type":"SelectorText","selector":"td p:nth-of-type(1)","multiple":false,"regex":""},{"id":"Program Description Long","parentSelectors":["Merchant-Link"],"type":"SelectorText","selector":"tr:contains('Program Description:') td:nth-of-type(2)","multiple":false,"regex":""},{"id":"Action Criteria","parentSelectors":["Merchant-Link"],"type":"SelectorText","selector":"tr:contains('Action Criteria:') td:nth-of-type(2)","multiple":false,"regex":""},{"id":"Commission","parentSelectors":["Merchant-Link"],"type":"SelectorText","selector":"tr:contains('Action Commission:') td:nth-of-type(2)","multiple":false,"regex":""},{"id":"Referral Days","parentSelectors":["Merchant-Link"],"type":"SelectorText","selector":"tr:contains('Referral Days:') td:nth-of-type(2)","multiple":false,"regex":""}]}
Thank you!