Hi! I watched through a bunch of the videos, read a bunch of forum posts and most of the documentation but can't quite get my scraping to fully work.
Background:
- The main page is paginated and has ten records per page with pagination buttons that don't change the URL. (My Scouting)
- I successfully used "Element click" to paginate through these pages. The selector is targeting the rows of the table.
- I [can] successfully scrape text data from the table using this method.
- I can jump into the child page linked in the table. But then the scraper gets stuck on the child page and never returns to the main page.
- The link itself is hidden behind Javascript but Web Scraper is obviously finding it when I use SelectorLink.
- The child page does have a unique URL. (e.g. My Scouting)
- I'd like to pull various text entries from the child page into the same row of data as the parent page's table row. e.g. the parent page table has name, status and unit. The child page has email and address. So the output would be best if it were:
Name|Status|Unit|Email|Address
Sitemap:
{"_id":"Leads2","startUrl":["https://my.scouting.org/69799648-F990-4368-9E91/membership-manager/invitation"],"selectors":[{"clickActionType":"real","clickElementSelector":"li.ant-pagination-item a","clickElementUniquenessType":"uniqueText","clickType":"clickOnce","delay":2000,"discardInitialElements":"do-not-discard","id":"page","multiple":true,"parentSelectors":["_root"],"selector":"tr.ant-table-row","type":"SelectorElementClick"},{"id":"parentName","multiple":false,"parentSelectors":["page"],"regex":"","selector":"td:nth-of-type(2) div","type":"SelectorText"},{"id":"source","multiple":false,"parentSelectors":["page"],"regex":"","selector":".c-invitation-manager-table__source-text span","type":"SelectorText"},{"id":"status","multiple":false,"parentSelectors":["page"],"regex":"","selector":"span.ant-tag","type":"SelectorText"},{"id":"unit","multiple":false,"parentSelectors":["page"],"regex":"","selector":"div.c-invitation-manager-table__unit-name--name","type":"SelectorText"},{"id":"gender","multiple":false,"parentSelectors":["page"],"regex":"","selector":"div.c-gender-icon","type":"SelectorText"},{"id":"lead","linkType":"linkFromRedirect","multiple":false,"parentSelectors":["page"],"selector":"parent","type":"SelectorLink"},{"id":"email","multiple":false,"parentSelectors":["lead"],"regex":"","selector":".c-invitation-detail-summary-card__contact-info a","type":"SelectorText"}]}