Can't scrape this (can't get links)

#1

so I'm trying to scrape this page: https://www.the-aop.org/find/photographers to get the Name and Email of each profile.

I try do this:
_root / link / text

1st: When trying to select the links on the root page, the selector actually clicks instead of selecting thus opening the profile page and not selecting.
2nd: when I copy/paste the selector ( #thumbGrid > div:nth-child(n) a ) the Select preview shows all elements on the page, the Data Preview shows the right link. But when scraping it doesn't actually scrape any data.

am I missing something?

#2

To avoid the 1st problem, after clicking the select button, in the top left corner just above the console, there is a 'Enable key' option that you can click, after that you will be able to hover over elements and select them by using the 'S' key, thus not having to click anything so the redirection is not triggered.

For the second problem, you will have to share your sitemap here, as the selector, in theory, should be working.

#3

ooooh so that's why "enable key" is for! Thanks a lot, didn't know that.

my sitemap is this:

{"_id":"photographers-uk-aop","startUrl":["https://www.the-aop.org/find/photographers"],"selectors":[{"id":"link","type":"SelectorLink","parentSelectors":["_root","pagination"],"selector":"#thumbGrid > div:nth-child(n) a","multiple":true,"delay":0},{"id":"email","type":"SelectorText","parentSelectors":["link"],"selector":"tr:contains('Email:') a","multiple":false,"regex":"","delay":0},{"id":"name","type":"SelectorText","parentSelectors":["link"],"selector":"div.cms-component h1 span","multiple":false,"regex":"","delay":0},{"id":"pagination","type":"SelectorLink","parentSelectors":["_root","pagination"],"selector":"div.column-full-width.foot-pagination a.pagination-button.next","multiple":false,"delay":0}]}

#4

Your sitemap seems fine with the exception of the pagination selector need to be multiple and I have slightly adjusted the link selector for the wrapper. Try this one and let me if it works:

{"_id":"photographers-uk-aop","startUrl":["https://www.the-aop.org/find/photographers"],"selectors":[{"id":"link","type":"SelectorLink","parentSelectors":["_root","pagination"],"selector":".thumbnailWrapper a","multiple":true,"delay":0},{"id":"email","type":"SelectorText","parentSelectors":["link"],"selector":"tr:contains('Email:') a","multiple":false,"regex":"","delay":0},{"id":"name","type":"SelectorText","parentSelectors":["link"],"selector":"div.cms-component h1 span","multiple":false,"regex":"","delay":0},{"id":"pagination","type":"SelectorLink","parentSelectors":["_root","pagination"],"selector":"div.column-full-width.foot-pagination a.pagination-button.next","multiple":true,"delay":0}]}