Can't Scrape all URLs in a directory

How to?
#1

I'm trying to scrape this page: Product Hunt – The best new products in tech.

I want to scrape the product name and one you click on each name a popup window will open, from which I want to scrape the external URL in the product name.

The sitemap:
{"_id":"producthunt-email-marketing-tools","startUrl":["Product Hunt – The best new products in tech. name","type":"SelectorText","parentSelectors":["_root"],"selector":"a[data-test]","multiple":true,"regex":"","delay":0},{"id":"tool URL","type":"SelectorLink","parentSelectors":["_root"],"selector":".styles_xLarge__24CcJ a[target]","multiple":false,"delay":0}]}

At the first attempt it scraped only the first results. Now it's not scraping at all. The scraping popup window opens and closes right away. What am I doing wrong?

#2

Hello, did you manage to solve this problem?
I would greatly appreciate a working script

#3

@JackJack Hi, it appears that it should be possible using the 'Link' selector.

Here's an example:

{"_id":"producthunt-com","startUrl":["https://www.producthunt.com/search"],"selectors":[{"id":"link","multiple":true,"parentSelectors":["_root"],"selector":".justify-center > a","type":"SelectorLink"},{"id":"name","multiple":false,"parentSelectors":["link"],"regex":"","selector":"h1","type":"SelectorText"},{"id":"short-desc","multiple":false,"parentSelectors":["link"],"regex":"","selector":"div.fontSize-18.noOfLines-undefined","type":"SelectorText"}]}