How to clic a link without <a> element

How to?
#1

The site displays several items. Each item redirects to a new url that contains the full information I want to extract. The problem is that neither the item element nor any of its children contain an <a> element. The only url I've found is the one in the data-to-posting attribute of a <div> element. But it doesn't act as a link so I can't navigate with the scraper.

Also, the site is using react, so I'm guesing this could be the problem maybe.

Url: https://urbania.pe/buscar/venta-de-departamentos?page=1

Sitemap:
{ "_id":"urbania_depto", "startUrl":[ "https://urbania.pe/buscar/venta-de-departamentos-en-lima?page=[1-3]" ], "selectors":[ { "delay":0, "id":"element", "multiple":true, "parentSelectors":[ "_root" ], "selector":"#react-posting-cards > div > div > div:nth-child(n)", "type":"SelectorLink" }, { "delay":0, "id":"metros", "multiple":false, "parentSelectors":[ "element" ], "regex":"", "selector":"div:nth-of-type(3) div.label", "type":"SelectorText" } ] }

#2

@spider Hi, it appears that the only viable solution would require conducting the scrape in 2 stages. First, extract each of the property links that are embedded in the following attribute - data-to-posting and afterward use the scraped links as the start URLs for a new sitemap.

You can extract the attributes using the following sitemap:

{"_id":"urbania_depto","startUrl":["https://urbania.pe/buscar/venta-de-departamentos-en-lima?page=[1-3]"],"selectors":[{"delay":0,"extractAttribute":"data-to-posting","id":"element","multiple":true,"parentSelectors":["_root"],"selector":"div.list-card-container > div[data-qa]","type":"SelectorElementAttribute"}]}

Attribute link
Attribute link1920×1283 173 KB

Learn how to add multiple start URLs for a sitemap here: 2019 - UnTECH # 17 - Scraping Multiple URL's with Webscraper.io - YouTube

Hope it helps!

#3

@ViestursWS thank you very much for your answer, it was really helpful.