Scraping part of text

How to?
#1

Hi guys

I want to scrape a part of the text on these sites. I face two problems:

  1. I need the scraper to click on multiple links on multiple sites, how to?
  2. I need to scrape only the part of text under the undertitle "Indbrud", but it can't recognize it as an element of itself. How to?

Url: Døgnrapporter | Politi

Sitemap: N/A

#2

Hi,

You can try this kind of setup:

{"_id":"politi","startUrl":["https://politi.dk/doegnrapporter?fromDate=2023/1/1&toDate=2024/2/27&newsType=Alle&page=[1-42]&district=OEstjyllands-Politi"],"selectors":[{"id":"listing","linkType":"linkFromHref","multiple":true,"parentSelectors":["_root"],"selector":"a.newsResultLink","type":"SelectorLink"},{"id":"Indbrud","multiple":false,"parentSelectors":["listing"],"regex":"(?<=Indbrud)[^]+","selector":".rich-text","type":"SelectorText"}]}