Scrape hidden div elements

How to?
#1

I'm trying to scrape hidden reviews from this web page:

Url: Durex Durex - 2 Glijmiddelen - Voor Extra Gevoel - Waterbasis - Play Sensitive 50ml - Play Pleassure Glijmiddel Tingle 100ml - MijnDrogist.nl

The reviews (apart from 2) are not displayed but hidden in the html. I have identified them but since they're not on the screen I don't seem to extract the date from it. Anyone willign and able to help me out here?

image
image840×406 101 KB

Sitemaps
{"_id":"Mijndrogist","startUrl":["Durex Durex - 2 Glijmiddelen - Voor Extra Gevoel - Waterbasis - Play Sensitive 50ml - Play Pleassure Glijmiddel Tingle 100ml - MijnDrogist.nl > div > div.review","type":"SelectorElement"},{"id":"nickname","multiple":false,"parentSelectors":["review"],"regex":"","selector":"div.review-by","type":"SelectorText"},{"id":"rating","multiple":false,"parentSelectors":["review"],"regex":"","selector":"b","type":"SelectorText"},{"id":"text","multiple":false,"parentSelectors":["review"],"regex":"","selector":"div.content","type":"SelectorText"},{"id":"reviews_hidden","multiple":true,"parentSelectors":["_root"],"selector":"#reviews > div > div.reviews-wrap hidden >div.reviews","type":"SelectorElement"}]}

#2

Fortunately, the reviews are all loaded in the source, so no element click or scrolling needed:

{"_id":"mijndrogist","startUrl":["https://www.mijndrogist.nl/durex-glijmiddel-play-sensitive-50ml-durex-glijmid.html"],"selectors":[{"id":"Title","multiple":false,"parentSelectors":["_root"],"regex":"","selector":"header h1","type":"SelectorText"},{"id":"Review elements","multiple":true,"parentSelectors":["_root"],"selector":"section#reviews div.review","type":"SelectorElement"},{"id":"Rating","multiple":false,"parentSelectors":["Review elements"],"regex":"","selector":"div.rating","type":"SelectorText"},{"id":"Rating text","multiple":false,"parentSelectors":["Review elements"],"regex":"","selector":"div.content","type":"SelectorText"},{"id":"Date","multiple":false,"parentSelectors":["Review elements"],"regex":"","selector":"div.review-by","type":"SelectorText"}]}
#3

Thanks @leemeng I'll try :slight_smile: