Data Preview looks great, but scraping does not work

How to?
#1

Describe the problem.
Data Preview works fine but scraping does not produce data.
Url: https://www.influenster.com/reviews/arctic-fox-100-vegan-electric-paradise-semi-permanent-hair-dye-color-4-oz

Sitemap:
{"_id":"inlfluenster-test","startUrl":["https://www.influenster.com/reviews/arctic-fox-100-vegan-electric-paradise-semi-permanent-hair-dye-color-4-oz"],"selectors":[{"id":"block","type":"SelectorElementClick","parentSelectors":["_root"],"selector":"div.sc-fQejPQ","multiple":false,"delay":2000,"clickElementSelector":".next a","clickType":"clickMore","discardInitialElements":"do-not-discard","clickElementUniquenessType":"uniqueText"},{"id":"containers","type":"SelectorElement","parentSelectors":["block"],"selector":"div.item:nth-of-type(n+3)","multiple":true,"delay":0},{"id":"author","type":"SelectorText","parentSelectors":["containers"],"selector":"a.name","multiple":false,"regex":"","delay":0},{"id":"location","type":"SelectorText","parentSelectors":["containers"],"selector":".author-card > div > span","multiple":false,"regex":"","delay":0},{"id":"rank","type":"SelectorText","parentSelectors":["containers"],"selector":"div.jIPpyN","multiple":false,"regex":"","delay":0},{"id":"date_Date","type":"SelectorText","parentSelectors":["containers"],"selector":"div.bYrDWo","multiple":false,"regex":"^.*(?=(\,))","delay":0},{"id":"stars","type":"SelectorHTML","parentSelectors":["containers"],"selector":"div.hkYNKD","multiple":false,"regex":"","delay":0},{"id":"text","type":"SelectorHTML","parentSelectors":["containers"],"selector":"div.review-text","multiple":false,"regex":"","delay":0}]}

#2

I figured it out. Had to change the selector from div.sc-fQejPQ to just .sc-fQejPQ

I don't know why that makes a difference but it works now. Here is the new site map:

{"_id":"inlfluenster-test","startUrl":["https://www.influenster.com/reviews/arctic-fox-100-vegan-electric-paradise-semi-permanent-hair-dye-color-4-oz"],"selectors":[{"id":"block","type":"SelectorElementClick","parentSelectors":["_root"],"selector":".sc-fQejPQ","multiple":false,"delay":2000,"clickElementSelector":".next a","clickType":"clickMore","discardInitialElements":"do-not-discard","clickElementUniquenessType":"uniqueText"},{"id":"containers","type":"SelectorElement","parentSelectors":["block"],"selector":"div.item:nth-of-type(n+3)","multiple":true,"delay":0},{"id":"author","type":"SelectorText","parentSelectors":["containers"],"selector":"a.name","multiple":false,"regex":"","delay":0},{"id":"location","type":"SelectorText","parentSelectors":["containers"],"selector":".author-card > div > span","multiple":false,"regex":"","delay":0},{"id":"rank","type":"SelectorText","parentSelectors":["containers"],"selector":"div.jIPpyN","multiple":false,"regex":"","delay":0},{"id":"date_Date","type":"SelectorText","parentSelectors":["containers"],"selector":"div.bYrDWo","multiple":false,"regex":"^.*(?=(\,))","delay":0},{"id":"stars","type":"SelectorHTML","parentSelectors":["containers"],"selector":"div.hkYNKD","multiple":false,"regex":"","delay":0},{"id":"text","type":"SelectorHTML","parentSelectors":["containers"],"selector":"div.review-text","multiple":false,"regex":"","delay":0}]}

#3

This site uses random chars in its selectors like div.hkYNKD which can change at any time. so all your selectors will probably fail later. You would need something like

div[class^='sc']

Also, the site is showing error on my side - Error 1020 Access denied

Ref: CSS Selectors Reference

#4

Thanks for this suggestion, it is very useful. How do you figure out what selector to use? Is it just experience or do you have some guidelines? Thanks!