I really really appreciate your patient and willingness to help me to start with.
I've used this tool multiple times with paid membership, I get used to how to paginate and scrape comments in a wrapper. But this time, Iframe gives a headache.
The whole comment component is in an Iframe, say if I want to get user name in the comments area, I tried iframe:iframe span.author but data return 'null' to me.
Did I miss something to make this work? Or is there any other little trick I can apply? Ultimately I want to scrape multiple pages of reviews(comments).
Again, thanks for clicking in and see my question!
Url: https://www.caradvice.com.au/750698/2019-bmw-330i-review/
Sitemap:
{"_id":"bmw3s","startUrl":["https://www.caradvice.com.au/bmw/3-series/reviews/"],"selectors":[{"id":"pagination-cars","type":"SelectorLink","parentSelectors":["_root","pagination-cars"],"selector":".col-xs-10 li","multiple":true,"delay":0},{"id":"article-title","type":"SelectorLink","parentSelectors":["_root","pagination-cars"],"selector":"div.recent-review-details h3 a","multiple":true,"delay":0},{"id":"features-wrapper","type":"SelectorElement","parentSelectors":["article-title"],"selector":"div.feature-ratings3-on","multiple":false,"delay":0},{"id":"car_specs_rating_overall","type":"SelectorElementAttribute","parentSelectors":["features-wrapper"],"selector":"div.lv-Rating","multiple":false,"extractAttribute":"data-ca-rating","delay":0},{"id":"car_performance_economy","type":"SelectorText","parentSelectors":["features-wrapper"],"selector":"div:nth-of-type(1) .u-container div.lv-Rating-value","multiple":false,"regex":"","delay":0},{"id":"car_cabinspace_comfort","type":"SelectorText","parentSelectors":["features-wrapper"],"selector":"div.lv-Rating:nth-of-type(2) div.lv-Rating-value","multiple":false,"regex":"","delay":0},{"id":"car_technology_connectivity","type":"SelectorText","parentSelectors":["features-wrapper"],"selector":"div.lv-Rating:nth-of-type(3) div.lv-Rating-value","multiple":false,"regex":"","delay":0},{"id":"car_price_features","type":"SelectorText","parentSelectors":["features-wrapper"],"selector":"div.lv-Rating:nth-of-type(4) div.lv-Rating-value","multiple":false,"regex":"","delay":0},{"id":"car_ride_handling","type":"SelectorText","parentSelectors":["features-wrapper"],"selector":"div.lv-Rating:nth-of-type(5) div.lv-Rating-value","multiple":false,"regex":"","delay":0},{"id":"iframe","type":"SelectorElement","parentSelectors":["article-title"],"selector":"iframe","multiple":false,"delay":0},{"id":"user_name","type":"SelectorText","parentSelectors":["iframe"],"selector":"iframe:iframe span.author","multiple":false,"regex":"","delay":0}]}