I am trying to scrape reviews off the Ugg.com website which requires opening and closing page dividers. Divider #1: Expand to show reviews. Divider #2: Expand to show full details of review (must be closed before moving to next page of reviews). How do I set up with selectors? I was trying to use element click but that wasn't working. Also, where in the site map do each Divider #1 and Divider #2 go?
Many thanks!
@mburke Hi, should be possible by using an 'Element click' selector.
Example:
{"_id":"ugg-com-test-reviews","startUrl":["https://www.ugg.com/men-apparel-pants/lionel-pant/1121072.html?dwvar_1121072_color=IKBL"],"selectors":[{"clickElementSelector":"div.featured-review-header-label:contains(\"Reviews\")","clickElementUniquenessType":"uniqueText","clickType":"clickOnce","delay":1200,"discardInitialElements":"do-not-discard","id":"expand-reviews-click","multiple":true,"parentSelectors":["_root","review-pagination"],"selector":"body","type":"SelectorElementClick"},{"id":"review-pagination","paginationType":"auto","parentSelectors":["_root","review-pagination"],"selector":".pr-rd-pagination > a:contains(\"Next\")","type":"SelectorPagination"},{"id":"review-wrapper","multiple":true,"parentSelectors":["review-pagination"],"selector":"div.pr-review","type":"SelectorElement"},{"id":"review","multiple":false,"parentSelectors":["review-wrapper"],"regex":"","selector":"p.pr-rd-description-text","type":"SelectorText"}]}