I think I've traveled as far as I can without asking for directions....
I am having trouble with scraping text from within a particular element. It works with the first element (discounts), but not in the next (delivery). And I think I am handling them the same way.
I can bring up the individual pages and preview the data, and the data for delivery is there. But when I run the actual scrape, the data shows up as "null". I also tried adding a scroll to the page, thinking that the element needed to be loaded first. But I get the same "null" result. Is there something I'm overlooking?
Also, when I change some parameters on the landing page, in order to get more selections, only the first ten pages are scraped. Is there a reason why I am not getting any more?
Url: http://turo.com
Sitemap:
{"_id":"turo_chrome_MAIN","startUrl":["https://turo.com/us/en/search?defaultZoomLevel=11&delivery=true&deliveryLocationType=history&endDate=01%2F08%2F2022&endTime=11%3A00&international=true&isMapSearch=false&itemsPerPage=20&latitude=36.084&location=LAS%20-%20McCarran%20International%20Airport&longitude=-115.15374&maximumDeliveryFee=30&maximumDistanceInMiles=50&maximumPrice=40&minimumPrice=10&placeId=ChIJXZwEH5_FyIARHh7EHiRZE0c&sortType=RELEVANCE&startDate=01%2F05%2F2022&startTime=11%3A00"],"selectors":[{"delay":0,"id":"car-link","multiple":true,"parentSelectors":["_root"],"selector":"a.css-8ydh9n-VehicleCardLinkBox","type":"SelectorLink"},{"delay":3000,"id":"scroll","multiple":false,"parentSelectors":["_root"],"selector":"div.searchResultsGrid","type":"SelectorElementScroll"},{"delay":0,"id":"model","multiple":false,"parentSelectors":["car-link"],"regex":"","selector":"h1","type":"SelectorText"},{"delay":0,"id":"rating","multiple":false,"parentSelectors":["car-link"],"regex":"","selector":"p.css-5a4mo9-StyledText","type":"SelectorText"},{"delay":0,"id":"price","multiple":false,"parentSelectors":["car-link"],"regex":"","selector":".u-rlMarginBottom16 .css-s587q0-StyledText span","type":"SelectorText"},{"delay":0,"id":"discounts","multiple":false,"parentSelectors":["car-link"],"regex":"","selector":"div.css-1lbm828-Well","type":"SelectorText"},{"delay":0,"id":"popularity","multiple":false,"parentSelectors":["car-link"],"regex":"\\d","selector":"div > span.css-mrzgsa-StyledText","type":"SelectorText"},{"delay":0,"id":"delivery","multiple":false,"parentSelectors":["car-link"],"regex":"","selector":"div.vehicleMapDetails-container","type":"SelectorText"},{"delay":2000,"id":"car-scroll","multiple":false,"parentSelectors":["car-link"],"selector":"[aria-busy] > div.fresnel-greaterThanOrEqual-md","type":"SelectorElementScroll"}]}
