Data preview always more than dowloaded data

How to?
#1

No matter how I set it up, I can only download the first 30 questions, but data preview normal

Url: Search

Sitemap:
{"_id":"quora","startUrl":["Search":0}]}

#2

I hope you would like this.

{"_id":"quoraquestion","startUrl":["https://www.quora.com/search?q=dog"],"selectors":[{"id":"questions","type":"SelectorElementScroll","parentSelectors":["_root"],"selector":"div.qu-p--medium","multiple":true,"delay":2000},{"id":"question","type":"SelectorText","parentSelectors":["questions"],"selector":"div.qu-flexDirection--row","multiple":false,"regex":"","delay":0}]}

1 Like
#3

thanks a lot, I'm so grateful ::

1 Like
#4

@Asad
i try use :nth-of-type(-n+100) control the number of scrape data, but seems it doesn't work, it still infinite scroll down, could you help me to check it? thanks a lot

{"_id":"quora_2","startUrl":["Search":0}]}

#6

For Quora website, it is possible to separate the scroller from the data scrapers. This example will get you about 125 rows. Adjust as needed:

{"_id":"forum-quora","startUrl":["https://www.quora.com/search?q=dog"],"selectors":[{"id":"Separate scroller","type":"SelectorElementScroll","parentSelectors":["_root"],"selector":"div#mainContent div > div.q-box > div > div[class^='CssComponent-sc']:nth-of-type(-n+125)","multiple":true,"delay":"4500"},{"id":"Row wrappers","type":"SelectorElement","parentSelectors":["_root"],"selector":"div#mainContent div > div.q-box > div > div[class^='CssComponent-sc']","multiple":true},{"id":"Topic and Link","type":"SelectorLink","parentSelectors":["Row wrappers"],"selector":"a.q-box","multiple":false}]}

2 Likes
#7

work like a charm, thank a lot ::