How to collect data from Kickstarter including the campaign text

How to?
#1

Hi,
I have problems with scrapping data from Kickstarter. I want to gather data on technology projects on Kickstarter. I used the web scraping extension but it does not seem to work. I need data for 2000 projects on the variables stated below. However, the most important variable is the campaign text, which is stored below Story on the project page. Can anyone give tips or help me out with scrapping the data from Kickstarter?

Variables: ID, Title, Blurb, Goal, Amount Pledged, State, Slug, Country, Currency, Deadline, Launch date, Amount of Backers, CreatorName, Location, Campaign Text, Images, Videos, Reward

Url: Discover » Technology — Kickstarter

Sitemap:
{id:"sitemap code"}

#2

Hello @Laura

After a while you keep clicking the load more button you will be stopped with captcha, only chance to get the remaining records is by using cloud scraper with proxy which would retry the page multiple times.
Check it out - Web Scraper - Pricing

Meanwhile I made an example tho. Maybe this will help:

{"_id":"kickstarter-com","startUrl":["https://www.kickstarter.com/discover/categories/technology"],"selectors":[{"id":"wrapper-load more","type":"SelectorElementClick","parentSelectors":["_root"],"selector":"#projects_list div.grid-col-12","multiple":true,"delay":2000,"clickElementSelector":"a.bttn:contains(\"Load more\")","clickType":"clickMore","discardInitialElements":"discard","clickElementUniquenessType":"uniqueCSSSelector"},{"id":"Title","type":"SelectorText","parentSelectors":["wrapper-load more"],"selector":"h3","multiple":false,"regex":"","delay":0},{"id":"Description","type":"SelectorText","parentSelectors":["wrapper-load more"],"selector":"h3 + p","multiple":false,"regex":"","delay":0},{"id":"Pledged-Amount","type":"SelectorText","parentSelectors":["wrapper-load more"],"selector":"[data-test-id=\"amount-pledged\"]","multiple":false,"regex":"","delay":0},{"id":"Funded","type":"SelectorText","parentSelectors":["wrapper-load more"],"selector":"[data-test-id=\"percent-raised\"]","multiple":false,"regex":"","delay":0},{"id":"Time left","type":"SelectorText","parentSelectors":["wrapper-load more"],"selector":"[data-test-id=\"time-left\"]","multiple":false,"regex":"","delay":0},{"id":"Sphere","type":"SelectorText","parentSelectors":["wrapper-load more"],"selector":"[data-test-id=\"time-left\"] + div a:nth(0)","multiple":false,"regex":"","delay":0},{"id":"Location","type":"SelectorText","parentSelectors":["wrapper-load more"],"selector":"[data-test-id=\"time-left\"] + div a:nth(1)","multiple":false,"regex":"","delay":0},{"id":"Image","type":"SelectorImage","parentSelectors":["wrapper-load more"],"selector":"img","multiple":false,"delay":0},{"id":"Link","type":"SelectorLink","parentSelectors":["wrapper-load more"],"selector":"div.hover-target a","multiple":false,"delay":0},{"id":"element-card","type":"SelectorElement","parentSelectors":["Link"],"selector":"body:has(h2.project-name)","multiple":true,"delay":0},{"id":"backer-amount","type":"SelectorText","parentSelectors":["element-card"],"selector":"div[role=\"progressbar\"] + div div + div:contains(\"backers\") span:nth(0)","multiple":false,"regex":"","delay":0},{"id":"video","type":"SelectorElementAttribute","parentSelectors":["element-card"],"selector":"video[preload=\"none\"] source:nth(1)","multiple":false,"extractAttribute":"src","delay":0}]}

#3

Thanks for your help!

I also need to extract some information from each project about the founding team (for instance, how many team members). I would also need the story and risk text of each project.

Is this also possible to extract?