Kickstarter - Categories (Urgent Need of Help)

How to?
#1

Hello everyone,

I'm new to this type of data extracting but I was wondering if you could help me out. I'm so stuck.
For my thesis I need to extract as much data as I can from Kickstarter.
My goal is to extract the data from each campaign, from just one category and one region (eg. all projects from Europe).
So for example:

category: technology, all projects
region: europe (this is now 7,533 projects).

Then I would need to see the following information in each column in excel:

  • project name
  • url
  • funded or not
  • number of backs
  • region
  • which category of technology
  • raised amount
  • funding period
  • goal
  • backers
  • the type of rewards
  • how many backers per rewards
  • ...

Please, can somebody help me out!?
I can extract some info but it keeps scraping and scraping or it doesn't extract all.

Url: https://www.kickstarter.com/discover/advanced?category_id=16&woe_id=966591&sort=magic&seed=2541685&page=1

Sitemap: don't know how to do this yet..

#3

Hi Thorser,

What information do you need in particular? A road map of instructions?

Thanks in any case!

#4

Yesterday I did a test, but I see that it went wrong. I'm going to repeat it again and I send it to you.
Do you agree?
Thank you.

#5

Hi !

That would be great yeah! If you could try it out for like 10 campaigns for example, to see the result.

Much appreciated!

#6

54
Captura de pantalla 2018-04-30 a las 9.38.54.png2560×1600 1.21 MB

Something like this....

#7

some information is spanish (so I'm from spain) but if this example is find for you, I can translate it

#8

Hi Thorser,

Looks good. But is that all the info that's available?

Because I would also need to see the different type of rewards you can select and how many backers each possible pledge holds.

And how do you program webscraper to only check a certain amount of projects, for example all projects technology from spain, madrid?

#9

Hi again,

Please, give me a moment to see how I can pass on the reward types, I understand what you need.
I'm looking for all the projects that are in Europe. For that, I look at this page: https://www.kickstarter.com/discover/advanced?category_id=16&woe_id=24865675&sort=magic&seed=2541685&page=1. It`s ok for you?

#10

Hi again! :slight_smile:

Yes, your link is correct.
But I was thinking in the meantime it would be better to make the scope a bit smaller.
So I would now focus only on technology projects in England (= 2,788 projects):

https://www.kickstarter.com/discover/advanced?category_id=16&woe_id=24554868&sort=magic&seed=2541685&page=1

Can you check for that please? Or if you can show me afterwards what your programming looked like.

Thanks.

#11

I'm trying to make the new query, it's a bit difficult ... Leave me an hour ...
There is no problem with giving you only the results of England.
In a while I send you a test.
Thank you.

#12

Thank you man! Very nice of you !

#13

I do it!.

I have to work with the data in excell. I'll seend you an example asap.

Bye!