I'd like search the entire subdirectory of [login to view URL]*
Any profile that has a Backed number (which is listed twice on the page and likely searchable) higher than 15, I want to pull that link into a spreadsheet.
A lot we'd be able to do with even something that limited in scope.
On Dec 2, 2015, at 4:34 PM, Jason Cooper wrote:
I'm looking to see if we can create a scraper that will go find and go through all, most or some of the profiles on Kickstarter and pull together select information. Each person that creates a project or backs a project has a Kickstarter profile. It's created automatically (although they aren't searchable directly). Example of a profile. All of the following information is public in that profile:
• the account name, and the date it was created
• any information you choose to add to your profile (like a picture, bio, or your location)
• projects you've backed (but not pledge amounts or rewards chosen)
• projects you've launched
• any comments you’ve posted on Kickstarter
• if you have "Liked" a project update
Some people also post links to their own websites or social media sites.
Our goal with this is to have a sortable list of project creators and backers from Kickstarter. It doesn't need to be comprehensive, but looking to pull as many as we can. In doing so, we'd like to then isolate:
1) Find creators who have launched projects in the past year
2) Find serial backers - people that have backed 10 or more projects in the past year
3) Have a little data on where they are (the links they post to their profiles) so that we can later look up their email and social media info
Hello,
All of you've mentioned we've already done for our recent projects. Let us help you with this. See our skills at: [The administrator removed this message for encouraging communication outside Freelancer.com, which breaches our Terms and Conditions - Section 13: Communication With Other Users.]
Don’t rush into awarding this project not to us neither to anyone else - it’s a good rule of thumb to talk more with a prospective developer and see if you’re on the same page.
So let’s talk! Happy to provide more accurate estimates after discussion.
Best,
A2 Design Inc
Hello Sir,
We have breadth and depth of programming knowledge and good client-facing skills.
Our goal is to provide effective web solutions that are focused on reducing your costs.
Contact us to receive a Free consultation for your web design, web development.
Thankyou
Hello,
I have great experiences in creating web scraper/bots. In fact, most of my projects here on freelancer are about web scraping. High quality and on-time delivery.
Sincerely,
Luell Kearl
Hi Sir, i can make this done with JSOUP / HTMLUNIT libraries for JAVA programming language, i would also use Hibernate lib to save this data in to a database for any further use.
This sounds like a fun project! I've done web scraping before for a university class (scraped TV program schedules from a website to a database).
I'd love to hear more about this!
Hello,
I already have a scraper, working on getting it do what you want, but it's made in Python, not PHP.
Getting all the profiles on kickstarter is gonna take some time and might require some GB of storage. For the moment I'm working on a small proof of concept.
Best regards,