Adapt existing web scraper to additional website

Stagecoach Software Pty Ltd (trading as RateMyAgent) has a fully functioning ruby Nokogiri scraper populating a MySQL database from a particular website. The scraper is based on a cloud server with cPanel interface and runs on daily cron jobs. The scraper generates several thousand rows of data per day in two key tables plus further rows in related tables. The database is designed to function as a backend to a forthcoming website.

This project requires a freelancer to adapt the existing scraper to operate on a further website operating in the same industry and displaying the same type of data but with higher volumes.

The existing code is available on github and Heroku and a development database is available on Heroku. These may be inspected by approved bidders before they accept the project.

Sundry other minor changes to the code and database may be required as the project progresses to help achieve the corporate objective of providing a useful and functioning website. The freelancer must ensure that the current production database and existing scraper continue to operate without interference throughout the project.

Further written instructions including identification of the site to be scraped will be provided to approved bidders. Bidders are free to revise their bids upon studying the instructions, the code or the existing database.

This project follows freelancer Project ID’s 5477803, 5129765, 5066285, 4975478 and 5799583. Further similar scraping projects for other sites will be offered to the successful bidder if this project is completed successfully. Those scraping projects will be followed by the creation of a RoR website that will present graphs showing aggregate and individual data obtained from the database and allowing complex user searches. Preference will be given to freelancers interested in and qualified to carry on work in the further backend projects and subsequent building of the website.

Bidders without demonstrable experience in Ruby, MySQL and Web Scraping will be rejected. Bids placed within minutes of the project being posted will also be rejected as indicative of no thought being applied to the project requirements.

Bids will be considered up to $1000 AUD

MySQL Ruby Web Scraping

Projekt-ID: #5944177

Über das Projekt