Extracting data via an API (JSON format) from a web site ([login to view URL]) and insert it to local MySQL database, column names need to remap, record need to be check before INSERT using RedBeanPHP. Data source coming from a series sub folders (scrapers) from [login to view URL] eg. planningalerts-scrapers/councilA, planningalerts-scrapers/councilB and I need to have the ability to add/remove the list either via an array, external text file etc, there are 120 subfolders/scrapers.
API is super easy to use. Eg.
GET [login to view URL][scraper]/[login to view URL][api_key]&query=[sql]
My DB has different tables and you need to save the source data to various tables. I also need help to setup something like RedBeanPHP, so I can easily add data to the database in the future. A bit like ScraperWiki on the [login to view URL] web site, I can do a little bit of coding and this one just too much for me as I am absolute green on RedBeanPHP.
Once collected the 'address', talk to google API and get the Lng and Lat.
I am also open to suggestions on DB design, RedBeanPHP usage, or any alternative framework.
I am thinking of using BitBucket private repo to allow us share code. Again, I am new to this too, not sure is it easier just zip and email. Let me know.
Please provide sample codes that you work before with similar requirements.
Hi
I have 15+ years experience in web scraping and data entry .so i can do easily. Please send me a more details so i can start your project ASAP.
Thanks
Hi,
Hope you are doing well!
I am an expert in any type of work in PHP/MySQL database development having 8+ years of experience in PHP/MySQL web development. I am a dedicated and trustworthy as well as very strict to deadline of project and finish project with zero bugs before deadline of project. So please award this job to me. I assure you I will finish it on your time. Please add my Skype ID : hire4onlinework and ping me anytime for further communication about your project.
I have gone through your job description and understood very well as well as comfortable with all the terms and conditions set aside by you. I can do your work once you award job to me. Trust me. I can be available for your work anytime for discussion and meeting over skype and quick response to your emails for task updates.
Above all I have good working experience in managing large and complex database with 100% optimized tables so I can handle you job easily.
I ensure that the delivered work is of high quality and will be delivered within agreed time.
I am waiting for your positive response to take things ahead.
Thanks & Regards
Afroz