- PHP based (Laravel?) web / server-side application that..
- Crawls through specified web content (multiple 'data URLs', not just a single one.) (Data URL = data source web page)
- Data URLs can be looped (for loop for query string), extracted from an array, or crawled from a web page with certain rules to find the right URLs.
- Extracts specified data fields from the 'data URLs', and forms a JSON object of them.
- Stores this JSON object into a NoSQL database (Redis / MongoDB).
- When executed, is able to send the crawled data as JSON objects to a remote server via REST api / RESTful methods.
Hello Sir...
I am a computer science tutor, I teach (among others) Scala and Algorithms.
I have done many crawling projects like this, and I'm planning to do this in Scala.
Please contact me for more details when possible.
I look forward to work for you Sir.
Best Regards.
Hey there !
We're 2 developers with vast and wide knowledge in Python and scripting specializing in Web Scraping.
We'll gladly do your project as it looks like something we can pull off, in fact, we recently just made this kind of project for someone else here.
Contact us for further details.