Build a website that scrapes image hashes and allows searches

Hi there i use C# and sql server 2012 i can develop a bot for you as per your requirements with images and stuff. I have done scrapping almost on Half of Worldwide web including ecommerce giants(Amazon,ebay,craigslist) News Feed, Social media websites, API's. I develop my own tools based on client requirements with Mulithreading, a Bot with human behaviour and Scrapping Applications with documents parsing. I Can do PDF Parsing and Capctha ByPass code as well. Contact me for further details

Hi there. I am a professional web scraper, with experience creating web platforms that call the data from a database. I would use an already developed software to create the API that will extract the images and all the data needed, then I would write a script on PHP that will connect the API to your server to save the data into MySQL, and finally I would create the platform in PHP that will call the data from the database and let it work as the website you mentioned. Hope to hear back from you soon so we can discuss further details of the project. Thanks, Daniel

Hi. Before I start to describe my idea about the project itself I want to ask few question so that I get a big picture of the project. 1. So, the crawler have to search which websites? As much as possible ? 2. What is the site we need to make crawler for? 3. So, this mean that we do not need to store images itself, we need only this hashes and maybe a links to the url, yes? The most important components of our system are: 1. Crawler - crawler should constantly run on the site and get most updated images. I'm planing to do this using python ans specially scrapy framework. Depending on the number of request we will make on the site we may need to add proxies so that we may not get banned. 2. Another important component is database. This is important to make sure that it response fast on big load in terms of traffic and storage. I suggest to use Mongo for this. From my experience it scale well. 3. And the web interface itself which will be a simple input as the site you showed. Let me know this details. Thx, hope we will collaborate.

Dear Sir, I'm very much delighted to let you know that i did data scraping with PHP-cURL, Node.js, Selenium from many sites. I just scraped the data from web site and then wrote the data in mysql database or excel or csv or xml file. I worked on many similar projects, I have big experience in data mining projects. I have written hundreds of web scrapers which scrape millions of pages each day. I'm ready to fulfill your requirement. I can finish this task in short time, with the best quality. I can assure 100% accuracy. Please give me the opportunity to do the work. With Kind Regards, Debdulal Roy Proshanta

Hi I have experience in web scraping. I scraped video links from youtube sites. I think i can also do like that from reddit.com. If you give me the chance to do this, I'll do my best and make you satisfy. I hope to discuss more detail and forward. Thanks

A proposal has not yet been provided

Hello, I am an experienced programmer and here I'd like to explain an approximate plan of work: 1. Scraping is performed in the following way: there is a queue which contains the urls needed to be scraped. Few threads pick urls from the queue, if an url happens to be an image, it is stored in the db, if it is an usual html page, parse all links to the same site and add new ones to the queue. After link being processed it is put to the queue again (the page can be updated later). The queue is initialized by the website url. 2. The database contains few hashes and the link to the original image. One of the hashes is the hash of the original image, other are hashes of processed image (scaled to some fixed size, transformed to white-black and so on) for approximately coinciding images search. 3. Search is performed as follows: the hashes of the image are calculated and looked in the db. The language I am going to use is Python, the database is MySQL. If you have any questions you are welcome to ask. Thank you in advance.

A proposal has not yet been provided

Dear Sir/ Madam, My name is Henry - the owner of PHAMTECH Co. My team is really interested in this project as it is exactly within our scope of expertise: We are web/ app design & development company located in Hochiminh city, VIETNAM. Working with a team who has both in-house DESIGNERS and PROGRAMMERS means that you can take advantage of both: Our designers could help revise the design even in coding process, which is a GREAT benefit for any ongoing project. + We plan and build. We don't use prebuilt templates which produce conflicting codes and bugs and hurt the system in the long term. + Our team is 100% in-house. We don't outsource projects elsewhere. So you pay for the real service - not marketing fee. In short, if you need an experienced team who offers *real English* communication, beautiful design & optimized code, premium after-service, in time and to budget, then we are the choice. If you need something based on solely ONE of the above criteria, then we're still happy if you decide to give another freelancer a chance. Just bookmark our Freelancer profile https://www.freelancer.com/u/phamtech211.html and come back in case the selected freelancer can't meet your demands. Best wishes, Henry.

Hi, I am a professional web data scraper specialized using Python program, PHP script, .Net program, Crawler and Bot. This demo will capture Business's name, address, zip, phone, ratings and reviews in 4 different sites. The final output will be save in *.XLSX format or as your quirement.I can start as early possible depending on your approval and acceptance. In relation to this application, I can rest assured I will impart a high quality and reliable, efficient and accurate with the output. Give me a try and I will try to get the best results and finish the project far before the deadline. Thanks, Saminatinny

Hello Sir => We have to collect information from reddit and store in to mysql db. => then using reddit api we have to apply method for reverse search of images. => also we have to store information like future increases in user activity and requests. Looking forward to your response. Please let us know if you have any query or question. Thanks Guru Technolabs

Hi, Dino here, I would be interested in discussing this project with you. Thanks for the consideration, I hope to hear from you soon Dino Please check my portofolio

Hello, Thanks for posting project related to my workspace.I have 10+ years experience in Php, WordPress, CakePhp, Codeigniter, HTML5, Bootstrap,Ajax, MySQL.I have done many projects using above technologies.I believe every project is different and require different approach to get the job done.I have good reputation on freelancer.com of my work. So I think I am capable of doing this job and will prove myself, If you think so , please leave a message..

Dear Sir, I have 4 years of experience in php/python/django/html/css. I have gone through your requirement and interested to work on your project. Please check my reviews and feedback for your reference. Thanks & Regards eGlobalSoft

A proposal has not yet been provided

Hy, We would be looking at a combined hardware and software solution. For scraping we would need to create an intelligent bot that would fetch images from the sources you indicate, but using a pausing time delay so we won't hammer the source/server. For storing we would need to create a hardware solution with multi terrabit storage space, and a software solution to backup hashes of images in the database. For web scraping it would be useful to start with a few sources and increase as you would need to expand. We are expert scrapers and can provide you with both hardware and software needs, as we can offer this application on a Software as a service style. Peter

Hi, I have rich experience in web scraping. And I am gonna use PHP, MySQL for this project. Look forward to your positive response. Bibi.

I'm developing on Linux exclusively. Let me know if you need it to run elsewhere and I will try not to use any Linux-exclusive code then. I will try to write independent scripts for the multiple parts of the process, so that scaleability won't become an issue later on. The parts I forsee are - Voat Crawler/Spider to find relevant posts and data (will put info to DB) - Image downloader (takes URLs from DB and actually fetches the images to disk) (possibly those two would be combined as a single part, will have to see what works best) - Thumbnail generator (gets told to build our website previews from fetched images, maybe on demand) - Image hasher (hashes images and puts hashinfo to DB) (as a separate part, this should allow extending or replacing the hashing logic later on) - Website interface to database and image cache/data (The real work. If you have an idea here how the Frontend should work, I'd be glad to let you do the Layout part. I would build the interface (SQL queries) to the database, for example as JSON data endpoints to be consumed by some javascript.) I would use the image hashing logic in the repo you showed me, sadly I couldn't get OpenCV to work here, the stuff I wanted to do made it segfault. scikit-image looks like a good alternative. I would still look into figuring that out. But at this time I can't guarantee 100% that I can get that working. I would believe about 14 days to have the backend running, some extra for the website. Needs some more talk I

A proposal has not yet been provided

A proposal has not yet been provided