Downloader Script

Storniert Veröffentlicht Mar 20, 2007 Bezahlt bei Lieferung
Storniert Bezahlt bei Lieferung

I want: 1. a multi-threaded script which I will host on my server 2. to download a lists of webpages (static and dynamic) 3. using anonymous proxies 4. by switching the proxy for each page request 5. and at the end of the project, zip all downloaded files into one file for easy download. The script will be launched through a web-page which will have a form where I can input project name and upload a text file. The text file will have 1000s of URLs of dynamic pages like: [url removed, login to view] or [url removed, login to view] Sometimes the URLs can be of secure pages https:// It is very important for the script to use anonymous proxies and keep changing them dynamically as the web-servers will deny repeated requests from the same IP. I only want the HTML of the page. I dont want the CSS, images etc. The script should support multiple projects and maintain a log. It should update the status of each record which can be done by updating the same in the text file that I upload. The Script an be in any language - PHP, PERL, Python, etc. I am open to anything that works the way I have specified Thanks for your interest. Eshwar

## Deliverables

1) Complete and fully-functional working program(s) in executable form as well as complete source code of all work done.

2) Deliverables must be in ready-to-run condition, as follows (depending on the nature of the deliverables):

a) For web sites or other server-side deliverables intended to only ever exist in one place in the Buyer's environment--Deliverables must be installed by the Seller in ready-to-run condition in the Buyer's environment.

b) For all others including desktop software or software the buyer intends to distribute: A software installation package that will install the software in ready-to-run condition on the platform(s) specified in this bid request.

3) All deliverables will be considered "work made for hire" under U.S. Copyright law. Buyer will receive exclusive and complete copyrights to all work purchased. (No GPL, GNU, 3rd party components, etc. unless all copyright ramifications are explained AND AGREED TO by the buyer on the site per the coder's Seller Legal Agreement).

## Platform

Linux server

Ingenieurwesen Java MySQL Perl PHP Python Softwarearchitektur Testen von Software

Projekt-ID: #2889383

Über das Projekt

1 Vorschlag Remote Projekt Aktiv Mar 21, 2007

1 Freelancer bietet durchschnittlich $170 für diesen Job

redshanks

See private message.

$170 USD in 3 Tagen
(0 Bewertungen)
0.0