Data Streaming upload/download server in Python Twisted.Web2(repost)
$100-500 USD
Abgesagt
Veröffentlicht vor etwa 13 Jahren
$100-500 USD
Bezahlt bei Lieferung
Write a server, in Python using [login to view URL], on an Ubuntu platform.
The server will stream SQL data dumps to and from a PostgreSQL backend server. The data will go to or from the client, or to or from Amazon s3.
For streaming to the client, provide appropriate headers that the major browsers will handle the download gracefully. Support all 3 data formats that pg_dump supports (plain-text, compressed, and tar) for both upload and download.
For streaming to Amazon S3, the boto library seems to be supported and widely used. We do not know at the beginning of the postgres dump what the size of the data is, so we need an orderly system of using multiple fixed size S3 'key's in the 'bucket' to receive the data.
Provide your own server, (a small VPS will suffice), with Postgresql 8.3, and Python 2.5 for deveopment. I will provide python mock modules that return Postgresql and S3 account identifiers and authentication.
I will need to verify functionality on your server before completion. I will handle deployment on my development server, but if I need assistance, we can arrange a follow-up hourly contract for support. In your delivery package, indicate clearly all dependencies (if any) other than the current twisted subversion checkout, python's standard lib, and the mock modules.
Keep all modified or new modules in their own namespace.
This is a reimplementation of a server already completed (using [login to view URL]). I find that web does not support streaming very well, and the implementation is proving difficult to maintain. Source code for the previous implementation will be available to the winning provider.
The current server does not support Amazon S3, so the interface will need to be extended to suit. I can provide a sample or template, but I think the current bulk-transfer page can just be extended.
The site is [login to view URL], and accounts are free, so if you wish you can check the current version out now (linked as 'Bulk Data Transfer') from the profile page.