Data Scraping using Tampermonkey or Greasemonkey

Fertiggestellt Veröffentlicht Feb 23, 2015 Bezahlt bei Lieferung
Fertiggestellt Bezahlt bei Lieferung

I have a script that I have been developing for a couple weeks and need to make it better.

My goal is to access a ssl webpage through a username and password that has tables that I need to scrape every 5 minutes and insert into MySQL. I have the DOM script that parses the tables and insert them into the Db but I need to make it automated on the client side since the data I need to access is behind a login session that if inactive will timeout after 2 hours.

The script needs to have some kind of error/debugging as well and if it doesn't run successfully after a couple tries send and email/text alert.

Another thing I've noticed is the page that I need to parse is access through a javascript post link. So the script might need to get the URL of the parse page for another page first and then parse use the URL it gets to parse the data. I'm sure it's possible. I think they did this to make parsing the page harder.

See attached scripts to see what I have so far and what I've tried. Also, there is token variable in one of the scripts. Please include the value of the token in your bid so that I know you've read my project. Thanks!

Datensuche JavaScript jQuery / Prototype PHP

Projekt-ID: #7192246

Über das Projekt

6 Vorschläge Remote Projekt Aktiv Feb 24, 2015

Vergeben an:

rajeshsonisl

Hello! With 99% completion rate, 750 successfully completed projects, and a 5.00 reputation (maximum possible, 5.0) (Yes, not even 4.99 average rating, can be verified on my profile page https://www.freelancer.com/u Mehr

$368 USD in 2 Tagen
(1032 Bewertungen)
8.8

6 Freelancer bieten im Durchschnitt $291 für diesen Job

prashushinde9

Hi, I (Myself a senior PHP, ASP.NET programmer using C# and VB) have a team having experience of more than 10 years in developing web and mobile applications. I have a team of expert programmers who write robust and bu Mehr

$309 USD in 10 Tagen
(54 Bewertungen)
7.1
fhasanbd

A proposal has not yet been provided

$377 USD in 7 Tagen
(104 Bewertungen)
6.6
sisodiakaran

Dear Employer, Let me introduce myself as an expert software programmer and am really interested in working with you. I have done many offline jobs. I am willing to complete your job at a very fast pace and at a min Mehr

$250 USD in 3 Tagen
(20 Bewertungen)
5.3
flashsaiful

Hi, I can do this for you. Please send a massage in the PMB for details.......Best Regards flashsaiful

$222 USD in 3 Tagen
(43 Bewertungen)
5.5