Cloud based scraping tool - historical price (multiple locations, same SKU)

$30-250 NZD

Geschlossen

Veröffentlicht

vor mehr als 4 Jahren

$30-250 NZD

Bezahlt bei Lieferung

This is an easy job for someone who knows how. I'm looking for a web scraper to be built and run weekly to scrape the prices from this site: [login to view URL] The scraper is to run in the cloud, I can provide hosting (as we already have another site running data) I have a 'Digital Ocean' account information will be stored and I will create various tools from the data: -chrome extension to monitor price (already created, you need to link with existing API) -app to monitor price (in the future) Due to thousands of SKU items we have the current other data being run through crawlerA scrapy with multiple IP addresses. information required is: Title/headline/name of the product URL Price (current) Weight/size/quantity (eg. 700g or pack of 2) Unit of measurement (kg, g, each, etc.) URL based scraping to compare price from the same site. Identifier from the URL is the SKU number show 'lowest price' from the last 6 months calculate 'average price' from the last 6 months *NOTE: the site has prices for 38 locations. The SKU number is the same but price can be different. You have to let me know the best way to approach this *I have the existing code which is deployed on Ubunutu droplet please start your message with "ONION" so I know you have read the brief This could be ongoing work as this is only 1x site as a trial data will be presented like the attached screenshot as an extra box under existing any questions please comment and we can talk

JavaScript

PHP

Python

Software Architecture

Web Scraping

Projekt-ID: 22332303

Über das Projekt

9 Vorschläge

Remote Projekt

Aktiv vor 4 Jahren

Möchten Sie etwas Geld verdienen?

E-Mail-Adresse

Vorteile einer Ausschreibung auf Freelancer

Legen Sie Ihr Budget und Ihren Zeitrahmen fest

Für Ihre Arbeit bezahlt werden

Skizzieren Sie Ihren Vorschlag

Sie können sich kostenlos anmelden und auf Aufträge bieten

9 Freelancer bieten im Durchschnitt $284 NZD für diesen Auftrag

@gangabass

First of all I know about "ONION". I have worked with Scrapy and Crawlera many times before that's why I'm ready to offer you the same solution. My scraper will be Python based and use Scrapy to monitore your target website. It will get all fields you need to each product (Title/headline/name of the product, Price etc) and save output into database (or CSV file). Thanks. Roman

$250 NZD in 2 Tagen

4,9

(676 Bewertungen)

7,9

@schoudhary1553

ONION Hello, I have gone through your job posting and become very much interested to work with you. I am an expert in this field. I have already completed several projects like this. For evidence you can see my profile. Please visit : https://www.freelancer.com/u/schoudhary1553 I have excellent command over English. I am a hard worker, productive and worthy of your attention I hope, I would be the right candidate for this post. Awaiting an affirmative response from you. Kinds Regards, Sandeep

$250 NZD in 7 Tagen

4,9

(159 Bewertungen)

7,4

@writingapp

ONION. Hi. I am ready to write your project Write apps on your demand in many languages (Visual Basic, VBA, VBS, .NET, C#, JS, Python, Java, PowerShell) Write database apps including many db formats: MS Access, MS SQL, SQL Server, MySQL, SQLite, PostgreSQL, Firebird Write Automation apps including: * Automation Desktop apps. Some examples: Automation Playing Games, Automation Start/Stop/Click 3rd party apps * Automation Web apps. Some examples: Automation Web Scraping apps, Automation Web Crawling apps * Automation Data Processing apps: Automation formatting data to a specified template * Automation Data, Document Converting apps * Automation Macro, VBA for all apps in MS Office (Excel, Word, Outlook), OpenOffice, GoogleSheet * Automation Installers/Setups * Convert your Manual tasks to Automation solutions Write Web Service, Web API, Desktop API apps. Some examples: Google API, Bing API, Facebook API, MS API Fix/Solve any errors in your OS, apps

$160 NZD in 3 Tagen

4,9

(60 Bewertungen)

5,6

@arvaibhav

I have experience in web scraping can do in python, java as per speed and processor usage requirements please check my profile and let me know if interested

$140 NZD in 7 Tagen

5,0

(24 Bewertungen)

5,2

@ozo42

onion cmmon, why onion? ping me. it was tltr

$1.110 NZD in 1 Tag

5,0

(9 Bewertungen)

4,7

@akiramatsui0305

"ONION" hi dear. i have read and understood your request.i am interested in your project and can do it very well. I have wide experience in Python scrapy spider and scraping data development and i am looking forward to contact me, please. i want to consult with you through chatting . thank you

$100 NZD in 3 Tagen

4,9

(5 Bewertungen)

2,7

@Sadhana141

Hi can scrape your data -- please look at the data - here there is limit to show full data {"NavigationList":[{"URL":"/category/fresh-foods-and-bakery","Name":"Fresh Foods & Bakery","ItemName":"Fresh Foods & Bakery","Children":[{"URL":"/category/fresh-foods-and-bakery/fruit--vegetables","Name":"Fruit & Vegetables","ItemName":"Fruit Vegetables","Children":[],"IsInMobileHeader":false,"ItemId":"f124319d-df93-02fe-6594-1d03fb2126b4"},{"URL":"/category/fresh-foods-and-bakery/butchery","Name":"Butchery","ItemName":"Butchery","Children":[],"IsInMobileHeader":false,"ItemId":"3218de7c-8d9f-eae1-f199-4d3fad8f3391"},{"URL":"/category/fresh-foods-and-bakery/seafood","Name":"Seafood","ItemName":"Seafood","Children":[],"IsInMobileHeader":false,"ItemId":"c55dcb69-754c-e826-19f2-53ce09c781f1"},{"URL":"/category/fresh-foods-and-bakery/deli-salads--cooked-meats","Name":"Deli, Salads & Cooked Meats","ItemName":"Deli Salads Cooked Meats","Children":[],"IsInMobileHeader":false,"ItemId":"b658bc9f-39fc-e9bb-e793-ac58b5cf9a5d"},{"URL":"/category/fresh-foods-and-bakery/bakery","Name":"Bakery","ItemName":"Bakery","Children":[],"IsInMobileHeader":false,"ItemId":"c627674f-86a5-417b-9742-a72d3d5d6602"},{"URL":"/category/fresh-foods-and-bakery/dairy--eggs","Name":"Dairy & Eggs","ItemName":"Dairy Eggs","Children":[],"IsInMobileHeader":false,"ItemId":"537286c9-9cc5-6ea7-160c-ee73ae1096e9"},{"URL":"/category/fresh-foods-and-bakery/bulk--loose-foods","Name":"Bulk & Loose

$200 NZD in 5 Tagen

1,0

(1 Bewertung)

1,8

@DrumSergio

ONION Hi, I have been working with scraping for a couple of years, although my total experience in different areas exceed 5. I am Sergio Fernández, Telecommunications Engineer which is more experienced with Selenium, but scrapy is not a problem. My rate for these type of projects is 40€/hour. Best regards

$250 NZD in 7 Tagen