
Completed
Posted
Paid on delivery
I need all product-related text data gathered from a single website and handed back to me as a clean, well-structured Excel workbook. The site contains several catalogue pages; the script must move through every section, capture each item and place its details—name, price, SKU, description, availability and any visible category tags—into the right columns. Everything is public and loads in plain HTML, so no login is required, but I do want the pull to be 100 % complete, free of duplicates and ready for quick analysis the moment I open the file. Deliverables • One .xlsx file containing the full product list • The reusable scraping script (Python with BeautifulSoup, Scrapy, or a similar tool) or a clear step-by-step method so I can repeat the extraction later Let me know your estimated turnaround and any potential hurdles you see with pagination or rate limits so we can address them up front. In total it there are 160.000 product entries with 5 specifications that I need in an excel or csv file. So its a quick job for a simple script.
Project ID: 40517061
83 proposals
Remote project
Active 7 days ago
Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
83 freelancers are bidding on average $124 USD for this job

HI there already i have checked project details i am able to scrap all product information for you so please contact me, thank you
$150 USD in 1 day
8.8
8.8

With over a decade of experience in Python, SQL, MongoDB, and particularly Web Scraping, I am certain that I have the right skills to generate the well-structured Excel workbook you need. I am quite familiar with tools like BeautifulSoup and Scrapy, and can even create a clear step-by-step guide for you to be able to repeat the extraction easily in the future. Having undertaken several projects involving data extraction and processing, including some complex ones with over 500k entries, I understand the importance of accuracy and duplicate elimination. With my well-tested methods and a keen eye for detail, rest assured that your 160k product entries will be captured without any loss or repetition, ensuring a complete dataset for your analysis. Moreover, my ability to build Windows software with user-friendly interfaces can prove beneficial for this task. Not only will I deliver an accurate and clean worksheet in record time but also provide you with a re-usable scraping script that can save you time and effort later on. So, let's get started on quickly making your data insightful!
$100 USD in 3 days
8.3
8.3

Hello, can you show me html page? we can start work right now and gather all product details asap, awaiting your answer, thank you............
$30 USD in 1 day
7.8
7.8

Good Day! I can build a reliable Python-based scraping solution to extract all product data from the website and deliver it in a clean Excel/CSV format. The script will systematically crawl all catalogue pages, handle pagination, and ensure every product is captured without duplicates. The output will include structured columns such as product name, price, SKU, description, availability, category tags, and the 5 specifications you mentioned. I will design the scraper using tools like BeautifulSoup/Scrapy with proper pagination handling, rate limiting control, and error recovery to ensure full coverage of ~160,000 records. Alongside the dataset, I will provide a reusable script with clear instructions so you can run or update the extraction anytime in the future. I will also include safeguards for performance (batch processing, retry logic) to handle large-scale data without breaking or missing entries. Given the dataset size, I will first confirm site structure stability and pagination logic, but once validated, I can deliver a complete, clean export ready for analysis. Ready to start as soon as access details are shared.
$140 USD in 7 days
7.3
7.3

Hi there, I have reviewed the project requirements for extracting product information into an Excel workbook from a website. Let's chat and discuss it further. To handle your project, I will start with creating a custom web scraping script using Python with BeautifulSoup. This script will navigate through all catalogue pages, extract product details such as name, price, SKU, description, availability, and category tags, and organize them neatly into an Excel workbook. The deliverables will include a comprehensive .xlsx file containing the complete product list and a reusable scraping script in Python for future extraction tasks. Before signing-off my bid, I would like to ask a question, i.e., have you encountered any specific challenges with pagination or rate limits on the website? Warm Regards, Aneesa.
$100 USD in 1 day
7.0
7.0

❤️ Hello ❤️, I carefully reviewed your requirements and understand you need around 160,000 public product entries scraped from a single website, including name, price, SKU, description, availability, category tags, and 5 specifications, delivered in a clean Excel or CSV file. ⚙️ I have strong experience with Python scraping using BeautifulSoup, Scrapy, Requests, pagination handling, duplicate removal, large dataset exports, and clean structured data delivery. ✅ I can deliver: • Complete product extraction across all catalogue sections • Name, price, SKU, description, availability, tags, and specifications • Pagination/rate-limit handling for stable crawling • Deduplicated Excel/CSV output ready for analysis • Reusable scraping script with clear run instructions • Sample output first for validation ? My focus will be speed, completeness, clean formatting, and a repeatable script you can reuse later. Best regards, Steven
$30 USD in 1 day
7.3
7.3

Extracting your 160k product catalogue... I see you need a 100% complete, deduplicated Excel workbook pulling roughly 160,000 product entries (Name, Price, SKU, Description, Availability, Categories) from a plain HTML site, along with the reusable script. Because 160,000 requests will trigger standard rate limits if coded poorly, here is my exact execution plan to address your hurdles: Concurrent Extraction: I will build a highly concurrent Python script (using Scrapy or aiohttp) with randomized headers and smart delays. This bypasses pagination blocks and safely pulls the data without hammering the server or getting your IP banned. Pandas Cleaning: I will process the raw HTML data through Pandas to strip out all duplicates, format your specifications perfectly, and output the clean .xlsx file ready for immediate analysis. The Handoff: You will receive the clean Excel workbook and the fully commented Python source code, including a brief README explaining exactly how to run the script for future extractions. Quick question: To help me structure the anti-ban logic, does the target website sit behind a strict Web Application Firewall (like Cloudflare), or will standard rotating headers be enough to prevent rate-limiting?
$240 USD in 5 days
7.2
7.2

Hi, I specialize in web scraping and data extraction. I've successfully completed similar projects using Python, BeautifulSoup, and Scrapy. I can efficiently extract all product data from the specified website into a well-organized Excel workbook, ensuring no duplicates and easy analysis. I will provide you with a reusable scraping script for future use. Let's discuss any potential pagination or rate limit challenges upfront. With 7+ years of experience, I guarantee a high-quality, timely delivery. Let's chat about your project requirements. Thank you.
$180 USD in 3 days
7.0
7.0

Ability to work quickly and deliver results as soon as possible-----------------Let’s get started to Complete this task Product Info Extraction into Excel I am talented solution oriented PYTHON/Full stack developer. ----keen eye for detail and outstanding observational abilities Please ping me to get started and provide you great results. Thanks
$250 USD in 7 days
6.9
6.9

Hello! I will create a PHP script to scrape data you need Please provide the details I have extensive experience in writing PHP scripts for data scraping Please see my reviews for reference.
$400 USD in 3 days
6.4
6.4

Hi, I’ve developed similar web scraping solutions that extract product data from multiple e-commerce sites, including Amazon and eBay. I can create a robust, reusable script that captures product names, prices, SKUs, descriptions, and images, while also handling pagination and duplicate entries. For this project, I’d use Python with libraries like BeautifulSoup and Selenium to ensure we get all the data, even from JavaScript-rendered content. I’d also implement a daily cron job to run the script automatically, so you always have the latest data without manual effort. Let’s schedule a 10-minute call to discuss your requirements in more detail and see if I’m the right fit for your project. I’m eager to learn more about your exciting project. Best regards, Adil
$196.17 USD in 7 days
6.3
6.3

Hello, 160000 products is not a simple job. They may have anti-bot .
$140 USD in 7 days
6.1
6.1

Hi there, Myself suganya, hope you are doing good. i am clear with the instruction and available to get the name, price, SKU, description, availability and any visible category tags from source website 100% perfectly. Good in data scraping. waiting for your message. i can get the sample output immediately if you wish. Thanks
$100 USD in 2 days
5.7
5.7

Hello, I can build a reusable Python scraping script and deliver the full product dataset as a clean Excel/CSV file. I understand the scope: one public website, no login, plain HTML, multiple catalogue sections, around 160,000 product entries, and 5 key specifications per product. The output will include structured columns such as product name, price, SKU, description, availability, category/tags, and source URL if useful for verification. My approach: Map all catalogue sections and pagination Extract product data using Python with BeautifulSoup/Scrapy Handle pagination systematically Deduplicate products by SKU/URL/name where appropriate Validate completeness by comparing discovered URLs vs extracted rows Export to .xlsx and/or CSV Provide the reusable script and clear instructions to rerun it later Potential hurdles are mainly pagination structure, server rate limits, duplicate URLs across categories, and missing/inconsistent product fields. I will add polite delays/retry logic so the extraction is reliable and does not overload the site. For 160,000 entries, I recommend CSV as the primary output for speed and Excel as a secondary formatted version if file size remains practical. I can start with a small sample scrape first, verify the structure with you, then run the full extraction.
$140 USD in 2 days
5.8
5.8

I can write python script to scrape all products into excel file. Available on chat to discuss and ready to start. Please share website url and specifications required
$65 USD in 7 days
5.7
5.7

Hi, I can create a Python scraping script to extract all 160,000 product entries, including name, price, SKU, description, availability, and category tags, then deliver the data in a clean Excel or CSV file with duplicate checks and full coverage across all catalogue pages. Approach: Handle pagination, optimize requests for large-scale extraction, and provide a reusable script for future runs. Estimated Turnaround: 1–2 days, depending on site structure and any rate limits. Best, Muhammad
$100 USD in 1 day
5.8
5.8

Hello! I can scrape all 160,000 product entries from your website and deliver a clean, duplicate-free Excel/CSV file with name, price, SKU, description, availability, and category tags. I will build a reusable Python scraping script using BeautifulSoup/Scrapy that can handle catalogue sections, pagination, and structured data extraction accurately. I will also check for rate limits, duplicate products, and missing fields to make sure the final file is complete and ready for quick analysis. Looking forward to your response. Thanks! Regards, Waqas Ahmad
$50 USD in 1 day
6.3
6.3

Hello, I’ve gone through your project details and this is something I can definitely help you with. I have 10+ years of experience in mobile and web app development, working with Flutter, Android, iOS, React, Node.js, and APIs. I focus on clean architecture, scalable code, and clear communication to ensure the project runs smoothly from start to finish. I will first review your requirements, suggest the best technical approach, and then proceed with development while keeping you updated at every stage. Here is my portfolio: https://www.freelancer.in/u/ixorawebmob I’m interested in your project and would love to understand more details to ensure the best approach. Could you clarify: What specific output format do you envision for the extracted product data? 1. Do you need this for mobile, web, or both? 2. Do you already have UI/UX designs or should we create them? 3. Will there be any third-party API or payment gateway integration? 4. What is your expected timeline for completion? 5. Are there any reference apps or websites you like? Let’s discuss over chat! Regards, Arpit Jaiswal
$155 USD in 25 days
5.4
5.4

With over a decade of experience in software development, data science and full-stack engineering, I undoubtedly have the skills to execute this project. I've accomplished several projects involving web scraping using Python and other libraries such as BeautifulSoup and Scrapy—precisely what you need for this task. My specialization in data preprocessing and analysis will ensure that your scraped data is accurate, clean and well-structured in your Excel workbook. My proficiency in HTML, Python, CSS, and Javascript not only enables me to scrape the data you require but also guarantees that pagination or rate limit hurdles won't be an issue for me. In fact, I pride myself on my problem-solving abilities which have come handy on countless occasions when extracting data from websites with similar architecture. In addition to delivering the final product—an organized Excel workbook—I'll also provide you with a reusable scraping script or a step-by-step method so that you can repeat the extraction later independently. My turnaround time will be optimized to swiftly deliver the entire dataset of roughly 160,000 product entries in a format of your choice (Excel or CSV). Plus, I'll ensure zero duplicates so you can kick start your analysis immediately. Save yourself time and effort by choosing me—a capable technologist—to handle your straightforward task! I look forward to working with you.
$30 USD in 3 days
5.0
5.0

Hello, I can build a Python script to extract all 160,000 product entries from the website and export the data into a clean Excel or CSV file with the required fields, including name, price, SKU, description, availability, and category tags. I will ensure the output is complete, duplicate-free, and well-structured for analysis, and I will also provide the reusable script for future use. Feel free to message me with the website URL so I can review any pagination or rate-limit considerations and provide an accurate turnaround time. Kind Regards, -Habib
$220 USD in 3 days
5.0
5.0

Vienna, Austria
Payment method verified
Member since Jun 28, 2011
$30-250 USD
$30-250 USD
$10-30 USD
$250-750 USD
$30-250 USD
$15-25 USD / hour
$1500-3000 USD
$250-750 USD
$3000-5000 USD
$15-25 CAD / hour
₹12500-37500 INR
$10-30 USD
$10-70 USD
$10-30 AUD
₹1500-12500 INR
$15-25 USD / hour
₹12500-37500 INR
$250-750 USD
₹1500-12500 INR
$120-150 AUD
₹1500-12500 INR
$250-750 USD
$30-250 USD
₹600-1500 INR
₹12500-37500 INR