
Geschlossen
Veröffentlicht
Bezahlt bei Lieferung
PROJECT BRIEF: Social Media & News Comment Monitoring System (Data Collection + NLP + Admin Panel + Power BI Integration) 1. Project Overview We are looking for an experienced full-stack developer or development team to build a complete monitoring system for collecting, processing, analysing and exporting social media and news comment data. The system must automatically fetch content, perform text cleaning and classification, run sentiment analysis, and make the processed data available for dashboards in Power BI. The project consists of four core components: Data acquisition Data processing & NLP Admin panel Power BI integration Hosting can be on AWS / Azure / VPS (developer may propose optimal architecture). 2. DATA ACQUISITION (APIs + Legal Scraping) The developer must be able to implement: 2.1 Public Data Sources X/Twitter API (official API only) YouTube API (video search, metrics, comments) Reddit API News portals with public comment sections (scraping only where legally permitted) Facebook/Meta data only if possible via legal Graph API endpoints (no scraping; must comply with Meta Platform Policy: [login to view URL] ) 2.2 Data Collection Requirements Configurable fetch frequency (e.g., every hour / once per day) Logging of errors and API limits Storage in a structured SQL database (PostgreSQL preferred, but open to alternatives) Expected data volume (initial estimate): 5,000–50,000 rows per day Scalable architecture to support higher volumes later 2.3 Data Structure Each collected item should include at minimum: Date/time Platform Source URL / ID Full text Author (if available & legally permissible) Number of likes / replies / views (if applicable) 3. DATA PROCESSING & NLP PIPELINE The developer must create an automated processing pipeline with: 3.1 Text Pre-Processing Removal of HTML, special characters, emojis, spam patterns Language detection: LV, RU, EN Tokenisation and normalisation 3.2 Automated Keyword & Topic Classification Keyword matching for predefined keyword lists Automatic extraction of additional keywords Optional: Topic modelling (LDA or similar), if feasible 3.3 Sentiment Analysis Sentiment classification (positive / negative / neutral) Developer may use an existing open-source model or fine-tune a lightweight model Accuracy must be optimised for Latvian/English/Russian if possible 3.4 Output Table For each processed text: Date Platform Source Text Sentiment value Topic / category Identified keywords Metrics (likes, shares, views, etc.) 4. ADMIN PANEL (Web Application) A secure admin panel where non-technical users can manage monitoring settings. 4.1 Core Features Add / edit / delete keywords and keyword groups Create thematic monitoring groups (e.g., “Elections”, “Education”, “Human rights”) Enable / disable data sources Filter by: Date range Platform Language Sentiment Keywords View summary statistics (optional basic charts) 4.2 Users & Authentication Initially 1–3 admin users Standard login system (JWT or session-based) Role-based access (optional) 5. POWER BI INTEGRATION Developer must provide one of the following: Option A — Direct API Feed Provide an API endpoint that Power BI can refresh automatically. Option B — Export to Files Periodic export of data into: CSV JSON Parquet (optional) Stored on AWS S3 / Azure Blob / server folder for Power BI ingestion. Power BI Requirements The exported/served table must include: date platform source text sentiment topic keywords metrics columns unique ID timestamp of last update Automatic scheduled refresh is required. 6. TECHNICAL REQUIREMENTS 6.1 Preferred Tech Stack (flexible) Backend: Python (FastAPI / Flask) or Node.js Frontend: React / Vue / standard admin template Database: PostgreSQL or MySQL NLP: Python (spaCy, NLTK, transformers) Hosting: AWS / Azure / DigitalOcean / other (developer may propose) 6.2 Documentation The developer must deliver: API documentation Database schema Instructions on deployment Admin panel user guide 6.3 Code Ownership All code and database schema must be fully delivered with full usage rights. 7. WHAT TO INCLUDE IN YOUR PROPOSAL Developers should provide: Description of relevant experience in: API integrations NLP / sentiment analysis Web scraping Admin panel development Power BI integrations Proposed tech stack Estimated timeframe Estimated cost (fixed price or hourly) Clarifications/questions if any requirements are unclear 8. Additional Notes Project must comply with all platform policies (Meta, YouTube, X, Reddit, etc.). No illegal scraping of Facebook is allowed. Scalability and reliability are important. GDPR Please also integrate Google Trends (via Pytrends or another available method) to monitor search interest for selected keywords in Latvia. The admin panel should allow adding keywords, and the system should store the search popularity time series (daily or weekly) in the database for Power BI.
Projekt-ID: 40065613
90 Vorschläge
Remote Projekt
Aktiv vor 26 Tagen
Legen Sie Ihr Budget und Ihren Zeitrahmen fest
Für Ihre Arbeit bezahlt werden
Skizzieren Sie Ihren Vorschlag
Sie können sich kostenlos anmelden und auf Aufträge bieten
90 Freelancer bieten im Durchschnitt €7.418 EUR für diesen Auftrag

Hi, I’m Muhammad Awais, a full-stack developer with hands-on experience in API integrations, NLP workflows, admin dashboards and Power BI connections. I understand you need an end-to-end Social Media & News Sentiment Analysis System: automated data collection from X (Twitter), YouTube, Reddit and public news comments, NLP processing, an admin panel to manage sources and keywords, and a Power BI export path. My approach is to design a scalable stack on AWS/Azure with PostgreSQL, a Python FastAPI backend, and a React-based admin UI. Data ingestion will support official APIs and compliant scraping where allowed, with configurable fetch frequencies and robust error logging. The NLP pipeline will perform HTML/emoji cleaning, language detection (LV/RU/EN), tokenization, keyword extraction, optional topic modelling, and sentiment classification with accuracy tuned for the target languages. Output tables will cover date, platform, source, text, sentiment, topic, keywords and metrics. The admin panel will let you add/edit keywords and groups, manage sources, and filter by date, platform, language, sentiment and keywords. Power BI integration will be via direct API feed or scheduled file exports to S3/Blob with a refresh setup. Documentation and full code ownership included. What is your preferred hosting platform and the key data governance requirements I should align with? Which cloud provider do you prefer and what are your uptime expectations? Do you have predefined keyword lis
€10.000 EUR in 27 Tagen
8,1
8,1

Having successfully executed similar projects, we understand the comprehensive requirements of your Social Media & News Sentiment Analysis System. Our expertise in AI-first product development and NLP positions us to deliver a robust solution tailored to your needs. With over 8 years of experience, we've built scalable systems integrating APIs, NLP, and web scraping. Our work with OpenAI, FastAPI, and sentiment analysis models ensures high accuracy across languages, including Latvian, English, and Russian. We specialize in end-to-end solutions, from data acquisition to Power BI integration, ensuring seamless operation and user-friendly admin panels. We propose using Python (FastAPI) for the backend and React for the frontend, with PostgreSQL for scalable data storage. Our transparent collaboration ensures compliance with platform policies and GDPR. Our portfolio includes similar AI-enabled projects, demonstrating our capability to meet and exceed project expectations. Q: Are there specific keywords or topics for initial monitoring? Q: Do you have a preferred timeline for project completion? We are eager to bring our expertise to your project and deliver a solution that exceeds expectations. Let’s discuss how we can achieve your goals. Best regards, Puru Gupta
€10.000 EUR in 44 Tagen
7,8
7,8

I bring over 10 years of expertise in full-stack development, specializing in API integrations, NLP, sentiment analysis, web scraping, admin panel development, and Power BI integrations. I understand the challenges of building a Social Media & News Sentiment Analysis System that requires automated data collection, text processing, sentiment analysis, and Power BI dashboard integration. In my past projects, I have successfully developed similar systems for clients in the fintech and healthcare sectors, delivering tailored solutions that met their needs effectively. My proficiency in Python, Node.js, React, and PostgreSQL aligns perfectly with the tech stack required for this project. I am confident in my ability to deliver a scalable, reliable, and GDPR-compliant system within your budget and timeline requirements. Let's discuss further how I can bring value to your project. Contact me to get started.
€8.000 EUR in 60 Tagen
6,7
6,7

With a sharp focus on data processing and a mastery of Python, I am more than equipped to take on your demanding project. My past success in building mobile apps and websites - particularly in social media application development - has prepared me exceptionally well for task of constructing a comprehensive Social Media & News Comment Monitoring System for you. I have an elite understanding of backend development languages like Python, with frameworks such as FastAPI and top-tier frontend technology like React, giving me the perfect dexterity to convert your needs into a working system. From my experience in building high-quality mobile apps and websites, I have been utilized various APIs (including Twitter, YouTube, Reddit), web scraping (news portals), and SQL databases (preferably PostgreSQL) that are aligned remarkably with your project requirements. For storage and analysis purposes, my knowledge of AWS (like S3) would be monumental in effectively organizing daily expected data volumes of 5000-50,000 rows. My expertise extends to Natural Language Processing (NLP) using major libraries like spaCy and NLTK which perfectly suits your sentiment analysis needs for Latvian/English/Russian. Additionally, I'm adept at setting up admin panels and incorporating automated processes such as filtering by date range or sentiment.
€10.000 EUR in 90 Tagen
6,8
6,8

Hi, this is Elias from Miami. I’ve reviewed the brief, and I understand the goal is to build a full monitoring platform that legally collects social media, news comments, and Google Trends data, runs a structured NLP pipeline (cleaning, language detection, topics, sentiment), and exposes everything cleanly to Power BI via API or scheduled exports. Scalability, policy compliance, and making the system usable for non-technical admins are clearly core priorities. I have 10+ years of experience building data pipelines and admin platforms that combine API integrations, legal scraping, NLP processing, and BI tooling. I’ve worked with FastAPI + Python NLP stacks (spaCy/transformers) I’d be happy to propose a clean, scalable architecture and deliver full documentation and ownership as requested. A few specific questions to align details early: Q1: For sentiment analysis, is explainability (why a text is positive/negative) important, or is accuracy the primary goal? Q2: Do monitoring groups and keywords need historical backfilling, or should they only apply from creation onward? Q3: For Power BI, do you prefer a direct API refresh model or file-based exports for reliability at higher volumes? Q4: Should Google Trends data be aligned strictly by country (Latvia only) or also broken down by language/region if available? Looking forward to discussing next steps. Regards, Elias
€7.500 EUR in 7 Tagen
6,1
6,1

As an accomplished PhD Researcher and a Senior Machine Learning Engineer specializing in Natural Language Processing (NLP), I believe I possess the essential skills demanded by this project. With over 8 years of experience building and deploying machine learning models, I am adept at data collection, data processing, NLP and sentiment analysis, which are the core components of your project. I am well-versed in popular Python libraries like spaCy, NLTK and Transformers that can create a robust automated text processing pipeline. Lastly, my familiarity with Power BI will enable me to seamlessly integrate the processed data from our system into user-friendly dashboards. Furthermore, my technical skills extend beyond just NLP - I'm experienced in Python's FastAPI and Node.js for backend development and using React or Vue for frontend. Given my comprehensive skill set, academic experience in Machine Learning combined with real-world contributions to impactful projects similar to yours—I firmly believe I am the ideal candidate to not only meet but exceed your expectations for this project. Let's leverage my expertise to capture the insights from social media & news!
€5.000 EUR in 30 Tagen
5,6
5,6

Hello! We can build your complete social media and news sentiment analysis system with automated data collection, NLP processing, admin panel, and Power BI integration. We are a team of 62 professionals with over 9 years of experience in API integrations, web scraping, sentiment analysis, and data pipeline development. Here's how we can help: - Implement legal data acquisition from X/Twitter, YouTube, Reddit APIs and permitted news portals with configurable fetch frequency and error logging - Build automated NLP pipeline with text preprocessing, language detection for LV/RU/EN, keyword classification, and sentiment analysis optimized for multilingual content - Develop secure web-based admin panel for keyword management, monitoring groups, source configuration, and filtering with user authentication - Create PostgreSQL database architecture to handle 5k-50k daily rows with scalability for future growth - Provide Power BI integration via API endpoint or scheduled exports to AWS S3/Azure Blob with automatic refresh capability - Deliver complete documentation including API docs, database schema, deployment instructions, and user guides What's your preferred Power BI integration method, API feed or file exports? Do you have existing keyword lists or should we help structure the initial monitoring setup? What's your priority timeline for MVP versus full feature rollout? Are there specific Latvian NLP models you'd like us to use or fine-tune?
€7.500 EUR in 4 Tagen
5,3
5,3

I reviewed your project requirements Social Media & News Sentiment Analysis System and I’m confident that my technical expertise aligns well with what you’re looking for. I specialize in designing and developing scalable applications with a focus on performance, clean architecture, and long-term maintainability. My Technical Expertise Includes: ?AI & Automation — NLP, predictive analytics, chatbot development, workflow automation ?Python Development — FastAPI / Flask / Django, API development, backend architecture ?MERN Stack — MongoDB, Express, React, Node.js for full-stack web applications ?Mobile Development — React Native & Flutter for high-performance cross-platform apps ?Cloud & Integrations — Firebase, AWS, REST APIs, micro-services architecture I believe in clear communication, timely delivery, and building solutions that are not just functional — but future-ready, scalable, and optimised for real-world use. Whether the requirement is a small module or a full-scale system, I’m confident that I can deliver with precision, quality, and reliability. I would be glad to discuss your technical scope further and collaborate with you to bring your project to life. Looking forward to connecting with you. Best regards, Vinod Kumar
€5.500 EUR in 20 Tagen
4,8
4,8

Nice to meet you dacec2, My name is Anthony Muñoz, I express my interest in working on your project after carefully reading the requirements and concluding that they match my area of knowledge and skills. I am currently the lead engineer for the IT agency DSPro and I have more than 10 years of experience in the field. I have successfully completed a large number of similar jobs and I consider your project to be a challenge in which I would like to work and be able to make it a reality. Please feel free to contact me, it will be my pleasure to help you. I greatly appreciate the time provided and I remain attentive to any questions or concerns. Greetings
€12.832 EUR in 7 Tagen
3,8
3,8

Hello there, I understand that you are looking for an experienced full-stack developer or development team to build a complete monitoring system for collecting, processing, analyzing, and exporting social media and news comment data, including data acquisition, processing & NLP, admin panel development, and Power BI integration. Proposed Solution: I propose to implement a robust system that will automate data acquisition from various public sources, process the data using NLP techniques for sentiment analysis, and provide an admin panel for easy management of monitoring settings. The integration with Power BI will ensure seamless data visualization and analysis. Key Deliverables: 1. Data acquisition from public sources (APIs and legal scraping) 2. Automated text processing and sentiment analysis pipeline 3. Secure admin panel for non-technical users 4. Integration with Power BI for data visualization Portfolio & Skills: I bring expertise in API integrations, NLP, web scraping, admin panel development, and Power BI integrations. I will share my portfolio with you in the DM. Kindly, ping me there. Call to Action: I’d love to connect for a quick chat to discuss your project in more detail. Best regards, Bilal
€7.500 EUR in 7 Tagen
3,6
3,6

Dear [Client], With over 57 successful projects completed and positive reviews, I am confident in my ability to deliver a high-quality Social Media & News Comment Monitoring System for you. My expertise in web development, issue fixing, performance enhancements, custom features, automation, and API integrations make me the ideal candidate for this project. To approach this project, I will: 1. Implement data acquisition from public sources and legal scraping methods. 2. Develop a robust data processing & NLP pipeline for text cleaning, classification, and sentiment analysis. 3. Create a user-friendly admin panel for managing monitoring settings. Let's discuss how I can bring your vision to life. Looking forward to collaborating with you. Best regards, Naveen Kumar
€5.000 EUR in 20 Tagen
3,0
3,0

Hi there, Managing API rate limits while ensuring accurate sentiment analysis across English, Russian, and Latvian often results in data bottlenecks and high false-positive rates. If the scraping pipeline isn't resilient, your Admin Panel will report inconsistent metrics, making your Power BI dashboards unreliable for decision-making. I will develop a high-throughput Python architecture that legally aggregates data from X, YouTube, and Reddit, processes it with a specialized tri-lingual NLP model for accurate sentiment classification, and automates the flow into a secure Admin Dashboard and Power BI. Here are two quick questions to ensure we align on the architecture: 1. For the sentiment analysis model, do you prefer we fine-tune a multilingual BERT model, or should we use a specific existing library to handle the LV/RU/EN nuances? 2. Regarding Power BI integration, would you prefer a direct live API feed via FastAPI, or is a scheduled CSV/Parquet dump to AWS S3 sufficient for your reporting needs? Let’s discuss your project now!
€5.500 EUR in 30 Tagen
2,8
2,8

Hello Sir, I understand you are looking to build a full-scale Social Media & News Comment Monitoring System covering data acquisition, NLP processing, admin management, and Power BI integration, with strict compliance to platform policies and GDPR. With 14+ years of experience in full-stack development, data engineering, NLP pipelines, and analytics integrations, I specialize in building scalable, compliant monitoring systems used for public sentiment, media analysis, and decision support. Relevant Expertise • API integrations: X/Twitter, YouTube, Reddit, news portals (policy-compliant scraping) • Data pipelines handling 10k–100k+ records/day • NLP & sentiment analysis (spaCy, transformers, multilingual processing) Proposed Approach • Data Acquisition: API-first ingestion + legal scraping, rate-limit handling, logging • Processing Pipeline: Cleaning, language detection, sentiment, keyword & topic tagging • Storage: Normalized PostgreSQL with scalable indexing • Admin Panel: Secure web UI for keyword groups, filters, source management Questions Do you require real-time dashboards or near-real-time (hourly/daily) updates only? Should sentiment models prioritize accuracy for Latvian first, or balanced across languages? Preferred Power BI integration: API endpoint or file-based ingestion? I can provide case studies in NLP monitoring, sentiment systems, and Power BI analytics platforms. Let’s connect on chat or a call to finalize scope, timeline, and cost. Regards, Arun
€5.000 EUR in 25 Tagen
2,7
2,7

Hello there Hope you are doing well as you are looking for a "Build a SOCIAL MEDIA AND NEWS SENTIMENT ANALYSIS SYSTEM " so will make the same as you want , I have already develop and Design the so many System , - I will use latest technology to develop your Application - I will share daily update with you - I Will deliver your project within timeline - After project completion will share complete source code - I will provide 1 year support our develop work - I have 10+ year experience in Web & App development - I will make the 100% responsive design , fast loading , SEO friendly and all - I will provide you super admin panel there you can manage the whole thing Please initiate the chat so will discuss together and all Thanks & Regards Dheeraj K.
€5.000 EUR in 35 Tagen
4,3
4,3

Start the proposal with: “Just finished a very similar [project type] that delivered [measurable result] for a client…” Then connect it directly to the client's project. Write the rest of the proposal focusing on: • Technical approach • Tools, frameworks, APIs •:Keep it under 150-200 words max. Here is the project: [PASTE JOB POST]
€7.500 EUR in 14 Tagen
1,6
1,6

With over 7 years of experience in web design and development, my team and I at the Google partner digital agency have successfully crafted numerous robust web applications and digital campaigns that deliver substantial returns on investments for our clients. This, along with our expertise in API Development, Data Processing and Python makes us perfectly aligned with your project needs. Developing a complete Social Media & News Comment Monitoring System entails simultaneous handling of multiple data streams, an area where we excel. Tracking multiple APIs efficiently, minimizing errors, ensuring structured storage (PostgreSQL preferably, as per your initial requirement) for large volumes of data and meeting the demands of a constantly evolving schema are all well within our proficiencies. My team is adept at managing scalable architectures on various hosting providers like AWS/Azure which enable uninterrupted performance even with increasing volumes of data. Apart from developing a smooth-functioning system, we build error loggings which can help identify any issues and ensure proper measures can be taken for resolution. In addition to this, we provide thorough documentations including API documentation and database schema that would aid in the understanding and maintenance of the developed system.
€7.500 EUR in 7 Tagen
0,0
0,0

Hey Mate , Good morning! I’ve carefully checked your requirements and really interested in this job. I’m full stack node.js developer working at large-scale apps as a lead developer with U.S. and European teams. I’m offering best quality and highest performance at lowest price. I can complete your project on time and your will experience great satisfaction with me. I’m well versed in React/Redux, Angular JS, Node JS, Ruby on Rails, html/css as well as javascript and jquery. I have rich experienced in FastAPI, Python, Data Processing, Sentiment Analysis, Power BI, Web Scraping and API Development. For more information about me, please refer to my portfolios. I’m ready to discuss your project and start immediately. Looking forward to hearing you back and discussing all details.. Please respond at your earliest convenience
€5.000 EUR in 4 Tagen
0,0
0,0

Hello dacec2, I am Vishal Maharaj, a seasoned professional with 20 years of expertise in Python, API Development, and FastAPI. I have meticulously reviewed your project requirements and am confident in delivering a comprehensive solution. For the Social Media & News Sentiment Analysis System, I propose to implement a robust data acquisition system utilizing official APIs and legal scraping methods. The data will undergo thorough processing and NLP techniques for sentiment analysis and keyword classification. I will develop a secure admin panel for easy monitoring and integrate Power BI for insightful dashboards. Kindly initiate a chat to discuss the project further. Cheers, Vishal Maharaj
€8.000 EUR in 40 Tagen
0,0
0,0

Dear Client! I am a seasoned full-stack developer with extensive experience in API integrations, NLP, web scraping, admin panel development, and Power BI integrations. I propose to build a comprehensive monitoring system that collects, processes, and analyzes social media and news comment data. The system will feature automated data acquisition, text processing, sentiment analysis, and seamless Power BI integration for insightful dashboards. Utilizing a flexible tech stack including Python (FastAPI/Flask), React/Vue, and PostgreSQL/MySQL, I will ensure scalability and reliability while complying with all platform policies. My expertise in developing admin panels and integrating complex systems makes me the ideal candidate for this project. I am excited to collaborate with you on this innovative solution. Best Regards.
€5.000 EUR in 7 Tagen
0,0
0,0

As a seasoned full-stack developer with over 7+ years of experience, I possess an extensive skill set that aligns perfectly with your project requirements. My expertise spans across multiple technologies ranging from offering robust backend solutions in Python using FastAPI and Flask to developing responsive and modern WebApps utilizing React.js, Vue.js, Node.js to proficiently managing databases such as PostgreSQL and MySQL. Additionally, your integration needs with Power BI can be efficiently taken care of through my experience with APIs and Data exporting. Furthermore, my strong Artificial Intelligence background significantly aids in your quest for sentiment analysis. With hands-on experience in predictive analytics, NLP, and computer vision - extracting meaningful insights from social media commentaries is something I’m more than well-versed in doing. Upon being chosen for this project, you can trust me to implement a high-performing NLP pipeline that not only accomplishes the required language detection capabilities but effectively cleanses the comments, performs tokenisation, topic classification (including LDA), and optimally tunes the sentiment analysis model for English-Russian-Latvian languages. Considering your expected data volume growth over time, it's crucial to have a scalable architecture - which is an aspect I've ensured in all my previous projects as well.
€5.000 EUR in 7 Tagen
0,0
0,0

Riga, Latvia
Mitglied seit Dez. 15, 2025
$10-40 USD
$10-30 USD
$1500-3000 USD
₹600-1500 INR
$25-50 USD / Stunde
₹750-1250 INR / Stunde
₹750-1250 INR / Stunde
$250-750 USD
₹750-1250 INR / Stunde
$3000-5000 AUD
₹12500-37500 INR
$250-750 USD
$250-750 AUD
$30-250 USD
$250-750 USD
$30-250 USD
€12-18 EUR / Stunde
$30-250 USD
$15-25 USD / Stunde
$10-30 CAD