
Abgeschlossen
Veröffentlicht
Bezahlt bei Lieferung
I need two focused Python utilities that help me keep both of my data platforms tidy by flagging objects that haven’t been touched in X days and suggesting safe-to-drop SQL. Program #1 – AWS Athena • Connect to my Athena catalog (I work from the AWS Management Console, but in code I’d like you to stay with boto3). • For every table and view in a specified database, look back over completed query executions for the chosen time window. • Views can nest CTEs or reference other views, so the script must walk the full dependency chain to decide whether a reference is direct or indirect. • Return one CSV with the following columns exactly: database , objectname, objecttype, last_reference_datetime, referencetype (direct/indirect) , referencedBy, RemovalSql – referencedBy is the QueryExecutionId when the object is called directly, otherwise the object that called it. – RemovalSql is only populated when the object is demonstrably unused (no direct or indirect reference in the window) so I can drop it immediately. Program #2 – Microsoft SQL Server • Query Store is already enabled, so use it to pull execution history. • Scan tables, views, stored procedures, triggers, queues, and functions. • Produce the very same CSV layout described above, with last_reference_datetime generated from Query Store data and RemovalSql included only when safe. Both scripts should accept command-line parameters for: – target database / connection information – look-back period in days – output file path I’m happy with standard libraries plus boto3 for the Athena side; choose whichever light dependencies you need for SQL Server (pyodbc, sqlalchemy, etc.). Code should be clean, well-commented, and ready to run from the terminal. Deliverables 1. Two independent .py files. 2. A brief README explaining prerequisites, setup, and examples of running each script. 3. Sample output CSVs from a dry-run (anonymised data is fine) so I can verify column order and content. Acceptance criteria • Scripts run without modification once credentials are supplied. • CSV headers and field ordering exactly match specification. • Objects with any level of recent reference are never assigned a RemovalSql. • Indirect references are accurately traced. I’m looking for efficient, reliable code that I can schedule regularly, with clear logging so future troubleshooting is straightforward.
Projekt-ID: 40268920
97 Vorschläge
Remote Projekt
Aktiv vor 15 Tagen
Legen Sie Ihr Budget und Ihren Zeitrahmen fest
Für Ihre Arbeit bezahlt werden
Skizzieren Sie Ihren Vorschlag
Sie können sich kostenlos anmelden und auf Aufträge bieten

Keeping two distinct data platforms free of orphaned objects is exactly the kind of work I specialize in—I've built similar audit tooling against both boto3/Athena and SQL Server Query Store. For Program #1, I'll paginate through Athena's `GetQueryExecution` history via boto3, parse each SQL statement to map table and view references, then recursively walk view definitions to classify every hit as direct or indirect before writing your exact CSV schema. For Program #2, I'll join `sys.dm_exec_query_stats` against Query Store's `query_store_query_text` to cover tables, views, procs, triggers, queues, and functions with the same output format. Both scripts will use `argparse` for connection details and look-back window, and I'll include unit tests with mocked API responses. I'm available to start immediately.
$30 USD in 1 Tag
4,2
4,2
97 Freelancer bieten im Durchschnitt $157 USD für diesen Auftrag

Hello, This project aligns perfectly with my experience building metadata-driven Python utilities for analytics and database governance. I’ve worked with both AWS Athena (via boto3) and SQL Server Query Store, including dependency tracing, execution history analysis, and safe-drop validation workflows. The indirect-reference requirement is especially important here, and I’m comfortable building reliable dependency graph logic to ensure nothing in use is ever flagged for removal. You’ll receive: • Two clean, independent Python scripts • Command-line parameter support as specified • Exact CSV structure and header ordering • Clear logging for scheduled automation • README with setup instructions and run examples • Sample anonymized output files for verification My code is structured, well-commented, and written to run immediately once credentials are supplied. Estimated turnaround: 4–6 days depending on environment size. If needed, I can also make the scripts scheduler-friendly (cron/Task Scheduler ready). Happy to clarify any edge cases before starting. Best, Jenifer
$250 USD in 7 Tagen
9,5
9,5

I am highly qualified to do this job with high QUALITY ----- I am Passionate PYTHON /Full stack developer having rich experience with so many successful Tasks. I have some queries to give you accurate time and price Please ping me to get started and provide you great results. Thanks!
$250 USD in 7 Tagen
7,8
7,8

⭐⭐⭐⭐⭐ Create Python Utilities for Managing Data Platforms Efficiently ❇️ Hi My Friend, I hope you're doing well. I've reviewed your project requirements and see you're looking for Python utilities to keep your data platforms organized. Look no further; Zohaib is here to help you! My team has successfully completed 50+ similar projects, focusing on Python utilities and data management. I will create efficient scripts that flag unused objects and suggest safe SQL drops, ensuring your data remains tidy. ➡️ Why Me? I can easily create your Python utilities for AWS Athena and SQL Server as I have 5 years of experience in Python programming, database management, and data analysis. My expertise includes working with libraries like boto3, pyodbc, and SQLAlchemy. Additionally, I have a strong grip on data querying and CSV file handling, ensuring a smooth and effective workflow for your project. ➡️ Let's have a quick chat to discuss your project in detail and let me show you samples of my previous work. I'm excited about the opportunity to assist you! ➡️ Skills & Experience: ✅ Python Programming ✅ AWS Athena ✅ SQL Server ✅ Data Management ✅ Boto3 ✅ Pyodbc ✅ SQLAlchemy ✅ CSV File Handling ✅ Command-Line Scripting ✅ Query Execution Analysis ✅ Data Cleanup ✅ Logging and Debugging Waiting for your response! Best Regards, Zohaib
$150 USD in 2 Tagen
8,0
8,0

Hello, We understand you need two Python utilities to audit unused database objects across AWS Athena and Microsoft SQL Server, ensuring a tidy data platform. Our proposed solutions will efficiently connect to both data sources, identify unused objects within your specified timeframe, and produce a well-structured CSV output. Each script will accommodate command-line parameters for flexibility and automate the tracking of both direct and indirect object references, enabling safe removal where applicable. At A2 Design, we have a proven track record in developing scalable and efficient solutions tailored to complex business needs. For instance, our work on MadPaws showcases our ability to handle large datasets and deliver seamless booking experiences, while TutorTime highlights our expertise in sophisticated matching algorithms and secure communication features. Both projects involved comprehensive data handling, ensuring accuracy and performance. Let’s discuss how we can bring your vision to life. Reach out to explore the next steps!
$100 USD in 1 Tag
7,8
7,8

Greeting! I specialise in building Python automation utilities for database analysis, cleanup, and reporting, delivering reliable, production-ready scripts that meet strict CSV and dependency requirements. With over 9 years of experience in Python, AWS, and SQL Server, I’ll create both your Athena and SQL Server utilities to accurately track object usage and safely generate removal SQL. Here's how I can help: * **AWS Athena Script**: Connect via boto3, traverse table/view dependencies including nested CTEs, parse query execution history, and output the exact CSV format with direct/indirect references and safe RemovalSql * **SQL Server Script**: Use Query Store to scan tables, views, procedures, triggers, queues, and functions, track last references, and populate RemovalSql only for unused objects * Accept command-line parameters for database/connection info, look-back window, and output path * Provide clean, well-commented Python code ready for terminal execution with logging for troubleshooting * Deliver README with setup instructions and example commands, plus sample anonymised CSVs demonstrating correct headers, column order, and content Do you want the Athena script to handle cross-database references, or only within the specified database? Also, for SQL Server, should the scripts connect via Windows Authentication, SQL Authentication, or support both?
$140 USD in 7 Tagen
6,7
6,7

This is a well-specced project. boto3 for Athena query history with recursive CTE/view dependency walking, and Query Store for SQL Server - both the right approach here. I will build each as a standalone CLI script (argparse for DB connection, lookback days, output path). The tricky bit is accurately tracing indirect references in Athena views that nest other views or CTEs - I will handle this with a recursive dependency walker that resolves the full chain before deciding if something is truly unused. RemovalSql only populates when safe, never for anything with any level of recent reference. Deliverables: 2 .py files + README + sample output CSVs from a dry run. Can have this ready in 2-3 days. - Usama
$500 USD in 45 Tagen
6,5
6,5

Hi there, I’ve carefully reviewed your project requirements, and with my extensive experience in developing Python scripts and applications, I’m confident that I can deliver a high-quality solution tailored to your needs. Whether it’s automation, data processing, or custom application development, I have the skills to ensure your project’s success. I’d love to discuss how I can contribute and help bring your vision to life. Feel free to check out my portfolio for more examples of my work: Portfolio: https://www.freelancer.com/u/webmasters486 Looking forward to hearing from you! Best regards, Muhammad Adil
$160 USD in 3 Tagen
6,2
6,2

Hello, I have over 7 years of experience in Data Processing, Data Management, SQL, and Python. I have carefully read the requirements for the project regarding creating two Python utilities for auditing unused DB objects in AWS Athena and Microsoft SQL Server. For Program #1 - AWS Athena, I will use boto3 to connect to the Athena catalog and analyze tables/views for unused objects within the specified time window. The script will walk through the dependency chain to determine direct or indirect references and provide a CSV report with all necessary columns as requested. For Program #2 - Microsoft SQL Server, I will utilize Query Store data to analyze various database objects and generate a similar CSV report with last reference datetime and safe-to-drop SQL suggestions. Both scripts will have command-line parameters for customization and will be well-commented for easy understanding. The deliverables will include two .py files, a README guide, and sample output CSVs for verification. I would like to discuss the project further in chat to ensure a successful implementation. You can visit my profile at https://www.freelancer.com/u/HiraMahmood4072. Thank you.
$100 USD in 2 Tagen
6,2
6,2

Hi, I can certainly help with both Python utilities to clean up your data platforms effectively. I will use boto3 for AWS Athena to track table and view references by walking through dependencies and detailed query execution history. For SQL Server, I’ll utilize Query Store to gather execution data for similar analysis. Each script will output a CSV file formatted to your specifications. With over 5 years of experience in Python programming and database management, I’ve developed efficient utilities that ensure reliability and clarity in analysis and logging. I’m ready to get started and can deliver clean, functional code as needed. Let me know if you want to proceed! Best Regards, Priyanka
$140 USD in 2 Tagen
6,0
6,0

Hello, I’m excited about the opportunity to contribute to your project. With my expertise in Python automation, AWS Athena (boto3) metadata/query-execution analysis, and SQL Server Query Store auditing, I can deliver two focused CLI utilities that accurately determine last usage (direct and indirect), traverse view dependency chains, and emit your exact CSV schema with safe-to-drop RemovalSql only when an object is truly unused within the look-back window. I’ll tailor the implementation to your requirements, including parameterized runtime inputs (DB/connection, look-back days, output path), clean logging, and reliable parsing for nested views/CTEs on Athena plus comprehensive object coverage on SQL Server (tables, views, procs, triggers, queues, functions) using Query Store history. You can expect clear communication, well-commented code, a concise README with runnable examples, and sample anonymised outputs that match your required header order and field rules exactly. Best regards, Juan
$140 USD in 1 Tag
5,6
5,6

Python Scripts: Unused DB Objects Audit I’m a full-stack software engineer with expertise in React, Node.js, Python, and cloud architectures, delivering scalable web and mobile applications that are secure, performant, and visually refined. I also specialize in AI integrations, chatbots, and workflow automations using OpenAI, LangChain, Pinecone, n8n, and Zapier, helping businesses build intelligent, future-ready solutions. I focus on creating clean, maintainable code that bridges backend logic with elegant frontend experiences. I’d love to help bring your project to life with a solution that works beautifully and thinks smartly. To review my samples and achievements, please visit:https://www.freelancer.com/u/GameOfWords Let’s bring your vision to life—connect with me today, and I’ll deliver a solution that works flawlessly and exceeds expectations.
$30 USD in 3 Tagen
5,5
5,5

Hi there,Good morning I am Talha. I have read you project details i saw you need help with Elasticsearch, Data Processing, Database Administration, SQL, Software Architecture, Data Management, Python, MySQL, Database Development and Data Analysis I am writing to propose an innovative approach to tackle your project. Our proposal centers on delivering creative and effective solutions that will set your project apart. We will present fresh, out-of-the-box ideas that align with your project's objectives, demonstrating how we can achieve remarkable results. Please note that the initial bid is an estimate, and the final quote will be provided after a thorough discussion of the project requirements or upon reviewing any detailed documentation you can share. Could you please share any available detailed documentation? I'm also open to further discussions to explore specific aspects of the project. Thanks Regards. Talha Ramzan
$30 USD in 10 Tagen
5,5
5,5

Hello, The hardest part of database cleanup isn’t finding old tables—it’s flawlessly tracing nested dependencies (CTEs, nested views) so you never break production. As a Data & AI Engineer, I specialize in building bulletproof infrastructure that safely automates technical debt removal. My Precise Execution: AWS Athena: I will use boto3 to pull query history and a lightweight SQL parser (like sqlglot) to recursively walk the AST. This mathematically guarantees we catch every hidden indirect reference before ever generating a RemovalSql command. MS SQL Server: I will cross-reference sys.query_store_plan with sys.sql_expression_dependencies to natively map the exact execution hierarchy of your SPs, triggers, functions, and views. Production-Ready Automation: Both standalone utilities will be built with argparse for seamless CLI/cron scheduling, featuring strict CSV formatting and robust logging. I will deliver clean, well-commented Python scripts that safely automate your database garbage collection. Let’s connect to confirm your SQL Server authentication method so I can start building. Best Regards, Shakib A.
$110 USD in 7 Tagen
5,5
5,5

With over 8 years of extensive experience in system administration, software engineering, and web development, I am confident I can deliver the reliable and efficient code that you are seeking for this project. Having worked on various operating systems including Linux, Windows, and Unix, I have a deep understanding of how to tailor my skills to cater to specific environment needs - just like the AWS Athena and Microsoft SQL Server platforms you use. I have been involved in creating solutions using several programming languages including Python and have a great command on associated libraries – precisely boto3 that you prefer for Athena and pyodbc or SQLAlchemy that may be needed for SQL Server. This, combined with my keen eye for detail and proven expertise in ensuring clean organized code will make your scripts robust. My skills also extend to optimizing performance, maintaining security and delivering exceptional user experience across diverse technological environments – all qualities that will prove valuable while developing utilities customized to your need.
$140 USD in 1 Tag
5,6
5,6

1. I am an expert in Python, Machine Learning, Data Analysis, R programming, R markdown as well. I have done many projects in Data mining and Machine learning projects. I have handled many data analysis part using R, Python based on the project requirement. I provide codes, writing reports as well. 2. Have done many projects. I read your project and sure I can handle your project. 3. Your project will be delivered on time with high standard 4. Assistance will be provided with number of clarifications until client satisfaction 5. I will provide assistance even after the payment. And will maintain data (content) security.
$150 USD in 3 Tagen
5,8
5,8

Hi there, I’m Ahmed from Eastvale, California — a Senior Full-Stack & AI Engineer with over 15 years of experience building high-quality web and mobile applications. After reviewing your job posting, I’m confident that my background and skill set make me an excellent fit for your project — Python Scripts: Unused DB Objects Audit . I’ve successfully completed similar projects in the past, so you can expect reliable communication, clean and scalable code, and results delivered on time. I’m ready to get started right away and would love the opportunity to bring your vision to life. Looking forward to working with you. Best regards, Ahmed Hassan
$120 USD in 2 Tagen
5,1
5,1

Hi... Nice to meet you. I am a data science with PYTHON. I have full experience in forcasting based on previous record data andanalysis recorded huge data. Firstly, training recorded data and then forcasting future data base on trained data. after that I made report base on analysed result. I am working more than 5 years in this field. I have finished similar many this projects before. So i am sure for your task and i can finish your task perfectly. Please discuss your project more. Thanks.
$70 USD in 1 Tag
5,4
5,4

I can help you build these audit utilities. For the Athena script, I will implement a robust SQL parser to walk the Abstract Syntax Tree (AST); this is essential because simple string matching fails to accurately identify indirect references within complex CTEs or nested views. Note that AWS Athena only retains query history for 45 days; I will ensure the script handles this ceiling gracefully while providing the exact CSV structure requested. For SQL Server, I will map Query Store execution data against `sys.sql_expression_dependencies` to accurately trace the relationship between stored procedures, views, and underlying tables. To ensure the "Safe-to-Drop" logic is truly safe, I’ll also cross-reference `sys.dm_db_index_usage_stats`—this catches read/write activity that might have been purged from the Query Store due to plan aging or size constraints. Both tools will be delivered as CLI-ready scripts using `boto3` and `pyodbc` with strict adherence to your column specifications.
$40 USD in 7 Tagen
4,8
4,8

Hi, As per my understanding: You need two production-ready Python utilities—one for AWS Athena (via boto3) and one for SQL Server (via Query Store)—that analyse object usage over a configurable look-back window, resolve full dependency chains (direct and indirect), and output a strictly formatted CSV. RemovalSql must only appear when an object has zero references (direct or indirect) in the period. Scripts must be CLI-driven, clean, and schedulable. Implementation approach: For Athena, I will use boto3 to enumerate tables/views, fetch QueryExecution history, parse query text, and build a dependency graph by resolving view definitions recursively. A graph traversal will classify references as direct or indirect and compute last_reference_datetime safely. For SQL Server, I’ll query Query Store DMVs and system catalogs to extract execution history and object dependencies (sys.sql_expression_dependencies), again building a dependency graph for accurate traceability. Both scripts will share a consistent CSV writer to guarantee exact header order. Logging (Python logging module) and argument parsing (argparse) will ensure reliability. A concise README and anonymised sample outputs will be included. Estimated timeline: 5–7 days. A few quick questions: Approximate database size (number of objects)? Expected max look-back window? Should we exclude system schemas? Preferred logging verbosity level?
$98 USD in 5 Tagen
5,2
5,2

Hello! The tricky part here is correctly proving indirect usage through view dependencies in Athena and avoiding false safe to drop flags in SQL Server, and I’d solve that with a dependency graph plus strict last seen logic from Query Store and CloudTrail backed query history. For Athena I will use boto3 to list tables and views, pull completed QueryExecution history in your look back window, parse each query to extract referenced objects, then build a dependency graph so views that call views are marked indirect with the correct referencedBy value. For Athena removal SQL will only be generated when an object is not found anywhere in the query history and not reached through any dependency chain, so you never get a dangerous drop statement. For SQL Server I will query Query Store for recent execution stats, map them back to tables, views, procs, triggers, functions, and queues, then apply the same direct and indirect classification and produce the same CSV schema and ordering. Both utilities will be clean CLI tools with args for database connection, look back days, output path, plus clear logging and a short README with run examples. Warm regards, Yulius Mayoru
$140 USD in 7 Tagen
5,0
5,0

plainsboro, United States
Zahlungsmethode verifiziert
Mitglied seit März 19, 2008
$250-750 USD
$30-75 USD
$250-750 USD
$100-200 USD
$250-750 USD
£250-750 GBP
€30-250 EUR
₹750-1250 INR / Stunde
€8-30 EUR
₹600-1500 INR
₹750-1250 INR / Stunde
$30-250 USD
$15-25 USD / Stunde
$250-750 USD
$250-750 USD
€10000-20000 EUR
₹12500-37500 INR
$8-15 CAD / Stunde
₹600-1500 INR
₹600-1500 INR
₹600-1500 INR
₹150000-250000 INR
$25-50 CAD / Stunde
$25-50 USD / Stunde
₹12500-37500 INR