An experienced Azure Data Engineer and Azure System Administrator in Consulting practice and has over 6 years of competitive experience in Big Data Processing, Data Engineering and Azure Platform Administration within large-scale IT for a variety of clients across all sectors.
I have a great experience in developing end to end ETL pipelines for data ingestion, cleaning, modelling and transformation and finally storing to destination.
Designed and implemented effective ETL processes to extract data from multiple on-premises and cloud-based source systems, including Salesforce, SAP online and legacy on-premises databases to Azure based Data Warehouse as per defined Physical Data Model.
Great exposure on Databricks to implement Lakehouse architecture to carry out incremental and delta processing, change data capture apart from standard data cleaning and transformation.
Currently based in Ireland and working easily available for calls, meeting to discuss detailed architecture, mitigate issues, address problems.