Senior Data Engineer – Azure & AWS

Candidate Description

A highly skilled Senior Cloud Data Engineer with ten years of hands-on experience across various cloud platforms, including Azure, AWS, GCP, and Oracle Cloud. This professional has a proven track record of delivering robust, scalable, and efficient cloud-based data solutions across retail, banking, healthcare, media, and sales domains. With expertise in data migration, data pipelines, and big data frameworks, they are well-versed in SQL, Python, and other programming languages. Their experience extends to utilizing reporting tools like Power BI and Tableau and implementing data governance and cloud best practices. A problem solver with a collaborative mindset, they are passionate about leveraging cloud technologies to drive digital transformation.

Currently, as a Senior Data Engineer, they manage complex data pipelines and integration projects using AWS Redshift, Azure Data Factory, Synapse, and Databricks. Their expertise in cloud services has enabled seamless data migration across cloud platforms. In contrast, their knowledge of big data tools like Airflow and Spark has been instrumental in optimizing data processing workflows. They have collaborated with DevOps teams and stakeholders to ensure that cloud infrastructure aligns with organizational goals, and their experience in data modelling, reporting, and visualization provides valuable insights to support business decisions.

They successfully created and maintained end-to-end data pipelines to migrate data from GCP and Azure to AWS Redshift, optimized data refresh processes using Airflow, and improved data transformation workflows with Synapse and Databricks. They also contributed to building Power BI dashboards for analyzing key business metrics and automated ADF pipelines, enhancing efficiency and data reliability.