Design and Implementation: Lead the design and implementation of complex cloud solutions using Microsoft Azure, focusing on integration with Databricks and Azure Data Factory.
Data Pipelines: Develop and maintain scalable and efficient data pipelines and architectures.
Performance Optimization: Ensure optimal architecture and performance of applications deployed on Azure.
Collaboration: Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions.
Lifecycle Management: Manage the full lifecycle of data and analytics solutions, from requirements gathering to deployment and maintenance.
Experience:
10+ years of experience as a data engineer, with strong proficiency in Azure services, Databricks, and Azure Data Factory.
10+ years of experience with designing and implementing data solutions using Azure .
Certifications: Azure Data Engineering or Databricks Certification.
Technical Skills: Strong knowledge of programming languages such as Python, SQL, or Scala.
Additional Skills: Experience with data modeling, ETL/ELT development, data integration, and orchestration techniques.
Skills
Azure,
Azure Data Factory,
Collaborate,
Collaboration,
Data Engineering,
Data Pipelines,
ETL,
Lifecycle,
Python,
Scala,
data integration,
data modeling