Azure Data Engineer

Job Summary:

• We are seeking an experienced Azure Data Solutions Architect with P&C Industry experience.
• If you are “data freak” and looking for a professionally challenging and financially rewarding career this position might be of interest to you. This position will play a pivotal role in the growth dynamics of XDuce.
• Azure Data Solutions Architect will spearhead new Data Driven initiatives of turnkey IT Projects and Consulting services in P&C Insurance (especially in Commercial Insurance) domain using Azure Databricks and Data lake environment.
• This Director level position directly reports to CTO and have 5-7 team members reporting into.
• Hands-on experience with DevOps practices, including CI/CD pipelines, automated testing, and configuration management tools (e.g., Ansible, Puppet, Chef).
• Solid understanding of networking concepts, security best practices, and compliance frameworks in the AWS ecosystem.
• Expertise in designing and building cloud solutions for data platforms, including data storage, processing, and analytics.
• Excellent problem-solving and troubleshooting skills with the ability to identify and resolve complex infrastructure and data platform issues.
• Strong communication and collaboration skills, with the ability to effectively articulate technical concepts to both technical and non-technical stakeholders.
• AWS certifications such as AWS Certified Solutions Architect – Professional, AWS Certified Data Analytics – Specialty or AWS Certified Machine Learning - Specialty are highly desirable.

Must Have Skills:

• P&C insurance background preferably “Commercial Insurance”
• Strong experience in Datawarehouse, Databricks
• Data Lake knowledge with structured and unstructured data processing

Skillset:

• 15 Years’ hands-on experience as a Data/ DWH Engineer in On-Prem and Cloud (Azure) environment
• Recent 3 + years' experience as Cloud Data Solution Architect recommending and designing Azure Cloud Solutions for P&C Insurance domain ( Commercial Insurance preferred)
• Recent 3 years of hands-on experience in Azure Databricks and Datalake; Performs Design, Development & Deployment using Azure Services (Data Factory, Databricks, PySpark, SQL)
• Develops and maintains scalable data pipelines and build new Data Source integrations to support increasing data volume and complexity.
• Experience in creating Technical Specification Design, Application Interface Design.
• Develop batch processing and integration solutions and process Structured and Non-Structured Data
• Data Modeling and Schema Designing expertise
• Demonstrated in-depth skills with Azure Databricks and PySpark, and SQL
• Collaborate and engage with BI & analytics and the business teams
• Excellent communication, presentation skills and ability to effectively interact with Sr. management of XDuce clients

Skills

• Azure, Azure Data Factory, Azure Databricks, Data pipelines, NoSQL, Azure Cosmos DB or Apache Cassandra, Azure SQL Database, Azure Data Lake Storage, Azure Synapse Analytics, data storage