01Overview
Databricks Architect UK Insurance
Location: Hyderabad/Pune
Experience: 10+ Years
Employment Type: Full-time
Key Responsibilities
Design and architect enterprise-scale data solutions using Databricks and cloud data platforms.Lead the design and implementation of Lakehouse architecture, Delta Lake, data pipelines, and data processing frameworks.Develop scalable data engineering solutions using Apache Spark, PySpark, SQL, and related technologies.Work closely with business, data engineering, and architecture teams to translate requirements into technical solutions.Define data ingestion, transformation, integration, governance, security, and performance strategies.Establish best practices for data quality, monitoring, optimization, and CI/CD.Provide technical leadership and mentorship to data engineering teams.Ensure solutions comply with relevant UK Insurance industry data, security, and regulatory requirements.Participate in architecture reviews, technical discussions, and solution design activities.
Required Skills
10+ years of experience in data engineering, data architecture, or related technology roles.Strong hands-on experience with Databricks and Apache Spark.Excellent knowledge of PySpark and SQL.Strong understanding of Delta Lake and Lakehouse architecture.Experience with cloud platforms, preferably Microsoft Azure.Experience designing enterprise data pipelines and data integration solutions.Strong understanding of data modeling, data governance, security, and performance optimization.Experience with CI/CD, Git, and DevOps practices.Excellent communication, stakeholder management, and problem-solving skills.
Domain Experience
Mandatory: UK Insurance domain experience.
Good understanding of insurance business processes, data, and terminology.
Experience working with insurance-related data such as policy, claims, customer, underwriting, billing, and risk is preferred.
Knowledge of UK insurance regulations and industry practices is an advantage.
Preferred Qualifications
Databricks certifications are a plus.
Azure certifications are preferred.
Experience with Azure Data Factory, ADLS, Azure DevOps, or similar Azure services.
Experience in large-scale enterprise transformation or modernization programs.
Skills Required
Data Modeling, Git, Devops, Microsoft Azure, Apache Spark, Data Governance, Pyspark, Sql, Security, Databricks, Performance Optimization .
