Hi,
Greeting!
This is an opportunity with one of our esteemed clients.
We are seeking a highly skilled Senior Specialist with 9 to 11 years of experience in Azure Databricks to design, develop, and optimize scalable data engineering solutions. The ideal candidate will lead technical initiatives, mentor teams, and ensure best practices in data engineering across large-scale projects.
Roles and Responsibilities
- Lead the design, development, deployment, and management of Azure Databricks environments.
- Architect and optimize ETL pipelines and Spark jobs for large-scale data processing.
- Oversee data ingestion, transformation, and integration processes ensuring data quality and consistency.
- Collaborate with stakeholders to define KPIs, reporting requirements, and data strategy.
- Work with Business Analysts to gather requirements and create architecture blueprints and design documents.
- Implement data security measures including role-based access and compliance controls.
- Drive CI/CD practices for data engineering projects.
- Provide technical leadership and mentorship to junior engineers and technical teams.
- Troubleshoot and resolve complex technical issues related to Databricks and Spark workloads.
- Lead the creation of common services frameworks and reusable components to reduce technical debt.
- Govern architecture and technology by leading reviews, assessments, and compliance checks.
- Drive continuous architecture improvement and cost optimization in collaboration with product and technical management teams.
- Stay updated with emerging technologies and incorporate innovative solutions to improve data processing and analytics.
Primary Skills
- Azure Databricks
- Azure Data Factory
- SQL
Secondary Skills
- Azure Synapse
- Logic Apps
- Delta Lake
Key Attributes
- Strong problem-solving and analytical skills.
- Excellent communication and collaboration abilities.
- Proven track record of leading teams and delivering scalable data solutions.
- Ability to balance technical depth with business understanding.
If interested in exploring this opportunity kindly send me your updated resume.
Looking forward to hearing from you.
