01Key Responsibilities
Design and develop data pipelines using Azure Databricks
Lead and mentor data engineering team members
Work with stakeholders to understand business requirements
Ensure high performance, scalability, and reliability of data solutions
Optimize ETL/ELT processes and data workflows
Collaborate with architects and cross-functional teams
Review code and ensure best practices are followed
Required Skills:
Strong experience in Azure Databricks
Hands-on experience with Azure Data Factory (ADF), ADLS, Azure SQL
Valuable knowledge of PySpark / Spark / SQL
Experience in data warehousing and ETL/ELT processes
Robust problem-solving and leadership skills
Preferred Skills:
Experience with Power BI or reporting tools
Knowledge of CI/CD and DevOps practices
Azure certifications (DP-203, AZ-900, etc.) .
