01Overview
Description :
As a Lead Data Engineer, you will be playing a crucial role in leading a dynamic team of data engineers and being responsible for technical architecture, design, implementation, optimizing and maintenance of data engineering solution components for our customers.
Your will be required to have strong hands-on experience in implementing and leading technical architecture, design and delivery of data engineering solutions on the Microsoft Azure platform, with a good understanding of data warehouse and data lake architecture patterns.
Requirements :
10+ years of hands-on experience in delivering data engineering solutionsExperience leading a team of 5+ team members, responsible for technical project management including stakeholder management, design review, code reviews and mentoringStrong hands-on experience in Microsoft Azure platform, with experience in data engineering related services and technologies including Azure Data Factory, Azure Functions, Azure Databricks, Azure Synapse Analytics, Azure Event Hub, Azure Stream Analytics and Azure Data Lake StorageExpertise in database concepts, SQL and relational modellingGood understanding and experience working with NoSQL databasesStrong hands-on experience in implementing data pipelines using Python and PySparkGood understanding of data lake and data warehouse concepts, modern data architecture patterns and industry trends in data engineering spaceHands-on experience in data modelling, with a good understanding of both ER modelling and dimensional modellingGood understanding and experience implementing data quality management solutionsGood understanding of metadata management for data engineering solutions and data platformsGood understanding of data governance concepts including data stewardship, data security and data privacy managementExperience with version control tools like Git for managing version control for source codeExperience with DevOps processes, including experience implementing CI/CD pipelines for data engineering solution componentsStrong analytical and problem-solving skills.Excellent communication and collaboration skills .
