01Key Responsibilities
1. Technical Leadership & Strategic Guidance: o Provide technical leadership and mentorship to cross-functional teams (cloud engineers, data engineers, business stakeholders) to architect robust Azure-based data solutions. o Ensure alignment of cloud solutions with business objectives, considering current and future growth. o Stay updated with the latest Azure innovations, trends, and best practices to recommend the best solutions for complex business needs. 2. Azure Data Lake and Database Solutions: o Design and deploy scalable and high-performance Azure Data Lake storage solutions to handle large volumes of unstructured and structured data. o Architect, configure, and manage Azure SQL Database, Cosmos DB, and other database offerings to ensure high availability, disaster recovery, and optimized performance. 3. Databricks Administration & Integration: o Manage, configure, and administer Azure Databricks environments, ensuring optimal performance, scalability, and security of data processing workloads. o Collaborate with data scientists, data engineers, and analysts to integrate Azure Databricks with other Azure services (e.g., Azure Data Lake, Azure Synapse) to build scalable data processing and analytics solutions. o Implement best practices for managing Databricks clusters, notebooks, libraries, and jobs to ensure efficiency and cost optimization. o Perform regular monitoring, troubleshooting, and performance tuning of Databricks workloads, ensuring high reliability and uptime. 4. Cloud Migration Strategy & Execution: o Develop and implement comprehensive strategies for migrating on-premises data and applications to Azure with minimal disruption to business operations. o Use Azure-native tools (e.g., Azure Migrate, Data Migration Assistant) to facilitate seamless migration of data assets to the cloud. 5. Azure Data Factory (ADF) Expertise: o Design, implement, and maintain efficient data pipelines using Azure Data Factory(ADF) to orchestrate and automate ETL workflows across various data sources and destinations. o Optimize pipeline performance, manage dependencies, and ensure seamless data movement across hybrid cloud environments. 6. Database Services Optimization: o Administer and optimize Azure Database offerings such as Azure SQL Database, SQL Managed Instances, and other relational/non-relational databases. o Design high-availability, fault-tolerant architectures, and ensure efficient data replication, backup, and recovery. 7. Performance Tuning & Optimization: o Identify and address performance .
