01Overview
About the Role Our client, a prominent analytics and business intelligence firm, is seeking a highly experienced Lead Data Engineer to join their team in Bhopal, Madhya Pradesh . This leadership role is crucial for designing, building, and optimizing robust data pipelines and architectures that support the organization's data-driven initiatives. You will lead a team of data engineers, architect scalable data solutions, and ensure the efficient flow and availability of high-quality data for analytics and machine learning. The ideal candidate possesses extensive experience in data warehousing, ETL/ELT processes, big data technologies, and has strong leadership and architectural skills. Key Responsibilities Lead the design, development, and maintenance of scalable and reliable data pipelines and infrastructure. Architect and implement data warehousing solutions and data lake strategies. Develop and optimize ETL/ELT processes for efficient data extraction, transformation, and loading. Manage and maintain big data platforms (e.g., Hadoop ecosystem, Spark). Collaborate with data scientists, analysts, and business stakeholders to understand data requirements. Ensure data quality, integrity, and security across all data systems. Mentor and guide junior data engineers, fostering best practices in data engineering. Optimize database performance and query efficiency. Evaluate and implement new data technologies and tools to enhance data capabilities. Troubleshoot and resolve data-related issues and ensure data availability. Requirements Bachelor's or Master's degree in Computer Science, Engineering, or a related quantitative field. 7+ years of experience in data engineering, with a proven track record in leading projects or teams. Expertise in SQL and experience with relational and NoSQL databases. Proficiency in programming languages such as Python, Scala, or Java. Hands-on experience with big data technologies (e.g., Spark, Hadoop, Kafka). Experience with cloud data platforms (e.g., AWS Redshift, S3, EMR; Azure Data Factory, Snowflake). Strong understanding of data warehousing concepts and dimensional modeling. Experience with ETL/ELT tools and workflow orchestration tools (e.g., Airflow). Excellent problem-solving, analytical, and communication skills. Benefits Competitive salary and performance-based bonuses. Comprehensive health, dental, and vision insurance. Generous paid time off and holidays. Opportunities for professional development and certifications. A collaborative and innovative work environment in Bhopal . Access to advanced data technologies. .
