Data Engineering Leads & Consultant (Chennai)

Data Engineering :: Leads & Consultant Engineering & Technology Team Company Description JMAN is the commercial data partner that specializes in maximizing value creation activities for private equity funds and their portfolio companies. We partner with our clients to address the growing need for investment decisions and value creation initiatives to be backed by reliable, real-time data. When companies partner with JMAN, we combine our data science and data engineering expertise with our deep commercial understanding to deliver tangible, high-value outcomes at pace. Founded in 2010, JMAN has a global footprint with offices in New York, London and Chennai. Our team of more than 350 experts partner with more than 80 private equity funds and over 200 portfolio companies. Nearly 85% of our business is from recurring partnerships with our clients. JMAN has been a portfolio company of Baird Capital since 2023. Position Technical specifications : - 4+ years of experience in data platform build or any related field. - Familiarity and has worked with cloud-based data warehousing solutions (e.g., Snowflake, Redshift, Databricks, Fabric) and principles - Proficient in SQL and Apache Spark / Python programming languages. - Experience with cloud platform majorly on Azure. - Experience in data pipelines and ETL/ELT tools, including AWS Glue/Azure Data Factory/ Synapse/Matillion/DBT - Experience in implementing or working with data governance frameworks and practices to ensure data integrity and regulatory compliance. - Knowledge of data quality tools and practices. - Good to have skills include - Data visualization using Power BI, Tableau, or Looker, and familiarity with full-stack technologies. - Experience with containerization technologies (e.g., Docker, Kubernetes) - Experience with CI/CD pipelines and DevOps methodologies. - Excellent communication, collaboration, and problem-solving skills. - Ability to work independently, adapt to changing priorities, and learn current technologies quickly. Requirements Responsibilities - Design and implement data pipelines using ETL/ELT tools and techniques. - Configure and manage data storage solutions, including relational databases, data warehouses, and data lakes. - Develop and implement data quality checks and monitoring processes. - Automate data platform deployments and operations using scripting and DevOps tools (e.g., Git, CI/CD pipeline). - Ensuring compliance with data governance and security standards throughout the data platform development process. - Troubleshoot and resolve data platform issues promptly and effectively. - Collaborate with the Data Architect to understand data platform requirements and design specifications. - Assist with data modelling and optimization tasks. - Work with business stakeholders to translate their needs into technical solutions. - Document the data platform architecture, processes, and best practices. - Stay up to date with the latest trends and technologies in full stack development, data engineering, and DevOps. - Proactively suggest improvements and innovations for the data platform. Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying. .