01Overview
Job Description:
Job Title: Data Engineer
Location: Mumbai
Experience: 1-3 years
Employment Type: Full-Time
About the Role
We are looking for a highly motivated Data Engineer to join our technology team. The ideal candidate will be responsible for designing, developing, and maintaining scalable data pipelines and data infrastructure to support business intelligence, analytics, and AI-driven initiatives.
A key responsibility of this role is to leverage Data Engineering and Artificial Intelligence technologies to support the automation of the diamond grading process. The candidate will work closely with business stakeholders, gemologists, and technology teams to build intelligent data solutions that improve grading accuracy, operational efficiency, and decision-making.
Key Responsibilities
Design, build, and maintain scalable ETL/ELT data pipelines.
Develop and optimise data workflows for collecting, transforming, and loading data from multiple sources.
Ensure high data quality, integrity, and consistency across enterprise systems.
Build and maintain data warehouses, data lakes, and reporting datasets.
Collaborate with business stakeholders, gemologists, and engineering teams to understand data requirements and deliver scalable solutions.
Leverage Data Engineering and AI technologies to automate and enhance the diamond grading and certification process.
Develop data pipelines and AI-ready datasets to support machine learning and Generative AI applications.
Integrate AI models and Large Language Models (LLMs) into existing business workflows wherever applicable.
Optimise SQL queries and improve overall data processing performance.
Monitor, troubleshoot, and maintain production data pipelines.
Implement data validation, logging, monitoring, and governance processes.
Support AI initiatives by preparing datasets, integrating AI services, and enabling intelligent automation across grading operations.
Required Skills
Strong proficiency in Python and SQL.
Experience with ETL/ELT development.
Hands-on experience with Apache Spark or PySpark.
Experience with Databricks or similar big data platforms.
Knowledge of relational databases such as SQL Server, PostgreSQL, or MySQL.
Experience with cloud platforms such as Microsoft Azure, AWS, or Google Cloud Platform.
Familiarity with orchestration tools such as Apache Airflow or Azure Data Factory.
Strong understanding of data warehousing concepts and data modelling.
Preferred Skills
Exposure to Generative AI and Large Language Models (LLMs).
Experience using OpenAI, Azure OpenAI, Gemini, Claude, or similar AI platforms.
Knowledge of LangChain, Retrieval-Augmented Generation (RAG), embeddings, and vector databases.
Experience integrating AI models into production applications.
Understanding of REST APIs and system integrations.
Interest in applying AI to computer vision, image analysis, or process automation is an added advantage.
Qualifications
Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field.
13 years of experience in Data Engineering or related roles.
Preferred Candidate Profile
Strong analytical and problem-solving skills.
Ability to work with cross-functional teams, including technology and business stakeholders.
Passion for Data Engineering, AI, and automation.
Eagerness to build innovative solutions that improve operational efficiency and transform traditional business processes.
Ability to learn domain-specific workflows, particularly within the diamond grading and certification industry. .
