Data Engineer (PL/SQL, Python, Spark, Hadoop & ETL)

Job Title: Data Engineer (PL/SQL, Python, Spark, Hadoop & ETL) Experience: 6 and above Location: Chennai Job Summary :-We are looking for a skilled Data Engineer with strong expertise in PL/SQL, Python, Apache Spark, Hadoop, and ETL tools to join our data engineering team. The ideal candidate will be responsible for designing, developing, and maintaining scalable data pipelines, optimizing large-scale data processing, and ensuring high-quality data integration across enterprise systems. The role requires hands-on experience with big data technologies, ETL development, and database programming. Key Responsibilities Design, develop, and maintain scalable ETL/ELT pipelines for processing large volumes of structured and unstructured data. Develop and optimize complex PL/SQL procedures, functions, packages, and SQL queries. Build data processing applications using Python and Apache Spark (PySpark). Develop and maintain big data solutions using the Hadoop ecosystem. Design, implement, and optimize ETL workflows using enterprise ETL tools. Perform data extraction, transformation, validation, and loading from multiple source systems. Analyze and resolve data quality issues, performance bottlenecks, and data gaps. Optimize batch processing jobs and improve overall system performance. Collaborate with data architects, business analysts, and application teams to understand business requirements. Ensure data accuracy, consistency, security, and compliance with organizational standards. Prepare technical documentation and support production deployments. Required Technical Skills Strong expertise in PL/SQL and SQL performance tuning. Hands-on experience with Python for data engineering and automation. Strong knowledge of Apache Spark (PySpark). Experience working with the Hadoop ecosystem (HDFS, Hive, MapReduce, or YARN). Experience with ETL tools such as Informatica, Talend, DataStage, SSIS, Apache NiFi, AWS Glue, or Matillion. Good understanding of data warehousing concepts and dimensional modeling. Experience working with relational databases such as Oracle, PostgreSQL, SQL Server, or MySQL. Strong analytical and problem-solving skills. .