01Overview
We are looking for an experienced Databricks Engineer with strong expertise in Databricks, AWS, PySpark, and SQL. The ideal candidate should have hands-on experience in designing, developing, optimizing, and supporting large-scale data processing solutions on the Databricks platform. The role involves both development and production support responsibilities, requiring solid troubleshooting, performance tuning, and collaboration skills.
Key Responsibilities - Design, develop, test, and deploy scalable data processing solutions using Databricks.
Build and optimize ETL/ELT pipelines using PySpark and SQL.Work with AWS services, particularly S3, for data storage and processing.Develop high-performance Databricks solutions following industry best practices.Monitor and support production workloads, investigate issues, and implement fixes.Perform root cause analysis and provide timely resolution for production incidents.Collaborate with business stakeholders, architects, and development teams to understand requirements and deliver solutions.Recommend architecture improvements, code optimizations, and performance enhancements.Ensure data quality, reliability, and scalability across data platforms.Participate in code reviews, testing, deployment, and release activities.
Required Skills - 7+ years of overall IT experience.
5+ years of hands-on experience with Databricks development.Strong experience with PySpark and SQL.Hands-on experience with AWS services, especially S3.Good understanding of Databricks architecture and optimization techniques.Experience in developing, debugging, and maintaining production data pipelines.Knowledge of data engineering best practices, performance tuning, and troubleshooting.Experience handling production support activities and incident management.Strong analytical and problem-solving skills.Excellent communication and stakeholder management skills.
Preferred Skills - Databricks Certificat . .
