01Overview
We are looking for an experienced Databricks Engineer with strong expertise in Databricks, AWS, PySpark, and SQL. The ideal candidate should have hands-on experience in designing, developing, optimizing, and supporting large-scale data processing solutions on the Databricks platform. The role involves both development and production support responsibilities, requiring solid troubleshooting, performance tuning, and collaboration skills.
Key Responsibilities
- Design, develop, test, and deploy scalable data processing solutions using Databricks.
- Build and optimize ETL/ELT pipelines using PySpark and SQL.
- Work with AWS services, particularly S3, for data storage and processing.
- Develop high-performance Databricks solutions following industry best practices.
- Monitor and support production workloads, investigate issues, and implement fixes.
- Perform root cause analysis and provide timely resolution for production incidents.
- Collaborate with business stakeholders, architects, and development teams to understand requirements and deliver solutions.
- Recommend architecture improvements, code optimizations, and performance enhancements.
- Ensure data quality, reliability, and scalability across data platforms.
- Participate in code reviews, testing, deployment, and release activities.
Required Skills
- 7+ years of overall IT experience.
- 5+ years of hands-on experience with Databricks development.
- Strong experience with PySpark and SQL.
- Hands-on experience with AWS services, especially S3.
- Good understanding of Databricks architecture and optimization techniques.
- Experience in developing, debugging, and maintaining production data pipelines.
- Knowledge of data engineering best practices, performance tuning, and troubleshooting.
- Experience handling production support activities and incident management.
- Strong analytical and problem-solving skills.
- Excellent communication and stakeholder management skills.
Preferred Skills
- Databricks Certificat .
