01Overview
Avensys is a reputed global IT professional services company, and our service spectrum includes enterprise solution consulting, business intelligence, business process automation and managed services. And we service a client base across banking and financial services, insurance, information technology, healthcare, retail, and supply chain
Job Summary
We are seeking an experienced Engineering Manager to lead a team of Data Engineers in designing, developing, and delivering scalable data platforms on Databricks. The role involves driving technical excellence, people leadership, delivery management, stakeholder engagement, and continuous improvement while ensuring high-quality, secure, and reliable data solutions.
Please note the EM role requires a 50% delivery focus and 50% hands-on technical expertise on the Databricks platform, along with strong stakeholder communication skills, preferably within banking
Key Responsibilities
Technical Leadership
Lead the design and implementation of scalable data platforms using Databricks.
Define technical architecture, coding standards, and engineering best practices.
Drive adoption of modern data engineering patterns including Medallion Architecture.
Review solution designs, code, and performance optimization strategies.
Ensure data security, governance, and compliance standards are followed.
Delivery Management
Own end-to-end delivery of multiple data engineering initiatives.
Plan sprint execution and manage project timelines.
Identify and mitigate delivery risks and dependencies.
Ensure production readiness and successful release management.
Drive continuous improvement in engineering processes.
People Management
Lead and mentor a team of Data Engineers and Technical Leads.
Conduct performance reviews and career development discussions.
Support hiring, onboarding, and capability development.
Foster a culture of collaboration, innovation, and accountability.
Stakeholder Management
Collaborate with Product Owners, Architects, Business stakeholders, and Platform teams.
Communicate delivery progress, risks, and technical decisions.
Manage stakeholder expectations and prioritize business requirements.
Operational Excellence
Ensure platform reliability, availability, and performance.
Drive root cause analysis for production incidents.
Improve monitoring, alerting, and observability.
Optimize cloud infrastructure and operational costs.
Required Skills
Databricks
Databricks Workspace
Delta Lake
Delta Live Tables (DLT)
Unity Catalog
Databricks Workflows
Auto Loader
Structured Streaming
MLflow (preferred)
Photon Engine
Databricks Asset Bundles (preferred)
AI Skills Nice to Have Genie & Cursor AI
Cloud Platforms
Microsoft Azure
AWS or Google Cloud Platform
Cloud Storage (ADLS, S3, GCS)
Data Engineering
Apache Spark (PySpark and Spark SQL)
Python
SQL
Data Warehousing
ETL/ELT Design
Medallion Architecture
Batch and Streaming Data Pipelines
Data Modeling (Star, Snowflake, Data Vault)
DevOps & CI/CD
Git
Azure DevOps / GitHub
CI/CD Pipelines
Terraform (preferred)
Infrastructure as Code
Database Technologies
SQL Server
Oracle
Snowflake
PostgreSQL
NoSQL databases (preferred)
Leadership Skills
Engineering leadership
Team management
Agile delivery
Stakeholder management
Risk management
Conflict resolution
Coaching and mentoring
Resource planning
Budget and capacity planning
Preferred Experience
1015+ years of experience in Data Engineering.
35+ years of experience leading engineering teams.
Hands-on experience with Databricks on Azure, AWS, or GCP.
Experience building enterprise-scale data platforms.
Solid understanding of cloud-native architectures and data governance.
Experience with performance tuning, cost optimization, and production support.
Nice to Have
Databricks Certified Data Engineer Professional
Azure Data Engineer Associate
Azure Solutions Architect
Experience with Apache Kafka or Event Hubs
Knowledge of AI/ML pipelines and Generative AI
Experience with Data Mesh or Data Fabric architectures
Its a mix of technical + delivery role. Say 50-50
Good Communication skills.
Databricks experience is a must.
Banking /Financial service experience .
Leading couple of squads (20+ members) to deliver outcome with delivery and quality focus is a must.
Solution and Design experience is a must.
Good planning skills is a must.
SQL is a must, Python/pyspark positive to have.
Experience in end-to-end delivery from requirements to production and post go live support.
Experience in project estimations, budgeting, and costing
CONSULTANT DETAILS
Consultant Name: Emimal Joshwa
Reg No: 201201037177
Avensys Consulting Sdn Bhd .
