01Overview
Experience: 815 years
Shift: General shift, late evening calls possible
Required Skills
Proficient in Scala, Spark, Kafka (any variant).
Experienced with distributed systems, batch/real-time data pipelines.
Hands-on with AWS cloud and Databricks for data lakehouse solutions.
Skilled in metadata-based frameworks, CI/CD (Jenkins, GIT Actions).
Familiar with monitoring/control stacks (Prometheus, Grafana).
Key Responsibilities
Build/manage robust data pipelines for data insights using AWS/Databricks.
Design scalable systems with observability, logging, and alerting.
Monitor system robustness, develop pipelines for structured and unstructured data.
Interface with Product, Regulatory, and Legal teams for compliance. .
