01Overview
Desired Characteristics
Minimum 5-10 years of software engineering experience.Proven long term experience and enthusiasm for distributed data processing at scale, eagerness to learn new things.Expertise in designing and architecting distributed low latency and scalable solutions in either cloud and on-premises environment.Exposure to the whole software development lifecycle from inception to production and monitoringFluency in Python or solid experience in Scala, JavaProficient with relational databases and Advanced SQLExpert in usage of services like Spark and HiveExperience with web frameworks such as Flask, DjangoExperience in adequate usage of any scheduler such as Apache Airflow, Apache Luigi, Chronos etc.Experience in Kafka or any other stream message processing solutions.Experience in adequate usage of cloud services (AWS) at scaleExperience in agile software development processesExcellent interpersonal and communication skillsNice To Have
Experience with large scale / multi-tenant distributed systemsExperience with columnar / NoSQL databases Vertica, Snowflake, HBase, Scylla, CouchbaseExperience in real team streaming frameworks Flink, StormExperience in open table formats such as Iceberg, Hudi or Deltalake .
