01Requirements
- Technology Side RTS Engineer, Kafka or confluent Kafka for Streaming
- Apache Flink Or Apache beam if Both are not there then must have exp in Pyspark
- Minimum exp: 5-6 years
- Programming Side: Java or Python
- Basic knowledge of Data mart or Data Modelling or Data Vault.
- Basic knowledge in Kubernetes deployment
Responsible to design, develop & manage Enterprise Data Warehouse modelling (Conceptual, Logical, Physical & Virtual), including model consolidation and integration.
- Responsible for how the data will be stored, consumed and managed within the Enterprise Data Warehouse
- Responsible for continuous & continual driving of data usage across the organization to drive the business value
- Provide guidance to developers, modelers and data administration concerning design and transition to the physical data workplace
- Recommend relational (RDBMS) and non-relational (NoSQL, Big Data, Doc DB) data storage technologies suitable to meet business and data needs based on deep understanding of data and existing/planned usage
- Drives the evaluation and adoption of emerging data warehouse technologies including Banking & Financial sector Industry Standard Data Models for building an EDW.
- Liaise with support and operational units to ensure data processing SLAs are well defined and followed
- Responsible for designing, facilitating & maintaining metadata (business glossary, definition, golden source, derivation logic, ownership, etc.), data lineage, quality, profiling, mining and master data management.
- Manage and establish standards for naming and abbreviation conventions, data definitions, ownership, documentation, and change management procedures/techniques .
