01Overview
AzureDatabricks
Location: - Indore
Exp: 4-12 years
Must Have Skills
- Hands on experience with Azure Databricks, Azure Data Factory, Azure Synapse Analytics, Azure Analysis Services, Blob Storage, Databricks/Spark, Azure SQL DW/Synapse, and Azure functions.
- In-depth knowledge of relational database design, data warehousing and dimensional data modeling concepts
- Working experience with Python, Spark, Pyspark.
Good to Have Skills
- Knowledge of Dev-Ops processes (CI/CD) and infrastructure as code.
- Knowledge of Master Data Management (MDM) and Data Quality tools.
- Experience developing REST APIs.
- Kafka
- Knowledge of key machine learning concepts & MLOPS
Job Summary
Responsibilities
- Develop and maintain ETL processes using Informatica Cloud CLI to ensure seamless data integration.
- Oversee the design and implementation of data warehousing solutions to support business intelligence initiatives.
- Provide expertise in Data Lake Concepts to optimize data storage and retrieval processes.
- Utilize Informatica Cloud Scheduler to automate data workflows and improve operational efficiency.
- Implement Cloud DWH solutions to enhance data accessibility and scalability.
- Write and optimize SQL queries to support data analysis and reporting needs.
- Collaborate with cross-functional teams to ensure data integration aligns with business requirements.
- Utilize Unix Shell Scripting to automate routine tasks and improve system performance.
- Ensure data quality and integrity through rigorous testing and validation processes.
- Provide technical guidance and support to junior developers and team members.
- Monitor and troubleshoot data integration issues to ensure timely resolution.
- Document technical specifications and maintain comprehensive project documentation.
- Stay updated with the latest industry trends and technologies to continuously improve data integration processes.
Qualifications
- Possess a robust understanding of ETL processes and tools particula .
