Key Responsibilities / Functional Skills:
Azure Databricks, Python , Scala, PySpark, Azure Data Factory.
Build and Maintain Data Pipelines from core banking and external sources
Implement Data quality improvements for monitoring, alerting and Invest
Data Secuirty and Complaince activities to be taken up
Collaborate with Innovation teams to operationalize models and rules
Must-Have:
- 5+ years of Total Experience
- Design and Implement Azure Data Factory, Manage Azure Data Lake storage (ADLS)
Hands on experience to build ETL Data Pipelines using Python, Scala and Pyspark, Optimize data model
Good to have:
- Hands-on experience in Azure services like Log Analytics, Azure Monitor, Storage services
- Banking Domain knowledge
- Power BU PL300
Kafka concepts