Must-Have:
· Design and Implement Azure Data Factory,
Manage Azure Data Lake storage (ADLS)
· Hands on experience to build ETL Data Pipelines using Python, Scala and Pyspark, Optimize data model
Azure Databricks, Python , Scala, PySpark, Azure Data Factory.
Build and Maintain Data Pipelines from core banking and external sources
Implement Data quality improvements for monitoring, alerting and Invest
Data Secuirty and Complaince activities to be taken up
Collaborate with Innovation teams to operationalize models and rules