Hi, I'm Raj!

Leading bank data modernization program which aims to publish the banking datasets in the on-prem data platforms (Teradata and Hadoop) to Snowflake on Microsoft Azure public cloud platform.

Role: IT System Owner

Platform: Data Lakehouse on Cloud

Technology Stack: Snowflake, Azure, TWS, Python Scripts, Collibra, IDMC

Highlights:

• Developed the Banking One Data Model which is implemented in Snowflake.
• Published ~100 banking datasets to Snowflake with data catalogues in Collibra.
• Published roadmap for the rest (~400) of the banking datasets.
• Automated the development of data ingestion framework config files.
• Automated the preparation of data catalogue YAML files from Excel data dictionaries.

Managed the banking data warehouse for a lending product with 10+ data sources and 25+ consumer groups for a US based investment bank.

Role: IT System Owner

Platform: Data Warehouse

Technology Stack: Teradata, Informatica PowerCenter, Macros, Stored Procedures, TWS, Autosys, Shell Scripts

Highlights:

• 10+ data sources feeding loan, account and client data into the data warehouse.
• 25+ consumer groups receive data.
• Supports multiple lending and deposit products.
• Managed a team of around 10 data engineers.

Designed the data lake storage layer and data ingestion framework and led delivery of the data pipelines for a US based investment bank.

Role: Designer, Technology Delivery Manager

Platform: Data Lake

Technology Stack: Hive, PySpark, SparkSQL, Parquet, Sqoop, TWS, Shell Scripts

Highlights:

• Pilot for onboarding the first of the many lending products.
• Framework is used to load 500+ tables using 1000+ batch jobs.

Designed and led delivery of the data warehouse from scratch for a US based Insurance provider.

Role: Data Modeler, ETL Designer

Platform: Data Warehouse

Technology Stack: Oracle, Informatica PowerCenter, Autosys, Shell Scripts

Highlights:

• 5+ data sources feeding employee attendance, contact center management and customer feedback data into the data warehouse.
• Multiple departments receive reports and dashboards.
• Managed a team of around 5 data engineers.

Designed and led delivery of the data distribution layer using a data virtualization platform for a US based investment bank.

Role: Designer, Technology Delivery Manager

Platform: Data Virtualization

Technology Stack: Tibco Data Virtualization

Highlights:

• Data virtualization brings data from multiple sources together without ETL.
• Provides a semantic layer over the data sources.
• Abstracts the platform specific technical know-how from the business analysts and users.
• Able to publish consumer specific views of the data with user entitlements.

Designed and led delivery of data pipelines that feed data into regulatory reporting systems for a US based investment bank.

Role: Designer, Technology Delivery Manager

Platform: Data Warehouse, Data Virtualization

Technology Stack: Teradata, Macros, SQL, Tibco Data Virtualization

Highlights:

• Feeds data into multiple regulatory reports like CCAR FR-Y14M.
• Users able to make adjustments to the data to refresh the reports.

Designed and led delivery of an analytics application for a US based investment bank to determine the pricing of new loans based on existing relationships that the client has with the firm.

Role: Designer, Technology Delivery Manager

Platform: Data Lake, Data Warehouse

Technology Stack: Hive, HiveQL, PySpark, Teradata, Stored Procedures, SQL, TWS, Spring Boot, REST API, Business Objects

Highlights:

• Extracts assets, liabilities, party and household information from 50+ datasets.
• Calculates revenue, expenses, profit at account and household level for 5+ million households.

Designed and led delivery of an analytics application for a US based investment bank to determine the mortgage loans eligible for rate adjustment. This involves calculating the cash flows and internal rate of return for eligible products.

Role: Designer, Technology Delivery Manager

Platform: Data Lake

Technology Stack: Hive, HiveQL, PySpark, TWS, Autosys

Highlights:

• Calculates cash flows and internal rate of return for the current and eligible mortgage products.
• Determines if the loan is eligible for rate adjustment based on a set of business rules.

Designed and led delivery of data pipelines that feed data into the risk models for a US based investment bank.

Role: Designer, Technology Delivery Manager

Platform: Data Warehouse

Technology Stack: Teradata, Macros, SQL

Highlights:

• Feeds loan portfolio data into market risk and credit risk models.
• Captures model outputs and distirbutes to the data consumer groups.

Designed and led delivery of an automated process to reconcile the KYC data feeding into the compliance processes for a US based investment bank.

Role: Designer, Technology Delivery Manager

Platform: Data Warehouse

Technology Stack: Teradata Macros, Python

Highlights:

• Reconciles incoming feed files with data stored in the data warehouse across ~20 files/tables.
• Reusable framework allows adding files/tables in future.
• Automated regression test of outbound xml files.

Designed and developed the Data Lineage web application which is used for impact analysis, identifying sources and consumers of datasets and tracking the process lineage from source to target interfaces.

Role: Designer, Developer

Platform: Web Application

Technology Stack: Python, Flask, Angular, DOT, GraphViz, NetworkX

Highlights:

• Discover metadata by parsing the code repositories for datasets and process modules.
• Build a lineage graph which associates the source and target datasets, interfaces and processes.
• Serve the metadata and lineage graphs via REST API.
• UI to view the dataset inventory, sources and consumers. Interface to analyze the impacted objects by input dataset. Interface to view the lineage graph which includes predecessors and successors.

Designed and led delivery of data pipelines as part of the lending sub-servicer onboarding for a US based investment bank.

Role: Designer, Technology Delivery Manager

Platform: Data Warehouse

Technology Stack: Teradata, Informatica Powercenter, SQL, Macros, MultiLoad

Highlights:

• Loosely coupled with the data source unlike before.
• Transformations are pushed down to the database where they run much quicker.
• Concurrent execution of smaller, easy to manage pipelines resulted in 65% reduction in ingestion time.

Designed and led delivery of the data distribution layer using a data virtualization platform.

Role: Designer, Technology Delivery Manager

Platform: Data Virtualization

Technology Stack: Tibco Data Virtualization

Highlights:

• Data virtualization brings data from multiple sources together without ETL.
• Provides a semantic layer over the data sources.
• Abstracts the platform specific technical know-how from the business analysts and users.

Designed and led delivery of the data distribution layer using a data virtualization platform.

Role: Designer, Technology Delivery Manager

Platform: Data Virtualization

Technology Stack: Tibco Data Virtualization

Highlights:

• Data virtualization brings data from multiple sources together without ETL.
• Provides a semantic layer over the data sources.
• Abstracts the platform specific technical know-how from the business analysts and users.

Designed and led delivery of the data distribution layer using a data virtualization platform.

Role: Designer, Technology Delivery Manager

Platform: Data Virtualization

Technology Stack: Tibco Data Virtualization

Highlights:

• Data virtualization brings data from multiple sources together without ETL.
• Provides a semantic layer over the data sources.
• Abstracts the platform specific technical know-how from the business analysts and users.

Developed this website to exhibit my professional work experience.

Platform: Azure Cloud

Technology Stack: HTML, CSS, Bootstrap, Azure Blob Storage, Azure DevOps, Azure Functions

Highlights:

• Static website is hosted in Azure Blob storage and served via Azure CDN.
• Azure DevOps pipeline is setup to publish the website on push to GitHub repository.
• Azure serverless function is setup to log the visits to the website.