Enterprise Order Data Pipeline & Analytics Platform
Problem Statement: The organization needed a robust and scalable data pipeline to handle large volumes of order data coming from live Amazon systems. Existing processes were not efficient for frequent data loads, leading to delays, inconsistencies, and limited visibility for Sales and Marketing reporting. The goal was to build an automated, high-performance pipeline ensuring accurate […]
Legacy Insurance Platform Modernization
Problem Statement: The organization relied on legacy COBOL programs for insurance data processing, making maintenance, scalability, and modernization difficult. The project aimed to transform legacy business logic into modern SQL-based processes, streamline data migration workflows, and ensure accurate delivery of multiple insurance data trails while supporting comprehensive testing and production readiness. Tools and Technologies: Alteryx, […]
Customer Insights Marketing Campaigns – ETL Solution
Problem Statement: The Customer Insights and Marketing team struggled with fragmented data sources and inefficient reporting processes, making accessing and analyzing critical sales and purchase order information difficult. This project aimed to streamline data integration and reporting by developing ETL/ELT pipelines in Azure Synapse, enabling timely and accurate insights to support better decision-making. Tools and […]
Formula 1 Project (Personal)
Problem Statement: To use the Raw Data (CSV and JSON files) regarding Formula1 from Ergast API to provide useful information. To implement ingestion, transformation, reporting, analysis, and scheduling with Azure Databricks. GitHub Tools and Technologies: Azure Data Bricks, PySpark, Spark SQL, Azure Key Vault, DBFS, Azure Data Lake Storage Gen2, DataFrames, DeltaLake Summary: Created new […]
System Design Documentation (We Are Luxe)
Problem Statement: To create System Design Documents for a UK client (We Are Luxe) in Visio. It includes the system design documentation of the EDI Process, Data Exchange Process, Power BI process, and Reconciliation Process. GitHub Tools and Technologies: Azure Data Factory, Microsoft Visio Summary: Created the System Design documents for Ecommerce, EDI, Power BI, […]
Reconciliation File for Orders (E-commerce)
Problem Statement: To provide information on Shipped and Non-Shipped Orders from the list of orders dropped by clients in SFTP servers. GitHub Tools and Technologies: Azure Data Factory, SQL Server Management Studio, Logic App, Azure SQL, Azure Key Vault Summary: XML files were dropped by our client on SFTP servers Country-wise which contained multiple Order […]