Customer Insights Marketing Campaigns – ETL Solution
Problem Statement: The Customer Insights and Marketing team struggled with fragmented data sources and inefficient reporting processes, making accessing and analyzing critical sales and purchase order information difficult. This project aimed to streamline data integration and reporting by developing ETL/ELT pipelines in Azure Synapse, enabling timely and accurate insights to support better decision-making. Tools and […]
Formula 1 Project (Personal)
Problem Statement: To use the Raw Data (CSV and JSON files) regarding Formula1 from Ergast API to provide useful information. To implement ingestion, transformation, reporting, analysis, and scheduling with Azure Databricks. GitHub Tools and Technologies: Azure Data Bricks, PySpark, Spark SQL, Azure Key Vault, DBFS, Azure Data Lake Storage Gen2, DataFrames, DeltaLake Summary: Created new […]
System Design Documentation (We Are Luxe)
Problem Statement: To create System Design Documents for a UK client (We Are Luxe) in Visio. It includes the system design documentation of the EDI Process, Data Exchange Process, Power BI process, and Reconciliation Process. GitHub Tools and Technologies: Azure Data Factory, Microsoft Visio Summary: Created the System Design documents for Ecommerce, EDI, Power BI, […]
Reconciliation File for Orders (E-commerce)
Problem Statement: To provide information on Shipped and Non-Shipped Orders from the list of orders dropped by clients in SFTP servers. GitHub Tools and Technologies: Azure Data Factory, SQL Server Management Studio, Logic App, Azure SQL, Azure Key Vault Summary: XML files were dropped by our client on SFTP servers Country-wise which contained multiple Order […]
Business Central (BC) OAuth Integration)
Problem Statement: To implement the OAuth integration for Business Central instead of using Web Access Key as it was getting expired from Microsoft. Github Tools and Technologies: Azure Active Directory, Azure Data Factory, SQL Server Management Studio, Business Central, Logic App, Azure SQL, Azure Key vault Summary: Previously used Web Access Key of BC to […]
Data warehouse for Reporting
Problem Statement: To build a data warehouse for PowerBI reporting purposes having source as Business Central and destination as Azure SQL Database. GitHub Tools and Technologies: Azure Data Factory, Microsoft Azure SQL Database, SQL Server Management Studio, Logic App, Azure Key Vault, Business Central, OData Summary: Designed and Implemented the Data warehouse from scratch using […]