Saurabha Kumar Sharma is a Data Engineer with 7+ years of experience specializing in cloud, ETL, and data visualization. He has a proven track record in leading data migration initiatives and designing end-to-end data pipelines.
Led migration from Tableau to Power BI, ensuring seamless data transition and enhanced visualization capabilities.
Designed and implemented end-to-end data pipelines for integration, transformation, and loading of large-scale data.
Automated complex workflows and data quality checks, ensuring data accuracy and integrity.
Participated in knowledge sharing and training, indicating leadership and continuous learning.
Successfully led migration from Tableau to Power BI, ensuring seamless data transition and enhanced visualization capabilities.
Developed robust pipelines for efficient data loading from diverse sources, including on-premises systems, APIs, SFTP, and SharePoint to Azure SQL Database.
Conducted proof of concept (PoC) on Bicep for resource deployment using Infrastructure as Code (IaC) principles, integrated with Azure DevOps CI/CD pipeline.
Implemented data governance practices and policies to maintain data security, privacy, and compliance with regulatory requirements.
Overview: This project focused on developing and optimizing data pipelines and AI models for an energy company. Responsibilities: Developed Azure Data Factory pipelines using ARM templates for data flow and orchestration. Configured Logic Apps within Azure Data Factory for automated email notifications. Utilized PySpark and Databricks for processing, analysis, and transformation of large-scale datasets. Developed AI models for proficiency detection using machine learning techniques and Azure services. Managed and optimized Unity catalog including metastore schema for data organization.
Key outcomes:
Optimized performance, scalability, and security of existing Azure frameworks.
Ensured compliance and data security standards through Azure Purview.
Enhanced decision-making processes through AI model insights.
Overview: This project involved extensive data modeling and pipeline design using Microsoft Fabric for a motor company. Responsibilities: Worked on data modeling using Microsoft Fabric's semantic model for efficient data structuring. Created visually appealing and informative Power BI reports with the team. Managed data lake and semantic model to ensure data integrity and accessibility. Utilized Co-Pilot and notebooks to automate Power BI report creation and streamline data processing.
Key outcomes:
Ensured efficient structuring and organization of data for analysis.
Enhanced data presentation and interpretation through Power BI reports.
Overview: This project focused on creating and integrating data pipelines for OFG using Azure services. Responsibilities: Developed Azure Data Factory pipelines using ARM templates. Configured Logic Apps for email notifications in Azure Data Factory. Worked with SQL databases and created stored procedures. Created Power BI dashboards and managed pipelines for Power BI integration.
Key outcomes:
Streamlined data flow and orchestration for the project.
Provided stakeholders with valuable insights through Power BI dashboards.
Overview: This project focused on building scalable data integration and processing for an educational context using Azure Synapse. Responsibilities: Proficient in creating Azure Synapse pipelines for data integration and processing. Configured Logic Apps to automate data loading from SharePoint to Blob storage. Utilized dedicated pools in Azure Synapse for optimized resource allocation.
Key outcomes:
Facilitated efficient data integration and processing within a scalable environment.
Optimized resource allocation and data processing with watermark systems.
Key outcomes:
Facilitated efficient data integration and processing within a scalable environment.
Optimized resource allocation and data processing with watermark systems.
Ensured smooth data retrieval and processing through Guzzle system.
Saurabha Kumar Sharma
Data Engineer