Shrey  ·  Senior Python / Snowflake Data Engineer  ·  7+ yrs

Senior
7+ years experienceremote
Available within 48 hrs

Proof of scale

99.8% uptime
85% reduction in processing time
52.35% reduction in operation cost
85% reduction in processing time99.8% uptime52.35% reduction in operation cost37% increase in performance
Built for
LululemonEveryday Health Group

About Shrey

Shrey is a Data Engineer with 7+ years of experience in Data Engineering and Marketing Automation, specializing in Python and cloud technologies. He has a proven track record of optimizing data processes and enhancing operational efficiency.

7+ years of commercial experience in

Skills(30)

PythonAWSAzureSnowflakeSQLPySparkGitMongoDBPostgreSQLC++NLPWeb ScrapingHDFSHiveAzure Data LakePower BIAzure SynapseDBTHadoopData WarehousingAzure Data FactoryApache SparkData ModelingGCP BigQueryPowerBiAzure Synapse SQL PoolsvscodeAzure Storage ExplorerWord CloudCount Vectorizer

Why hire Shrey?

Production deploy authorityRecognized contributor in open sourceBuilt data solutions from scratch

Engineered an advanced data storage solution leveraging Amazon S3, optimizing data accessibility.

Automated bug triage for primary key constraint violations, reducing processing time by 85%.

Designed a data pipeline to organize data from 100+ sources while ensuring 99.8% uptime.

Migrated from SQL Server to Databricks, reducing operation costs by 52.35% and increasing performance by 37%.

Contributed to open source projects in the FinTech industry, showcasing commitment to community.

Reduced processing time by 85% through automated bug triage.

Achieved 99.8% uptime in data pipeline operations.

Realized a 52.35% reduction in operation costs with migration to Databricks.

Increased performance by 37% through efficient data migration strategies.

Project highlights(5)

NLP Sentiment AnalysisData Engineer

Overview: Developed an NLP model to analyze product reviews for sentiment. Responsibilities: Utilized web scraping, word cloud, and count vectorizer to project the true sentiment of words, significantly reducing review time.

PythonNLPWeb Scraping

ATC Dataset AnalysisData Engineer

Overview: Conducted a comprehensive analysis of the ATC dataset using Big Data tools and technologies. Responsibilities: Created partitioning of desired columns in Hive, performed data transformation using PySpark, and stored data into Azure Data Lake for visualization in Power BI.

PySparkHDFSHiveAzure Data LakePower BIAzure Synapse

Associate Data Engineer (Big Data + ATC Dataset)

As an Associate Data Engineer, Shrey worked on 13+ Big Data modules, creating a comprehensive data pipeline for the ATC Dataset using Azure Data Factory and Synapse. He performed root cause analysis to identify improvement opportunities, enhancing efficiency by 19%. His expertise in data modeling and cloud technologies contributed to significant project outcomes.

SnowflakeDBTPythonSQLPySparkHiveHadoopMongoDBData WarehousingAzure Data FactoryAzure SynapseApache SparkData ModelingGCP BigQuery

ATC Dataset Analysis (Personal Project)

In his personal project, ATC Dataset Analysis, Shrey utilized Big Data tools to analyze the ATC dataset. He created data partitions in Hive and transformed data using PySpark, storing it in Azure Data Lake and visualizing it with Power BI. This project showcased his ability to handle large datasets and derive insights effectively.

PysparkHDFSHiveAzure Data lakePowerBiAzure Synapse SQL PoolsvscodeAzure Storage Explorer

NLP Sentiment Analysis

Shrey developed an NLP Sentiment Analysis tool that utilized web scraping and natural language processing techniques to assess product reviews. By employing word clouds and count vectorizers, he was able to save an average of 23 minutes in review time, providing quick insights into customer sentiment.

NLPWeb ScrapingWord CloudCount VectorizerPython

Industry experience

EdTech

Reported in resume

Logistics & Supply Chain

Reported in resume

Manufacturing & Industrial

1 project
  • Associate Data Engineer (Big Data + ATC Dataset)Snowflake · DBT · Python · SQL +10

Ready to work with Shrey?

Schedule an interview and onboard within 48 hours. No long hiring cycles.

At a Glance

Experience7+ years
Work moderemote
Starting from₹1.7 L/mo
Direct hirePossible
Start within48 hours
From₹1.7 L/ month

Single contract. No agency markup confusion.

Typically responds within 4 business hours.

5-day replacement guarantee
48-hour onboarding, single invoice
Direct chat — no recruiter middleman
Seniority signals
Owns production deploysGreenfield architectSystem ownerRecognised OSS contributor
VerifiedVetted by Witarist
Technical skills assessed & verified
Background & identity checked
English communication verified
Ready to onboard in 48 hours

Not sure if this is the right fit?

Tell us your requirements and we'll match you with the best candidates.

Shrey

Data Engineer