Shivam · Senior AWS Data Engineer · 6+ yrs
Mid-LevelProof of scale
About Shivam
Shivam is a Data Engineer with 6+ years of experience in designing scalable data pipelines and managing AWS Data Lakes. He has a proven track record in ETL/ELT migrations and dashboard development.
6+ years of commercial experience in
Skills(21)
Why hire Shivam?
Managed a 75+ TB AWS Data Lake with 99.9% reliability.
Achieved 80% reduction in migration time through optimized ETL processes.
Developed 10+ QuickSight Dashboards that influenced strategic decisions.
Implemented a real-time user data collection pipeline capable of ingesting 10K+ records daily.
Reduced manual efforts by 60% through Salesforce-WebEngage integration.
Pioneered and managed a 75+ TB AWS Data Lake with 99.9% reliability.
Achieved an 80% reduction in migration time and 99% improvement in data reliability.
Implemented a real-time user data collection pipeline (FAST API) capable of ingesting 10K+ records daily.
Reduced data processing time by 95% for academic result uploads, enabling 99% faster access to insights.
Project highlights(4)
Salesforce-WebEngage Integration – Senior Data Engineer
Overview: Built an end-to-end integration for migrating objects from Salesforce to S3 and performing ETL for incremental data to WebEngage. Responsibilities: Automated the entire data flow using EventBridge, Lambda, and Glue for daily processing. Integrated and processed 0.5M+ records daily for 10+ attributes. Empowered decision-making and reduced manual efforts by 60%.
Key outcomes:
Reduced manual efforts by 60%
Processed 0.5M+ records daily
User Data API – Senior Data Engineer
Overview: Implemented a FAST API pipeline for real-time user data collection across platforms. Responsibilities: Seamlessly ingested user data into a Data Lake via Kinesis DataStream. Enhanced insights reporting for collected data.
Key outcomes:
Ingested 10K+ records daily for real-time insights
Academic Integration – Senior Data Engineer
Overview: Engineered a user-friendly pipeline for Academic heads to upload exam results via a web interface. Responsibilities: Reduced data processing time by 95%. Enabled 99% faster access to reliable insights for dashboards and developments through RDS.
Key outcomes:
Achieved 95% reduction in data processing time
Enabled 99% faster access to reliable insights
User onboarding to QuickSight – Data Engineer Intern
Overview: Built an automated flow for employee onboarding to AWS QuickSight. Responsibilities: Automated credentialing and role management for new and existing employees. Managed account deletion upon employee departure automatically. Reduced onboarding time by 90% and man-hours by 95%.
Key outcomes:
Reduced onboarding time by 90%
Reduced man-hours by 95%
Industry experience
SaaS / B2B
2 projects- •User Data API— Senior Data EngineerAPIs · Python · Kinesis DataStream
- •User onboarding to QuickSight— Data Engineer InternAWS QuickSight · AWS · Python · SQL +4
EdTech
Reported in resumeMarTech & AdTech
1 project- •Academic Integration— Senior Data EngineerSQL · AWS · Spark · PySpark +6
At a Glance
Single contract. No agency markup confusion.
Typically responds within 4 business hours.
Vetted by WitaristNot sure if this is the right fit?
Tell us your requirements and we'll match you with the best candidates.
Shivam
AWS Data Engineer