Gagan Sharma  ·  Lead GCP Data Engineer  ·  10+ yrs

Principal
10+ years experienceremote
Available within 48 hrs

Proof of scale

40% optimized query execution times
petabyte-scale data lake
millions of transactions daily
petabyte-scale data lakemillions of transactions daily40% optimized query execution times

About Gagan

Gagan Sharma is a Data Engineer with 10+ years of experience in designing and implementing big data solutions on Google Cloud Platform. He has a proven track record in leading data engineering projects and optimizing data pipelines for various industries.

10+ years of commercial experience in

CybersecurityFinTechMarTech & AdTechGovernment & Public Sector

Skills(21)

GCPMongoDBAWSPythonApache AirflowBigQueryApache KafkaApache SparkSQLData MaskingOAuthBigQuery MLNLTKSpaCyPower BIPub/SubDataflowLookerHadoopAWS RedshiftTableau

Why hire Gagan?

Production deploy authorityMentored 5+ juniorsLed multiple complex projects

Led design and implementation of a petabyte-scale data lake on GCP.

Optimized query execution times by 40% for e-commerce analytics.

Developed real-time fraud detection system processing millions of transactions daily.

Led design and implementation of a petabyte-scale data lake.

Optimized query execution times by 40%.

Successfully migrated a legacy on-premise data warehouse to GCP.

Project highlights(11)

Enterprise Data Lake on GCP – Lead Data Engineer

Overview: Designed and implemented a petabyte-scale data lake on GCP for enterprise data analytics and reporting. Responsibilities: Developed scalable ETL pipelines using Apache Airflow and Python. Implemented data security protocols for a healthcare analytics platform.

GCPBigQueryApache AirflowPython

Key outcomes:

  • Successfully designed and implemented a petabyte-scale data lake.

Real-time Fraud Detection System – Lead Data Engineer

Overview: Developed a real-time fraud detection system for a banking institution to identify suspicious transactions and prevent fraud. Responsibilities: Designed a data pipeline for processing millions of transactions daily. Implemented machine learning models for fraud pattern detection.

Apache KafkaApache SparkPythonSQLAWS

Key outcomes:

  • Designed a data pipeline processing millions of transactions daily.

Healthcare Data Security Compliance – Data Security Engineer

Overview: Implemented data security protocols for a healthcare analytics platform. Responsibilities: Designed encryption mechanisms for PII data. Ensured compliance with HIPAA and GDPR.

GCPPythonSQLBigQuery

Key outcomes:

  • Successfully designed encryption mechanisms for PII data.

Healthcare Data Security Compliance – Data Security Engineer

Healthcare Data Security Compliance — encryption + RBAC + HIPAA/GDPR + PII data masking.

GCPPythonSQLBigQueryData MaskingOAuth

Key outcomes:

  • Successfully designed encryption mechanisms for PII data.

  • Ensured compliance with HIPAA and GDPR regulations.

Predictive Analytics for Finance – Data Engineer

Predictive Analytics for Finance — financial risk + NLP sentiment + ML features.

GCPBigQuery MLPythonNLTKSpaCyApache AirflowPower BI

Key outcomes:

  • Developed predictive analytics models for financial risk assessment.

  • Integrated NLP techniques for sentiment analysis.

  • Optimized query performance and cost efficiency.

Industry experience

Cybersecurity

7 projects
  • •Enterprise Data Lake on GCP— Lead Data EngineerGCP · BigQuery · Apache Airflow · Python
  • •Real-time Fraud Detection System— Lead Data EngineerApache Kafka · Apache Spark · Python · SQL +1
  • •Healthcare Data Security Compliance— Data Security EngineerGCP · Python · SQL · BigQuery
  • •Healthcare Data Security Compliance— Data Security EngineerGCP · Python · SQL · BigQuery +2
  • •Smart City Data Platform— Lead Data EngineerGCP · BigQuery · Python · Apache Airflow
  • •Telecom Data Processing System— Data EngineerApache Spark · Hadoop · Python · Apache Airflow +1
  • •Fraud Detection System for Banking— Lead Data EngineerApache Kafka · Apache Spark · Python · SQL +1

FinTech

2 projects
  • •Real-time Fraud Detection System— Lead Data EngineerApache Kafka · Apache Spark · Python · SQL +1
  • •Fraud Detection System for Banking— Lead Data EngineerApache Kafka · Apache Spark · Python · SQL +1

MarTech & AdTech

1 project
  • •Data Pipeline for AdTech Platform— Data EngineerGCP · Pub/Sub · Dataflow · BigQuery +2

Government & Public Sector

1 project
  • •Smart City Data Platform— Lead Data EngineerGCP · BigQuery · Python · Apache Airflow

Ready to work with Gagan?

Schedule an interview and onboard within 48 hours. No long hiring cycles.

At a Glance

Experience10+ years
Work moderemote
Starting from₹1.7 L/mo
Direct hirePossible
Start within48 hours
From₹1.7 L/ month

Single contract. No agency markup confusion.

Typically responds within 4 business hours.

5-day replacement guarantee
48-hour onboarding, single invoice
Direct chat — no recruiter middleman
Seniority signals
Owns production deploysGreenfield architectSystem ownerCode reviewerMentor / leads juniors
VerifiedVetted by Witarist
Technical skills assessed & verified
Background & identity checked
English communication verified
Ready to onboard in 48 hours

Not sure if this is the right fit?

Tell us your requirements and we'll match you with the best candidates.

Gagan Sharma

Data Engineer