Devesh  ·  AWS Spark Data Engineer  ·  3+ yrs

Junior
3+ years experienceonsite
Available within 48 hrs

Built for

L&T Finance

About Devesh

Devesh is a Data Engineer with 3+ years of experience in building and maintaining complex data pipelines. He specializes in Python, SQL, and AWS technologies, focusing on data processing and analytics.

3+ years of commercial experience in

FinTechInsuranceBankingLogistics & Supply Chain

Skills(26)

PythonSQLApache SparkAWSApache AirflowSnowflakeApache KafkaAWS S3AWS EMRAWS GlueAWS AthenaSnowplow AnalyticsHadoopDjangoJavaScriptPostgreSQLPysparkSpark-StreamingHiveShell-ScriptsHTMLCSSDockerAjaxJQueryPaypal

Why hire Devesh?

Production deploy authorityBuilt from scratch / 'ground up'

Designed and maintained complex data pipelines for large-scale data processing

Automated data workflows for banking operations, enhancing efficiency

Implemented real-time event data processing platforms for user behavior tracking

Developed a full-featured E-Commerce website with secure payment integration

Successfully designed and maintained complex data pipelines for large-scale data processing using Spark

Engineered Spark ETL scripts to clean, transform data, and calculate scores for financial analytics, supporting data-driven decision-making

Automated data workflows for banking operations and integrated diverse data sources into centralized data lakes

Project highlights(5)

L&T Finance Loan Origination System – Data Engineer

Overview: This project focused on enhancing Loan Origination System (LOS) and Business Rules Engine (BRE) processes for financial products. Responsibilities: Designed and implemented Spark ETL scripts to clean, transform data, and calculate scores based on various financial parameters. Ingested data from diverse sources into a centralized Data Lake using AWS S3, EMR, Glue, and Athena.

PythonApache SparkAWS S3AWS EMRAWS GlueAWS AthenaApache Airflow

Key outcomes:

  • Enhanced LOS and BRE processes through advanced data analytics

  • Supported data-driven decision-making for various Lines of Business

Good Data Analytics Event Data Collection – Data Engineer

Overview: This project focused on building an open-source data collection platform that generates complete, accurate, and well-structured event data across all platforms and channels. Responsibilities: Collected raw Snowplow events data via Stream Collector, sent to Apache Kafka Sink, and transformed raw data into TSV format using Stream Enricher.

PythonSnowplow AnalyticsApache KafkaApache SparkHadoop

Key outcomes:

  • Implemented a robust open-source data collection platform

  • Enabled continuous data ingestion and transformation using Spark and Kafka

E-Commerce Website Development – Software Developer

Overview: Developed a full-featured E-Commerce website allowing customers to buy electronic gadgets, physical goods, and clothes. Responsibilities: Developed the website using the Django Framework for the backend, implemented features for customers to manage products and process online payments.

PythonDjangoJavaScriptPostgreSQL

Key outcomes:

  • Developed a complete E-Commerce platform with core shopping functionalities

  • Implemented secure payment gateway integration

User Behavior Tracking – Data Engineer

User Behavior Tracking — gathering + analyzing website event data via Snowplow Analytics with HDFS storage. PySpark + Spark-Streaming + Snowplow + Apache Kafka + Hadoop.

PysparkSpark-StreamingSnowplow AnalyticsApache KafkaHadoopHiveShell-ScriptsPythonJavaScript

Key outcomes:

  • Enabled comprehensive user behavior tracking on a website.

  • Implemented real-time data processing for event data.

  • Ensured structured storage of partitioned event data for efficient querying.

  • Utilized Snowplow Analytics for accurate and complete data collection.

E-Commerce Website – Software Developer

E-Commerce Website — full-featured site with cart + wish lists + secure online payment. Django + HTML + CSS + JavaScript + PostgreSQL.

DjangoHTMLCSSJavaScriptPostgreSQLDockerAjaxJQueryPaypalPython

Key outcomes:

  • Developed a complete E-Commerce platform with core shopping functionalities.

  • Implemented secure payment gateway integration.

  • Created a custom admin panel for efficient management of website operations.

  • Enabled sales and customer reporting for business insights.

Industry experience

FinTech

3 projects
  • •L&T Finance Loan Origination System— Data EngineerPython · Apache Spark · AWS S3 · AWS EMR +3
  • •E-Commerce Website Development— Software DeveloperPython · Django · JavaScript · PostgreSQL
  • •E-Commerce Website— Software DeveloperDjango · HTML · CSS · JavaScript +6

Insurance

Reported in resume

Banking

Reported in resume

Logistics & Supply Chain

Reported in resume

Ready to work with Devesh?

Schedule an interview and onboard within 48 hours. No long hiring cycles.

At a Glance

Experience3+ years
Work modeonsite
Starting from₹1.9 L/mo
Direct hirePossible
Start within48 hours
From₹1.9 L/ month

Single contract. No agency markup confusion.

Typically responds within 4 business hours.

5-day replacement guarantee
48-hour onboarding, single invoice
Direct chat — no recruiter middleman
Seniority signals
Owns production deploysGreenfield architect
VerifiedVetted by Witarist
Technical skills assessed & verified
Background & identity checked
English communication verified
Ready to onboard in 48 hours

Not sure if this is the right fit?

Tell us your requirements and we'll match you with the best candidates.

Devesh

AWS Data Engineer