Srikant · Senior Spark / AWS Data Engineer · 6+ yrs
Mid-LevelProof of scale
About Srikant
Srikant is a Big Data Engineer with 6+ years of experience specializing in data processing and transformation using Spark and AWS. He has a proven track record in developing end-to-end data pipelines and optimizing performance for large datasets.
6+ years of commercial experience in
Skills(8)
Why hire Srikant?
Developed and optimized end-to-end data pipelines using Apache NiFi and ADF across multiple projects.
Achieved performance tuning of Spark jobs processing millions of data records.
Owned code development and enhancement for critical modules such as Compensation Management.
Successfully migrated SQL scripts to Scala for enhanced data transformation capabilities.
Contributed to building a cloud-based data warehousing system on AWS.
Built Unified Data Analytics Platform handling 10+ data sources for ingestion + ETL logic pipelines with large dataset processing + transformation + client statistics as Senior Data Engineer using Hadoop + Spark + Spark SQL + Hive + Scala
Built Unify Billing System for recurring revenue calculation across organizations with Big Data Spark high-speed performance + robust business logic using Hadoop + Spark + Spark SQL + Databricks + ADF as Data Engineer
Built Rocket Analytics Platform next-gen analytics replacing on-premise data warehouse + Amazon Web Services Platform (AWS) Big Data + cloud-based data warehousing using Hadoop + Spark + Spark SQL + Oracle Bigdata Cloud + AWS
Project highlights(3)
Unified Data Analytics Platform – Senior Data Engineer
Overview: Developed a Unified Data Analytics Platform handling 10+ data sources for ingestion and ETL logic pipelines. Responsibilities: Developed End-to-End pipelines using Apache NiFi and Scala Spark transformations. Tuned Spark jobs for performance optimization when processing millions of data records. Owned code development and enhancement for Compensation Management, Delivery Imports, and Price Deliveries modules. Administered sprint planning with stakeholders and managed migration of SQL to Scala scripts.
Key outcomes:
Developed end-to-end data pipelines using Apache NiFi and Scala Spark.
Achieved performance tuning of Spark jobs processing millions of data.
Owned and enhanced critical modules like Compensation Management.
Unify Billing System – Data Engineer
Overview: Implemented a Unify Billing System for calculating recurring revenue for various organizations. Responsibilities: Performed performance tuning of Spark jobs processing millions of data, including bulk-testing. Developed End-to-End pipelines using ADF. Owned code development and enhancement for Compensation Management, Delivery Imports, and Price Deliveries Modules.
Key outcomes:
Improved performance of Spark jobs handling millions of data records.
Developed and optimized end-to-end data pipelines using ADF.
Rocket Analytics Platform – Data Engineer
Overview: Contributed to building a next-generation analytics platform replacing an on-premise data warehouse. Responsibilities: Built data pipelines for the new analytics platform. Wrote data models using Spring Boot. Converted traditional system transformations into Spark transformations.
Key outcomes:
Built robust data pipelines for a next-generation analytics platform on AWS.
Successfully migrated traditional system transformations to Spark.
Industry experience
Logistics & Supply Chain
3 projects- •Unified Data Analytics Platform— Senior Data EngineerSpark · PySpark · Scala · Apache NiFi +1
- •Unify Billing System— Data EngineerSpark · PySpark · ADF · SQL
- •Rocket Analytics Platform— Data EngineerSpark · AWS · Shell Script
At a Glance
Single contract. No agency markup confusion.
Typically responds within 4 business hours.
Vetted by WitaristNot sure if this is the right fit?
Tell us your requirements and we'll match you with the best candidates.
Srikant
Data Engineer