Trinetra pandey · Senior Python / Spark Data Engineer · 5+ yrs
Mid-LevelAbout Trinetra
Trinetra Pandey is a Data Engineer with 5+ years of hands-on experience specializing in Python, Spark, and AWS for building robust ETL pipelines. Vetted by Witarist and ready to join your team within 48 hours.
5+ years of commercial experience in
Skills(12)
Why hire Trinetra?
Designed and developed data solutions, including e-commerce backends and real-time streaming systems.
Implemented CI/CD pipelines for automated deployment, system monitoring, scalability, and disaster recovery procedures.
Led the development and fine-tuning of a reinforcement learning-based chatbot model, enhancing its performance.
Optimized long-running queries across different databases for improved performance.
Developed data pipelines using Medolina architecture and DBT to process data for analytics purposes.
Built Zid — cutting-edge Arabic e-commerce SaaS + Medolina architecture data pipelines as Data Engineer / Backend Developer
Built Velocity Media Data Aggregator — AWS services + South Africa public places info + OpenAI for content generation as Data Engineer / Developer
Built Szoovespeedy — robust e-commerce backend with Ruby on Rails + eSIM plans + dynamic plan display + cart + checkout + 3rd-party APIs as Backend Developer
Project highlights(3)
E-commerce Data Pipeline – Data Engineer / Backend Developer
Overview: A cutting-edge e-commerce platform designed specifically for SaaS applications, catering to Arabic countries. Responsibilities: Developed data pipelines using Medolina architecture and DBT for analytics purposes. Managed MySQL database maintenance, automation, AWS Glue job monitoring, script deployment, and Docker image deployment. Ensured smooth operation of MySQL databases, including maintenance tasks and performance optimization. Implemented automation strategies to streamline repetitive tasks and enhance operational efficiency. Monitored AWS Glue jobs for timely execution and troubleshooting. Used Terraform for infrastructure deployments.
Key outcomes:
Developed data pipelines using Medolina architecture and DBT to process data for analytics purposes.
Implemented automation strategies to streamline repetitive tasks and enhance operational efficiency.
Managed and deployed Docker images, ensuring consistency and reliability across environments.
Created data visualizations and dashboards to communicate insights effectively to stakeholders.
Data Aggregation Project – Data Engineer / Developer
Overview: An innovative data extraction and integration project leveraging various AWS services to gather, process, and present comprehensive information about public places in South Africa. Responsibilities: Developed and maintained data extraction scripts using Apify, created data pipelines for collecting data, and managed data storage and organization in AWS S3. Leveraged AWS Lambda to process data transformation and cleaning using Pandas DataFrames for loading into MySQL.
Key outcomes:
Implemented CI/CD pipelines for automated deployment, monitoring system performance, scalability, and security.
Led the construction and training of a reinforcement learning-based chatbot model, improving performance through iterative development and fine-tuning.
Developed comprehensive testing plans to ensure data accuracy and website functionality.
Created detailed project documentation for accessibility and understanding.
E-commerce Backend Platform – Backend Developer
Overview: A robust e-commerce backend platform built with Ruby on Rails, providing a seamless user experience for purchasing eSIM plans. Responsibilities: Collaborated with team members to understand user specifications and project requirements. Implemented robust ETL processes to efficiently extract, transform, and load email content into PostgreSQL. Designed and implemented the PostgreSQL database schema to effectively store and organize processed data.
Key outcomes:
Implemented robust ETL processes to efficiently extract, transform, and load email content into PostgreSQL.
Designed and implemented scalable data processing pipelines using Apache Spark.
Created administrative dashboards for effective platform management.
Implemented third-party integration for dynamic data plan retrieval.
Industry experience
E-commerce
2 projects- •E-commerce Data Pipeline— Data Engineer / Backend DeveloperPython · AWS · MySQL · DBT +1
- •E-commerce Backend Platform— Backend DeveloperRuby on Rails · Python · PostgreSQL · Spark
AI / ML Platform
3 projects- •E-commerce Data Pipeline— Data Engineer / Backend DeveloperPython · AWS · MySQL · DBT +1
- •Data Aggregation Project— Data Engineer / DeveloperPython · AWS · MySQL · Pandas +1
- •E-commerce Backend Platform— Backend DeveloperRuby on Rails · Python · PostgreSQL · Spark
Media & Entertainment
1 project- •E-commerce Backend Platform— Backend DeveloperRuby on Rails · Python · PostgreSQL · Spark
SaaS / B2B
2 projects- •E-commerce Data Pipeline— Data Engineer / Backend DeveloperPython · AWS · MySQL · DBT +1
- •E-commerce Backend Platform— Backend DeveloperRuby on Rails · Python · PostgreSQL · Spark
At a Glance
Single contract. No agency markup confusion.
Typically responds within 4 business hours.
Vetted by WitaristNot sure if this is the right fit?
Tell us your requirements and we'll match you with the best candidates.
Trinetra pandey
Python Developer