Thirunagari Gopi Chaithanya  ·  Senior Spark / Kafka Data Engineer  ·  5+ yrs

Mid-Level
5+ years experienceremote
Available within 48 hrs

Built for

Credit SuisseSoftBank GroupLakshmi Villas BankJocata

About Thirunagari

Thirunagari Gopi Chaithanya is a Senior Data Engineer with 6+ years of experience specializing in Big Data and cloud technologies. He has a proven track record in designing and implementing complex data pipelines and architectures.

5+ years of commercial experience in

FinTechBankingLogistics & Supply ChainManufacturing & Industrial

Skills(23)

AWSApache SparkKafkaAzureJavaPythonDockerKubernetesTalendSnowflakeSparkAirflowHDFSSpring BootElasticsearchKibanaPySparkPostgreSQLStormHBaseSpringHibernateOracle

Why hire Thirunagari?

Production deploy authorityDesigned data architectures

Designed and implemented ETL Warehouse data modeling using Informatica, Cassandra, and Power BI.

Engineered and deployed end-to-end ML applications within Azure MLops Cloud Environment.

Optimized Hive QL/Pig scripts using execution engines like Tez and Spark, improving query performance.

Developed robust real-time data streaming and analytics solutions using Kafka, Storm, HBase, and Spark.

Implemented CI/CD pipelines with Jenkins and Terraform for automated deployments.

Multi-cloud (AWS + Azure) data engineering

Project highlights(4)

Financial Services Data Pipeline – Senior Data Engineer

Overview: This project involved data processing and transformation for a financial advisory client, focusing on Big Data solutions. Responsibilities: Developed multiple Kafka & Kafka Connectors for producing and consuming data based on software requirements. Configured Spark Streaming Jobs in Airflow for automated script deployment to process ongoing data from Kafka and store it in HDFS. Designed and implemented jobs in Azure Databricks, Azure Data Storage, Azure Synapse ETL, Azure Cosmos DB, EventHub, Azure Data Catalog, Azure Functions, Azure Purview, and MDM.

KafkaSparkAirflowAzureHDFS

Key outcomes:

  • Configured Spark Streaming jobs in Airflow for automated script deployment, resulting in easier job scheduling.

  • Designed data migration pipelines to Azure cloud using Azure SQL.

Big Data Processing for Credit Suisse – Senior Data Engineer

Overview: This project focused on Big Data batch and real-time processing solutions within a financial services context. Responsibilities: Integrated Spring Boot with Elastic Search and Kibana to display application status and log records. Wrote and tuned queries using PySpark, PostgreSQL & Airflow Application for data analysis.

Spring BootElasticsearchKibanaPySparkPostgreSQL

Key outcomes:

  • Implemented Spring Boot integration with Elastic Search and Kibana to provide real-time application status.

  • Designed and developed authorization policies for Big Data Hadoop resources using Ranger API.

Real-time Data Streaming for SoftBank Group – Senior Data Engineer

Overview: This project focused on real-time data streaming and analytics for a financial services group, involving Microservices deployment in Azure. Responsibilities: Designed and developed real-time data streaming and analytics using Kafka, Storm, and HBase, Spark.

KafkaStormHBaseSparkSpring Boot

Key outcomes:

  • Designed and developed real-time data streaming and analytics solutions using Kafka, Storm, HBase, and Spark.

  • Deployed microservices using SpringBoot, MongoDB, and Kafka in an Azure Production Cluster.

Customer Credit Card System for Lakshmi Villas Bank – Java Consultant

Overview: This project involved a customer credit card system and an Online Investment Service (OIS). Responsibilities: Worked on the complete life cycle of software development, including new requirement gathering, redesigning, and implementing business functionalities.

JavaSpringHibernateOracle

Key outcomes:

  • Successfully implemented new business functionalities for a customer credit card system.

  • Managed database objects and enhancements in Oracle 11g database.

Industry experience

FinTech

3 projects
  • •Big Data Processing for Credit Suisse— Senior Data EngineerSpring Boot · Elasticsearch · Kibana · PySpark +1
  • •Real-time Data Streaming for SoftBank Group— Senior Data EngineerKafka · Storm · HBase · Spark +1
  • •Customer Credit Card System for Lakshmi Villas Bank— Java ConsultantJava · Spring · Hibernate · Oracle

Banking

2 projects
  • •Real-time Data Streaming for SoftBank Group— Senior Data EngineerKafka · Storm · HBase · Spark +1
  • •Customer Credit Card System for Lakshmi Villas Bank— Java ConsultantJava · Spring · Hibernate · Oracle

Logistics & Supply Chain

Reported in resume

Manufacturing & Industrial

Reported in resume

Ready to work with Thirunagari?

Schedule an interview and onboard within 48 hours. No long hiring cycles.

At a Glance

Experience5+ years
Work moderemote
Starting from₹2.0 L/mo
Direct hirePossible
Start within48 hours
From₹2.0 L/ month

Single contract. No agency markup confusion.

Typically responds within 4 business hours.

5-day replacement guarantee
48-hour onboarding, single invoice
Direct chat — no recruiter middleman
Seniority signals
Owns production deploysGreenfield architectSystem owner
VerifiedVetted by Witarist
Technical skills assessed & verified
Background & identity checked
English communication verified
Ready to onboard in 48 hours

Not sure if this is the right fit?

Tell us your requirements and we'll match you with the best candidates.

Thirunagari Gopi Chaithanya

Big Data engineer with Talend