Jeyasimhan is a Data Engineer with 15+ years of experience in data engineering and multi-cloud solutions. He has a proven track record in designing and implementing ETL processes and data transformation solutions.
Proven experience as a Technical Architect with 15 years in data engineering.
Strong multi-cloud expertise with Azure, Google Cloud, and AWS.
Demonstrated ownership in ETL processes and data migration.
Designed and configured cluster architectures for distributed data processing.
Automated error logging and created Dashboard Metrics for framework performance monitoring.
Successfully converted large sets of legacy and unstructured data into structured formats for analytics.
Led and implemented ETL processes for clinical and multi-cloud data, handling various file formats.
Developed and deployed web crawlers to collect millions of records from e-commerce platforms.
Designed and configured cluster architectures and node configurations for efficient data processing systems.
Overview: Managed ETL processes for legacy clinical data, transforming it into a structured format. Responsibilities: Worked closely with the Data Analytics team and stakeholders to design the data conversion process. Wrote notebook scripts using Python to filter and ingest various file formats (.tgz, .csv, json) with multi-level structures.
Key outcomes:
Successfully processed and transformed legacy clinical data into a structured format.
Designed and implemented ETL pipelines using Azure Data Factory.
Overview: Developed automation scripts (Web Crawler) to collect fashion industry data for trend analytics, adhering to GDPR policy. Responsibilities: Gathered client requirements and conducted requirement analysis for the web crawler. Performed ETL on large-scale data using Redis for caching and RabbitMQ for queuing.
Key outcomes:
Collected millions of records from e-commerce platforms using automation scripts.
Ensured GDPR compliance in data collection processes.
Overview: Converted legacy hard copy billing systems into digital solutions using Google Cloud. Responsibilities: Configured initial authentication setup using boto on local machines. Used Google Cloud to convert existing data into an Entity relationship format.
Key outcomes:
Successfully converted legacy hard copy bills to digital format on Google Cloud.
Automated file transactions and data conversion processes.
NATE FRAMEWORK — PNate framework installation on Storage Servers + cluster architecture + node configuration + automated error logs + dashboard metrics. PERL + Python + Unix Shell + MySQL.
Key outcomes:
Successfully installed and configured the PNate framework across diverse storage servers.
Automated error logging and generated dashboard metrics for monitoring.
Ensured framework compatibility and qualification across partner server versions.
Green Images — US government legacy hard-copy billing → digital solutions via Google Cloud Storage + Data Store with automated file transactions. gsutil + boto + Shell Scripting.
Key outcomes:
Successfully converted legacy hard copy bills to digital format on Google Cloud.
Automated file transactions and data conversion processes.
Configured secure authentication for cloud operations.
Jeyasimhan
Azure Data Engineer