Priyank is a Python Developer with 3. 5+ years of experience, specializing in backend development, data processing, and ETL pipelines.
Designed and implemented multiple end-to-end ETL pipelines for complex data extraction.
Automated data workflows and integrated with AWS for secure storage and retrieval.
Optimized database queries in MySQL and PostgreSQL for significant performance improvements.
Developed robust logging and error-handling frameworks for pipeline events.
Built Artemis PDF-to-JSON pipeline + Upstream ETL framework with AWS migration
Overview: Developed a scalable ETL framework using Python to automate data extraction, transformation, and loading processes. Responsibilities: Designed and implemented an end-to-end ETL pipeline using Core Python, integrating multiple data sources into a centralized database. Automated data workflows, including data validation, transformation, enrichment, and loading into AWS RDS and S3, ensuring data consistency and reliability.
Key outcomes:
Designed and implemented an end-to-end ETL pipeline integrating multiple data sources.
Automated data workflows and ensured data consistency using AWS RDS and S3.
Developed secure and scalable RESTful API endpoints for real-time data exchange.
Overview: Designed and implemented a data pipeline to extract and process data from PDF files into JSON format. Responsibilities: Created Python scripts to extract data from complex PDF structures and transform it into normalized JSON format. Automated the entire pipeline using Python scripting and integrated it with AWS S3 for secure storage and retrieval.
Key outcomes:
Successfully extracted data from complex PDF structures and transformed it into normalized JSON.
Automated the entire data pipeline using Python and integrated with AWS S3.
Developed robust data enrichment services for complex calculations and data quality checks.
Priyank
Python Developer