Subhajit is a Data Engineer with 6+ years of experience in data processing and machine learning. He has a strong background in Python and PySpark, with proven capabilities in developing chatbots and data pipelines.
Led multiple chatbot projects across various platforms, enhancing customer interaction.
Improved data processing speed by optimizing Spark utilization in Python.
Transformed datasets for a global big data program, ensuring data quality and integrity.
Successfully transformed and maintained critical datasets for the global data program.
Delivered actionable reports by aligning technical solutions with client business requirements.
Developed a multi-language chatbot, improving farmer support and query resolution.
Overview: The data42 program is Novartis' global big data initiative, focused on building a FAIR data platform and products to transform medicine development. Responsibilities: Transformed new datasets according to requirements using PySpark. Maintained code repositories, ensuring version control and collaboration. Collaborated with clients to understand business needs and translated them into actionable reports for Foundry Workshop.
Key outcomes:
Successfully transformed and maintained critical datasets for the global data program.
Delivered actionable reports by aligning technical solutions with client business requirements.
Overview: This project focused on processing month-end sales compensation data from the Finance Engine. Responsibilities: Performed month-end data processing using Azure Data Factory Pipeline. Utilized Spark in Python for distributed data processing on large streaming datasets.
Key outcomes:
Successfully processed month-end compensation data reliably.
Improved data processing speed by utilizing Spark in Python for distributed workloads.
Overview: This project focused on developing a chatbot for Bharat Sanchar Nigam Limited to interact with users for various service-related queries. Responsibilities: Led the Chat-Bot project end-to-end. Developed a chatbot to interact with users for Billing, Payments, Offers, and Services queries.
Key outcomes:
Successfully led the development and deployment of a multi-channel chatbot.
Enhanced customer service by integrating the chatbot across various digital platforms.
Key outcomes:
Successfully led the development and deployment of a multi-channel chatbot.
Enhanced customer service by integrating the chatbot across various digital platforms.
Key outcomes:
Successfully predicted employee iteration rates based on comprehensive data analysis.
Delivered a highly accurate QnA chatbot solution.
Subhajit
Azure Data Engineer