Shivam  ·  Senior Python / AWS Data Engineer  ·  5+ yrs

Overview: Built an AI voice assistant to answer queries and manage schedules for users, serving as a platform for AI-driven customer interaction. Responsibilities: Gathered data from PDFs to form the knowledge base for the organization. Responsible for integrating RAG (Retrieval-Augmented Generation). Built the general architecture diagram for the system. Integrated Twilio with AI for communication functionalities. Retrieved data from GHL (GoHighLevel) to create contacts, appointments, tasks, and notes. Fine-tuned the LLM model and evaluated its performance using a BLEU score. Deployed the entire project on an AWS EC2 instance.

Overview: Developed a ChatBot leveraging Langchain and OpenAI models to summarize PDF data, streamlining information extraction for efficiency. Responsibilities: Used the OpenAI API key to import Langchain for AI model integration. Utilized Pinecone as a VectorDB for efficient data retrieval. Employed OpenAI Embeddings for finding similar searches by vectorDB. Responsible for integrating RAG (Retrieval-Augmented Generation) within the chatbot. Led the project with a team of 6 developers, orchestrating the integration of the Langchain framework with OpenAI models for PDF data summarization.

Overview: Developed an ML model for sales prediction to provide insights for inventory management, revenue growth, and new investment decisions. Responsibilities: Gathered requirements directly from the Business Team and collected necessary data. Performed Exploratory Data Analysis (EDA) to understand data patterns. Applied various Feature Engineering and Feature Selection techniques.

Overview: Developed a system to recommend hot-selling cars to users visiting a website, predicting cars likely to sell within 24-48 hours. Responsibilities: Created the ETL pipeline using AWS Glue, connecting to MongoDB and Apache Kafka. Connected to Databricks to perform machine learning operations. Applied feature transformation and filtering, then stored the processed data into a Data Warehouse.