About
Machine Learning Engineer with 7+ years of software engineering experience, specializing in Machine Learning, Deep Learning, and Generative AI. Experienced in building and deploying end-to-end ML solutions, including LLM fine-tuning, RAG architectures, synthetic data generation, LLM evaluation, Agentic AI, and guardrails using LangChain and LangGraph. Strong foundation in cloud-native development and DevOps, with hands-on experience in AWS, Docker, Terraform, and CI/CD.
Awards
- AWS Certified Cloud Practitioner : Certificate
- Won 2nd Price for the Event : TestAutothon 2019
- Certified CAFE 5 Practitioner
- Won PAT ON BACK prize for Extraordinary Performance in Team | Epam Systems
- Llama Award Winner– Best Performer ×2 | ServiceNow
Skills
Please find the Skills below :
Programming Languages & Libraries
PYTHON 95%
JAVA 90%
SQL 90%
PANDAS / NUMPY / SCIKIT-LEARN / PYTORCH 90%
Modeling & Generative AI
LLM FINE-TUNING & RAG ARCHITECTURES 95%
AGENTIC AI & MULTI-AGENT WORKFLOWS 95%
SYNTHETIC DATA GENERATION & LLM EVALUATION 90%
GUARDRAILS, CLASSIFICATION & REGRESSION 90%
NEURAL NETWORKS & NLP 90%
Framework
LANGCHAIN 95%
LANGGRAPH 95%
JUNIT 5 90%
TEST NG 90%
Cloud & DevOps Tools
AWS 90%
DOCKER & TERRAFORM 80%
GIT / GITLAB / GITHUB / BITBUCKET 95%
JENKINS & GITLAB CI 80%
LOCALSTACK 70%
Database
MySQL 80%
Oracle DB 80%
DynamoDB 80%
RDS DB 80%
Automation Testing Tools
SELENIUM 100%
REST ASSURED 100%
POSTMAN 90%
APPIUM 70%
GATLING 40%
Resume
Summary
Shiv Tripathi
Machine Learning Engineer with 7+ years of software engineering experience, specializing in Machine Learning, Deep Learning, and Generative AI. Experienced in building and deploying end-to-end ML solutions across LLM fine-tuning, RAG architectures, synthetic data generation, LLM evaluation, Agentic AI, and guardrails, with a strong foundation in cloud-native development and DevOps.
- Generative AI : Hands-on experience with LLM fine-tuning, RAG, Agentic AI, synthetic data generation, LLM evaluation, guardrails, content moderation, and LLM-as-a-Judge workflows.
- ServiceNow NowLLM : Worked on Content Moderation and Guardrails, including model evaluation, threshold optimization, real-time monitoring, iterative improvement, and Mixtral base-model fault-pattern analysis.
- RAG Systems : Built RAG workflows using research papers, moderation guidelines, and guardrail rules as knowledge sources; implemented document ingestion, chunking, embeddings, vector retrieval, and LLM-based generation.
- Agentic Workflows : Designed multi-agent tool-calling systems for HR, ITSM, and CSM use cases, optimizing tool selection, orchestration, and structured outputs to reduce operational effort.
- ML Stack : Python, Java, SQL, Pandas, NumPy, Scikit-learn, PyTorch, Keras, Matplotlib, Seaborn, NLTK, LangChain, and LangGraph.
- Modeling : Experienced with regression, classification, clustering, neural networks, NLP, deep learning, and model performance trade-off analysis across precision, recall, false positives, and false negatives.
- Cloud & DevOps : Built cloud-deployable ML and GenAI applications using AWS, Docker, Terraform, LocalStack, Git, GitLab, Bitbucket, Jenkins, and GitLab CI/CD.
- Engineering Foundation : Strong background in software quality, automation, microservices, APIs, and distributed cloud systems, supporting reliable ML application delivery.
Education
Post Graduate Program– AI and ML
2024 - 2025
International Institute of Information Technology Hyderabad (IIITH), Hyderabad
COMPUTER SCIENCE AND ENGINEERING
BACHELOR OF ENGINEERING
2014 - 2018
Shri Ramdeobaba College Of Engineering And Management, Nagpur - Maharastra
CGPA : 7.94
Professional Experience
SERVICENOW
Dec 2023 - Present
Machine Learning Engineer (MLE) | Hyderabad, India
- Collaborated on Content Moderation and Guardrails for the NowLLM platform, contributing across LLM fine-tuning, synthetic data generation, model evaluation, threshold optimization, real-time monitoring, and iterative model improvement.
- Analyzed fault patterns in the Mixtral base model to improve model reliability and moderation performance.
- Designed and evaluated threshold strategies across multiple model versions, balancing precision, recall, false-positive and false-negative trade-offs, and overall model safety.
- Built an automated synthetic-data generation and evaluation pipeline using LangGraph, LLM-as-a-Judge, and multi-model orchestration, reducing manual data-generation effort by approximately 90%.
- Designed and deployed a Multi-Agent Tool-Calling system for HR, ITSM, and CSM workflows, optimizing tool-selection strategies and structured outputs to reduce operational effort by approximately 50%.
- Contributed to an end-to-end RAG system for Content Moderation and Guardrails, including document ingestion, chunking, embeddings, vector retrieval, LLM-based generation, Docker containerization, Terraform provisioning, and AWS deployment.
LONDON STOCK EXCHANGE (LSEG) Account | EPAM SYSTEMS
Aug 2021 - Dec 2023
Software Development Engineer in Test (SDET) | Hyderabad, India
- Played a pivotal role in two projects within LSEG's Financial domain, operating in an Agile environment.
- Responsible for Designing and Developing Automation Framework (AWS Test Automation Framework) to run in different Environment for API and AWS - Microservices.
- Designed and Developed framework using Robot Framework- Python and Java 8 - Junit5.
- Successfully collaborated with various AWS Services, including AWS Lambda, SES, SNS, SQS, CloudWatch, EC2, S3 Bucket, RDS-DB, DynamoDB and more, as part of project requirements.
- Implemented a Logging feature within the Test Framework, ensuring parallel test execution with logs that remain separate and uncluttered.
- Added Reporting feature in Test Framework for better Debugging of Tests on Success/Failure.
- Designed and executed cloud feature testing locally using Docker, Localstack, and Terraform, resulting in significant cost reduction for cloud-based test runs (i.e., AWS)
- Devised a Docker-based mock of the production Trino Database to facilitate automation test data setup, subsequently integrated it with AWS ECS (Elastic Container Service).
ERT Global Account | EPAM SYSTEMS
Sep 2018 - July 2021
Software Development Engineer in Test (SDET) | Hyderabad, India
- Played a vital role within the ERT Global Account in the healthcare domain, operating in a SAFe 5 Agile environment.
- Held responsibility for conceiving and crafting Automation Framework (Selenium Framework , RestAssured Framework) capable of running seamlessly across diverse environments, encompassing UI, API, and Mobile testing.
- Worked in DD (Data Driven) and BDD (Behavioral Driven Development) framework in Selenium-Java and Katalon.
- Performed Web Testing using Selenium-Java and Katalon.
- Performed API Testing for RESTful web Services using RestAssured , POSTMAN and Katalon.
- Performed Mobile Testing for the Hybrid App on the Android device and supported browsers using Appium on Local and CloudPlatform: BrowserStack.
- Created framework, enabling the execution of feature files in Cucumber without the Example section, instead extracting data from JSON files. This innovation greatly facilitated test execution in diverse environments.
Certificates
