Archish Arun
Los Altos, California, United States
1K followers
500+ connections
About
trying to be a little bit better than i was yesterday
Activity
1K followers
Experience
Education
Licenses & Certifications
-
First Degree Black Belt
Hiruko Wellness Inc.
Issued
Publications
-
THaMES: An End-to-End Tool for Hallucination Mitigation and Evaluation in Large Language Models
Presented at NeurIPS Solar 2024!
This paper introduces THaMES (Tool for Hallucination Mitigations and EvaluationS), an integrated framework and library addressing hallucinations in LLMs. THaMES features automated test set generation, multifaceted benchmarking, and adaptable mitigation strategies. THaMES assesses a model's ability to detect and reduce hallucinations across various tasks, including text generation and binary classification, applying optimal mitigation strategies like…Presented at NeurIPS Solar 2024!
This paper introduces THaMES (Tool for Hallucination Mitigations and EvaluationS), an integrated framework and library addressing hallucinations in LLMs. THaMES features automated test set generation, multifaceted benchmarking, and adaptable mitigation strategies. THaMES assesses a model's ability to detect and reduce hallucinations across various tasks, including text generation and binary classification, applying optimal mitigation strategies like In-Context Learning (ICL), Retrieval Augmented Generation (RAG), and Parameter-Efficient Fine-tuning (PEFT). Evaluations of state-of-the-art LLMs using a knowledge base of academic papers, political news, and Wikipedia reveal that commercial models like GPT-4o benefit more from RAG than ICL, while open-weight models like Llama-3.1-8B-Instruct and Mistral-Nemo gain more from ICL. Additionally, PEFT significantly enhances the performance of Llama-3.1-8B-Instruct in both evaluation tasks.Other authorsSee publication
Courses
-
Data Bootcamp (Python)
ECON-UB232
-
Data Structures and Algorithms
CS102
-
Ethics and AI
PWR2
-
From Languages to Information (Natural Language Processing)
CS124
-
Introduction to Computer Science in Java (OOP)
CS101
-
Introduction to Microeconomics
ECON02
-
Probability Theory for Programmers
CS109
-
Programming Abstractions
CS106B
-
Python for Programmers
-
-
Trigonometry Honors
-
Honors & Awards
-
Outstanding Performer, Jazz Combo Honors
Downbeat Magazine
as bandleader + lead pianist, among the top 10 national youth jazz collectives
-
NYU Leslie eLab Entrepreneurship Fellowship (sponsored by Santander Bank)
NYU Leslie eLab
-
Best Beginner Hack
MVHacks 2019
Other similar profiles
Explore top content on LinkedIn
Find curated posts and insights for relevant topics all in one place.
View top content