Experience
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
Other similar profiles
Explore more posts
-
Jiacheng Lin
TL;DR: Cascade RL and even Cascade smaller LR SFT for mitigating catastrophic forgetting. Nvidia recently showed that Cascade RL can mitigate catastrophic forgetting. Really excellent and exciting work! (https://lnkd.in/gDwKxG5f) We also observed similar effects in healthcare domains (clinical trial tasks) in our recent paper: Developing Large Language Models for Clinical Research Using One Million Clinical Trials https://lnkd.in/gNCf9M4i. Beyond Cascade RL, we also find that Cascade SFT with a smaller learning rate can significantly suppress catastrophic forgetting, even across highly heterogeneous clinical trial tasks. This is based on the findings in my previous paper below: SFT Doesn't Always Hurt General Capabilities: Revisiting Domain-Specific Fine-Tuning in LLMs https://lnkd.in/gqWJdvmX.
2 Comments
Explore top content on LinkedIn
Find curated posts and insights for relevant topics all in one place.
View top content