Tag: lottery ticket hypothesis
All the talks with the tag "lottery ticket hypothesis".
KS-Lottery - Finding Certified Lottery Tickets for Multilingual Language Models
Aritra MukhopadhayaPublished: at 02:00 PMThe KS-Lottery method identifies a small subset of LLM parameters highly effective in multilingual fine-tuning. This talk covers the theoretical foundation, experimental results, and surprising findings, such as fine-tuning 18 tokens’ embedding of LLaMA sufficing to reach full fine-tuning translation performance.