Goodbye LoRa, hello DoRa

[ICML 2024 Oral]

DoRA consistently outperforms LoRA with various tasks (LLM, LVLM, VLM, compressed LLM, diffusion, etc.).
[Paper] https://arxiv.org/abs/2402.09353
[Code] https://github.com/NVlabs/DoRA
[Website] https://nbasyl.github.io/DoRA-project-page/

(Noc - https://www.threads.net/@cmhungsteve/post/C8uTQ9nvKHl/?xmt=AQGzutpi1FGWMWfiA8b0id1OEJDUR7y6cmkwDcDHdoCebA)

diffusion dora etc hello icml llm lora lvlm machinelearningnews tasks vlm