Reading Club #5. Low-Rank Adaptation (LoRA)
Гостем нового выпуска стала Дарья Леднева — ML-Researcher, DeepPavlov; Middle DS, Sber; магистрантка AI Talent Hub
Мы обсудили три статьи про методы для эффективной адаптации LLM. Подходы QLoRA, QA-LoRA и LQ-LoRA объединяют техники Low-Rank Adaptation и квантизации.
Статьи:
QLoRA -
QA-LoRA -
LQ-LoRA -
Презентация:
Магистратура AI Talent Hub —
24 hours ago 00:00:17 37
1 day ago 00:13:51 1
![[] You’re NOT RICH Because You Keep Making These Mental Error](https://sun9-67.userapi.com/impg/TQyykeQBJV8m6i1fzq8u7j1kgwFD6n_tCoTPZg/kOZJqBFOMwg.jpg?size=320x240&quality=95&keep_aspect_ratio=1&background=000000&sign=a633724f652920ad721fccebb57dcaf9&c_uniq_tag=eaKF3b6MZ8I7CmZc2piM-_Z4GfdlUL9LZeciLvUAdOA&type=video_thumb)
3 days ago 01:29:01 6
![[oliviareadsalatte] cozy november days, lots of reading, & cosmere | WEEKLY VLOG](https://sun9-67.userapi.com/impg/Gxe9axrEzcU9ZKGPFkXQ3H7L1G0l994cvG5wiw/CYYr5OMr6Aw.jpg?size=320x240&quality=95&keep_aspect_ratio=1&background=000000&sign=1f32b13a55db48eb0137e0c2071dad46&c_uniq_tag=GH5eANGZWSV_LB8pZvm9ND_jLP5E51vWU1Ng8zgNNEI&type=video_thumb)
3 days ago 00:11:24 1K
3 days ago 00:39:52 6
![[PeruseProject] Reading 3 Fantasy Books Nominated for a Goodreads Award! (are they worth the hype?)](https://sun9-42.userapi.com/impg/BlKZVukTi99BXUtYxWOGbxfT33I4mq6cWxFtog/vBx8xQc4z68.jpg?size=320x240&quality=95&keep_aspect_ratio=1&background=000000&sign=c84003bfaa089c6ec7b26c9ddc9e2483&c_uniq_tag=ifwOwRbjQqN7xihd1VbDw9jhafBBMPXE0VteF7km7Iw&type=video_thumb)
4 days ago 00:00:59 1
4 days ago 00:42:34 1
![[Destiny Sidwell] How much I read in a week *booktuber edition* ✨📚🌟 stepping out of my comfort zone, second chance etc](https://sun9-73.userapi.com/impg/VGivWsIxXoan82cmbHmZSck8R0LVCzXht3x23A/nofXJJ4M7kM.jpg?size=320x240&quality=95&keep_aspect_ratio=1&background=000000&sign=fe7c3661b717c7841b50c9ff085b7b73&c_uniq_tag=L0FVXy4wQR_jyZutAyTeS4wHuDngJScD8Gl9-UHMem0&type=video_thumb)
4 days ago 00:27:31 7
![[Destiny Sidwell] This video ends when I hit my reading goal *125 books* 📖🌟](https://sun9-52.userapi.com/impg/JHi_27wZDD89ba5jJMHnvAwLO9RVB5G24JSLJQ/TgH8ZQHu47E.jpg?size=320x240&quality=95&keep_aspect_ratio=1&background=000000&sign=7328563adb796a326845820657eb3a7f&c_uniq_tag=0GcQRGADtX8vXDM1watO90fx87Xm-o-NfhMcgV4r5fE&type=video_thumb)
4 days ago 01:34:03 915
![[PHONK Club] Phonk Music 2024 ※ Best Aggressive Drift Phonk ※ Фонка 2024](https://sun9-80.userapi.com/impg/nvPHUQgE4nsR2VJIXwj-1LD1nIJceMa9ZI3r5Q/w7GeJoAl-Ok.jpg?size=320x240&quality=95&keep_aspect_ratio=1&background=000000&sign=29f78131601e58eb6bf390bd95b7a053&c_uniq_tag=P30AQzw7_i-gekp6-aqaa4GYtIuZtgiI2heKqnkZx18&type=video_thumb)
5 days ago 00:03:22 844
6 days ago 00:15:30 4
![[] 15 Practical Ways To Be More Creative](https://sun9-45.userapi.com/impg/RV6B06GoqQi6hwDv9qBkmZzHRnEFfwm0vMeHTA/zS8V_RVsyQs.jpg?size=320x240&quality=95&keep_aspect_ratio=1&background=000000&sign=28344b99172eca50779beab95d283209&c_uniq_tag=wa2TVvKuMoXf2mSOT4pXUOoAD0XEKnkXCOdRgMHh9Wo&type=video_thumb)
1 week ago 00:48:48 259
1 week ago 00:48:05 8
![[Destiny Sidwell] Week in my life ✨💞| Eras tour, Holiday decorating, back at home and more!](https://sun9-34.userapi.com/impg/QREqoq-ZCtzM-B9RDHKSYbYCOoBi4h0fleRWZg/y8bq-CDCrWw.jpg?size=320x240&quality=95&keep_aspect_ratio=1&background=000000&sign=7e6dab000cfeeba47d5cc2b7ca6147c4&c_uniq_tag=YbM1UAfB7VPL6eBaoFSyXsXiNAsR0feVEipMs6xXnaU&type=video_thumb)
1 week ago 00:30:08 14
![[Destiny Sidwell] Decorate with me for Christmas 🎄🤶| Week in my life vlog, buying decor, decorating and more](https://sun9-5.userapi.com/impg/Pc-36Gc8HwcSnjpvPY3nHmAq-iP3cVQgPCCoyA/Tcdh8TOFPm4.jpg?size=320x240&quality=95&keep_aspect_ratio=1&background=000000&sign=8877a17eed74c365e915a3b582d7f7b3&c_uniq_tag=MMp_aZPRbx1lTBmXc7NPsogGD_UgjY4-i9cUN2A461g&type=video_thumb)
1 week ago 01:52:25 20
![[oliviareadsalatte] cozy fall days, barnes and noble trip and haul, + new favorite book! | WEEKLY VLOG](https://sun9-67.userapi.com/impg/wwJGYGfCYwtNSskkzCYAXWYUn_Eur5ZAvZmalA/RwqZQAGoPHY.jpg?size=320x240&quality=95&keep_aspect_ratio=1&background=000000&sign=1ee0d7bf50e30cb74c7d6f442243ce42&c_uniq_tag=ZOQ_XNoCgt9ysYBq0_SInFcE87hhBANI5WBYlJOQYl0&type=video_thumb)
1 week ago 01:18:56 6
![[oliviareadsalatte] i’m currently reading 6 books and spiraling | WEEKLY VLOG](https://sun9-51.userapi.com/impg/AsIVC5hzfaLq1Pc4F5pyHrEGl2RDfUptW5YwHw/MbmSPm6Gz78.jpg?size=320x240&quality=95&keep_aspect_ratio=1&background=000000&sign=3678fc43d091844e08140068452e3955&c_uniq_tag=4j89AsuWqja7zQIjmP1uQ2QxXZWBHdF_jqoFN_iM5aI&type=video_thumb)
1 week ago 00:14:18 6
![[Caser] The Kid Who Stole $230,000,000](https://sun9-36.userapi.com/impg/4U6e1ouw9GjRGHMh2u0jQXtNt9nAIC2-TodzQg/x1ASFlq1peI.jpg?size=320x240&quality=95&keep_aspect_ratio=1&background=000000&sign=3090fcdae5b4b85484e0bd0d2c35708d&c_uniq_tag=ZCl2SDV1LvNjhXOo4ZQFZx03I-pm-iPsWgdf_b40J3k&type=video_thumb)
2 weeks ago 00:35:04 5
![[PeruseProject] I read my worst book of the year (& yes it was a popular romantasy novel)](https://sun9-51.userapi.com/impg/5JYmhQrEFV0eG62muxZjsh8troVrl6L7-zQ8jg/CVtO5OZAPgY.jpg?size=320x240&quality=95&keep_aspect_ratio=1&background=000000&sign=1a1c568c22e0d31297528124d8d91b95&c_uniq_tag=crJeRSDdQ9jBZi_9ArH1N34By2leIQ5I5Q9r9WpKrDU&type=video_thumb)
2 weeks ago 00:36:15 4
![[PeruseProject] Replacing my TikTok Screen Time With Reading! (no more doom scrolling lol)](https://sun9-80.userapi.com/impg/84h1RlV8Eb8EqJb88N39qrezR3fXpMbfMXFrAA/mxkGkk8ZTNg.jpg?size=320x240&quality=95&keep_aspect_ratio=1&background=000000&sign=2b52ea44b7db5eb38fcca2f4b7b00ac4&c_uniq_tag=XnMroO-qEVtlzOtP8dZ8kgSCx6lYkw4eBXgOB7Kn0vw&type=video_thumb)
2 weeks ago 01:53:46 1.1K
2 weeks ago 01:27:38 8
2 weeks ago 00:13:59 16
![[- Exøtic_Glitch 0-0] //Michael Afton Meets MHA//Remake//Part 1//FNaF X MHA//Gacha//](https://sun9-59.userapi.com/impg/fMV_II-XFG-j9-ln18Q1mSJHhfcFO59LSOoH-g/q2shcdTO1HM.jpg?size=320x240&quality=95&keep_aspect_ratio=1&background=000000&sign=c59d9e564fc1bdc36648b9a685b4728f&c_uniq_tag=IBk2kJCBfQW2002fr2FfN3RBZ1ok704Zn4r6Uq2h6DI&type=video_thumb)
2 weeks ago 00:13:57 14
![[- Exøtic_Glitch 0-0] Past VS Future Aftons Singing Battle[]Re-Remake[]](https://sun9-79.userapi.com/impg/-UZV2TeyWKTQ94evvkep3Cv-exy8FNdXP8vUzw/FCpod7-ur5c.jpg?size=320x240&quality=95&keep_aspect_ratio=1&background=000000&sign=00e6a1b1c424c8c752518ec3bf137d8e&c_uniq_tag=gj6pu6PuyqTd-NjUdk3_mly8sWkObuNQJIYRFzOu3cU&type=video_thumb)
2 weeks ago 00:36:41 121
