오늘 리뷰할 논문은 2023년 NIPS에 publish 되었던 LLM-Pruner이다.  https://openreview.net/forum?id=J8Ajf9WfXP LLM-Pruner: On the Structural Pruning of Large Language ModelsLarge language models (LLMs) have shown remarkable capabilities in language understanding and generation. However, such impressive capability typically comes with a substantial model size, which...openreview.net  멀티모달, LLM 등으로 대표되는 large model..

https://arxiv.org/abs/2409.05976 FLoRA: Federated Fine-Tuning Large Language Models with Heterogeneous Low-Rank AdaptationsThe rapid development of Large Language Models (LLMs) has been pivotal in advancing AI, with pre-trained LLMs being adaptable to diverse downstream tasks through fine-tuning. Federated learning (FL) further enhances fine-tuning in a privacy-aware manner byarxiv.orgarXiv 2024..