Discovering Sparsity Allocation for Layer-wise Pruning of Large Language Models

Lujun LI; Peijie DONG; Zhenheng TANG; Xiang LIU; Qiang WANG; Wenhan LUO; Wei XUE; Qifeng LIU; Xiaowen CHU; Yike GUO

Discovering Sparsity Allocation for Layer-wise Pruning of Large Language Models

Lujun LI
, Peijie DONG
, Zhenheng TANG
, Xiang LIU
, Qiang WANG
, Wenhan LUO
, Wei XUE
, Qifeng LIU
, Xiaowen CHU
, Yike GUO^*

^*Corresponding author for this work

Division of Emerging Interdisciplinary Areas

Research output: Contribution to conference › Conference Paper › peer-review

Original language	English
Publication status	Published - Dec 2024
Event	The Thirty-eighth Annual Conference on Neural Information Processing Systems - Duration: 1 Dec 2024 → 1 Dec 2024

Conference

Conference	The Thirty-eighth Annual Conference on Neural Information Processing Systems
Period	1/12/24 → 1/12/24

Cite this

@conference{292928ea1f764ea8ac4a38cbb7175c2a,

title = "Discovering Sparsity Allocation for Layer-wise Pruning of Large Language Models",

author = "Lujun LI and Peijie DONG and Zhenheng TANG and Xiang LIU and Qiang WANG and Wenhan LUO and Wei XUE and Qifeng LIU and Xiaowen CHU and Yike GUO",

year = "2024",

month = dec,

language = "English",

note = "The Thirty-eighth Annual Conference on Neural Information Processing Systems ; Conference date: 01-12-2024 Through 01-12-2024",

}

TY - CONF

T1 - Discovering Sparsity Allocation for Layer-wise Pruning of Large Language Models

AU - LI, Lujun

AU - DONG, Peijie

AU - TANG, Zhenheng

AU - LIU, Xiang

AU - WANG, Qiang

AU - LUO, Wenhan

AU - XUE, Wei

AU - LIU, Qifeng

AU - CHU, Xiaowen

AU - GUO, Yike

PY - 2024/12

Y1 - 2024/12

M3 - Conference Paper

T2 - The Thirty-eighth Annual Conference on Neural Information Processing Systems

Y2 - 1 December 2024 through 1 December 2024

ER -