Communication-efficient decentralized learning with sparsification and adaptive peer selection

Zhenheng Tang; Shaohuai Shi; Xiaowen Chu

doi:10.1109/ICDCS47774.2020.00153

Communication-efficient decentralized learning with sparsification and adaptive peer selection

Zhenheng Tang, Shaohuai Shi, Xiaowen Chu

Research output: Chapter in Book/Conference Proceeding/Report › Conference Paper published in a book › peer-review

Original language	English
Title of host publication	Proceedings - 2020 IEEE 40th International Conference on Distributed Computing Systems, ICDCS 2020
Publisher	Institute of Electrical and Electronics Engineers Inc.
Pages	1207-1208
Number of pages	2
ISBN (Electronic)	9781728170022
DOIs	https://doi.org/10.1109/ICDCS47774.2020.00153
Publication status	Published - Nov 2020
Externally published	Yes
Event	40th IEEE International Conference on Distributed Computing Systems, ICDCS 2020 - Singapore, Singapore Duration: 29 Nov 2020 → 1 Dec 2020

Publication series

Name	Proceedings - International Conference on Distributed Computing Systems
Volume	2020-November

Conference

Conference	40th IEEE International Conference on Distributed Computing Systems, ICDCS 2020
Country/Territory	Singapore
City	Singapore
Period	29/11/20 → 1/12/20

Keywords

Adaptive Peer Selection
Deep Learning
Distributed Learning
Federated Learning
Model Sparsification

Access to Document

10.1109/ICDCS47774.2020.00153

Cite this

Tang, Z., Shi, S., & Chu, X. (2020). Communication-efficient decentralized learning with sparsification and adaptive peer selection. In Proceedings - 2020 IEEE 40th International Conference on Distributed Computing Systems, ICDCS 2020 (pp. 1207-1208). Article 9355592 (Proceedings - International Conference on Distributed Computing Systems; Vol. 2020-November). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ICDCS47774.2020.00153

Tang, Zhenheng ; Shi, Shaohuai ; Chu, Xiaowen. / Communication-efficient decentralized learning with sparsification and adaptive peer selection. Proceedings - 2020 IEEE 40th International Conference on Distributed Computing Systems, ICDCS 2020. Institute of Electrical and Electronics Engineers Inc., 2020. pp. 1207-1208 (Proceedings - International Conference on Distributed Computing Systems).

@inproceedings{0c2b3c3d069f4482b24ad669c402478a,

title = "Communication-efficient decentralized learning with sparsification and adaptive peer selection",

keywords = "Adaptive Peer Selection, Deep Learning, Distributed Learning, Federated Learning, Model Sparsification",

author = "Zhenheng Tang and Shaohuai Shi and Xiaowen Chu",

year = "2020",

month = nov,

doi = "10.1109/ICDCS47774.2020.00153",

language = "English",

series = "Proceedings - International Conference on Distributed Computing Systems",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

pages = "1207--1208",

booktitle = "Proceedings - 2020 IEEE 40th International Conference on Distributed Computing Systems, ICDCS 2020",

note = "40th IEEE International Conference on Distributed Computing Systems, ICDCS 2020 ; Conference date: 29-11-2020 Through 01-12-2020",

}

Tang, Z, Shi, S & Chu, X 2020, Communication-efficient decentralized learning with sparsification and adaptive peer selection. in Proceedings - 2020 IEEE 40th International Conference on Distributed Computing Systems, ICDCS 2020., 9355592, Proceedings - International Conference on Distributed Computing Systems, vol. 2020-November, Institute of Electrical and Electronics Engineers Inc., pp. 1207-1208, 40th IEEE International Conference on Distributed Computing Systems, ICDCS 2020, Singapore, Singapore, 29/11/20. https://doi.org/10.1109/ICDCS47774.2020.00153

Communication-efficient decentralized learning with sparsification and adaptive peer selection. / Tang, Zhenheng; Shi, Shaohuai; Chu, Xiaowen.
Proceedings - 2020 IEEE 40th International Conference on Distributed Computing Systems, ICDCS 2020. Institute of Electrical and Electronics Engineers Inc., 2020. p. 1207-1208 9355592 (Proceedings - International Conference on Distributed Computing Systems; Vol. 2020-November).

Research output: Chapter in Book/Conference Proceeding/Report › Conference Paper published in a book › peer-review

TY - GEN

T1 - Communication-efficient decentralized learning with sparsification and adaptive peer selection

AU - Tang, Zhenheng

AU - Shi, Shaohuai

AU - Chu, Xiaowen

PY - 2020/11

Y1 - 2020/11

KW - Adaptive Peer Selection

KW - Deep Learning

KW - Distributed Learning

KW - Federated Learning

KW - Model Sparsification

UR - https://www.scopus.com/pages/publications/85101998411

U2 - 10.1109/ICDCS47774.2020.00153

DO - 10.1109/ICDCS47774.2020.00153

M3 - Conference Paper published in a book

AN - SCOPUS:85101998411

T3 - Proceedings - International Conference on Distributed Computing Systems

SP - 1207

EP - 1208

BT - Proceedings - 2020 IEEE 40th International Conference on Distributed Computing Systems, ICDCS 2020

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 40th IEEE International Conference on Distributed Computing Systems, ICDCS 2020

Y2 - 29 November 2020 through 1 December 2020

ER -

Tang Z, Shi S, Chu X. Communication-efficient decentralized learning with sparsification and adaptive peer selection. In Proceedings - 2020 IEEE 40th International Conference on Distributed Computing Systems, ICDCS 2020. Institute of Electrical and Electronics Engineers Inc. 2020. p. 1207-1208. 9355592. (Proceedings - International Conference on Distributed Computing Systems). doi: 10.1109/ICDCS47774.2020.00153

Communication-efficient decentralized learning with sparsification and adaptive peer selection

Publication series

Conference

Keywords

Access to Document

Other files and links

Cite this