Towards Scalable Distributed Training of Deep Learning on Public Cloud Clusters

Xiaowen Chu; Zhibo Chen; Ping Gao; Jing Gong; Zhenyu Guo; Chenyang Guo; Xue Huang; Xinan Jiang; Rui Lan; Weiliang Lin; Peng Meng; Xianbin Ouyang; Shutao Song; Jieqian Wei; Yongjian Wu; Liqiang Xie; Xiaomin Xu; Bo Yang; Yan Zhang; Xianhao Zhou; Feihu Zhou; Zilin Zhu; Xingyao Wang; Shaohuai Shi

Towards Scalable Distributed Training of Deep Learning on Public Cloud Clusters

Xiaowen Chu
, Zhibo Chen
, Ping Gao
, Jing Gong
, Zhenyu Guo
, Chenyang Guo
, Xue Huang
, Xinan Jiang
, Rui Lan
, Weiliang Lin
, Peng Meng
, Xianbin Ouyang
, Shutao Song^*
, Jieqian Wei
, Yongjian Wu
, Liqiang Xie
, Xiaomin Xu
, Bo Yang
, Yan Zhang
, Xianhao Zhou^*

Feihu Zhou, Zilin Zhu, Xingyao Wang, Shaohuai Shi^*

^*Corresponding author for this work

Department of Computer Science and Engineering

Research output: Contribution to conference › Conference Paper › peer-review

Original language	English
Publication status	Published - Apr 2021
Event	The 4th Machine Learning and Systems Conference, MLSys 2021 - Duration: 1 Apr 2021 → 1 Apr 2021

Conference

Conference	The 4th Machine Learning and Systems Conference, MLSys 2021
Period	1/04/21 → 1/04/21

Access to Document

https://hdl.handle.net/1783.1/109760

Cite this

Chu, X., Chen, Z., Gao, P., Gong, J., Guo, Z., Guo, C., Huang, X., Jiang, X., Lan, R., Lin, W., Meng, P., Ouyang, X., Song, S., Wei, J., Wu, Y., Xie, L., Xu, X., Yang, B., Zhang, Y., ... Shi, S. (2021). Towards Scalable Distributed Training of Deep Learning on Public Cloud Clusters. Paper presented at The 4th Machine Learning and Systems Conference, MLSys 2021. https://hdl.handle.net/1783.1/109760

@conference{01eab3b0cca94f92a3de1b8e7ce8809d,

title = "Towards Scalable Distributed Training of Deep Learning on Public Cloud Clusters",

author = "Xiaowen Chu and Zhibo Chen and Ping Gao and Jing Gong and Zhenyu Guo and Chenyang Guo and Xue Huang and Xinan Jiang and Rui Lan and Weiliang Lin and Peng Meng and Xianbin Ouyang and Shutao Song and Jieqian Wei and Yongjian Wu and Liqiang Xie and Xiaomin Xu and Bo Yang and Yan Zhang and Xianhao Zhou and Feihu Zhou and Zilin Zhu and Xingyao Wang and Shaohuai Shi",

year = "2021",

month = apr,

language = "English",

note = "The 4th Machine Learning and Systems Conference, MLSys 2021 ; Conference date: 01-04-2021 Through 01-04-2021",

}

Chu, X, Chen, Z, Gao, P, Gong, J, Guo, Z, Guo, C, Huang, X, Jiang, X, Lan, R, Lin, W, Meng, P, Ouyang, X, Song, S, Wei, J, Wu, Y, Xie, L, Xu, X, Yang, B, Zhang, Y, Zhou, X, Zhou, F, Zhu, Z, Wang, X & Shi, S 2021, 'Towards Scalable Distributed Training of Deep Learning on Public Cloud Clusters', Paper presented at The 4th Machine Learning and Systems Conference, MLSys 2021, 1/04/21 - 1/04/21. <https://hdl.handle.net/1783.1/109760>

TY - CONF

T1 - Towards Scalable Distributed Training of Deep Learning on Public Cloud Clusters

AU - Chu, Xiaowen

AU - Chen, Zhibo

AU - Gao, Ping

AU - Gong, Jing

AU - Guo, Zhenyu

AU - Guo, Chenyang

AU - Huang, Xue

AU - Jiang, Xinan

AU - Lan, Rui

AU - Lin, Weiliang

AU - Meng, Peng

AU - Ouyang, Xianbin

AU - Song, Shutao

AU - Wei, Jieqian

AU - Wu, Yongjian

AU - Xie, Liqiang

AU - Xu, Xiaomin

AU - Yang, Bo

AU - Zhang, Yan

AU - Zhou, Xianhao

AU - Zhou, Feihu

AU - Zhu, Zilin

AU - Wang, Xingyao

AU - Shi, Shaohuai

PY - 2021/4

Y1 - 2021/4

M3 - Conference Paper

T2 - The 4th Machine Learning and Systems Conference, MLSys 2021

Y2 - 1 April 2021 through 1 April 2021

ER -