Skip to main navigation Skip to search Skip to main content

Low Bit Transferring: Native MoE FFN Transferring Algorithm under Unified Distributed Tensor View Architecture

  • GU, Hao (Team member)
  • LI, Lujun (Team member)
  • HAN, Sirui (PI)
  • XUE, Wei (CoPI)
  • WANG, Lei (CoPI)

Project: Research

Project Details

Chinese Project Title

低精度通讯: 基于统一分布式Tensor架构的MoE FFN通讯算法
StatusActive
Effective start/end date18/12/25 → 17/12/27

Fingerprint

Explore the research topics touched on by this project. These labels are generated based on the underlying awards/grants. Together they form a unique fingerprint.
View full fingerprint