From 9833d814d5751dfeb29fd4d273296ecb96cf95c4 Mon Sep 17 00:00:00 2001 From: binmakeswell Date: Sat, 21 May 2022 18:31:11 +0800 Subject: [PATCH] [NFC] fix paper link --- README-zh-Hans.md | 2 +- README.md | 2 +- 2 files changed, 2 insertions(+), 2 deletions(-) diff --git a/README-zh-Hans.md b/README-zh-Hans.md index ba18cf971bbd..569a5208fb82 100644 --- a/README-zh-Hans.md +++ b/README-zh-Hans.md @@ -83,7 +83,7 @@ Colossal-AI 为您提供了一系列并行训练组件。我们的目标是让 - 流水线并行 - 1维, [2维](https://arxiv.org/abs/2104.05343), [2.5维](https://arxiv.org/abs/2105.14500), [3维](https://arxiv.org/abs/2105.14450) 张量并行 - [序列并行](https://arxiv.org/abs/2105.13120) - - [零冗余优化器 (ZeRO)](https://arxiv.org/abs/2108.05818) + - [零冗余优化器 (ZeRO)](https://arxiv.org/abs/1910.02054) - 异构内存管理 - [PatrickStar](https://arxiv.org/abs/2108.05818) - 使用友好 diff --git a/README.md b/README.md index 04ebceddccd5..85faf50950b6 100644 --- a/README.md +++ b/README.md @@ -85,7 +85,7 @@ distributed training in a few lines. - Pipeline Parallelism - 1D, [2D](https://arxiv.org/abs/2104.05343), [2.5D](https://arxiv.org/abs/2105.14500), [3D](https://arxiv.org/abs/2105.14450) Tensor Parallelism - [Sequence Parallelism](https://arxiv.org/abs/2105.13120) - - [Zero Redundancy Optimizer (ZeRO)](https://arxiv.org/abs/2108.05818) + - [Zero Redundancy Optimizer (ZeRO)](https://arxiv.org/abs/1910.02054) - Heterogeneous Memory Menagement - [PatrickStar](https://arxiv.org/abs/2108.05818)