Commits

Branch selector

 master

User selector

All users

Datepicker

All time

Commit History

Commits on May 9, 2023

• fix a small type error on bf16+pp (microsoft#3441)

  Show description for 195563a
  

  3 peopleauthored
  195563a

Commits on May 8, 2023

• fix spelling error (microsoft#3482)

  Show description for f1fab90
  

  luliyucoordinate

  and

  loadams

  authored
  f1fab90

• Fix spelling errors in comments and documents (microsoft#3486)

  Show description for 87edbc8
  

  3 peopleauthored
  87edbc8

• Doc corrections (microsoft#3435)

  Show description for 4132118
  

  goodship1

  and

  loadams

  authored
  4132118

• Build: Update license in setup (microsoft#3484)

  PabloEmidio

  authored
  f3f4c44

Commits on May 7, 2023

• [Docs] Update automatic-tensor-parallelism.md (microsoft#3198)

  Show description for 9715d80
  

  3 peopleauthored
  9715d80

Commits on May 5, 2023

• launcher/multinode_runner.py: mapping env variables in running cmd for mpich runner (microsoft#3372)

  Show description for 4e886f0
  

  3 peopleauthored
  4e886f0

Commits on May 4, 2023

• add sharded checkpoint loading for AutoTP path to reduce the peak mem… (microsoft#3102)

  Show description for d10b8ca
  

  sywangyi

  and

  tjruwase

  authored
  d10b8ca

• Hybrid Engine Refactor and Llama Inference Support (microsoft#3425)

  Show description for 0a61d5d
  

  cmikeh2

  and

  jeffra

  authored
  0a61d5d

Commits on May 3, 2023

• add skip for mismatched cuda versions (microsoft#3436)

  mrwyattii

  authored
  d2e6110

• Enable auto TP policy for llama model (microsoft#3170)

  Show description for 2c63e34
  

  3 peopleauthored
  2c63e34

• bump to 0.9.3

  jeffra

  committed
  5314c9a

• Update 2020-09-09-sparse-attention.md (microsoft#3432)

  Show description for e0e8085
  

  goodship1

  and

  loadams

  authored
  e0e8085

• Adagrad support in ZeRO (microsoft#3401)

  Show description for d3550dc
  

  jomayeri

  and

  tjruwase

  authored
  d3550dc

Commits on May 2, 2023

• [zero_to_fp32] fix shared param recovery (microsoft#3407)

  Show description for 77ebf76
  

  3 peopleauthored
  77ebf76

• Add ZeRO 1 support to PP for BF16. (microsoft#3399)

  Show description for dcb4a7d
  

  jomayeri

  and

  tjruwase

  authored
  dcb4a7d

• OPT Activation Function Hotfix (microsoft#3400)

  Show description for 52d7e80
  

  3 peopleauthored
  52d7e80

• Fix PipelineEngine.eval_batch result (microsoft#3316)

  Show description for b0d9c4d
  

  nrailg

  and

  jeffra

  authored
  b0d9c4d

Commits on May 1, 2023

• Update links (microsoft#3424)

  loadams

  authored
  b2ac7f6

• Add HE support for the rest of model containers (microsoft#3191)

  Show description for 3e85646
  

  RezaYazdaniAminabadi

  and

  jeffra

  authored
  3e85646

• save tensors in context of memory_efficient_linear (microsoft#3413)

  Show description for 42858a9
  

  tohtana

  and

  tjruwase

  authored
  42858a9

• doc updates (microsoft#3415)

  goodship1

  authored
  b4b63f5

Commits on Apr 30, 2023

• Fix pipeline module evaluation when contiguous activation checkpointing is enabled (microsoft#3005)

  Show description for 7ddc3b0
  

  BacharL

  and

  tjruwase

  authored
  7ddc3b0

Commits on Apr 28, 2023

• remove megatron-lm, no longer pip installable (microsoft#3389)

  Show description for a094c97
  

  jeffra

  and

  loadams

  authored
  a094c97

Commits on Apr 26, 2023

• [docs] add twitter badge to readme

  jeffra

  authored
  f7d71ec

• Fix memory leak in zero2 contiguous gradients (microsoft#3306)

  Show description for 01d1749
  

  3 peopleauthored
  01d1749

• stage_1_and_2.py: do gradient scale only for fp16 (microsoft#3166)

  Show description for 0e35766
  

  guoyejun

  and

  tjruwase

  authored
  0e35766

• [DRAFT] Tentative implementation of MiCS (microsoft#2964)

  Show description for 2e99f6e
  

  5 peopleauthored
  2e99f6e

Commits on Apr 25, 2023

• Auto TP Tutorial with T5 Example (microsoft#2962)

  Show description for d925395
  

  molly-smith

  and

  jeffra

  authored
  d925395

• fixing default communication_data_type for bfloat16_enabled and docs (microsoft#3370)

  Show description for d56268f
  

  4 peopleauthored
  d56268f

• Fix redundant shared_params in zero_to_fp32.py (microsoft#3149)

  Show description for 39825a9
  

  ShijieZZZZ

  and

  tjruwase

  authored
  39825a9

Commits on Apr 24, 2023

• add deepspeed chat blog links, add tags (microsoft#3369)

  conglongli

  authored
  085981b

• Update DS-Chat issue template (microsoft#3368)

  Show description for 3031eec
  mrwyattii

  authored
  3031eec

• fix mpich launcher issue in multi-node (microsoft#3078)

  Show description for a748bfc
  

  sywangyi

  and

  tjruwase

  authored
  a748bfc

• hybrid_engine: check tuple size when fusing lora params (microsoft#3311)

  Show description for c9196b6
  

  3 peopleauthored
  c9196b6

Pagination

Previous

Next