Commits

Branch selector

 77ebf76

User selector

All users

Datepicker

All time

Commit History

Commits on May 2, 2023

• [zero_to_fp32] fix shared param recovery (microsoft#3407)

  Show description for 77ebf76
  

  3 peopleauthored
  77ebf76

• Add ZeRO 1 support to PP for BF16. (microsoft#3399)

  Show description for dcb4a7d
  

  jomayeri

  and

  tjruwase

  authored
  dcb4a7d

• OPT Activation Function Hotfix (microsoft#3400)

  Show description for 52d7e80
  

  3 peopleauthored
  52d7e80

• Fix PipelineEngine.eval_batch result (microsoft#3316)

  Show description for b0d9c4d
  

  nrailg

  and

  jeffra

  authored
  b0d9c4d

Commits on May 1, 2023

• Update links (microsoft#3424)

  loadams

  authored
  b2ac7f6

• Add HE support for the rest of model containers (microsoft#3191)

  Show description for 3e85646
  

  RezaYazdaniAminabadi

  and

  jeffra

  authored
  3e85646

• save tensors in context of memory_efficient_linear (microsoft#3413)

  Show description for 42858a9
  

  tohtana

  and

  tjruwase

  authored
  42858a9

• doc updates (microsoft#3415)

  goodship1

  authored
  b4b63f5

Commits on Apr 30, 2023

• Fix pipeline module evaluation when contiguous activation checkpointing is enabled (microsoft#3005)

  Show description for 7ddc3b0
  

  BacharL

  and

  tjruwase

  authored
  7ddc3b0

Commits on Apr 28, 2023

• remove megatron-lm, no longer pip installable (microsoft#3389)

  Show description for a094c97
  

  jeffra

  and

  loadams

  authored
  a094c97

Commits on Apr 26, 2023

• [docs] add twitter badge to readme

  jeffra

  authored
  f7d71ec

• Fix memory leak in zero2 contiguous gradients (microsoft#3306)

  Show description for 01d1749
  

  3 peopleauthored
  01d1749

• stage_1_and_2.py: do gradient scale only for fp16 (microsoft#3166)

  Show description for 0e35766
  

  guoyejun

  and

  tjruwase

  authored
  0e35766

• [DRAFT] Tentative implementation of MiCS (microsoft#2964)

  Show description for 2e99f6e
  

  5 peopleauthored
  2e99f6e

Commits on Apr 25, 2023

• Auto TP Tutorial with T5 Example (microsoft#2962)

  Show description for d925395
  

  molly-smith

  and

  jeffra

  authored
  d925395

• fixing default communication_data_type for bfloat16_enabled and docs (microsoft#3370)

  Show description for d56268f
  

  4 peopleauthored
  d56268f

• Fix redundant shared_params in zero_to_fp32.py (microsoft#3149)

  Show description for 39825a9
  

  ShijieZZZZ

  and

  tjruwase

  authored
  39825a9

Commits on Apr 24, 2023

• add deepspeed chat blog links, add tags (microsoft#3369)

  conglongli

  authored
  085981b

• Update DS-Chat issue template (microsoft#3368)

  Show description for 3031eec
  mrwyattii

  authored
  3031eec

• fix mpich launcher issue in multi-node (microsoft#3078)

  Show description for a748bfc
  

  sywangyi

  and

  tjruwase

  authored
  a748bfc

• hybrid_engine: check tuple size when fusing lora params (microsoft#3311)

  Show description for c9196b6
  

  3 peopleauthored
  c9196b6

Commits on Apr 23, 2023

• README.md: Update MosaicML docs link (microsoft#3344)

  Show description for 39b429d
  

  kobindra

  and

  jeffra

  authored
  39b429d

Commits on Apr 22, 2023

• add bf16 cuda kernel support (microsoft#3092)

  Show description for 297cd9e
  

  dc3671

  and

  tjruwase

  authored
  297cd9e

Commits on Apr 21, 2023

• print default values (microsoft#3347)

  mrwyattii

  authored
  2f8d384

• Diffusers 0.15.0 bug fix (microsoft#3345)

  Show description for 496a9a3
  molly-smith

  authored
  496a9a3

• Hipify cooperative_groups headers (microsoft#3323)

  Show description for 6e1cbeb
  

  rraminen

  and

  loadams

  authored
  6e1cbeb

• Fix formatting (microsoft#3343)

  Show description for 4a3ca4e
  mrwyattii

  authored
  4a3ca4e

• bump to 0.9.2

  jeffra

  committed
  78afab0

• Explicitly check for OPT activation function (microsoft#3278)

  Show description for 793c23e
  

  3 peopleauthored
  793c23e

• Fix missing scale attributes for GPTJ (microsoft#3256)

  Show description for 145c3a7
  

  3 peopleauthored
  145c3a7

Commits on Apr 20, 2023

• Fix for dist not being initialized when constructing main config (microsoft#3324)

  Show description for ad168a6
  mrwyattii

  authored
  ad168a6

• zero3 checkpoint frozen params (microsoft#3205)

  Show description for dd8df20
  tjruwase

  authored
  dd8df20

• Update Dockerfile (microsoft#3298)

  Show description for ab1d2f8
  

  bobowwb

  and

  loadams

  authored
  ab1d2f8

• Update README.md (microsoft#3315)

  Show description for dd902a3
  digger-yu

  authored
  dd902a3

Commits on Apr 19, 2023

• Add pre-compiling ops test (microsoft#3277)

  Show description for 4de4d2a
  

  loadams

  and

  jeffra

  authored
  4de4d2a

Pagination

Previous

Next