Skip to content

Commit

Permalink
[doc] uio (wenet-e2e#1733)
Browse files Browse the repository at this point in the history
  • Loading branch information
robin1001 authored Mar 10, 2023
1 parent 46eb1d4 commit 76adcfe
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions docs/UIO.md
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
# UIO for WeNet
# Big Data Training: UIO

In order to support the model training of industrial tens of millions of hours of speech dataset, the data processing
method UIO (Unified IO) has been updated in WeNet. The document will introduce UIO from the following sections:
Expand Down Expand Up @@ -174,4 +174,4 @@ class DistributedSampler:

Q2: How to deal with unbalanced data?

A: Use model.join() to handle the imbalance of data allocated on each rank. Please refer [this](https://pytorch.org/tutorials/advanced/generic_join.html#how-does-join-work).
A: Use model.join() to handle the imbalance of data allocated on each rank. Please refer [this](https://pytorch.org/tutorials/advanced/generic_join.html#how-does-join-work).

0 comments on commit 76adcfe

Please sign in to comment.