Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

exporting projection layers of joiner separately for onnx #584

Merged
merged 8 commits into from
Oct 11, 2022
Merged

exporting projection layers of joiner separately for onnx #584

Changes from 1 commit
Commits
Show all changes
8 commits
Select commit Hold shift + click to select a range
fdbfcdf
exporting projection layers of joiner separately for onnx
EmreOzkose Sep 25, 2022
d501c3c
fix style
EmreOzkose Sep 25, 2022
4b797e6
fix minor
EmreOzkose Sep 28, 2022
6910a25
fix minor
EmreOzkose Sep 28, 2022
d8b20bf
projection layers are added to onnx check
EmreOzkose Sep 28, 2022
42071bc
update onnx_pretrained.py according to exporting changes
EmreOzkose Sep 28, 2022
143d0a9
add joiner proj to args in actions
EmreOzkose Sep 28, 2022
6f6ed68
fix minors
EmreOzkose Sep 29, 2022
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
update onnx_pretrained.py according to exporting changes
  • Loading branch information
@EmreOzkose
EmreOzkose committed Sep 28, 2022
commit 42071bc529ec4d5f03ba8f5bf66a87498201f1c3
16 changes: 12 additions & 4 deletions egs/librispeech/ASR/pruned_transducer_stateless3/onnx_pretrained.py
View file
Original file line number Diff line number Diff line change
@@ -27,7 +27,7 @@

Usage of this script:

./pruned_transducer_stateless3/jit_trace_pretrained.py \
./pruned_transducer_stateless3/onnx_pretrained.py \
--encoder-model-filename ./pruned_transducer_stateless3/exp/encoder.onnx \
--decoder-model-filename ./pruned_transducer_stateless3/exp/decoder.onnx \
--joiner-model-filename ./pruned_transducer_stateless3/exp/joiner.onnx \
@@ -194,6 +194,7 @@ def greedy_search(
decoder_input_nodes[0].name: decoder_input.numpy(),
},
)[0].squeeze(1)
decoder_out = torch.from_numpy(decoder_out)

offset = 0
for batch_size in batch_size_list:
@@ -209,11 +210,17 @@ def greedy_search(
logits = joiner.run(
[joiner_output_nodes[0].name],
{
joiner_input_nodes[0].name: current_encoder_out.numpy(),
joiner_input_nodes[1].name: decoder_out,
joiner_input_nodes[0]
.name: current_encoder_out.unsqueeze(1)
.unsqueeze(1)
.numpy(),
joiner_input_nodes[1]
.name: decoder_out.unsqueeze(1)
.unsqueeze(1)
.numpy(),
},
)[0]
logits = torch.from_numpy(logits)
logits = torch.from_numpy(logits).squeeze(1).squeeze(1)
# logits'shape (batch_size, vocab_size)

assert logits.ndim == 2, logits.shape
@@ -236,6 +243,7 @@ def greedy_search(
decoder_input_nodes[0].name: decoder_input.numpy(),
},
)[0].squeeze(1)
decoder_out = torch.from_numpy(decoder_out)

sorted_ans = [h[context_size:] for h in hyps]
ans = []