Skip to content

Commit

Permalink
fix
Browse files Browse the repository at this point in the history
  • Loading branch information
jinhongyii committed Jan 7, 2025
1 parent cdbc828 commit ba53fb1
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion _posts/2025-01-06-microserving-llm-engines.md
Original file line number Diff line number Diff line change
Expand Up @@ -73,7 +73,7 @@ class LLMEngine:
"""
pass

def start_generate(prompt, begin, seq_id) -> AsyncGenerator[int]:
def start_generate(prompt, begin, seq_id) -> AsyncGenerator[TokenId]:
"""
One-line summary: Start token generation
Expand Down

0 comments on commit ba53fb1

Please sign in to comment.