Skip to content

Commit

Permalink
Remove unnecessary comment
Browse files Browse the repository at this point in the history
  • Loading branch information
gordicaleksa committed Aug 8, 2024
1 parent c5c87fc commit d773c88
Showing 1 changed file with 0 additions and 9 deletions.
9 changes: 0 additions & 9 deletions train_llama3.py
Original file line number Diff line number Diff line change
Expand Up @@ -740,15 +740,6 @@ def encode(
return t

def decode(self, t: Sequence[int]) -> str:
"""
Decodes a list of token IDs into a string.
Args:
t (List[int]): The list of token IDs to be decoded.
Returns:
str: The decoded string.
"""
# Typecast is safe here. Tiktoken doesn't do anything list-related with the sequence.
return self.model.decode(cast(List[int], t))

Expand Down

0 comments on commit d773c88

Please sign in to comment.