Skip to content

Commit

Permalink
Remove bad type annotation
Browse files Browse the repository at this point in the history
  • Loading branch information
alex-lew authored Jul 18, 2024
1 parent cd2b3ea commit bd3bcb5
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion hfppl/llms.py
Original file line number Diff line number Diff line change
Expand Up @@ -37,7 +37,7 @@ def __init__(self, lm):

self.MAX_TOKEN_LENGTH = self.precompute_token_length_masks(lm)

def precompute_token_length_masks(self, lm) -> Dict[int, Set[int]]:
def precompute_token_length_masks(self, lm):
"""Precompute masks for tokens of different lengths.
Each mask is a set of token ids that are of the given length or shorter."""
Expand Down

0 comments on commit bd3bcb5

Please sign in to comment.