Skip to content

Commit

Permalink
pre-commit
Browse files Browse the repository at this point in the history
  • Loading branch information
dlwh committed Nov 5, 2024
1 parent 957768d commit 9b3f98d
Showing 1 changed file with 1 addition and 0 deletions.
1 change: 1 addition & 0 deletions src/levanter/data/text.py
Original file line number Diff line number Diff line change
Expand Up @@ -575,6 +575,7 @@ class LMSupervisedDatasetConfig:

validation_urls: List[str] = () # type:ignore


def preprocess_supervised_example(
batch, tokenizer: PreTrainedTokenizerBase, input_field: str, output_field: str
) -> dict:
Expand Down

0 comments on commit 9b3f98d

Please sign in to comment.