Skip to content

Commit

Permalink
Another round of lint
Browse files Browse the repository at this point in the history
  • Loading branch information
raikonenfnu committed Dec 23, 2023
1 parent 369ad35 commit c86b7b0
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion python/turbine_models/custom_models/llm_app.py
Original file line number Diff line number Diff line change
Expand Up @@ -92,7 +92,7 @@ def generate(self, input_ids):
# Because we have stored the res in KV-cache.
token_len = input_ids.shape[-1]
if self.init_cache:
input_ids = input_ids[:, self.prev_token_len:]
input_ids = input_ids[:, self.prev_token_len :]
inputs = [ireert.asdevicearray(self.runner.config.device, input_ids)]
if self.first_input or not self.init_cache:
s = time.time()
Expand Down

0 comments on commit c86b7b0

Please sign in to comment.