Skip to content

Commit

Permalink
fix ci
Browse files Browse the repository at this point in the history
Signed-off-by: MengqingCao <[email protected]>
  • Loading branch information
MengqingCao committed Nov 30, 2024
1 parent fce1e2c commit 3eda947
Showing 1 changed file with 5 additions and 1 deletion.
6 changes: 5 additions & 1 deletion vllm/model_executor/layers/vocab_parallel_embedding.py
Original file line number Diff line number Diff line change
Expand Up @@ -134,7 +134,11 @@ def __post_init__(self):


# TODO (cmq): fix this for ascend npu
@torch.compile(dynamic=True, backend="npu")
current_backend = "inductor"
if current_platform.is_npu():
current_backend = "npu"

@torch.compile(dynamic=True, backend=current_backend)
def get_masked_input_and_mask(
input_: torch.Tensor, org_vocab_start_index: int,
org_vocab_end_index: int, num_org_vocab_padding: int,
Expand Down

0 comments on commit 3eda947

Please sign in to comment.