Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Torch Error #1132

Open
Jufyer opened this issue Jun 24, 2024 · 0 comments
Open

Torch Error #1132

Jufyer opened this issue Jun 24, 2024 · 0 comments

Comments

@Jufyer
Copy link

Jufyer commented Jun 24, 2024

Hi,
I get an Error if I want to run the model. My input in Anaconda is the following:

torchrun --nproc_per_node 1 example_chat_completion.py \ --ckpt_dir LLamaa/ \ --tokenizer_path tokenizer.model \ --max_seq_len 512 --max_batch_size 6

This is the Command from the GitHub-Page here. I think the important part of the Error is following:

 [W socket.cpp:697] [c10d] The client socket has failed to connect to [NB-KUHNLA]:29500 (system error: 10049 - Die angeforderte Adresse ist in diesem Kontext ung³ltig.).
C:\Users\User\miniconda3\Lib\site-packages\torch\distributed\distributed_c10d.py:613: UserWarning: Attempted to get default timeout for nccl backend, but NCCL support is not compiled

But the whole Error can be fund here: https://pastebin.com/emJyPEC2

Runtime Environment

  • Model: [llama-2-7b]
  • Using via huggingface?: [yes/no]
  • OS: [Windows]
  • GPU VRAM:
  • Number of GPUs: 1
  • GPU Make: [Intel]

I am thankfull if you could help me

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant