Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

pip magic #48

Open
K0shachiyamyatA opened this issue Jan 25, 2025 · 4 comments
Open

pip magic #48

K0shachiyamyatA opened this issue Jan 25, 2025 · 4 comments
Labels

Comments

@K0shachiyamyatA
Copy link

ModuleNotFoundError: No module named 'resource'
(venv) PS E:\0llm> pip install resource
Collecting resource
  Downloading Resource-0.2.1-py2.py3-none-any.whl (25 kB)
Collecting python-easyconfig>=0.1.0
  Downloading Python_EasyConfig-0.1.7-py2.py3-none-any.whl (5.4 kB)
Collecting JsonForm>=0.0.2
  Downloading JsonForm-0.0.2.tar.gz (2.4 kB)
Collecting JsonSir>=0.0.2
  Downloading JsonSir-0.0.2.tar.gz (2.2 kB)
Requirement already satisfied: jsonschema in e:\0llm\venv\lib\site-packages (from JsonForm>=0.0.2->resource) (4.23.0)
Requirement already satisfied: PyYAML in e:\0llm\venv\lib\site-packages (from python-easyconfig>=0.1.0->resource) (6.0.2)
Requirement already satisfied: six in e:\0llm\venv\lib\site-packages (from python-easyconfig>=0.1.0->resource) (1.17.0)
Requirement already satisfied: referencing>=0.28.4 in e:\0llm\venv\lib\site-packages (from jsonschema->JsonForm>=0.0.2->resource) (0.36.2)
Requirement already satisfied: attrs>=22.2.0 in e:\0llm\venv\lib\site-packages (from jsonschema->JsonForm>=0.0.2->resource) (24.3.0)
Requirement already satisfied: rpds-py>=0.7.1 in e:\0llm\venv\lib\site-packages (from jsonschema->JsonForm>=0.0.2->resource) (0.22.3)
Requirement already satisfied: jsonschema-specifications>=2023.03.6 in e:\0llm\venv\lib\site-packages (from jsonschema->JsonForm>=0.0.2->resource) (2024.10.1)
Requirement already satisfied: typing-extensions>=4.4.0 in e:\0llm\venv\lib\site-packages (from referencing>=0.28.4->jsonschema->JsonForm>=0.0.2->resource) (4.12.2)
Using legacy 'setup.py install' for JsonForm, since package 'wheel' is not installed.
Using legacy 'setup.py install' for JsonSir, since package 'wheel' is not installed.
Installing collected packages: python-easyconfig, JsonSir, JsonForm, resource
    Running setup.py install for JsonSir ... done
    Running setup.py install for JsonForm ... done
Successfully installed JsonForm-0.0.2 JsonSir-0.0.2 python-easyconfig-0.1.7 resource-0.2.1
WARNING: You are using pip version 21.2.3; however, version 24.3.1 is available.
You should consider upgrading via the 'E:\0llm\venv\Scripts\python.exe -m pip install --upgrade pip' command.
(venv) PS E:\0llm> python -m vllm.entrypoints.openai.api_server --served-model-name ui-tars --model ./UI-TARS-7B-DPO.f16.gguf
Traceback (most recent call last):
  File "C:\Users\user\AppData\Local\Programs\Python\Python310\lib\runpy.py", line 187, in _run_module_as_main
    mod_name, mod_spec, code = _get_module_details(mod_name, _Error)
  File "C:\Users\user\AppData\Local\Programs\Python\Python310\lib\runpy.py", line 110, in _get_module_details
    __import__(pkg_name)
  File "E:\0llm\venv\lib\site-packages\vllm\__init__.py", line 3, in <module>
    from vllm.engine.arg_utils import AsyncEngineArgs, EngineArgs
  File "E:\0llm\venv\lib\site-packages\vllm\engine\arg_utils.py", line 11, in <module>
    from vllm.config import (CacheConfig, CompilationConfig, ConfigFormat,
  File "E:\0llm\venv\lib\site-packages\vllm\config.py", line 22, in <module>
    from vllm.model_executor.layers.quantization import (QUANTIZATION_METHODS,
  File "E:\0llm\venv\lib\site-packages\vllm\model_executor\__init__.py", line 1, in <module>
    from vllm.model_executor.parameter import (BasevLLMParameter,
  File "E:\0llm\venv\lib\site-packages\vllm\model_executor\parameter.py", line 7, in <module>
    from vllm.distributed import get_tensor_model_parallel_rank
  File "E:\0llm\venv\lib\site-packages\vllm\distributed\__init__.py", line 1, in <module>
    from .communication_op import *
  File "E:\0llm\venv\lib\site-packages\vllm\distributed\communication_op.py", line 6, in <module>
    from .parallel_state import get_tp_group
  File "E:\0llm\venv\lib\site-packages\vllm\distributed\parallel_state.py", line 38, in <module>
    import vllm.distributed.kv_transfer.kv_transfer_agent as kv_transfer
  File "E:\0llm\venv\lib\site-packages\vllm\distributed\kv_transfer\kv_transfer_agent.py", line 15, in <module>
    from vllm.distributed.kv_transfer.kv_connector.factory import (
  File "E:\0llm\venv\lib\site-packages\vllm\distributed\kv_transfer\kv_connector\factory.py", line 3, in <module>
    from .base import KVConnectorBase
  File "E:\0llm\venv\lib\site-packages\vllm\distributed\kv_transfer\kv_connector\base.py", line 14, in <module>
    from vllm.sequence import IntermediateTensors
  File "E:\0llm\venv\lib\site-packages\vllm\sequence.py", line 16, in <module>
    from vllm.inputs import SingletonInputs, SingletonInputsAdapter
  File "E:\0llm\venv\lib\site-packages\vllm\inputs\__init__.py", line 7, in <module>
    from .registry import (DummyData, InputContext, InputProcessingContext,
  File "E:\0llm\venv\lib\site-packages\vllm\inputs\registry.py", line 13, in <module>
    from vllm.transformers_utils.tokenizer import AnyTokenizer
  File "E:\0llm\venv\lib\site-packages\vllm\transformers_utils\tokenizer.py", line 16, in <module>
    from vllm.utils import make_async
  File "E:\0llm\venv\lib\site-packages\vllm\utils.py", line 15, in <module>
    import resource
ModuleNotFoundError: No module named 'resource'
@ycjcl868 ycjcl868 added the model label Jan 26, 2025
@HappyToSummer
Copy link

I also have the same problem

python 3.12
vllm 0.6.6
transformers 4.48.1

@RikkTheGaijin
Copy link

Same issue.

C:\>vllm serve "bytedance-research/UI-TARS-7B-DPO"
Traceback (most recent call last):
  File "<frozen runpy>", line 198, in _run_module_as_main
  File "<frozen runpy>", line 88, in _run_code
  File "C:\Users\WDAGUtilityAccount\AppData\Local\Programs\Python\Python312\Scripts\vllm.exe\__main__.py", line 4, in <module>
  File "C:\Users\WDAGUtilityAccount\AppData\Local\Programs\Python\Python312\Lib\site-packages\vllm\__init__.py", line 3, in <module>
    from vllm.engine.arg_utils import AsyncEngineArgs, EngineArgs
  File "C:\Users\WDAGUtilityAccount\AppData\Local\Programs\Python\Python312\Lib\site-packages\vllm\engine\arg_utils.py", line 11, in <module>
    from vllm.config import (CacheConfig, CompilationConfig, ConfigFormat,
  File "C:\Users\WDAGUtilityAccount\AppData\Local\Programs\Python\Python312\Lib\site-packages\vllm\config.py", line 22, in <module>
    from vllm.model_executor.layers.quantization import (QUANTIZATION_METHODS,
  File "C:\Users\WDAGUtilityAccount\AppData\Local\Programs\Python\Python312\Lib\site-packages\vllm\model_executor\__init__.py", line 1, in <module>
    from vllm.model_executor.parameter import (BasevLLMParameter,
  File "C:\Users\WDAGUtilityAccount\AppData\Local\Programs\Python\Python312\Lib\site-packages\vllm\model_executor\parameter.py", line 7, in <module>
    from vllm.distributed import get_tensor_model_parallel_rank
  File "C:\Users\WDAGUtilityAccount\AppData\Local\Programs\Python\Python312\Lib\site-packages\vllm\distributed\__init__.py", line 1, in <module>
    from .communication_op import *
  File "C:\Users\WDAGUtilityAccount\AppData\Local\Programs\Python\Python312\Lib\site-packages\vllm\distributed\communication_op.py", line 6, in <module>
    from .parallel_state import get_tp_group
  File "C:\Users\WDAGUtilityAccount\AppData\Local\Programs\Python\Python312\Lib\site-packages\vllm\distributed\parallel_state.py", line 38, in <module>
    import vllm.distributed.kv_transfer.kv_transfer_agent as kv_transfer
  File "C:\Users\WDAGUtilityAccount\AppData\Local\Programs\Python\Python312\Lib\site-packages\vllm\distributed\kv_transfer\kv_transfer_agent.py", line 15, in <module>
    from vllm.distributed.kv_transfer.kv_connector.factory import (
  File "C:\Users\WDAGUtilityAccount\AppData\Local\Programs\Python\Python312\Lib\site-packages\vllm\distributed\kv_transfer\kv_connector\factory.py", line 3, in <module>
    from .base import KVConnectorBase
  File "C:\Users\WDAGUtilityAccount\AppData\Local\Programs\Python\Python312\Lib\site-packages\vllm\distributed\kv_transfer\kv_connector\base.py", line 14, in <module>
    from vllm.sequence import IntermediateTensors
  File "C:\Users\WDAGUtilityAccount\AppData\Local\Programs\Python\Python312\Lib\site-packages\vllm\sequence.py", line 16, in <module>
    from vllm.inputs import SingletonInputs, SingletonInputsAdapter
  File "C:\Users\WDAGUtilityAccount\AppData\Local\Programs\Python\Python312\Lib\site-packages\vllm\inputs\__init__.py", line 7, in <module>
    from .registry import (DummyData, InputContext, InputProcessingContext,
  File "C:\Users\WDAGUtilityAccount\AppData\Local\Programs\Python\Python312\Lib\site-packages\vllm\inputs\registry.py", line 13, in <module>
    from vllm.transformers_utils.tokenizer import AnyTokenizer
  File "C:\Users\WDAGUtilityAccount\AppData\Local\Programs\Python\Python312\Lib\site-packages\vllm\transformers_utils\tokenizer.py", line 16, in <module>
    from vllm.utils import make_async
  File "C:\Users\WDAGUtilityAccount\AppData\Local\Programs\Python\Python312\Lib\site-packages\vllm\utils.py", line 15, in <module>
    import resource
ModuleNotFoundError: No module named 'resource'

@Neighkey
Copy link

is it possible to fix this?
i googled and saw that it's a windows problem.
no fixes.
so i'm assuming that the local deployment is only for mac and linux.
tch

@tinkererkzy
Copy link

vllm does not support windows
use wsl or docker

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

6 participants