Skip to content

ModuleNotFoundError: No module named 'vllm._C' #33

Description

@VenomHzp

(localgpt-vision) D:\Python_Project\python_project\localGPT-Vision-main>python app.py
INFO 06-14 19:30:20 [importing.py:17] Triton not installed or not compatible; certain GPU-related functions will not be available.
WARNING 06-14 19:30:20 [importing.py:29] Triton is not installed. Using dummy decorators. Install it via pip install triton to enable kernel compilation.
INFO 06-14 19:30:20 [init.py:244] Automatically detected platform cuda.
Traceback (most recent call last):
File "D:\Python_Project\python_project\localGPT-Vision-main\app.py", line 9, in
from models.responder import generate_response
File "D:\Python_Project\python_project\localGPT-Vision-main\models\responder.py", line 3, in
from models.model_loader import load_model, is_single_image_model
File "D:\Python_Project\python_project\localGPT-Vision-main\models\model_loader.py", line 7, in
from vllm.sampling_params import SamplingParams
File "D:\Anaconda\envs\localgpt-vision\lib\site-packages\vllm_init_.py", line 13, in
from vllm.engine.arg_utils import AsyncEngineArgs, EngineArgs
File "D:\Anaconda\envs\localgpt-vision\lib\site-packages\vllm\engine\arg_utils.py", line 22, in
from vllm.config import (BlockSize, CacheConfig, CacheDType, CompilationConfig,
File "D:\Anaconda\envs\localgpt-vision\lib\site-packages\vllm\config.py", line 37, in
from vllm.model_executor.layers.quantization import (QUANTIZATION_METHODS,
File "D:\Anaconda\envs\localgpt-vision\lib\site-packages\vllm\model_executor_init_.py", line 4, in
from vllm.model_executor.parameter import (BasevLLMParameter,
File "D:\Anaconda\envs\localgpt-vision\lib\site-packages\vllm\model_executor\parameter.py", line 10, in
from vllm.distributed import get_tensor_model_parallel_rank
File "D:\Anaconda\envs\localgpt-vision\lib\site-packages\vllm\distributed_init_.py", line 4, in
from .communication_op import *
File "D:\Anaconda\envs\localgpt-vision\lib\site-packages\vllm\distributed\communication_op.py", line 9, in
from .parallel_state import get_tp_group
File "D:\Anaconda\envs\localgpt-vision\lib\site-packages\vllm\distributed\parallel_state.py", line 150, in
from vllm.platforms import current_platform
File "D:\Anaconda\envs\localgpt-vision\lib\site-packages\vllm\platforms_init_.py", line 276, in getattr
current_platform = resolve_obj_by_qualname(
File "D:\Anaconda\envs\localgpt-vision\lib\site-packages\vllm\utils.py", line 2239, in resolve_obj_by_qualname
module = importlib.import_module(module_name)
File "D:\Anaconda\envs\localgpt-vision\lib\importlib_init
.py", line 126, in import_module
return _bootstrap._gcd_import(name[level:], package, level)
File "D:\Anaconda\envs\localgpt-vision\lib\site-packages\vllm\platforms\cuda.py", line 18, in
import vllm._C # noqa
ModuleNotFoundError: No module named 'vllm._C'

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions