runtime error
Exit code: 1. Reason: 00001-of-000001.safetensors: 98%|█████████▊| 6.64G/6.74G [00:17<00:00, 779MB/s][A model-00001-of-000001.safetensors: 100%|█████████▉| 6.74G/6.74G [00:17<00:00, 379MB/s] Downloading shards: 100%|██████████| 1/1 [00:18<00:00, 18.04s/it] Downloading shards: 100%|██████████| 1/1 [00:18<00:00, 18.04s/it] Traceback (most recent call last): File "/home/user/app/web_demo.py", line 662, in <module> demo = build_demo(args) File "/home/user/app/web_demo.py", line 471, in build_demo fetch_model(args.model_name) File "/home/user/app/web_demo.py", line 143, in fetch_model DEPLOY_MODELS[model_name] = load_model(model_path, dtype=dtype) File "/home/user/app/deepseek_vl2/serve/inference.py", line 43, in load_model vl_gpt = vl_gpt.cuda().eval() File "/usr/local/lib/python3.10/site-packages/transformers/modeling_utils.py", line 2528, in cuda return super().cuda(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/torch/nn/modules/module.py", line 905, in cuda return self._apply(lambda t: t.cuda(device)) File "/usr/local/lib/python3.10/site-packages/torch/nn/modules/module.py", line 797, in _apply module._apply(fn) File "/usr/local/lib/python3.10/site-packages/torch/nn/modules/module.py", line 797, in _apply module._apply(fn) File "/usr/local/lib/python3.10/site-packages/torch/nn/modules/module.py", line 797, in _apply module._apply(fn) File "/usr/local/lib/python3.10/site-packages/torch/nn/modules/module.py", line 820, in _apply param_applied = fn(param) File "/usr/local/lib/python3.10/site-packages/torch/nn/modules/module.py", line 905, in <lambda> return self._apply(lambda t: t.cuda(device)) File "/usr/local/lib/python3.10/site-packages/torch/cuda/__init__.py", line 247, in _lazy_init torch._C._cuda_init() RuntimeError: Found no NVIDIA driver on your system. Please check that you have an NVIDIA GPU and installed a driver from http://www.nvidia.com/Download/index.aspx
Container logs:
Fetching error logs...