GPU 专用 GPU 内存 & 共享 GPU 内存 完整解释
一、基础定义(Windows 任务管理器显卡栏可见) 1. 专用 GPU 内存(Dedicated GPU M…
多模态大模型 vLLM-Omni 双卡完整部署实战:多模态 / 文生图 / 文生视频双卡张量并行落地指南
一、前言:为什么需要 vLLM-Omni 双卡部署 vLLM-Omni 是 vLLM 官方推出的统一多模态推理…
CUDA 报错解析:torch.AcceleratorError: CUDA error: invalid device ordinal
一、核心原因 无效 GPU 设备编号,代码指定的 GPU 序号不存在,常见场景: 二、快速排查步骤 1. 先查…
Windows Windows 软链接保姆级教程:一招解决C盘爆满、文件迁移、路径固定难题
很多人用Windows都会遇到这些痛点: ✅ 软件默认装在C盘,越用越满,不敢乱删; ✅ 游戏缓存、微信文件、…
Linux Ubuntu 超详细 JDK 安装配置教程(零基础一键搞定)
很多 Java 开发新手,在 Ubuntu 系统搭建开发环境时,总会卡在 JDK 安装、环境变量配置、版本冲突…
多模态大模型 vLLM Wan2.2-I2V 启动命令解析与优化方案
一、原命令拆解说明 bash 运行 参数释义: 二、关键问题与适配优化(Windows WSL 运行 Wan2…
AI戏剧 Jellyfish 对接 RustFS 完整配置指南:高性能对象存储落地实操
在云原生、边缘存储、AI 非结构化数据存储场景中,传统 MinIO 存储常面临 GC 卡顿、高并发性能瓶颈、内…
Rust RustFS 从零配置指南:轻量高性能 S3 对象存储快速搭建
在轻量化私有存储、边缘存储、小型集群对象存储场景中,传统 MinIO 存在内存占用偏高、启动速度慢的问题,而 …
Rust 吊打传统对象存储?RustFS:基于Rust的高性能S3兼容分布式存储
在云原生、AI训练、大数据飞速普及的当下,对象存储已经成为企业存储基础设施的核心组件。不管是业务静态资源存储、…
热门文章
2026年7月大模型最新排行榜:神仙打架!国产模型正式跻身全球第一梯队
AI大模型的迭代速度,早已超越了大众认知。几乎每月都有新模型、新能力刷新行业上限,曾经固定的榜单格局,如今每周...
低显存极速部署 LTX2.3 视频模型|BBuf ltx23-modelopt-fp8-sglang-transformer 完整解析
前言 LTX2.3 是 Lightricks 推出的 22B 参数 DiT 架构开源视频生成模型,支持文生视频...
2026最新大模型排名深度解读:国产模型强势突围,行业梯队彻底洗牌
AI大模型赛道早已告别“一家独大”的时代,迭代速度远超所有人的想象。仅仅半年时间,全球大模型格局再度重构:老牌...
国产开源标杆 Qwen(通义千问)深度解析:从小模型到旗舰全谱系大模型
在百花齐放的开源大模型赛道里,来自阿里云通义实验室的 Qwen(通义千问) 绝对是绕不开的选择。 从 0.5B...
Bernini-R + ComfyUI 完整部署使用指南
一、基础介绍 Bernini-R 是字节跳动开源、基于 Wan2.2 DiT 架构的大一统多模态视频生成 / ...
最新评论
烙馍网
现在很多物业只收钱不做事,自己买的停车位,缴了停车管理费,排风系统不开,系统不运行年久失修已经锈了,这种物业有必要存在吗?
一路向北
(APIServer pid=3720) Traceback (most recent call last):
(APIServer pid=3720) File "/mnt/c/Users/AI-Space001/venv-vllm/bin/vllm", line 8, in
(APIServer pid=3720) sys.exit(main())
(APIServer pid=3720) ~~~~^^
(APIServer pid=3720) File "/mnt/c/Users/AI-Space001/venv-vllm/lib/python3.14/site-packages/vllm/entrypoints/cli/main.py", line 92, in main
(APIServer pid=3720) args.dispatch_function(args)
(APIServer pid=3720) ~~~~~~~~~~~~~~~~~~~~~~^^^^^^
(APIServer pid=3720) File "/mnt/c/Users/AI-Space001/venv-vllm/lib/python3.14/site-packages/vllm/entrypoints/cli/serve.py", line 148, in cmd
(APIServer pid=3720) uvloop.run(run_server(args))
(APIServer pid=3720) ~~~~~~~~~~^^^^^^^^^^^^^^^^^^
(APIServer pid=3720) File "/mnt/c/Users/AI-Space001/venv-vllm/lib/python3.14/site-packages/uvloop/__init__.py", line 96, in run
(APIServer pid=3720) return __asyncio.run(
(APIServer pid=3720) ~~~~~~~~~~~~~^
(APIServer pid=3720) wrapper(),
(APIServer pid=3720) ^^^^^^^^^^
(APIServer pid=3720) ......
(APIServer pid=3720) **run_kwargs
(APIServer pid=3720) ^^^^^^^^^^^^
(APIServer pid=3720) )
(APIServer pid=3720) ^
(APIServer pid=3720) File "/usr/lib/python3.14/asyncio/runners.py", line 204, in run
(APIServer pid=3720) return runner.run(main)
(APIServer pid=3720) ~~~~~~~~~~^^^^^^
(APIServer pid=3720) File "/usr/lib/python3.14/asyncio/runners.py", line 127, in run
(APIServer pid=3720) return self._loop.run_until_complete(task)
(APIServer pid=3720) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^
(APIServer pid=3720) File "uvloop/loop.pyx", line 1512, in uvloop.loop.Loop.run_until_complete
(APIServer pid=3720) File "uvloop/loop.pyx", line 1505, in uvloop.loop.Loop.run_until_complete
(APIServer pid=3720) self.run_forever()
(APIServer pid=3720) File "uvloop/loop.pyx", line 1379, in uvloop.loop.Loop.run_forever
(APIServer pid=3720) self._run(mode)
(APIServer pid=3720) File "uvloop/loop.pyx", line 557, in uvloop.loop.Loop._run
(APIServer pid=3720) raise self._last_error
(APIServer pid=3720) File "uvloop/loop.pyx", line 476, in uvloop.loop.Loop._on_idle
(APIServer pid=3720) handler._run()
(APIServer pid=3720) File "uvloop/cbhandles.pyx", line 83, in uvloop.loop.Handle._run
(APIServer pid=3720) File "uvloop/cbhandles.pyx", line 63, in uvloop.loop.Handle._run
(APIServer pid=3720) callback(*args)
(APIServer pid=3720) File "/mnt/c/Users/AI-Space001/venv-vllm/lib/python3.14/site-packages/uvloop/__init__.py", line 48, in wrapper
(APIServer pid=3720) return await main
(APIServer pid=3720) ^^^^^^^^^^
(APIServer pid=3720) File "/mnt/c/Users/AI-Space001/venv-vllm/lib/python3.14/site-packages/vllm/entrypoints/openai/api_server.py", line 678, in run_server
(APIServer pid=3720) await run_server_worker(listen_address, sock, args, **uvicorn_kwargs)
(APIServer pid=3720) File "/mnt/c/Users/AI-Space001/venv-vllm/lib/python3.14/site-packages/vllm/entrypoints/openai/api_server.py", line 696, in run_server_worker
(APIServer pid=3720) shutdown_task = await build_and_serve(
(APIServer pid=3720) ^^^^^^^^^^^^^^^^^^^^^^
(APIServer pid=3720) engine_client, listen_address, sock, args, **uvicorn_kwargs
(APIServer pid=3720) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
(APIServer pid=3720) )
(APIServer pid=3720) ^
(APIServer pid=3720) File "/mnt/c/Users/AI-Space001/venv-vllm/lib/python3.14/site-packages/vllm/entrypoints/openai/api_server.py", line 594, in build_and_serve
(APIServer pid=3720) await init_app_state(engine_client, app.state, args, supported_tasks)
(APIServer pid=3720) File "/mnt/c/Users/AI-Space001/venv-vllm/lib/python3.14/site-packages/vllm/entrypoints/openai/api_server.py", line 407, in init_app_state
(APIServer pid=3720) await init_generate_state(
(APIServer pid=3720) engine_client, state, args, request_logger, supported_tasks
(APIServer pid=3720) )
(APIServer pid=3720) File "/mnt/c/Users/AI-Space001/venv-vllm/lib/python3.14/site-packages/vllm/entrypoints/openai/generate/api_router.py", line 140, in init_generate_state
(APIServer pid=3720) state.openai_serving_chat.warmup()
(APIServer pid=3720) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^
(APIServer pid=3720) File "/mnt/c/Users/AI-Space001/venv-vllm/lib/python3.14/site-packages/vllm/entrypoints/openai/chat_completion/serving.py", line 181, in warmup
(APIServer pid=3720) self.renderer.warmup(
(APIServer pid=3720) ~~~~~~~~~~~~~~~~~~~~^
(APIServer pid=3720) ChatParams(
(APIServer pid=3720) ^^^^^^^^^^^
(APIServer pid=3720) ......
(APIServer pid=3720) )
(APIServer pid=3720) ^
(APIServer pid=3720) )
(APIServer pid=3720) ^
(APIServer pid=3720) File "/mnt/c/Users/AI-Space001/venv-vllm/lib/python3.14/site-packages/vllm/renderers/base.py", line 251, in warmup
(APIServer pid=3720) self._warmup_mm_processor(
(APIServer pid=3720) ~~~~~~~~~~~~~~~~~~~~~~~~~^
(APIServer pid=3720) self.mm_processor,
(APIServer pid=3720) ^^^^^^^^^^^^^^^^^^
(APIServer pid=3720) log_prefix="Multi-modal",
(APIServer pid=3720) ^^^^^^^^^^^^^^^^^^^^^^^^^
(APIServer pid=3720) )
(APIServer pid=3720) ^
(APIServer pid=3720) File "/mnt/c/Users/AI-Space001/venv-vllm/lib/python3.14/site-packages/vllm/renderers/base.py", line 221, in _warmup_mm_processor
(APIServer pid=3720) _ = processor.apply(processor_inputs, timing_ctx=TimingContext(enabled=False))
(APIServer pid=3720) File "/mnt/c/Users/AI-Space001/venv-vllm/lib/python3.14/site-packages/vllm/multimodal/processing/processor.py", line 1685, in apply
(APIServer pid=3720) ) = self._cached_apply_hf_processor(inputs, timing_ctx)
(APIServer pid=3720) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^
(APIServer pid=3720) File "/mnt/c/Users/AI-Space001/venv-vllm/lib/python3.14/site-packages/vllm/multimodal/processing/processor.py", line 1474, in _cached_apply_hf_processor
(APIServer pid=3720) ) = self._apply_hf_processor_main(
(APIServer pid=3720) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^
(APIServer pid=3720) prompt=inputs.prompt,
(APIServer pid=3720) ^^^^^^^^^^^^^^^^^^^^^
(APIServer pid=3720) ......
(APIServer pid=3720) enable_hf_prompt_update=False,
(APIServer pid=3720) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
(APIServer pid=3720) )
(APIServer pid=3720) ^
(APIServer pid=3720) File "/mnt/c/Users/AI-Space001/venv-vllm/lib/python3.14/site-packages/vllm/multimodal/processing/processor.py", line 1291, in _apply_hf_processor_main
(APIServer pid=3720) mm_processed_data = self._apply_hf_processor_mm_only(
(APIServer pid=3720) mm_items=mm_items,
(APIServer pid=3720) hf_processor_mm_kwargs=hf_processor_mm_kwargs,
(APIServer pid=3720) tokenization_kwargs=tokenization_kwargs,
(APIServer pid=3720) )
(APIServer pid=3720) File "/mnt/c/Users/AI-Space001/venv-vllm/lib/python3.14/site-packages/vllm/multimodal/processing/processor.py", line 1232, in _apply_hf_processor_mm_only
(APIServer pid=3720) _, mm_processed_data, _ = self._apply_hf_processor_text_mm(
(APIServer pid=3720) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^
(APIServer pid=3720) prompt_text=self.dummy_inputs.get_dummy_text(mm_counts),
(APIServer pid=3720) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
(APIServer pid=3720) ......
(APIServer pid=3720) tokenization_kwargs=tokenization_kwargs,
(APIServer pid=3720) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
(APIServer pid=3720) )
(APIServer pid=3720) ^
(APIServer pid=3720) File "/mnt/c/Users/AI-Space001/venv-vllm/lib/python3.14/site-packages/vllm/multimodal/processing/processor.py", line 1153, in _apply_hf_processor_text_mm
(APIServer pid=3720) processed_data = self._call_hf_processor(
(APIServer pid=3720) prompt=prompt_text,
(APIServer pid=3720) ......
(APIServer pid=3720) tok_kwargs=tokenization_kwargs,
(APIServer pid=3720) )
(APIServer pid=3720) File "/mnt/c/Users/AI-Space001/venv-vllm/lib/python3.14/site-packages/vllm/model_executor/models/qwen3_vl.py", line 1265, in _call_hf_processor
(APIServer pid=3720) video_outputs = super()._call_hf_processor(
(APIServer pid=3720) prompt="",
(APIServer pid=3720) ......
(APIServer pid=3720) tok_kwargs=tok_kwargs,
(APIServer pid=3720) )
(APIServer pid=3720) File "/mnt/c/Users/AI-Space001/venv-vllm/lib/python3.14/site-packages/vllm/multimodal/processing/processor.py", line 1110, in _call_hf_processor
(APIServer pid=3720) return self.info.ctx.call_hf_processor(
(APIServer pid=3720) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^
(APIServer pid=3720) self.info.get_hf_processor(**mm_kwargs),
(APIServer pid=3720) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
(APIServer pid=3720) dict(text=prompt, **mm_data),
(APIServer pid=3720) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
(APIServer pid=3720) dict(**mm_kwargs, **tok_kwargs),
(APIServer pid=3720) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
(APIServer pid=3720) )
(APIServer pid=3720) ^
(APIServer pid=3720) File "/mnt/c/Users/AI-Space001/venv-vllm/lib/python3.14/site-packages/vllm/multimodal/processing/context.py", line 269, in call_hf_processor
(APIServer pid=3720) output = hf_processor(**data, **allowed_kwargs)
(APIServer pid=3720) File "/mnt/c/Users/AI-Space001/venv-vllm/lib/python3.14/site-packages/transformers/processing_utils.py", line 668, in __call__
(APIServer pid=3720) processed_videos, videos_replacements = self._process_videos(videos, **merged_kwargs["videos_kwargs"])
(APIServer pid=3720) ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
(APIServer pid=3720) File "/mnt/c/Users/AI-Space001/venv-vllm/lib/python3.14/site-packages/transformers/processing_utils.py", line 770, in _process_videos
(APIServer pid=3720) processed_videos = self.video_processor(videos, **kwargs)
(APIServer pid=3720) File "/mnt/c/Users/AI-Space001/venv-vllm/lib/python3.14/site-packages/transformers/video_processing_utils.py", line 178, in __call__
(APIServer pid=3720) return self.preprocess(videos, **kwargs)
(APIServer pid=3720) ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^
(APIServer pid=3720) File "/mnt/c/Users/AI-Space001/venv-vllm/lib/python3.14/site-packages/transformers/video_processing_utils.py", line 369, in preprocess
(APIServer pid=3720) preprocessed_videos = self._preprocess(videos=videos, **kwargs)
(APIServer pid=3720) File "/mnt/c/Users/AI-Space001/venv-vllm/lib/python3.14/site-packages/transformers/models/qwen3_vl/video_processing_qwen3_vl.py", line 223, in _preprocess
(APIServer pid=3720) stacked_videos = self.rescale_and_normalize(
(APIServer pid=3720) stacked_videos, do_rescale, rescale_factor, do_normalize, image_mean, image_std
(APIServer pid=3720) )
(APIServer pid=3720) File "/mnt/c/Users/AI-Space001/venv-vllm/lib/python3.14/site-packages/transformers/image_processing_backends.py", line 346, in rescale_and_normalize
(APIServer pid=3720) images = self.normalize(images.to(dtype=torch.float32), image_mean, image_std)
(APIServer pid=3720) File "/mnt/c/Users/AI-Space001/venv-vllm/lib/python3.14/site-packages/transformers/image_processing_backends.py", line 300, in normalize
(APIServer pid=3720) def normalize(
(APIServer pid=3720)
(APIServer pid=3720) File "/mnt/c/Users/AI-Space001/venv-vllm/lib/python3.14/site-packages/vllm/entrypoints/openai/api_server.py", line 673, in _interrupt_init
(APIServer pid=3720) raise KeyboardInterrupt("terminated")
(APIServer pid=3720) KeyboardInterrupt: terminated
烙馍网
徐工徐工,祝您成功
一路向北
一起战胜癌症
一路向北
已经添加
一路向北
申请友情链接:
名称:烙馍省钱
网址:https://tb-m.luomor.com/
已添加文心AIGC
一路向北
已经添加
一路向北
申请友情链接:
名称:烙馍省钱
网址:https://tb-m.luomor.com/
已添加烙馍网
一路向北
已加
一路向北
已加
热评文章
地下停车场排风系统:地下空间的 “呼吸系统”,保障通行安全的隐形工程
开车驶入地下车库,很多人只会留意车位、照明与监控,却很少关注头顶管道里持续运转的排风系统。它藏在吊顶、机房、风...
brew install mysql
brew install mysql==> Auto-updating Homebrew…Adjust ...
CentOS 重启后 Supervisord 无法自启?已 enable 仍失效终极排查方案
做 CentOS 运维的小伙伴大概率遇到过这个诡异问题:明明已经执行 systemctl enable sup...
零门槛做原创音乐!2026AI音乐制作全攻略,普通人也能秒变音乐人
以前总觉得做音乐是专业人的专属技能:会乐理、懂编曲、会乐器、熟剪辑,缺一不可,普通人想写一首专属原创歌,简直难...
告别WSL折腾!triton-windows 让 Windows 原生支持 Triton GPU 编译
做AI模型训练、推理优化、自定义GPU算子开发的小伙伴,大概率都被一个问题困扰过:Triton 编译器仅原生支...