多模态大模型 vLLM-Omni 部署 uset 全模态模型完整实战指南
一、前言:为什么选择 vLLM-Omni + uset 模型 传统推理框架存在明显割裂:纯 LLM 引擎只支持…
多模态大模型 vLLM Wan2.2-I2V 启动命令解析与优化方案
一、原命令拆解说明 bash 运行 参数释义: 二、关键问题与适配优化(Windows WSL 运行 Wan2…
多模态大模型 vLLM-Omni 部署 Wan2.2 遇 cutlass_scaled_mm 内核崩溃?完整排查与修复指南
最近在 WSL2 环境部署 vLLM-Omni 推理 Wan2.2 视频生成模型时,服务启动阶段的 Dummy…
CUDA 彻底解决CUDA OOM显存溢出:明明显存充足却分配失败(显存碎片终极方案)
适用场景:大模型推理、API服务部署、PyTorch训练、多Worker并发任务 报错特征:GPU总显存充足、…
多模态大模型 彻底解决!PyTorch CUDA缓存分配器内部断言崩溃:handles_.at(i) CUDACachingAllocator.cpp:427
最近在部署 Wan2.2 文生视频模型(T2V) + vllm-omni 分布式推理服务时,遇到一个非常棘手、…
CUDA Wan2.2-I2V 双卡部署 CUDA OOM 彻底解决:显存打满、碎片严重、子进程崩溃问题
一、问题背景 近期在基于 vLLM-OMNI 部署 Wan2.2-I2V 图像转视频模型时,双卡(24G * …
多模态大模型 vLLM-Omni 0.23 完整部署 Wan2.2 文生视频模型实战博文
一、前言:为什么选 vLLM-Omni 0.23 + Wan2.2 Wan2.2 是阿里开源的高性能文生 / …
多模态大模型 极速部署!vLLM-Omni 一站式运行 Wan2.2 视频生成模型实战教程
最近开源圈爆火的Wan2.2视频生成模型,凭借14B MoE架构、高清画质、流畅动态画面,成为文生视频、图生视…
大型语言模型 【踩坑实录】vllm-omni 本地编译构建失败:Git dubious ownership 报错终极解决
最近在 WSL2 + Python3.12 环境下本地编译安装 vllm-omni时,遇到了经典的 setup…
热门文章
2026欧洲旅游费用明细|穷游/舒适/轻奢档位,一次性算清!
很多人迟迟不敢出发欧洲,最大的顾虑永远是:去欧洲到底要花多少钱?怕预算不够、怕隐形消费、怕被坑。 网上攻略五花...
摄像头 5V1A,能不能用 5V2A 电源适配器?很多人搞反了
家里监控摄像头原配电源是 5V 1A,适配器坏了,手头刚好有个 5V 2A 的电源,能不能直接换上? 先说结论...
AI正式更名SI!沿用数十年的人工智能,为何突然换名?
如果最近你刷到SI而非熟悉的AI,别懵圈,不是新名词炒作,是行业标志性的变革来了! 当地时间9月29日,美国正...
MiniMax H3 本地部署:BF16 / INT8 精度与 720P、1080P 分辨率实战解析
摘要:MiniMax H3 开源之后,很多开发者困惑:BF16、INT8 不同量化精度下,到底能不能跑 720...
MacBook 合盖用外接显示器,电池供电黑屏?终极解决指南
很多 Mac 用户都会遇到一个困扰:开盖时外接显示器正常工作,一旦合上笔记本盖子、仅靠电池供电,外接显示器立刻...
最新评论
烙馍网
SI了都要AI
烙馍网
AI的要SI
烙馍网
随着雄商高铁 2026 年 9 月 28 日开通,京港高铁仅剩两段待完工:昌九高铁预计 2027 年 3 月通车;北京丰台至雄安段尚在前期阶段,暂未确定开工时间。2027 年昌九段通车后,雄安至香港西九龙可实现京港高铁正线贯通;整条通道(北京丰台至香港西九龙)全线贯通时间,需等待丰雄高铁落地,暂无官方明确时间表。
烙馍网
强烈推荐烙馍网字帖生成器:https://zt.luomor.com/。免费免登录,内置小学各年级生字库,田字格、米字格随意切换,支持拼音、笔顺描红,描红深浅可调。输入文字实时预览,A4 直接打印,给孩子做生字练习非常省心,家长必备练字工具
烙馍网
现在很多物业只收钱不做事,自己买的停车位,缴了停车管理费,排风系统不开,系统不运行年久失修已经锈了,这种物业有必要存在吗?
一路向北
(APIServer pid=3720) Traceback (most recent call last):
(APIServer pid=3720) File "/mnt/c/Users/AI-Space001/venv-vllm/bin/vllm", line 8, in
(APIServer pid=3720) sys.exit(main())
(APIServer pid=3720) ~~~~^^
(APIServer pid=3720) File "/mnt/c/Users/AI-Space001/venv-vllm/lib/python3.14/site-packages/vllm/entrypoints/cli/main.py", line 92, in main
(APIServer pid=3720) args.dispatch_function(args)
(APIServer pid=3720) ~~~~~~~~~~~~~~~~~~~~~~^^^^^^
(APIServer pid=3720) File "/mnt/c/Users/AI-Space001/venv-vllm/lib/python3.14/site-packages/vllm/entrypoints/cli/serve.py", line 148, in cmd
(APIServer pid=3720) uvloop.run(run_server(args))
(APIServer pid=3720) ~~~~~~~~~~^^^^^^^^^^^^^^^^^^
(APIServer pid=3720) File "/mnt/c/Users/AI-Space001/venv-vllm/lib/python3.14/site-packages/uvloop/__init__.py", line 96, in run
(APIServer pid=3720) return __asyncio.run(
(APIServer pid=3720) ~~~~~~~~~~~~~^
(APIServer pid=3720) wrapper(),
(APIServer pid=3720) ^^^^^^^^^^
(APIServer pid=3720) ......
(APIServer pid=3720) **run_kwargs
(APIServer pid=3720) ^^^^^^^^^^^^
(APIServer pid=3720) )
(APIServer pid=3720) ^
(APIServer pid=3720) File "/usr/lib/python3.14/asyncio/runners.py", line 204, in run
(APIServer pid=3720) return runner.run(main)
(APIServer pid=3720) ~~~~~~~~~~^^^^^^
(APIServer pid=3720) File "/usr/lib/python3.14/asyncio/runners.py", line 127, in run
(APIServer pid=3720) return self._loop.run_until_complete(task)
(APIServer pid=3720) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^
(APIServer pid=3720) File "uvloop/loop.pyx", line 1512, in uvloop.loop.Loop.run_until_complete
(APIServer pid=3720) File "uvloop/loop.pyx", line 1505, in uvloop.loop.Loop.run_until_complete
(APIServer pid=3720) self.run_forever()
(APIServer pid=3720) File "uvloop/loop.pyx", line 1379, in uvloop.loop.Loop.run_forever
(APIServer pid=3720) self._run(mode)
(APIServer pid=3720) File "uvloop/loop.pyx", line 557, in uvloop.loop.Loop._run
(APIServer pid=3720) raise self._last_error
(APIServer pid=3720) File "uvloop/loop.pyx", line 476, in uvloop.loop.Loop._on_idle
(APIServer pid=3720) handler._run()
(APIServer pid=3720) File "uvloop/cbhandles.pyx", line 83, in uvloop.loop.Handle._run
(APIServer pid=3720) File "uvloop/cbhandles.pyx", line 63, in uvloop.loop.Handle._run
(APIServer pid=3720) callback(*args)
(APIServer pid=3720) File "/mnt/c/Users/AI-Space001/venv-vllm/lib/python3.14/site-packages/uvloop/__init__.py", line 48, in wrapper
(APIServer pid=3720) return await main
(APIServer pid=3720) ^^^^^^^^^^
(APIServer pid=3720) File "/mnt/c/Users/AI-Space001/venv-vllm/lib/python3.14/site-packages/vllm/entrypoints/openai/api_server.py", line 678, in run_server
(APIServer pid=3720) await run_server_worker(listen_address, sock, args, **uvicorn_kwargs)
(APIServer pid=3720) File "/mnt/c/Users/AI-Space001/venv-vllm/lib/python3.14/site-packages/vllm/entrypoints/openai/api_server.py", line 696, in run_server_worker
(APIServer pid=3720) shutdown_task = await build_and_serve(
(APIServer pid=3720) ^^^^^^^^^^^^^^^^^^^^^^
(APIServer pid=3720) engine_client, listen_address, sock, args, **uvicorn_kwargs
(APIServer pid=3720) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
(APIServer pid=3720) )
(APIServer pid=3720) ^
(APIServer pid=3720) File "/mnt/c/Users/AI-Space001/venv-vllm/lib/python3.14/site-packages/vllm/entrypoints/openai/api_server.py", line 594, in build_and_serve
(APIServer pid=3720) await init_app_state(engine_client, app.state, args, supported_tasks)
(APIServer pid=3720) File "/mnt/c/Users/AI-Space001/venv-vllm/lib/python3.14/site-packages/vllm/entrypoints/openai/api_server.py", line 407, in init_app_state
(APIServer pid=3720) await init_generate_state(
(APIServer pid=3720) engine_client, state, args, request_logger, supported_tasks
(APIServer pid=3720) )
(APIServer pid=3720) File "/mnt/c/Users/AI-Space001/venv-vllm/lib/python3.14/site-packages/vllm/entrypoints/openai/generate/api_router.py", line 140, in init_generate_state
(APIServer pid=3720) state.openai_serving_chat.warmup()
(APIServer pid=3720) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^
(APIServer pid=3720) File "/mnt/c/Users/AI-Space001/venv-vllm/lib/python3.14/site-packages/vllm/entrypoints/openai/chat_completion/serving.py", line 181, in warmup
(APIServer pid=3720) self.renderer.warmup(
(APIServer pid=3720) ~~~~~~~~~~~~~~~~~~~~^
(APIServer pid=3720) ChatParams(
(APIServer pid=3720) ^^^^^^^^^^^
(APIServer pid=3720) ......
(APIServer pid=3720) )
(APIServer pid=3720) ^
(APIServer pid=3720) )
(APIServer pid=3720) ^
(APIServer pid=3720) File "/mnt/c/Users/AI-Space001/venv-vllm/lib/python3.14/site-packages/vllm/renderers/base.py", line 251, in warmup
(APIServer pid=3720) self._warmup_mm_processor(
(APIServer pid=3720) ~~~~~~~~~~~~~~~~~~~~~~~~~^
(APIServer pid=3720) self.mm_processor,
(APIServer pid=3720) ^^^^^^^^^^^^^^^^^^
(APIServer pid=3720) log_prefix="Multi-modal",
(APIServer pid=3720) ^^^^^^^^^^^^^^^^^^^^^^^^^
(APIServer pid=3720) )
(APIServer pid=3720) ^
(APIServer pid=3720) File "/mnt/c/Users/AI-Space001/venv-vllm/lib/python3.14/site-packages/vllm/renderers/base.py", line 221, in _warmup_mm_processor
(APIServer pid=3720) _ = processor.apply(processor_inputs, timing_ctx=TimingContext(enabled=False))
(APIServer pid=3720) File "/mnt/c/Users/AI-Space001/venv-vllm/lib/python3.14/site-packages/vllm/multimodal/processing/processor.py", line 1685, in apply
(APIServer pid=3720) ) = self._cached_apply_hf_processor(inputs, timing_ctx)
(APIServer pid=3720) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^
(APIServer pid=3720) File "/mnt/c/Users/AI-Space001/venv-vllm/lib/python3.14/site-packages/vllm/multimodal/processing/processor.py", line 1474, in _cached_apply_hf_processor
(APIServer pid=3720) ) = self._apply_hf_processor_main(
(APIServer pid=3720) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^
(APIServer pid=3720) prompt=inputs.prompt,
(APIServer pid=3720) ^^^^^^^^^^^^^^^^^^^^^
(APIServer pid=3720) ......
(APIServer pid=3720) enable_hf_prompt_update=False,
(APIServer pid=3720) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
(APIServer pid=3720) )
(APIServer pid=3720) ^
(APIServer pid=3720) File "/mnt/c/Users/AI-Space001/venv-vllm/lib/python3.14/site-packages/vllm/multimodal/processing/processor.py", line 1291, in _apply_hf_processor_main
(APIServer pid=3720) mm_processed_data = self._apply_hf_processor_mm_only(
(APIServer pid=3720) mm_items=mm_items,
(APIServer pid=3720) hf_processor_mm_kwargs=hf_processor_mm_kwargs,
(APIServer pid=3720) tokenization_kwargs=tokenization_kwargs,
(APIServer pid=3720) )
(APIServer pid=3720) File "/mnt/c/Users/AI-Space001/venv-vllm/lib/python3.14/site-packages/vllm/multimodal/processing/processor.py", line 1232, in _apply_hf_processor_mm_only
(APIServer pid=3720) _, mm_processed_data, _ = self._apply_hf_processor_text_mm(
(APIServer pid=3720) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^
(APIServer pid=3720) prompt_text=self.dummy_inputs.get_dummy_text(mm_counts),
(APIServer pid=3720) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
(APIServer pid=3720) ......
(APIServer pid=3720) tokenization_kwargs=tokenization_kwargs,
(APIServer pid=3720) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
(APIServer pid=3720) )
(APIServer pid=3720) ^
(APIServer pid=3720) File "/mnt/c/Users/AI-Space001/venv-vllm/lib/python3.14/site-packages/vllm/multimodal/processing/processor.py", line 1153, in _apply_hf_processor_text_mm
(APIServer pid=3720) processed_data = self._call_hf_processor(
(APIServer pid=3720) prompt=prompt_text,
(APIServer pid=3720) ......
(APIServer pid=3720) tok_kwargs=tokenization_kwargs,
(APIServer pid=3720) )
(APIServer pid=3720) File "/mnt/c/Users/AI-Space001/venv-vllm/lib/python3.14/site-packages/vllm/model_executor/models/qwen3_vl.py", line 1265, in _call_hf_processor
(APIServer pid=3720) video_outputs = super()._call_hf_processor(
(APIServer pid=3720) prompt="",
(APIServer pid=3720) ......
(APIServer pid=3720) tok_kwargs=tok_kwargs,
(APIServer pid=3720) )
(APIServer pid=3720) File "/mnt/c/Users/AI-Space001/venv-vllm/lib/python3.14/site-packages/vllm/multimodal/processing/processor.py", line 1110, in _call_hf_processor
(APIServer pid=3720) return self.info.ctx.call_hf_processor(
(APIServer pid=3720) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^
(APIServer pid=3720) self.info.get_hf_processor(**mm_kwargs),
(APIServer pid=3720) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
(APIServer pid=3720) dict(text=prompt, **mm_data),
(APIServer pid=3720) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
(APIServer pid=3720) dict(**mm_kwargs, **tok_kwargs),
(APIServer pid=3720) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
(APIServer pid=3720) )
(APIServer pid=3720) ^
(APIServer pid=3720) File "/mnt/c/Users/AI-Space001/venv-vllm/lib/python3.14/site-packages/vllm/multimodal/processing/context.py", line 269, in call_hf_processor
(APIServer pid=3720) output = hf_processor(**data, **allowed_kwargs)
(APIServer pid=3720) File "/mnt/c/Users/AI-Space001/venv-vllm/lib/python3.14/site-packages/transformers/processing_utils.py", line 668, in __call__
(APIServer pid=3720) processed_videos, videos_replacements = self._process_videos(videos, **merged_kwargs["videos_kwargs"])
(APIServer pid=3720) ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
(APIServer pid=3720) File "/mnt/c/Users/AI-Space001/venv-vllm/lib/python3.14/site-packages/transformers/processing_utils.py", line 770, in _process_videos
(APIServer pid=3720) processed_videos = self.video_processor(videos, **kwargs)
(APIServer pid=3720) File "/mnt/c/Users/AI-Space001/venv-vllm/lib/python3.14/site-packages/transformers/video_processing_utils.py", line 178, in __call__
(APIServer pid=3720) return self.preprocess(videos, **kwargs)
(APIServer pid=3720) ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^
(APIServer pid=3720) File "/mnt/c/Users/AI-Space001/venv-vllm/lib/python3.14/site-packages/transformers/video_processing_utils.py", line 369, in preprocess
(APIServer pid=3720) preprocessed_videos = self._preprocess(videos=videos, **kwargs)
(APIServer pid=3720) File "/mnt/c/Users/AI-Space001/venv-vllm/lib/python3.14/site-packages/transformers/models/qwen3_vl/video_processing_qwen3_vl.py", line 223, in _preprocess
(APIServer pid=3720) stacked_videos = self.rescale_and_normalize(
(APIServer pid=3720) stacked_videos, do_rescale, rescale_factor, do_normalize, image_mean, image_std
(APIServer pid=3720) )
(APIServer pid=3720) File "/mnt/c/Users/AI-Space001/venv-vllm/lib/python3.14/site-packages/transformers/image_processing_backends.py", line 346, in rescale_and_normalize
(APIServer pid=3720) images = self.normalize(images.to(dtype=torch.float32), image_mean, image_std)
(APIServer pid=3720) File "/mnt/c/Users/AI-Space001/venv-vllm/lib/python3.14/site-packages/transformers/image_processing_backends.py", line 300, in normalize
(APIServer pid=3720) def normalize(
(APIServer pid=3720)
(APIServer pid=3720) File "/mnt/c/Users/AI-Space001/venv-vllm/lib/python3.14/site-packages/vllm/entrypoints/openai/api_server.py", line 673, in _interrupt_init
(APIServer pid=3720) raise KeyboardInterrupt("terminated")
(APIServer pid=3720) KeyboardInterrupt: terminated
烙馍网
徐工徐工,祝您成功
一路向北
一起战胜癌症
一路向北
已经添加
一路向北
申请友情链接:
名称:烙馍省钱
网址:https://tb-m.luomor.com/
已添加文心AIGC
热评文章
AI正式更名SI!沿用数十年的人工智能,为何突然换名?
如果最近你刷到SI而非熟悉的AI,别懵圈,不是新名词炒作,是行业标志性的变革来了! 当地时间9月29日,美国正...
京港高铁:贯穿中国南北的超级高铁大动脉✨
在中国纵横交错的高铁网络里,有一条跨越南北、串联京津冀、中原、华中、华南直达港澳的黄金通道,它就是无数人期待的...
Mac 电池100%、循环仅120次,拔电源立刻关机?元凶大概率是显示器USB‑C供电
很多Mac用户都遇到过一个极其诡异的故障:系统显示电池100%电量、电池状态正常、循环次数极低,只要拔掉电源瞬...
告别静态界面:Intelligent UI,重新定义人机交互的未来
我们早已习惯了固定的软件界面:打开APP是一成不变的布局,操作路径被提前锁定,用户只能被动适配界面、一步步点击...
Hermes + 微信 ClawBot:把自进化 AI 智能体装进你的微信
一句话总结:ClawBot 是微信侧的消息网关,Hermes Agent 是背后自主运行的 AI 智能体,二者...