GPU 告别WSL折腾!triton-windows 让 Windows 原生支持 Triton GPU 编译
做AI模型训练、推理优化、自定义GPU算子开发的小伙伴,大概率都被一个问题困扰过:Triton 编译器仅原生支…
大型语言模型 Mac(Apple Silicon)安装 vLLM 完整实战指南|M1/M2/M3/M4 本地部署大模型写一篇博文介绍mac安装vllm
更新时间:2026-08|适配 macOS Sonoma / Sequoia 重要前置结论: 原版 vLLM …
多模态大模型 MiniMax H3 深度解析:开源视频模型新王,全模态生成的里程碑
2026 年 7 月 31 日,国产大模型公司 MiniMax 正式发布新一代通用视频模型 MiniMax H…
ComfyUI ComfyUI llama.cpp 运行Qwen-VL报错:OMP多库冲突闪退终极解决教程
近期在ComfyUI中使用llama.cpp部署Qwen2.5-VL/Qwen3-VL多模态模型时,很多人会遇…
大型语言模型 吃透llama.cpp加载日志:Qwen3.5-27B本地部署参数详解
很多小伙伴在本地用 llama.cpp 部署多模态大模型时,都会看到两行加载日志,但大多不清楚具体含义、显存门…
大型语言模型 HPC 并行开发必备:一文看懂 LLVM/OpenMP 官方文档站 openmp.llvm.org
前言 做高性能计算、多核多 GPU 并行开发的开发者,几乎都绕不开 OpenMP 并行标准;而基于 LLVM …
大型语言模型 Windows专属|Llama.cpp 最新版下载路径+GGUF模型高速镜像(2026实测可用)
很多Windows用户本地部署Llama.cpp,最常踩三大坑:GitHub打不开、海外下载超时、选错系统版本…
大型语言模型 全网最全Llama模型下载路径汇总(Llama2/3/3.1 官方+镜像+一键部署)
作为Meta推出的开源大模型,Llama系列凭借免费商用、性能强劲、轻量化可本地部署的优势,成为AI开发者入门…
CUDA 完美解决:Windows 编译 llama-cpp-python CUDA 目录不存在报错(ComfyUI 便携版专属方案)
最近在 Windows 端 ComfyUI 便携版 环境中安装、编译 llama-cpp-python 时,大…
热门文章
保姆级教程!CentOS 7 从零安装配置 MySQL 8.0(全程可复制)
很多小伙伴在搭建 Linux 服务器环境时,都会卡在 MySQL 安装、密码初始化、远程连接报错、权限配置等问...
英雄联盟全英雄经典台词汇总:那些年我们听过的峡谷之声
英雄联盟自上线以来,已拥有超过160位英雄。每一位英雄都有独特的语音台词,有的霸气侧漏,有的富含哲理,有的温柔...
“懦弱之举,我绝不姑息”:一句游戏台词,为何成了全网最刚的精神信条
如果你常玩《英雄联盟》,或是刷到过电竞相关的内容,一定听过这句气场拉满的台词 ——“懦弱之举,我绝不姑息”。 ...
ComfyUI 报错 HostBuffer.read_file_slice failed error=1450 终极解决教程
很多小伙伴在使用 ComfyUI 运行大模型、视频模型、Minimax 系列模型时,会遇到一类无解报错:模型初...
China GT翻车:顶级赛车赛事,安保日薪仅60元,60岁大爷撑住了所有底线
最近China GT中国超级跑车锦标赛上海站的风波,彻底撕开了国内高端赛事最讽刺的一层遮羞布。 一边是千万级规...
最新评论
烙馍网
强烈推荐烙馍网字帖生成器:https://zt.luomor.com/。免费免登录,内置小学各年级生字库,田字格、米字格随意切换,支持拼音、笔顺描红,描红深浅可调。输入文字实时预览,A4 直接打印,给孩子做生字练习非常省心,家长必备练字工具
烙馍网
现在很多物业只收钱不做事,自己买的停车位,缴了停车管理费,排风系统不开,系统不运行年久失修已经锈了,这种物业有必要存在吗?
一路向北
(APIServer pid=3720) Traceback (most recent call last):
(APIServer pid=3720) File "/mnt/c/Users/AI-Space001/venv-vllm/bin/vllm", line 8, in
(APIServer pid=3720) sys.exit(main())
(APIServer pid=3720) ~~~~^^
(APIServer pid=3720) File "/mnt/c/Users/AI-Space001/venv-vllm/lib/python3.14/site-packages/vllm/entrypoints/cli/main.py", line 92, in main
(APIServer pid=3720) args.dispatch_function(args)
(APIServer pid=3720) ~~~~~~~~~~~~~~~~~~~~~~^^^^^^
(APIServer pid=3720) File "/mnt/c/Users/AI-Space001/venv-vllm/lib/python3.14/site-packages/vllm/entrypoints/cli/serve.py", line 148, in cmd
(APIServer pid=3720) uvloop.run(run_server(args))
(APIServer pid=3720) ~~~~~~~~~~^^^^^^^^^^^^^^^^^^
(APIServer pid=3720) File "/mnt/c/Users/AI-Space001/venv-vllm/lib/python3.14/site-packages/uvloop/__init__.py", line 96, in run
(APIServer pid=3720) return __asyncio.run(
(APIServer pid=3720) ~~~~~~~~~~~~~^
(APIServer pid=3720) wrapper(),
(APIServer pid=3720) ^^^^^^^^^^
(APIServer pid=3720) ......
(APIServer pid=3720) **run_kwargs
(APIServer pid=3720) ^^^^^^^^^^^^
(APIServer pid=3720) )
(APIServer pid=3720) ^
(APIServer pid=3720) File "/usr/lib/python3.14/asyncio/runners.py", line 204, in run
(APIServer pid=3720) return runner.run(main)
(APIServer pid=3720) ~~~~~~~~~~^^^^^^
(APIServer pid=3720) File "/usr/lib/python3.14/asyncio/runners.py", line 127, in run
(APIServer pid=3720) return self._loop.run_until_complete(task)
(APIServer pid=3720) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^
(APIServer pid=3720) File "uvloop/loop.pyx", line 1512, in uvloop.loop.Loop.run_until_complete
(APIServer pid=3720) File "uvloop/loop.pyx", line 1505, in uvloop.loop.Loop.run_until_complete
(APIServer pid=3720) self.run_forever()
(APIServer pid=3720) File "uvloop/loop.pyx", line 1379, in uvloop.loop.Loop.run_forever
(APIServer pid=3720) self._run(mode)
(APIServer pid=3720) File "uvloop/loop.pyx", line 557, in uvloop.loop.Loop._run
(APIServer pid=3720) raise self._last_error
(APIServer pid=3720) File "uvloop/loop.pyx", line 476, in uvloop.loop.Loop._on_idle
(APIServer pid=3720) handler._run()
(APIServer pid=3720) File "uvloop/cbhandles.pyx", line 83, in uvloop.loop.Handle._run
(APIServer pid=3720) File "uvloop/cbhandles.pyx", line 63, in uvloop.loop.Handle._run
(APIServer pid=3720) callback(*args)
(APIServer pid=3720) File "/mnt/c/Users/AI-Space001/venv-vllm/lib/python3.14/site-packages/uvloop/__init__.py", line 48, in wrapper
(APIServer pid=3720) return await main
(APIServer pid=3720) ^^^^^^^^^^
(APIServer pid=3720) File "/mnt/c/Users/AI-Space001/venv-vllm/lib/python3.14/site-packages/vllm/entrypoints/openai/api_server.py", line 678, in run_server
(APIServer pid=3720) await run_server_worker(listen_address, sock, args, **uvicorn_kwargs)
(APIServer pid=3720) File "/mnt/c/Users/AI-Space001/venv-vllm/lib/python3.14/site-packages/vllm/entrypoints/openai/api_server.py", line 696, in run_server_worker
(APIServer pid=3720) shutdown_task = await build_and_serve(
(APIServer pid=3720) ^^^^^^^^^^^^^^^^^^^^^^
(APIServer pid=3720) engine_client, listen_address, sock, args, **uvicorn_kwargs
(APIServer pid=3720) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
(APIServer pid=3720) )
(APIServer pid=3720) ^
(APIServer pid=3720) File "/mnt/c/Users/AI-Space001/venv-vllm/lib/python3.14/site-packages/vllm/entrypoints/openai/api_server.py", line 594, in build_and_serve
(APIServer pid=3720) await init_app_state(engine_client, app.state, args, supported_tasks)
(APIServer pid=3720) File "/mnt/c/Users/AI-Space001/venv-vllm/lib/python3.14/site-packages/vllm/entrypoints/openai/api_server.py", line 407, in init_app_state
(APIServer pid=3720) await init_generate_state(
(APIServer pid=3720) engine_client, state, args, request_logger, supported_tasks
(APIServer pid=3720) )
(APIServer pid=3720) File "/mnt/c/Users/AI-Space001/venv-vllm/lib/python3.14/site-packages/vllm/entrypoints/openai/generate/api_router.py", line 140, in init_generate_state
(APIServer pid=3720) state.openai_serving_chat.warmup()
(APIServer pid=3720) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^
(APIServer pid=3720) File "/mnt/c/Users/AI-Space001/venv-vllm/lib/python3.14/site-packages/vllm/entrypoints/openai/chat_completion/serving.py", line 181, in warmup
(APIServer pid=3720) self.renderer.warmup(
(APIServer pid=3720) ~~~~~~~~~~~~~~~~~~~~^
(APIServer pid=3720) ChatParams(
(APIServer pid=3720) ^^^^^^^^^^^
(APIServer pid=3720) ......
(APIServer pid=3720) )
(APIServer pid=3720) ^
(APIServer pid=3720) )
(APIServer pid=3720) ^
(APIServer pid=3720) File "/mnt/c/Users/AI-Space001/venv-vllm/lib/python3.14/site-packages/vllm/renderers/base.py", line 251, in warmup
(APIServer pid=3720) self._warmup_mm_processor(
(APIServer pid=3720) ~~~~~~~~~~~~~~~~~~~~~~~~~^
(APIServer pid=3720) self.mm_processor,
(APIServer pid=3720) ^^^^^^^^^^^^^^^^^^
(APIServer pid=3720) log_prefix="Multi-modal",
(APIServer pid=3720) ^^^^^^^^^^^^^^^^^^^^^^^^^
(APIServer pid=3720) )
(APIServer pid=3720) ^
(APIServer pid=3720) File "/mnt/c/Users/AI-Space001/venv-vllm/lib/python3.14/site-packages/vllm/renderers/base.py", line 221, in _warmup_mm_processor
(APIServer pid=3720) _ = processor.apply(processor_inputs, timing_ctx=TimingContext(enabled=False))
(APIServer pid=3720) File "/mnt/c/Users/AI-Space001/venv-vllm/lib/python3.14/site-packages/vllm/multimodal/processing/processor.py", line 1685, in apply
(APIServer pid=3720) ) = self._cached_apply_hf_processor(inputs, timing_ctx)
(APIServer pid=3720) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^
(APIServer pid=3720) File "/mnt/c/Users/AI-Space001/venv-vllm/lib/python3.14/site-packages/vllm/multimodal/processing/processor.py", line 1474, in _cached_apply_hf_processor
(APIServer pid=3720) ) = self._apply_hf_processor_main(
(APIServer pid=3720) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^
(APIServer pid=3720) prompt=inputs.prompt,
(APIServer pid=3720) ^^^^^^^^^^^^^^^^^^^^^
(APIServer pid=3720) ......
(APIServer pid=3720) enable_hf_prompt_update=False,
(APIServer pid=3720) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
(APIServer pid=3720) )
(APIServer pid=3720) ^
(APIServer pid=3720) File "/mnt/c/Users/AI-Space001/venv-vllm/lib/python3.14/site-packages/vllm/multimodal/processing/processor.py", line 1291, in _apply_hf_processor_main
(APIServer pid=3720) mm_processed_data = self._apply_hf_processor_mm_only(
(APIServer pid=3720) mm_items=mm_items,
(APIServer pid=3720) hf_processor_mm_kwargs=hf_processor_mm_kwargs,
(APIServer pid=3720) tokenization_kwargs=tokenization_kwargs,
(APIServer pid=3720) )
(APIServer pid=3720) File "/mnt/c/Users/AI-Space001/venv-vllm/lib/python3.14/site-packages/vllm/multimodal/processing/processor.py", line 1232, in _apply_hf_processor_mm_only
(APIServer pid=3720) _, mm_processed_data, _ = self._apply_hf_processor_text_mm(
(APIServer pid=3720) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^
(APIServer pid=3720) prompt_text=self.dummy_inputs.get_dummy_text(mm_counts),
(APIServer pid=3720) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
(APIServer pid=3720) ......
(APIServer pid=3720) tokenization_kwargs=tokenization_kwargs,
(APIServer pid=3720) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
(APIServer pid=3720) )
(APIServer pid=3720) ^
(APIServer pid=3720) File "/mnt/c/Users/AI-Space001/venv-vllm/lib/python3.14/site-packages/vllm/multimodal/processing/processor.py", line 1153, in _apply_hf_processor_text_mm
(APIServer pid=3720) processed_data = self._call_hf_processor(
(APIServer pid=3720) prompt=prompt_text,
(APIServer pid=3720) ......
(APIServer pid=3720) tok_kwargs=tokenization_kwargs,
(APIServer pid=3720) )
(APIServer pid=3720) File "/mnt/c/Users/AI-Space001/venv-vllm/lib/python3.14/site-packages/vllm/model_executor/models/qwen3_vl.py", line 1265, in _call_hf_processor
(APIServer pid=3720) video_outputs = super()._call_hf_processor(
(APIServer pid=3720) prompt="",
(APIServer pid=3720) ......
(APIServer pid=3720) tok_kwargs=tok_kwargs,
(APIServer pid=3720) )
(APIServer pid=3720) File "/mnt/c/Users/AI-Space001/venv-vllm/lib/python3.14/site-packages/vllm/multimodal/processing/processor.py", line 1110, in _call_hf_processor
(APIServer pid=3720) return self.info.ctx.call_hf_processor(
(APIServer pid=3720) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^
(APIServer pid=3720) self.info.get_hf_processor(**mm_kwargs),
(APIServer pid=3720) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
(APIServer pid=3720) dict(text=prompt, **mm_data),
(APIServer pid=3720) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
(APIServer pid=3720) dict(**mm_kwargs, **tok_kwargs),
(APIServer pid=3720) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
(APIServer pid=3720) )
(APIServer pid=3720) ^
(APIServer pid=3720) File "/mnt/c/Users/AI-Space001/venv-vllm/lib/python3.14/site-packages/vllm/multimodal/processing/context.py", line 269, in call_hf_processor
(APIServer pid=3720) output = hf_processor(**data, **allowed_kwargs)
(APIServer pid=3720) File "/mnt/c/Users/AI-Space001/venv-vllm/lib/python3.14/site-packages/transformers/processing_utils.py", line 668, in __call__
(APIServer pid=3720) processed_videos, videos_replacements = self._process_videos(videos, **merged_kwargs["videos_kwargs"])
(APIServer pid=3720) ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
(APIServer pid=3720) File "/mnt/c/Users/AI-Space001/venv-vllm/lib/python3.14/site-packages/transformers/processing_utils.py", line 770, in _process_videos
(APIServer pid=3720) processed_videos = self.video_processor(videos, **kwargs)
(APIServer pid=3720) File "/mnt/c/Users/AI-Space001/venv-vllm/lib/python3.14/site-packages/transformers/video_processing_utils.py", line 178, in __call__
(APIServer pid=3720) return self.preprocess(videos, **kwargs)
(APIServer pid=3720) ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^
(APIServer pid=3720) File "/mnt/c/Users/AI-Space001/venv-vllm/lib/python3.14/site-packages/transformers/video_processing_utils.py", line 369, in preprocess
(APIServer pid=3720) preprocessed_videos = self._preprocess(videos=videos, **kwargs)
(APIServer pid=3720) File "/mnt/c/Users/AI-Space001/venv-vllm/lib/python3.14/site-packages/transformers/models/qwen3_vl/video_processing_qwen3_vl.py", line 223, in _preprocess
(APIServer pid=3720) stacked_videos = self.rescale_and_normalize(
(APIServer pid=3720) stacked_videos, do_rescale, rescale_factor, do_normalize, image_mean, image_std
(APIServer pid=3720) )
(APIServer pid=3720) File "/mnt/c/Users/AI-Space001/venv-vllm/lib/python3.14/site-packages/transformers/image_processing_backends.py", line 346, in rescale_and_normalize
(APIServer pid=3720) images = self.normalize(images.to(dtype=torch.float32), image_mean, image_std)
(APIServer pid=3720) File "/mnt/c/Users/AI-Space001/venv-vllm/lib/python3.14/site-packages/transformers/image_processing_backends.py", line 300, in normalize
(APIServer pid=3720) def normalize(
(APIServer pid=3720)
(APIServer pid=3720) File "/mnt/c/Users/AI-Space001/venv-vllm/lib/python3.14/site-packages/vllm/entrypoints/openai/api_server.py", line 673, in _interrupt_init
(APIServer pid=3720) raise KeyboardInterrupt("terminated")
(APIServer pid=3720) KeyboardInterrupt: terminated
烙馍网
徐工徐工,祝您成功
一路向北
一起战胜癌症
一路向北
已经添加
一路向北
申请友情链接:
名称:烙馍省钱
网址:https://tb-m.luomor.com/
已添加文心AIGC
一路向北
已经添加
一路向北
申请友情链接:
名称:烙馍省钱
网址:https://tb-m.luomor.com/
已添加烙馍网
一路向北
已加
热评文章
家长老师必藏🔥免费在线字帖生成工具|zt.luomor.com
家里有小学生,还在花钱买现成练字帖吗?挖到一个完全免费、不用注册登录的汉字练习表生成网站👉https://zt...
Docker 构建报错:sqlite3 node-gyp 找不到 Python 解决方案
故障现象 使用 Docker 打包 Node 项目,执行 yarn install --frozen-lock...
CentOS7 安装 MySQL8.0 时报 NOKEY / Public key is not installed
问题原因 CentOS7 安装 MySQL8.0 时报 NOKEY / Public key is not i...
解决 VSCode/CodeBuddy DevContainer 报错:Unable to resolve resource、远程连接器退出码1
日常使用 VSCode、CodeBuddy CN 的 DevContainer 容器开发环境时,很多人会遇到一...
CentOS 手把手使用 YUM 安装 Node.js(保姆级教程)
大家好!很多小伙伴在搭建 CentOS 服务器环境时,需要部署 Node.js 运行环境,用于前端打包、后端服...