xTag

Overview

Full name
docker.io/gpustack/runner
Registry
docker.io
Namespace
gpustack
Repository
runner
Cached tags
742
Last synced
07/13/2026, 10:47 AM

Introduction

GPUStack Runner 镜像，在 GPU 节点上执行 LLM 推理任务，需 NVIDIA GPU 与驱动，GPUStack 平台专用执行器组件。

Details

gpustack/runner 为 GPUStack 平台的 GPU 推理执行器，在 GPU 节点加载并运行 LLM 模型推理任务。定位为 GPU 推理执行组件，需 --gpus all 与 GPUStack Server 调度；docker GPU 节点部署，非 CPU-only K8s 常规场景。

快速启动

docker run -d --name gpustack-runner \
  --gpus all \
  -e GPUSTACK_SERVER_URL=http://gpustack-server:8080 \
  docker.io/gpustack/runner:latest

推荐实践

docker run -d --name gpustack-runner \
  --gpus all \
  --restart unless-stopped \
  -e GPUSTACK_SERVER_URL=http://gpustack.internal:8080 \
  -v /data/models:/models \
  docker.io/gpustack/runner:v0.4.0

核心参数说明

  • --gpus all — NVIDIA GPU 推理加速
  • -e GPUSTACK_SERVER_URL — GPUStack 控制面地址
  • -v .../models:... — 模型权重缓存
  • 定位 — GPUStack 平台执行器

Latest tags (20)

View all 742 tags →
TagArchPushed AtSizeDigestSyncWishAction
docker.io/gpustack/runner
:cann9.0-a3-vllm0.20.2
linux/amd64linux/arm64
2026/06/15 10:596.7 GBsha256:69e585b470ab…
docker.io/gpustack/runner
:cann9.0-910b-vllm0.20.2
linux/amd64linux/arm64
2026/06/15 10:596.6 GBsha256:c03b18bbf5c8…
docker.io/gpustack/runner
:cann9.0-310p-vllm0.20.2
linux/amd64linux/arm64
2026/06/15 10:595.5 GBsha256:0378b0dfedf8…
docker.io/gpustack/runner
:cann9.0-a3-vllm0.20.2-dev
linux/amd64linux/arm64
2026/06/15 10:246.7 GBsha256:69e585b470ab…
docker.io/gpustack/runner
:cann9.0-910b-vllm0.20.2-dev
linux/amd64linux/arm64
2026/06/15 10:246.6 GBsha256:c03b18bbf5c8…
docker.io/gpustack/runner
:cann9.0-310p-vllm0.20.2-dev
linux/amd64linux/arm64
2026/06/15 10:245.5 GBsha256:0378b0dfedf8…
docker.io/gpustack/runner
:cann9.0-a3-vllm0.20.2-linux-amd64
linux/amd64
2026/06/15 10:246.7 GBsha256:69e585b470ab…
docker.io/gpustack/runner
:cann9.0-a3-vllm0.20.2-linux-arm64
linux/arm64
2026/06/15 10:236.4 GBsha256:2a29d296bacb…
docker.io/gpustack/runner
:cann9.0-310p-vllm0.20.2-linux-arm64
linux/arm64
2026/06/15 10:235.4 GBsha256:e395231e61cf…
docker.io/gpustack/runner
:cann9.0-910b-vllm0.20.2-linux-amd64
linux/amd64
2026/06/15 10:236.6 GBsha256:c03b18bbf5c8…
docker.io/gpustack/runner
:cann9.0-310p-vllm0.20.2-linux-amd64
linux/amd64
2026/06/15 10:225.5 GBsha256:0378b0dfedf8…
docker.io/gpustack/runner
:cann9.0-910b-vllm0.20.2-linux-arm64
linux/arm64
2026/06/15 10:226.4 GBsha256:7f756a932636…
docker.io/gpustack/runner
:cann9.0-a3-vllm0.20.2rc1
linux/amd64linux/arm64
2026/06/11 17:436.7 GBsha256:cc0a73b2c33c…
docker.io/gpustack/runner
:cann9.0-910b-vllm0.20.2rc1
linux/amd64linux/arm64
2026/06/11 17:436.6 GBsha256:2eccb39ff630…
docker.io/gpustack/runner
:cann9.0-310p-vllm0.20.2rc1
linux/amd64linux/arm64
2026/06/11 17:435.5 GBsha256:b39d64a474d2…
docker.io/gpustack/runner
:cann9.0-910b-vllm0.20.2rc1-linux-amd64
linux/amd64
2026/06/11 17:416.6 GBsha256:2eccb39ff630…
docker.io/gpustack/runner
:cann9.0-a3-vllm0.20.2rc1-linux-amd64
linux/amd64
2026/06/11 17:406.7 GBsha256:cc0a73b2c33c…
docker.io/gpustack/runner
:cann9.0-910b-vllm0.20.2rc1-linux-arm64
linux/arm64
2026/06/11 17:396.4 GBsha256:db85f96f0267…
docker.io/gpustack/runner
:cann9.0-310p-vllm0.20.2rc1-linux-amd64
linux/amd64
2026/06/11 17:385.5 GBsha256:b39d64a474d2…
docker.io/gpustack/runner
:cann9.0-310p-vllm0.20.2rc1-linux-arm64
linux/arm64
2026/06/11 17:385.4 GBsha256:de4b826043a2…