Overview
- Full name
docker.io/seldonio/mlserver- Registry
- docker.io
- Namespace
- seldonio
- Repository
- mlserver
- Cached tags
- 926
- Last synced
- 07/05/2026, 11:36 PM
Introduction
Seldon MLServer 模型推理镜像，多框架 ML 模型统一 serving API，Seldon Core/KServe 推理运行时。
Details
seldonio/mlserver 运行 Seldon MLServer 高性能模型推理服务，支持 sklearn/XGBoost/ONNX/HuggingFace 等多框架模型统一 REST/gRPC API。定位为 ML 模型 serving 运行时，需挂载模型 artifact；K8s InferenceService/SeldonDeployment 推理后端。
快速启动
docker run -d --name mlserver \
-p 8080:8080 \
-v /data/models:/models \
-e MLSERVER_MODEL_URI=/models \
docker.io/seldonio/mlserver:latest
推荐实践
docker run -d --name mlserver \
--restart unless-stopped \
-p 8080:8080 -p 8081:8081 \
-v /data/models:/models \
-e MLSERVER_MODEL_URI=/models \
-e MLSERVER_MODEL_IMPLEMENTATION=mlserver_sklearn.SKLearnModel \
docker.io/seldonio/mlserver:1.5.0
核心参数说明
-p 8080:8080— REST 推理 API-p 8081:8081— gRPC 推理 API-e MLSERVER_MODEL_URI— 模型目录- 框架 — sklearn/ONNX/HF 等
Kubernetes
apiVersion: apps/v1
kind: Deployment
metadata:
name: mlserver
spec:
replicas: 2
selector:
matchLabels:
app: mlserver
template:
metadata:
labels:
app: mlserver
spec:
containers:
- name: mlserver
image: docker.io/seldonio/mlserver:1.5.0
ports:
- containerPort: 8080
env:
- name: MLSERVER_MODEL_URI
value: /models
volumeMounts:
- name: models
mountPath: /models
volumes:
- name: models
persistentVolumeClaim:
claimName: ml-models
---
apiVersion: v1
kind: Service
metadata:
name: mlserver
spec:
selector:
app: mlserver
ports:
- port: 8080
targetPort: 8080
KServe InferenceService 集成；PVC/S3 存模型 artifact。
Latest tags (20)
View all 926 tags →| Tag | Arch | Pushed At | Size | Digest | Sync | Wish | Action |
|---|---|---|---|---|---|---|---|
docker.io/seldonio/mlserver :1.7.2-rc1 | linux/amd64 | 2025/12/18 08:33 | 4.6 GB | sha256:703242167dab… | |||
docker.io/seldonio/mlserver :1.7.2-rc1-huggingface | linux/amd64 | 2025/12/18 08:31 | 3.9 GB | sha256:dc85f062adf2… | |||
docker.io/seldonio/mlserver :1.7.2-rc1-xgboost | linux/amd64 | 2025/12/18 08:27 | 927.2 MB | sha256:d9c27152fe24… | |||
docker.io/seldonio/mlserver :1.7.2-rc1-sklearn | linux/amd64 | 2025/12/18 08:24 | 608.7 MB | sha256:6042102a9c9d… | |||
docker.io/seldonio/mlserver :1.7.2-rc1-catboost | linux/amd64 | 2025/12/18 08:24 | 728.9 MB | sha256:66d9399dc0d6… | |||
docker.io/seldonio/mlserver :1.7.2-rc1-mlflow | linux/amd64 | 2025/12/18 08:24 | 697.5 MB | sha256:d6725c3a6d95… | |||
docker.io/seldonio/mlserver :1.7.2-rc1-slim | linux/amd64 | 2025/12/18 08:23 | 550.9 MB | sha256:c8eb1b05496d… | |||
docker.io/seldonio/mlserver :1.7.2-rc1-lightgbm | linux/amd64 | 2025/12/18 08:23 | 596.2 MB | sha256:54fb3d8b8407… | |||
docker.io/seldonio/mlserver :1.7.1 | linux/amd64 | 2025/06/06 20:41 | 4.6 GB | sha256:80c10c963d5e… | |||
docker.io/seldonio/mlserver :1.7.1-huggingface | linux/amd64 | 2025/06/06 20:39 | 3.9 GB | sha256:f8920ab6a949… | |||
docker.io/seldonio/mlserver :1.7.1-catboost | linux/amd64 | 2025/06/06 20:32 | 693.8 MB | sha256:16ae6df1a5c0… | |||
docker.io/seldonio/mlserver :1.7.1-mllib | linux/amd64 | 2025/06/06 20:32 | 936.1 MB | sha256:e5c838d723cb… | |||
docker.io/seldonio/mlserver :1.7.1-sklearn | linux/amd64 | 2025/06/06 20:32 | 576.5 MB | sha256:2d294e9e51b7… | |||
docker.io/seldonio/mlserver :1.7.1-xgboost | linux/amd64 | 2025/06/06 20:31 | 992.3 MB | sha256:5b5e5db61c0f… | |||
docker.io/seldonio/mlserver :1.7.1-mlflow | linux/amd64 | 2025/06/06 20:31 | 682.2 MB | sha256:492c8bbac687… | |||
docker.io/seldonio/mlserver :1.7.1-slim | linux/amd64 | 2025/06/06 20:31 | 519.2 MB | sha256:5585ce607dc5… | |||
docker.io/seldonio/mlserver :1.7.1-lightgbm | linux/amd64 | 2025/06/06 20:31 | 564.2 MB | sha256:6804f3bb8f56… | |||
docker.io/seldonio/mlserver :1.7.1.rc1 | linux/amd64 | 2025/06/04 23:55 | 4.6 GB | sha256:e7adfccbedf9… | |||
docker.io/seldonio/mlserver :1.7.1.rc1-huggingface | linux/amd64 | 2025/06/04 23:53 | 3.9 GB | sha256:c5fdd388e331… | |||
docker.io/seldonio/mlserver :1.7.1.rc1-mllib | linux/amd64 | 2025/06/04 23:45 | 936.8 MB | sha256:3041c0ee75d9… |