Overview
- Full name
docker.io/kubeflow/spark-operator- Registry
- docker.io
- Namespace
- kubeflow
- Repository
- spark-operator
- Cached tags
- 14
- Last synced
- 07/13/2026, 01:35 PM
Introduction
Kubeflow Spark Operator 镜像，K8s 上 Spark 作业 CRD 调度控制器，大数据批处理与 ML 特征工程 SparkApplication 管理。
Details
kubeflow/spark-operator 提供 Kubernetes Spark Operator，通过 SparkApplication CRD 在 K8s 上提交与管理 Spark 批处理/流作业。定位为 K8s Spark 作业控制面，非独立 Spark 集群；大数据 ETL、ML 特征工程或 K8s 原生 Spark 作业调度。
快速启动
docker pull docker.io/kubeflow/spark-operator:v1beta2-1.3.8-3.1.1
# kubectl apply -f spark-operator manifest
推荐实践
# helm install spark-operator spark-operator/spark-operator
# kubectl apply -f sparkapplication.yaml
核心参数说明
- 角色 — Spark K8s Operator
- CRD — SparkApplication/ScheduledSparkApplication
- 部署 — kubectl/Helm 安装
- 勿 — 独立 docker run 业务应用
Latest tags (20)
View all 14 tags →| Tag | Arch | Pushed At | Size | Digest | Sync | Wish | Action |
|---|---|---|---|---|---|---|---|
docker.io/kubeflow/spark-operator :latest | linux/amd64linux/arm64 | 2025/03/25 20:07 | 540.0 MB | sha256:773f8dffd267… | |||
docker.io/kubeflow/spark-operator :2.1.1 | linux/amd64linux/arm64 | 2025/03/25 20:07 | 540.0 MB | sha256:773f8dffd267… | |||
docker.io/kubeflow/spark-operator :2.1.0 | linux/arm64linux/amd64 | 2024/12/11 13:53 | 525.3 MB | sha256:1a0389ff2a68… | |||
docker.io/kubeflow/spark-operator :2.1.0-rc.0 | linux/arm64linux/amd64 | 2024/10/24 17:05 | 525.2 MB | sha256:955b4ee91c00… | |||
docker.io/kubeflow/spark-operator :2.0.2 | linux/amd64linux/arm64 | 2024/10/11 09:57 | 538.2 MB | sha256:aa7b5612218c… | |||
docker.io/kubeflow/spark-operator :2.0.1 | linux/arm64linux/amd64 | 2024/09/26 10:30 | 525.7 MB | sha256:61f02068c148… | |||
docker.io/kubeflow/spark-operator :2.0.0 | linux/amd64linux/arm64 | 2024/09/23 11:12 | 537.5 MB | sha256:628e42363519… | |||
docker.io/kubeflow/spark-operator :2.0.0-rc.0 | linux/arm64linux/amd64 | 2024/08/12 11:07 | 524.4 MB | sha256:620f53e64093… | |||
docker.io/kubeflow/spark-operator :v1beta2-1.6.2-3.5.0 | linux/arm64linux/amd64 | 2024/07/22 13:24 | 524.4 MB | sha256:ea2380156a26… | |||
docker.io/kubeflow/spark-operator :v1beta2-1.6.1-3.5.0 | linux/amd64linux/arm64 | 2024/06/18 00:52 | 536.0 MB | sha256:9e57048ca1d1… | |||
docker.io/kubeflow/spark-operator :v1beta2-1.6.0-3.5.0 | linux/amd64linux/arm64 | 2024/06/05 22:51 | 0.0 MB | sha256:7107dd19cf2b… | |||
docker.io/kubeflow/spark-operator :v1beta2-1.5.0-3.5.0 | linux/amd64linux/arm64 | 2024/06/05 10:24 | 535.9 MB | sha256:07ebf76bda28… | |||
docker.io/kubeflow/spark-operator :v1beta2-1.4.6-3.5.0 | linux/arm64linux/amd64 | 2024/05/07 23:47 | 524.2 MB | sha256:a460a989c315… | |||
docker.io/kubeflow/spark-operator :v1beta2-1.4.5-3.5.0 | linux/amd64linux/arm64 | 2024/04/26 08:58 | 540.8 MB | sha256:e94b84077378… |