Overview
- Full name
docker.io/crawlabteam/crawlab- Registry
- docker.io
- Namespace
- crawlabteam
- Repository
- crawlab
- Cached tags
- 13
- Last synced
- 07/05/2026, 04:57 PM
Introduction
Crawlab 分布式爬虫管理平台镜像，Spider 调度、节点管理与可视化监控，企业级爬虫任务编排与数据采集中枢。
Details
crawlabteam/crawlab 运行 Crawlab 爬虫管理平台，支持 Spider 上传、定时调度、分布式 Worker 节点与任务监控 Dashboard。定位为爬虫编排 Web 平台，依赖 MongoDB 存储元数据；电商价格监控、舆情采集或内部数据抓取任务统一管理与弹性扩缩 Worker。
快速启动
docker run -d --name crawlab \
-p 8080:8080 \
docker.io/crawlabteam/crawlab:latest
推荐实践
docker run -d --name crawlab \
--restart unless-stopped \
-p 8080:8080 \
-e CRAWLAB_MONGO_HOST=mongo \
-e CRAWLAB_MONGO_PASSWORD=changeme \
docker.io/crawlabteam/crawlab:0.6.3
核心参数说明
-p 8080:8080— Crawlab Web UICRAWLAB_MONGO_PASSWORD— MongoDB 密码（高敏）- Worker — 独立节点连接 Master
- 调度 — Cron 与分布式执行
Kubernetes
apiVersion: apps/v1
kind: Deployment
metadata:
name: crawlab
spec:
replicas: 1
selector:
matchLabels:
app: crawlab
template:
metadata:
labels:
app: crawlab
spec:
containers:
- name: crawlab
image: docker.io/crawlabteam/crawlab:0.6.3
ports:
- containerPort: 8080
envFrom:
- secretRef:
name: crawlab-mongo
---
apiVersion: v1
kind: Service
metadata:
name: crawlab
spec:
selector:
app: crawlab
ports:
- port: 8080
targetPort: 8080
Worker 独立 Deployment；Secret 管理 Mongo 凭据。
Latest tags (20)
View all 13 tags →| Tag | Arch | Pushed At | Size | Digest | Sync | Wish | Action |
|---|---|---|---|---|---|---|---|
docker.io/crawlabteam/crawlab :develop | linux/amd64 | 2025/12/03 15:52 | 397.8 MB | sha256:28360c2d1f59… | |||
docker.io/crawlabteam/crawlab :test | linux/amd64 | 2025/10/09 12:49 | 397.7 MB | sha256:c2edf6466d76… | |||
docker.io/crawlabteam/crawlab :latest | linux/amd64 | 2024/10/09 10:38 | 1.3 GB | sha256:a0f72ac7325a… | |||
docker.io/crawlabteam/crawlab :0.6.3-dev | linux/amd64 | 2024/06/14 15:54 | 1.3 GB | sha256:5c1fdd02565b… | |||
docker.io/crawlabteam/crawlab :0.6.3 | linux/amd64 | 2023/07/26 16:17 | 1.9 GB | sha256:9dbe97240ba2… | |||
docker.io/crawlabteam/crawlab :0.6.2 | linux/amd64 | 2023/06/16 13:58 | 1.9 GB | sha256:42fb216da002… | |||
docker.io/crawlabteam/crawlab :0.6.1 | linux/amd64 | 2023/03/23 13:13 | 1.6 GB | sha256:df086df45034… | |||
docker.io/crawlabteam/crawlab :0.6.0-1 | linux/amd64 | 2022/10/27 12:51 | 1.6 GB | sha256:ae21b86841a6… | |||
docker.io/crawlabteam/crawlab :main | linux/amd64 | 2022/06/01 14:23 | 636.3 MB | sha256:fc938f6dd55a… | |||
docker.io/crawlabteam/crawlab :0.6.0 | linux/amd64 | 2022/05/23 09:19 | 636.1 MB | sha256:3fca9eabd409… | |||
docker.io/crawlabteam/crawlab :merge | linux/amd64 | 2022/02/28 13:08 | 625.5 MB | sha256:0bb95ed7aa99… | |||
docker.io/crawlabteam/crawlab :0.6.0-beta.20211224 | linux/amd64 | 2021/12/24 18:24 | 627.6 MB | sha256:e6e59fb9c98f… | |||
docker.io/crawlabteam/crawlab :release | linux/amd64 | 2021/08/02 18:16 | 365.2 MB | sha256:d36b7410ea03… |