介绍

Airflow是一个可编程，调度和监控的工作流平台，基于有向无环图(DAG)，airflow可以定义一组有依赖的任务，按照依赖依次执行。airflow提供了丰富的命令行工具用于系统管控，而其web管理界面同样也可以方便的管控调度任务，并且对任务运行状态进行实时监控，方便了系统的运维和管理。

安装部署

helm官方chart： https://github.com/helm/charts/tree/master/stable/airflow

版本信息

apiVersion: v1
description: Airflow is a platform to programmatically author, schedule and monitor workflows
name: airflow
version: 3.0.2
appVersion: 1.10.3
icon: https://airflow.apache.org/_images/pin_large.png
home: https://airflow.apache.org/
maintainers:
  - name: gsemet
    email: gaetan@xeberon.net
sources:
  - https://airflow.apache.org/
keywords:
  - workflow
  - dag

部署脚本

helm install --namespace "airflow" --name "airflow" stable/airflow

value.yaml

persistence:
  enabled: true
  # 若设置了默认storageClass，则无需指定
  # storageClass: default

postgresql:
  enabled: true
  # 若设置了默认storageClass，则无需指定
  # storageClass: default

  # 经测试，以下方式不可用☹
  # 不使用chart内置pg库，指定自建pg库
  # enabled: false
  # uri: postgresql+psycopg2://airflow:airflow@10.0.4.32:31759/airflow

rancher服务状态

airflow dashboard

FAQ

q

helm version
Client: &version.Version{SemVer:"v2.13.1", GitCommit:"618447cbf203d147601b4b9bd7f8c37a5d39fbb4", GitTreeState:"clean"}
Server: &version.Version{SemVer:"v2.14.0", GitCommit:"05811b84a3f93603dd6c2fcfe57944dfa7ab7fd0", GitTreeState:"clean"}

Error: validation failed: error validating "": error validating data: ValidationError(Deployment.spec.template.spec.containers[0].resources): unknown field "scheduler" in io.k8s.api.core.v1.ResourceRequirements

a

在github上找到类似问题： https://github.com/helm/helm/issues/5750 回滚 helm server 版本到v2.13.1