K
Q

How to run airflow CLI commands with airflow/kubernetes installed from Helm stable/airflow?

8/24/2020

Difficulty running airflow commands when running Airflow on Kubernetes that I installed from the Helm stable/airflow repo. For instance I try to exec into the scheduler pod and run airflow list and I get the following error:

airflow.exceptions.AirflowConfigException: error: cannot use sqlite with the KubernetesExecutor airlow

Ok so I switch to the celery executor.

Same thing

airflow.exceptions.AirflowConfigException: error: cannot use sqlite with the CeleryExecutor

So what is the correct way to run airflow CLI commands when running on K8s?

-- alex
airflow
kubernetes
kubernetes-helm

Similar Questions

Kubernetes env variable to containers
What is the default 'name' of the kubernetes master cluster host?
I want to use fabric8 kubernetes client (java) inside a pod. How do I obtain the kubernetes client for the cluster it is deployed on?
Scale down kubernetes job but dont delete pods until complete
kubectl top deosn't work

1 Answer

8/24/2020

Make sure you are using bash. /home/airflow/.bashrc imports the environment variables from /home/airflow/airflow_env.sh to setup the connection. The following are some examples:

kubectl exec -ti airflow-scheduler-nnn-nnn -- /bin/bash
$ airflow list_dags

Or with shell you can import the env vars yourself:

kubectl exec -ti airflow-scheduler-nnn-nnn -- sh -c ". /home/airflow/airflow_env.sh && airflow list_dags"
-- Faheem
Source: StackOverflow