Airflow 1.9.0 正在排队,但任务没有 运行

Airflow 1.9.0 is queuing but tasks are not running

Airflow 突然停止了 运行 任务。以下全部运行 airflow scheduler airflow webserver airflow worker

webui消息

All dependencies are met but the task instance is not running. In most cases this just means that the task will probably be scheduled soon unless: - The scheduler is down or under heavy load

If this task instance does not start soon please contact your Airflow administrator for assistance.

调度程序似乎在循环中,不断重复以下消息。 WebUI 显示任务处于排队状态。尝试重新启动调度程序,没有帮助。

[2018-11-17 22:03:45,809] {{jobs.py:1607}} DEBUG - Starting Loop...
[2018-11-17 22:03:45,809] {{jobs.py:1627}} INFO - Heartbeating the process manager
[2018-11-17 22:03:45,810] {{jobs.py:1662}} INFO - Heartbeating the executor
[2018-11-17 22:03:45,810] {{base_executor.py:103}} DEBUG - 124 running task instances
[2018-11-17 22:03:45,810] {{base_executor.py:104}} DEBUG - 0 in queue
[2018-11-17 22:03:45,810] {{base_executor.py:105}} DEBUG - 76 open slots
[2018-11-17 22:03:45,810] {{base_executor.py:132}} DEBUG - Calling the <class 'airflow.executors.celery_executor.CeleryExecutor'> sync method
[2018-11-17 22:03:45,810] {{celery_executor.py:80}} DEBUG - Inquiring about 124 celery task(s)

气流设置: apache-airflow[celery, redis, all]==1.9.0

我也检查了这些帖子,但没有帮助我:

Airflow 1.9.0 is queuing but not launching tasks

Airflow tasks get stuck at "queued" status and never gets running

问题已解决。 当您在 2018-11-15 或之后创建构建时,这是一个问题 结果 apache-airflow[celery, redis, all]==1.9.0 使用了最新版本的 redis-py 3.0.1不适用于芹菜 4.2.1。 解决方案是使用 redis-py 2.10.6 redis==2.10.6 apache-airflow[celery, all]==1.9.0