在我可以调试此实例之前运行下一个作业实例
Next Instance of Job Runs Before I Can Debug This Instance
当我在 Airflow 上进行开发并打开我的 DAG 时,它会在第 6 步失败,并且不会启动第 7-9 步。但是在我调试问题之前,下一个实例(我将 start_date 放在过去)将开始并且 运行 一直到第 5 步并在第 6 步失败,完全搞砸了我的工作流程。这种行为是预期的,还是可以将其关闭,以便下一个实例不会启动,直到这个实例到处都是绿色?
查看文档以了解您可以在运算符上设置的以下两个选项。
depends_on_past (bool) – when set to true, task instances will run sequentially while relying on the previous task’s schedule to succeed. The task instance for the start_date is allowed to run.
wait_for_downstream (bool) – when set to true, an instance of task X will wait for tasks immediately downstream of the previous instance of task X to finish successfully before it runs. This is useful if the different instances of a task X alter the same asset, and this asset is used by tasks downstream of task X. Note that depends_on_past is forced to True wherever wait_for_downstream is used.
当我在 Airflow 上进行开发并打开我的 DAG 时,它会在第 6 步失败,并且不会启动第 7-9 步。但是在我调试问题之前,下一个实例(我将 start_date 放在过去)将开始并且 运行 一直到第 5 步并在第 6 步失败,完全搞砸了我的工作流程。这种行为是预期的,还是可以将其关闭,以便下一个实例不会启动,直到这个实例到处都是绿色?
查看文档以了解您可以在运算符上设置的以下两个选项。
depends_on_past (bool) – when set to true, task instances will run sequentially while relying on the previous task’s schedule to succeed. The task instance for the start_date is allowed to run.
wait_for_downstream (bool) – when set to true, an instance of task X will wait for tasks immediately downstream of the previous instance of task X to finish successfully before it runs. This is useful if the different instances of a task X alter the same asset, and this asset is used by tasks downstream of task X. Note that depends_on_past is forced to True wherever wait_for_downstream is used.