NiFi 生成巨大的日志文件 - 连续记录 - 流量控制器执行任务已被取消

NiFi generating huge log file - continuously logging - A flow controller execution task has been cancelled

我的 Nifi 实例疯狂地一遍又一遍地生成大量相同的日志。我的流程由 ExecuteStreamCommand 组成,它在内部调用 Java 可执行 jar。另外,看看 NiFi UI,那个处理器似乎卡在了 1 个活动线程上。即使当我重新启动 NiFi 时,这种状态似乎仍会保留并且会继续发生。正如您在下面看到的,它在一秒钟内记录了数千行相同的日志。疯了!

    016-08-03 17:21:12,904 DEBUG [Timer-Driven Process Thread-3] org.apache.nifi.engine.FlowEngine A flow controller execution task 'java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@3fe940f' has been cancelled.
2016-08-03 17:21:12,904 DEBUG [Timer-Driven Process Thread-3] org.apache.nifi.engine.FlowEngine A flow controller execution task 'java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@5c02799' has been cancelled.
2016-08-03 17:21:12,915 DEBUG [Timer-Driven Process Thread-3] org.apache.nifi.engine.FlowEngine A flow controller execution task 'java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@52871b90' has been cancelled.
2016-08-03 17:21:12,915 DEBUG [Timer-Driven Process Thread-3] org.apache.nifi.engine.FlowEngine A flow controller execution task 'java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@5c488f85' has been cancelled.
2016-08-03 17:21:12,915 DEBUG [Timer-Driven Process Thread-3] org.apache.nifi.engine.FlowEngine A flow controller execution task 'java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@2be136ef' has been cancelled.
2016-08-03 17:21:12,915 DEBUG [Timer-Driven Process Thread-3] org.apache.nifi.engine.FlowEngine A flow controller execution task 'java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@2f1930e5' has been cancelled.
2016-08-03 17:21:12,915 DEBUG [Timer-Driven Process Thread-3] org.apache.nifi.engine.FlowEngine A flow controller execution task 'java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@4528e50d' has been cancelled.
2016-08-03 17:21:12,915 DEBUG [Timer-Driven Process Thread-3] org.apache.nifi.engine.FlowEngine A flow controller execution task 'java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@5d046e8a' has been cancelled.
2016-08-03 17:21:12,915 DEBUG [Timer-Driven Process Thread-3] org.apache.nifi.engine.FlowEngine A flow controller execution task 'java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@7ff06d8b' has been cancelled.
2016-08-03 17:21:12,915 DEBUG [Timer-Driven Process Thread-3] org.apache.nifi.engine.FlowEngine A flow controller execution task 'java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@1908e488' has been cancelled.
2016-08-03 17:21:12,915 DEBUG [Timer-Driven Process Thread-3] org.apache.nifi.engine.FlowEngine A flow controller execution task 'java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@1b8a6a29' has been cancelled.
2016-08-03 17:21:12,915 DEBUG [Timer-Driven Process Thread-3] org.apache.nifi.engine.FlowEngine A flow controller execution task 'java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@650437ec' has been cancelled.
2016-08-03 17:21:12,926 DEBUG [Timer-Driven Process Thread-3] org.apache.nifi.engine.FlowEngine A flow controller execution task 'java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@196492f2' has been cancelled.
2016-08-03 17:21:12,926 DEBUG [Timer-Driven Process Thread-3] org.apache.nifi.engine.FlowEngine A flow controller execution task 'java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@471609f2' has been cancelled.
2016-08-03 17:21:12,926 DEBUG [Timer-Driven Process Thread-3] org.apache.nifi.engine.FlowEngine A flow controller execution task 'java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@f05e81b' has been cancelled.
2016-08-03 17:21:12,926 DEBUG [Timer-Driven Process Thread-3] org.apache.nifi.engine.FlowEngine A flow controller execution task 'java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@4bfa0540' has been cancelled.
2016-08-03 17:21:12,926 DEBUG [Timer-Driven Process Thread-3] org.apache.nifi.engine.FlowEngine A flow controller execution task 'java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@76b4fdcf' has been cancelled.
2016-08-03 17:21:12,926 DEBUG [Timer-Driven Process Thread-3] org.apache.nifi.engine.FlowEngine A flow controller execution task 'java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@19a2372' has been cancelled.
2016-08-03 17:21:12,926 DEBUG [Timer-Driven Process Thread-3] org.apache.nifi.engine.FlowEngine A flow controller execution task 'java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@21ff466a' has been cancelled.
2016-08-03 17:21:12,926 DEBUG [Timer-Driven Process Thread-3] org.apache.nifi.engine.FlowEngine A flow controller execution task 'java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@3ab48710' has been cancelled.
2016-08-03 17:21:12,926 DEBUG [Timer-Driven Process Thread-3] org.apache.nifi.engine.FlowEngine A flow controller execution task 'java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@6bbf5f0c' has been cancelled.
2016-08-03 17:21:12,926 DEBUG [Timer-Driven Process Thread-3] org.apache.nifi.engine.FlowEngine A flow controller execution task 'java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@3b6e60ba' has been cancelled.
2016-08-03 17:21:13,131 DEBUG [Timer-Driven Process Thread-3] org.apache.nifi.engine.FlowEngine A flow controller execution task 'java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@60f9bdab' has been cancelled.
2016-08-03 17:21:13,131 DEBUG [Timer-Driven Process Thread-3] org.apache.nifi.engine.FlowEngine A flow controller execution task 'java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@7eeb3aa3' has been cancelled.
2016-08-03 17:21:13,131 DEBUG [Timer-Driven Process Thread-3] org.apache.nifi.engine.FlowEngine A flow controller execution task 'java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@6f3d5d4d' has been cancelled.
2016-08-03 17:21:13,131 DEBUG [Timer-Driven Process Thread-3] org.apache.nifi.engine.FlowEngine A flow controller execution task 'java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@271e8ba0' has been cancelled.
2016-08-03 17:21:13,131 DEBUG [Timer-Driven Process Thread-3] org.apache.nifi.engine.FlowEngine A flow controller execution task 'java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@aa77e0d' has been cancelled.
2016-08-03 17:21:13,132 DEBUG [Timer-Driven Process Thread-3] org.apache.nifi.engine.FlowEngine A flow controller execution task 'java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@2d3e73d8' has been cancelled.
2016-08-03 17:21:13,132 DEBUG [Timer-Driven Process Thread-3] org.apache.nifi.engine.FlowEngine A flow controller execution task 'java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@286c9407' has been cancelled.
2016-08-03 17:21:13,132 DEBUG [Timer-Driven Process Thread-3] org.apache.nifi.engine.FlowEngine A flow controller execution task 'java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@7bfc4921' has been cancelled.
2016-08-03 17:21:13,132 DEBUG [Timer-Driven Process Thread-3] org.apache.nifi.engine.FlowEngine A flow controller execution task 'java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@4a1a0745' has been cancelled.
2016-08-03 17:21:13,132 DEBUG [Timer-Driven Process Thread-3] org.apache.nifi.engine.FlowEngine A flow controller execution task 'java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@14640d6d' has been cancelled.
2016-08-03 17:21:13,142 DEBUG [Timer-Driven Process Thread-5] org.apache.nifi.engine.FlowEngine A flow controller execution task 'java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@58646f4a' has been cancelled.
2016-08-03 17:21:13,142 DEBUG [Timer-Driven Process Thread-5] org.apache.nifi.engine.FlowEngine A flow controller execution task 'java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@41488026' has been cancelled.
2016-08-03 17:21:13,142 DEBUG [Timer-Driven Process Thread-5] org.apache.nifi.engine.FlowEngine A flow controller execution task 'java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@5b728765' has been cancelled.
2016-08-03 17:21:13,142 DEBUG [Timer-Driven Process Thread-5] org.apache.nifi.engine.FlowEngine A flow controller execution task 'java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@6f49e603' has been cancelled.
2016-08-03 17:21:13,142 DEBUG [Timer-Driven Process Thread-5] org.apache.nifi.engine.FlowEngine A flow controller execution task 'java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@14acca9f' has been cancelled.
2016-08-03 17:21:13,142 DEBUG [Timer-Driven Process Thread-5] org.apache.nifi.engine.FlowEngine A flow controller execution task 'java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@11e0219c' has been cancelled.
2016-08-03 17:21:13,142 DEBUG [Timer-Driven Process Thread-5] org.apache.nifi.engine.FlowEngine A flow controller execution task 'java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@5e66d56a' has been cancelled.
2016-08-03 17:21:13,142 DEBUG [Timer-Driven Process Thread-5] org.apache.nifi.engine.FlowEngine A flow controller execution task 'java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@7e3f595b' has been cancelled.
2016-08-03 17:21:13,142 DEBUG [Timer-Driven Process Thread-5] org.apache.nifi.engine.FlowEngine A flow controller execution task 'java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@c359c31' has been cancelled.
2016-08-03 17:21:13,142 DEBUG [Timer-Driven Process Thread-5] org.apache.nifi.engine.FlowEngine A flow controller execution task 'java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@1c49a0ea' has been cancelled.

看起来 org.apache.nifi 正在调试级别记录,这可以解释为什么您会看到这么多日志。默认情况下,NiFi 附带的 logback.xml 信息级别的日志。

FlowEngine 是一个线程池执行器,它执行流的所有任务,您看到的日志语句是在检查任务完成的结果时发生的。你是对的,当一个处理器被调度到 运行 在 0 秒时它正在尽可能快地执行,这确实执行了很多任务。我不完全确定为什么这么多任务报告为已取消而不是正常完成。