天鹅座停在开始
Cygnus stop at start
我已经使用 this guide 在 Ubuntu 14.04 上安装了 Cygnus,当我通过(正确填充)继续启动 cygnus 时:
nohup APACHE_FLUME_HOME/bin/cygnus-flume-ng agent --conf APACHE_FLUME_HOME/conf -f APACHE_FLUME_HOME/conf/cygnus.conf -n cygnusagent -Dflume.root.logger=INFO,LOGFILE [-p <mgmt-if-port>] [-t <polling-interval>] &
我得到这个输出:
Warning: JAVA_HOME is not set!
+ exec /usr/bin/java -Xmx20m -cp '/etc/flume/apache-flume-1.4.0-bin/conf:/etc/flume/apache-flume-1.4.0-bin/lib/*:/etc/flume/apache-flume-1.4.0-bin/plugins.d/cygnus/lib/*'
-Djava.library.path= com.telefonica.iot.cygnus.nodes.CygnusApplication -f /usr/cygnus/conf/agent_1.conf -n cygnusagent
Starting an ordered shutdown of Cygnus
Stopping sources
All the channels are empty
Stopping channels Stopping sinks
问题出在哪里?
版本:0.8.0
会议。文件:
cygnusagent.channel = mysql-channel
cygnusagent.sinks = mysql-sink
cygnusagent.sources = http-source
cygnusagent.sources.http-source.channels = mysql-channel
cygnusagent.sources.http-source.type = org.apache.flume.source.http.HTTPSource
cygnusagent.sources.http-source.port = 5050
cygnusagent.sources.http-source.handler = es.tid.fiware.fiwareconnectors.cygnus.handlers.OrionRestHandler
cygnusagent.sources.http-source.handler.notification_target = /notify
cygnusagent.sources.http-source.handler.default_service = def_serv
cygnusagent.sources.http-source.handler.default_service_path = def_servpath
cygnusagent.sources.http-source.handler.events_ttl = 10
cygnusagent.sources.http-source.interceptors = ts de
cygnusagent.sources.http-source.interceptors.ts.type = timestamp
cygnusagent.sources.http-source.interceptors.de.type = es.tid.fiware.fiwareconnectors.cygnus.interceptors.DestinationExtractor$Builder
cygnusagent.sources.http-source.interceptors.de.matching_table = /usr/cygnus/conf/matching_table.conf
cygnusagent.sinks.mysql-sink.channel = mysql-channel
cygnusagent.sinks.mysql-sink.type = es.tid.fiware.fiwareconnectors.cygnus.sinks.OrionMySQLSink
cygnusagent.sinks.mysql-sink.mysql_host = 127.0.0.1
cygnusagent.sinks.mysql-sink.mysql_port = 3306
cygnusagent.sinks.mysql-sink.mysql_username = root
cygnusagent.sinks.mysql-sink.mysql_password = root
cygnusagent.sinks.mysql-sink.attr_persistence = row
cygnusagent.channels.mysql-channel.type = memory
cygnusagent.channels.mysql-channel.capacity = 1000
cygnusagent.channels.mysql-channel.transactionCapacity = 100
日志:
2015-05-20 18:51:59,475 (main) [INFO -
com.telefonica.iot.cygnus.nodes.CygnusApplication.main(CygnusApplication.java:235)]
Starting a Jetty server listening on port 8081 (Management Interface)
2015-05-20 18:51:59,519 (main) [INFO -
org.mortbay.log.Slf4jLog.info(Slf4jLog.java:67)] Logging to
org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
org.mortbay.log.Slf4jLog
2015-05-20 18:51:59,519 (main) [INFO -
com.telefonica.iot.cygnus.nodes.CygnusApplication.main(CygnusApplication.java:238)]
Starting Cygnus application
2015-05-20 18:51:59,528 (Thread-1) [INFO -
org.mortbay.log.Slf4jLog.info(Slf4jLog.java:67)] jetty-6.1.26
2015-05-20 18:51:59,544 (lifecycleSupervisor-1-0) [INFO -
org.apache.flume.node.PollingPropertiesFileConfigurationProvider.start(PollingPropertiesFileConfigurationProvider.java:61)]
Configuration provider starting
2015-05-20 18:51:59,559 (conf-file-poller-0) [INFO -
org.apache.flume.node.PollingPropertiesFileConfigurationProvider$FileWatcherRunnable.run(PollingPropertiesFileConfigurationProvider.java:133)]
Reloading configuration
file:/etc/flume/apache-flume-1.4.0-bin/conf/cygnus.conf
2015-05-20 18:51:59,575 (conf-file-poller-0) [INFO -
org.apache.flume.conf.FlumeConfiguration$AgentConfiguration.addProperty(FlumeConfiguration.java:1016)]
Processing:mysql-sink
2015-05-20 18:51:59,588 (conf-file-poller-0) [INFO -
org.apache.flume.conf.FlumeConfiguration$AgentConfiguration.addProperty(FlumeConfiguration.java:1016)]
Processing:mysql-sink
2015-05-20 18:51:59,588 (conf-file-poller-0) [INFO -
org.apache.flume.conf.FlumeConfiguration$AgentConfiguration.addProperty(FlumeConfiguration.java:1016)]
Processing:mysql-sink
2015-05-20 18:51:59,589 (conf-file-poller-0) [WARN -
org.apache.flume.conf.FlumeConfiguration$AgentConfiguration.addProperty(FlumeConfiguration.java:1046)]
Invalid property specified: channel
2015-05-20 18:51:59,592 (conf-file-poller-0) [WARN -
org.apache.flume.conf.FlumeConfiguration.(FlumeConfiguration.java:101)]
Configuration property ignored: cygnusagent.channel = mysql-channel
2015-05-20 18:51:59,593 (conf-file-poller-0) [INFO -
org.apache.flume.conf.FlumeConfiguration$AgentConfiguration.addProperty(FlumeConfiguration.java:1016)]
Processing:mysql-sink
2015-05-20 18:51:59,593 (conf-file-poller-0) [INFO -
org.apache.flume.conf.FlumeConfiguration$AgentConfiguration.addProperty(FlumeConfiguration.java:930)]
Added sinks: mysql-sink Agent: cygnusagent
2015-05-20 18:51:59,594 (conf-file-poller-0) [INFO -
org.apache.flume.conf.FlumeConfiguration$AgentConfiguration.addProperty(FlumeConfiguration.java:1016)]
Processing:mysql-sink
2015-05-20 18:51:59,594 (conf-file-poller-0) [INFO -
org.apache.flume.conf.FlumeConfiguration$AgentConfiguration.addProperty(FlumeConfiguration.java:1016)]
Processing:mysql-sink
2015-05-20 18:51:59,594 (conf-file-poller-0) [INFO -
org.apache.flume.conf.FlumeConfiguration$AgentConfiguration.addProperty(FlumeConfiguration.java:1016)]
Processing:mysql-sink
2015-05-20 18:51:59,621 (conf-file-poller-0) [WARN -
org.apache.flume.conf.FlumeConfiguration$AgentConfiguration.isValid(FlumeConfiguration.java:319)]
Agent configuration for 'cygnusagent' does not contain any channels.
Marking it as invalid.
2015-05-20 18:51:59,621 (conf-file-poller-0) [WARN -
org.apache.flume.conf.FlumeConfiguration.validateConfiguration(FlumeConfiguration.java:127)]
Agent configuration invalid for agent 'cygnusagent'. It will be
removed.
2015-05-20 18:51:59,622 (conf-file-poller-0) [INFO -
org.apache.flume.conf.FlumeConfiguration.validateConfiguration(FlumeConfiguration.java:140)]
Post-validation flume configuration contains configuration for agents:
[]
2015-05-20 18:51:59,622 (conf-file-poller-0) [WARN -
org.apache.flume.node.AbstractConfigurationProvider.getConfiguration(AbstractConfigurationProvider.java:138)]
No configuration found for this host:cygnusagent
2015-05-20 18:51:59,640 (Thread-1) [WARN -
org.mortbay.log.Slf4jLog.warn(Slf4jLog.java:76)] failed
SocketConnector@0.0.0.0:8081: java.net.BindException: Address already
in use
2015-05-20 18:51:59,652 (Thread-1) [WARN -
org.mortbay.log.Slf4jLog.warn(Slf4jLog.java:76)] failed
Server@62526d1d: java.net.BindException: Address already in use
2015-05-20 18:51:59,652 (Thread-1) [FATAL -
com.telefonica.iot.cygnus.http.JettyServer.run(JettyServer.java:62)]
Fatal error running the Management Interface. Details=Address already
in use
2015-05-20 18:51:59,669 (conf-file-poller-0) [INFO -
org.apache.flume.node.Application.startAllComponents(Application.java:138)]
Starting new configuration:{ sourceRunners:{} sinkRunners:{}
channels:{} }
2015-05-20 18:51:59,723 (conf-file-poller-0) [INFO -
org.apache.flume.node.Application.stopAllComponents(Application.java:101)]
Shutting down configuration: { sourceRunners:{} sinkRunners:{}
channels:{} }
2015-05-20 18:51:59,724 (conf-file-poller-0) [INFO -
org.apache.flume.node.Application.startAllComponents(Application.java:138)]
Starting new configuration:{ sourceRunners:{} sinkRunners:{}
channels:{} }
如您在此日志中所见:
2015-05-20 18:51:59,589 (conf-file-poller-0) [WARN - org.apache.flume.conf.FlumeConfiguration$AgentConfiguration.addProperty(FlumeConfiguration.java:1046)] Invalid property specified: channel
由于属性 channel
无效,因此没有配置频道。取而代之的是,您必须使用 channels
:
cygnusagent.channels = mysql-channel
请考虑使用 Cygnus template to create your configuration (there is a section in the README。
日志的问题之一是:
2015-05-20 18:51:59,652 (Thread-1) [FATAL - com.telefonica.iot.cygnus.http.JettyServer.run(JettyServer.java:62)] Fatal error running the Management Interface. Details=Address already in use
这是由于 运行 cygnus 的一项试验中产生的垃圾过程。通过杀死进程解决。
还进行了其他响应中建议的更改以清除所有警告。
我已经使用 this guide 在 Ubuntu 14.04 上安装了 Cygnus,当我通过(正确填充)继续启动 cygnus 时:
nohup APACHE_FLUME_HOME/bin/cygnus-flume-ng agent --conf APACHE_FLUME_HOME/conf -f APACHE_FLUME_HOME/conf/cygnus.conf -n cygnusagent -Dflume.root.logger=INFO,LOGFILE [-p <mgmt-if-port>] [-t <polling-interval>] &
我得到这个输出:
Warning: JAVA_HOME is not set!
+ exec /usr/bin/java -Xmx20m -cp '/etc/flume/apache-flume-1.4.0-bin/conf:/etc/flume/apache-flume-1.4.0-bin/lib/*:/etc/flume/apache-flume-1.4.0-bin/plugins.d/cygnus/lib/*'
-Djava.library.path= com.telefonica.iot.cygnus.nodes.CygnusApplication -f /usr/cygnus/conf/agent_1.conf -n cygnusagent
Starting an ordered shutdown of Cygnus
Stopping sources
All the channels are empty
Stopping channels Stopping sinks
问题出在哪里?
版本:0.8.0
会议。文件:
cygnusagent.channel = mysql-channel
cygnusagent.sinks = mysql-sink
cygnusagent.sources = http-source
cygnusagent.sources.http-source.channels = mysql-channel
cygnusagent.sources.http-source.type = org.apache.flume.source.http.HTTPSource
cygnusagent.sources.http-source.port = 5050
cygnusagent.sources.http-source.handler = es.tid.fiware.fiwareconnectors.cygnus.handlers.OrionRestHandler
cygnusagent.sources.http-source.handler.notification_target = /notify
cygnusagent.sources.http-source.handler.default_service = def_serv
cygnusagent.sources.http-source.handler.default_service_path = def_servpath
cygnusagent.sources.http-source.handler.events_ttl = 10
cygnusagent.sources.http-source.interceptors = ts de
cygnusagent.sources.http-source.interceptors.ts.type = timestamp
cygnusagent.sources.http-source.interceptors.de.type = es.tid.fiware.fiwareconnectors.cygnus.interceptors.DestinationExtractor$Builder
cygnusagent.sources.http-source.interceptors.de.matching_table = /usr/cygnus/conf/matching_table.conf
cygnusagent.sinks.mysql-sink.channel = mysql-channel
cygnusagent.sinks.mysql-sink.type = es.tid.fiware.fiwareconnectors.cygnus.sinks.OrionMySQLSink
cygnusagent.sinks.mysql-sink.mysql_host = 127.0.0.1
cygnusagent.sinks.mysql-sink.mysql_port = 3306
cygnusagent.sinks.mysql-sink.mysql_username = root
cygnusagent.sinks.mysql-sink.mysql_password = root
cygnusagent.sinks.mysql-sink.attr_persistence = row
cygnusagent.channels.mysql-channel.type = memory
cygnusagent.channels.mysql-channel.capacity = 1000
cygnusagent.channels.mysql-channel.transactionCapacity = 100
日志:
2015-05-20 18:51:59,475 (main) [INFO - com.telefonica.iot.cygnus.nodes.CygnusApplication.main(CygnusApplication.java:235)] Starting a Jetty server listening on port 8081 (Management Interface)
2015-05-20 18:51:59,519 (main) [INFO - org.mortbay.log.Slf4jLog.info(Slf4jLog.java:67)] Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog
2015-05-20 18:51:59,519 (main) [INFO - com.telefonica.iot.cygnus.nodes.CygnusApplication.main(CygnusApplication.java:238)] Starting Cygnus application
2015-05-20 18:51:59,528 (Thread-1) [INFO - org.mortbay.log.Slf4jLog.info(Slf4jLog.java:67)] jetty-6.1.26
2015-05-20 18:51:59,544 (lifecycleSupervisor-1-0) [INFO - org.apache.flume.node.PollingPropertiesFileConfigurationProvider.start(PollingPropertiesFileConfigurationProvider.java:61)] Configuration provider starting
2015-05-20 18:51:59,559 (conf-file-poller-0) [INFO - org.apache.flume.node.PollingPropertiesFileConfigurationProvider$FileWatcherRunnable.run(PollingPropertiesFileConfigurationProvider.java:133)] Reloading configuration file:/etc/flume/apache-flume-1.4.0-bin/conf/cygnus.conf
2015-05-20 18:51:59,575 (conf-file-poller-0) [INFO - org.apache.flume.conf.FlumeConfiguration$AgentConfiguration.addProperty(FlumeConfiguration.java:1016)] Processing:mysql-sink
2015-05-20 18:51:59,588 (conf-file-poller-0) [INFO - org.apache.flume.conf.FlumeConfiguration$AgentConfiguration.addProperty(FlumeConfiguration.java:1016)] Processing:mysql-sink
2015-05-20 18:51:59,588 (conf-file-poller-0) [INFO - org.apache.flume.conf.FlumeConfiguration$AgentConfiguration.addProperty(FlumeConfiguration.java:1016)] Processing:mysql-sink
2015-05-20 18:51:59,589 (conf-file-poller-0) [WARN - org.apache.flume.conf.FlumeConfiguration$AgentConfiguration.addProperty(FlumeConfiguration.java:1046)] Invalid property specified: channel
2015-05-20 18:51:59,592 (conf-file-poller-0) [WARN - org.apache.flume.conf.FlumeConfiguration.(FlumeConfiguration.java:101)] Configuration property ignored: cygnusagent.channel = mysql-channel
2015-05-20 18:51:59,593 (conf-file-poller-0) [INFO - org.apache.flume.conf.FlumeConfiguration$AgentConfiguration.addProperty(FlumeConfiguration.java:1016)] Processing:mysql-sink
2015-05-20 18:51:59,593 (conf-file-poller-0) [INFO - org.apache.flume.conf.FlumeConfiguration$AgentConfiguration.addProperty(FlumeConfiguration.java:930)] Added sinks: mysql-sink Agent: cygnusagent
2015-05-20 18:51:59,594 (conf-file-poller-0) [INFO - org.apache.flume.conf.FlumeConfiguration$AgentConfiguration.addProperty(FlumeConfiguration.java:1016)] Processing:mysql-sink
2015-05-20 18:51:59,594 (conf-file-poller-0) [INFO - org.apache.flume.conf.FlumeConfiguration$AgentConfiguration.addProperty(FlumeConfiguration.java:1016)] Processing:mysql-sink
2015-05-20 18:51:59,594 (conf-file-poller-0) [INFO - org.apache.flume.conf.FlumeConfiguration$AgentConfiguration.addProperty(FlumeConfiguration.java:1016)] Processing:mysql-sink
2015-05-20 18:51:59,621 (conf-file-poller-0) [WARN - org.apache.flume.conf.FlumeConfiguration$AgentConfiguration.isValid(FlumeConfiguration.java:319)] Agent configuration for 'cygnusagent' does not contain any channels. Marking it as invalid.
2015-05-20 18:51:59,621 (conf-file-poller-0) [WARN - org.apache.flume.conf.FlumeConfiguration.validateConfiguration(FlumeConfiguration.java:127)] Agent configuration invalid for agent 'cygnusagent'. It will be removed.
2015-05-20 18:51:59,622 (conf-file-poller-0) [INFO - org.apache.flume.conf.FlumeConfiguration.validateConfiguration(FlumeConfiguration.java:140)] Post-validation flume configuration contains configuration for agents: []
2015-05-20 18:51:59,622 (conf-file-poller-0) [WARN - org.apache.flume.node.AbstractConfigurationProvider.getConfiguration(AbstractConfigurationProvider.java:138)] No configuration found for this host:cygnusagent
2015-05-20 18:51:59,640 (Thread-1) [WARN - org.mortbay.log.Slf4jLog.warn(Slf4jLog.java:76)] failed SocketConnector@0.0.0.0:8081: java.net.BindException: Address already in use
2015-05-20 18:51:59,652 (Thread-1) [WARN - org.mortbay.log.Slf4jLog.warn(Slf4jLog.java:76)] failed Server@62526d1d: java.net.BindException: Address already in use
2015-05-20 18:51:59,652 (Thread-1) [FATAL - com.telefonica.iot.cygnus.http.JettyServer.run(JettyServer.java:62)] Fatal error running the Management Interface. Details=Address already in use
2015-05-20 18:51:59,669 (conf-file-poller-0) [INFO - org.apache.flume.node.Application.startAllComponents(Application.java:138)] Starting new configuration:{ sourceRunners:{} sinkRunners:{} channels:{} }
2015-05-20 18:51:59,723 (conf-file-poller-0) [INFO - org.apache.flume.node.Application.stopAllComponents(Application.java:101)] Shutting down configuration: { sourceRunners:{} sinkRunners:{} channels:{} }
2015-05-20 18:51:59,724 (conf-file-poller-0) [INFO - org.apache.flume.node.Application.startAllComponents(Application.java:138)] Starting new configuration:{ sourceRunners:{} sinkRunners:{} channels:{} }
如您在此日志中所见:
2015-05-20 18:51:59,589 (conf-file-poller-0) [WARN - org.apache.flume.conf.FlumeConfiguration$AgentConfiguration.addProperty(FlumeConfiguration.java:1046)] Invalid property specified: channel
由于属性 channel
无效,因此没有配置频道。取而代之的是,您必须使用 channels
:
cygnusagent.channels = mysql-channel
请考虑使用 Cygnus template to create your configuration (there is a section in the README。
日志的问题之一是:
2015-05-20 18:51:59,652 (Thread-1) [FATAL - com.telefonica.iot.cygnus.http.JettyServer.run(JettyServer.java:62)] Fatal error running the Management Interface. Details=Address already in use
这是由于 运行 cygnus 的一项试验中产生的垃圾过程。通过杀死进程解决。
还进行了其他响应中建议的更改以清除所有警告。