flume 和测试 flume 的 运行 结果
The run result of flume and test flume
my flume configuration file is as follows:
a1.sources = r1
a1.sinks = k1
a1.channels = c1
# Describe/configure the source
a1.sources.r1.type = exec
a1.sources.r1.channels = c1
a1.sources.r1.command = tail -F /home/hadoop/flume-1.5.0-bin/log_exec_tail
# Describe the sink
a1.sinks.k1.type = logger
# Use a channel which buffers events in memory
a1.channels.c1.type = memory
a1.channels.c1.capacity = 1000
a1.channels.c1.transactionCapacity = 100
# Bind the source and sink to the channel
a1.sources.r1.channels = c1
a1.sinks.k1.channel = c1
并使用以下 stript 启动我的 flume 代理:
bin/flume-ng agent -n a1 -c conf -f conf/flume_log.conf -Dflume.root.logger=INFO,console
问题一:运行结果如下,不知道运行成功与否!
问题2:还有下面的句子不知道是什么意思 "the queation of flume test":
注意:要测试 Flume 代理是否正常 运行ning,请打开一个新终端 window 并将目录更改为 /home/horton/solutions/:
霍顿@ip:~$ cd /home/horton/solutions/
运行 以下脚本将日志条目写入 nodemanager.log:
$./test_flume_log.sh
如果成功,您应该会在 HDFS 的 /user/horton/flume_sink 目录中看到新文件
停止 logagent Flume agent
根据您的 flume 配置,每当文件 /home/hadoop/flume-1.5.0-bin/log_exec_tail
发生更改时,它都会执行尾部操作并将结果附加到控制台中。
所以要测试它是否正常工作,
1. run the command bin/flume-ng agent -n a1 -c conf -f conf/flume_log.conf -Dflume.root.logger=INFO,console
2. Open a terminal and add few lines in the file /home/hadoop/flume-1.5.0-bin/log_exec_tail
3. Save it
4. Now check the terminal where you triggered flume command
5. You can see newly added lines displayed
my flume configuration file is as follows:
a1.sources = r1
a1.sinks = k1
a1.channels = c1
# Describe/configure the source
a1.sources.r1.type = exec
a1.sources.r1.channels = c1
a1.sources.r1.command = tail -F /home/hadoop/flume-1.5.0-bin/log_exec_tail
# Describe the sink
a1.sinks.k1.type = logger
# Use a channel which buffers events in memory
a1.channels.c1.type = memory
a1.channels.c1.capacity = 1000
a1.channels.c1.transactionCapacity = 100
# Bind the source and sink to the channel
a1.sources.r1.channels = c1
a1.sinks.k1.channel = c1
并使用以下 stript 启动我的 flume 代理: bin/flume-ng agent -n a1 -c conf -f conf/flume_log.conf -Dflume.root.logger=INFO,console
问题一:运行结果如下,不知道运行成功与否!
问题2:还有下面的句子不知道是什么意思 "the queation of flume test":
注意:要测试 Flume 代理是否正常 运行ning,请打开一个新终端 window 并将目录更改为 /home/horton/solutions/: 霍顿@ip:~$ cd /home/horton/solutions/ 运行 以下脚本将日志条目写入 nodemanager.log: $./test_flume_log.sh 如果成功,您应该会在 HDFS 的 /user/horton/flume_sink 目录中看到新文件 停止 logagent Flume agent
根据您的 flume 配置,每当文件 /home/hadoop/flume-1.5.0-bin/log_exec_tail
发生更改时,它都会执行尾部操作并将结果附加到控制台中。
所以要测试它是否正常工作,
1. run the command bin/flume-ng agent -n a1 -c conf -f conf/flume_log.conf -Dflume.root.logger=INFO,console
2. Open a terminal and add few lines in the file /home/hadoop/flume-1.5.0-bin/log_exec_tail
3. Save it
4. Now check the terminal where you triggered flume command
5. You can see newly added lines displayed