Flume 散乱汇总

 

1. 启动命令中 no-reload-conf 参数：没有此参数，会动态加载配置文件，默认每30秒加载一次配置文；有此参数，则只在启动时加载一次配置文件

 

 

 

hdfs sink 压 . 缩

 

>> agent.sinks.lzo-hdfs-write.type = hdfs
>> agent.sinks.lzo-hdfs-write.hdfs.path = hdfs://10.34.4.55:8020/tmp/
>> agent.sinks.lzo-hdfs-write.hdfs.filePrefix = test%Y
>> agent.sinks.lzo-hdfs-write.channel = lzo-memory-channel
>> agent.sinks.lzo-hdfs-write.hdfs.rollInterval = 3600
>> agent.sinks.lzo-hdfs-write.hdfs.rollSize = 209715200
>> agent.sinks.lzo-hdfs-write.hdfs.rollCount = 0
>> agent.sinks.lzo-hdfs-write.hdfs.batchSize = 1000
>> agent.sinks.lzo-hdfs-write.hdfs.codeC = lzo
>> agent.sinks.lzo-hdfs-write.hdfs.fileType = CompressedStream