本文共 1898 字，大约阅读时间需要 6 分钟。

原理

案例

使用Flume1监控一个端口，其sink组中的sink分别对接Flume2和Flume3，采用FailoverSinkProcessor，实现故障转移的功能。

配置文件

# agent1# 定义sources、channels、sinksa1.sources = r1a1.channels = c1a1.sinks = k1 k2# 配置sourcea1.sources.r1.type = netcata1.sources.r1.bind = hadoop01a1.sources.r1.port = 11111# 配置channela1.channels.c1.type = memory# 配置sink组a1.sinkgroups = g1a1.sinkgroups.g1.sinks = k1 k2# 配置SinkProcessor：failover是故障转移，load_balance是负载均衡# a1.sinkgroups.g1.processor.type = failovera1.sinkgroups.g1.processor.type = load_balance# 如果是负载均衡，还需要配置负载均衡策略 round_robin或者randoma1.sinkgroups.g1.processor.selector = round_robin# 配置sink:k1发送数据到hadoop02a1.sinks.k1.type = avroa1.sinks.k1.hostname = hadoop02a1.sinks.k1.port = 22222# 配置sink k2:数据发送到hadoop03的33333端口a1.sinks.k2.type = avroa1.sinks.k2.hostname = hadoop03a1.sinks.k2.port = 33333# 配置source、channel、sink关系a1.sources.r1.channels = c1a1.sinks.k1.channel = c1a1.sinks.k2.channel = c1

# agent2# 定义sources、channels、sinksa1.sources = r1a1.channels = c1a1.sinks = k1# 配置source 从指定地址的端口接收数据a1.sources.r1.type = avroa1.sources.r1.bind = hadoop02a1.sources.r1.port = 22222# 配置channela1.channels.c1.type = memory# 配置sink a1.sinks.k1.type = logger# 测试logger打印到控制台# 配置source、sink、channel关系a1.sources.r1.channels = c1a1.sinks.k1.channel = c1

# agent3# 定义sources、channels、sinksa1.sources = r1a1.channels = c1a1.sinks = k1# 配置source 从指定地址的端口接收数据a1.sources.r1.type = avroa1.sources.r1.bind = hadoop03a1.sources.r1.port = 33333# 配置channela1.channels.c1.type = memory# 配置sink a1.sinks.k1.type = logger# 测试logger打印到控制台# 配置source、sink、channel关系a1.sources.r1.channels = c1a1.sinks.k1.channel = c1

转载地址：https://blog.csdn.net/FlatTiger/article/details/114015942 如侵犯您的版权，请留言回复原文章的地址，我们会给您删除此文章，给您带来不便请您谅解！