链接 Flink Sink
Chaining Flink Sinks
背景
- 本人是Flink新手，Apache Storm背景出身
- 致力于开发无损 gRPC 接收器
症结
- 有限号。将根据 gRPC 端点返回的错误代码进行重试
- 之后数据会被flush到Kafka Queue中进行离线处理
- 重试决定将基于返回的错误代码。
问题
是否可以链接另一个接收器，以便响应（成功或错误）也可用于任何自定义处理的下游？
答案是根据 by Dominik Wosiński
It's not possible in general, You will have to work around that, either by providing both functionalities in a single sink or using some existing fuctions like AsyncIO to write to gRPC and then sink the failures to kafka, but that may be harder if You need any strong guarantees.
背景
- 本人是Flink新手，Apache Storm背景出身
- 致力于开发无损 gRPC 接收器
症结
- 有限号。将根据 gRPC 端点返回的错误代码进行重试
- 之后数据会被flush到Kafka Queue中进行离线处理
- 重试决定将基于返回的错误代码。
问题
是否可以链接另一个接收器，以便响应（成功或错误）也可用于任何自定义处理的下游？
答案是根据
It's not possible in general, You will have to work around that, either by providing both functionalities in a single sink or using some existing fuctions like AsyncIO to write to gRPC and then sink the failures to kafka, but that may be harder if You need any strong guarantees.