Data Mountaineer KCQL 支持 Json 个数组
Data Mountaineer KCQL support for Json Arrays
我是 kafka 的新手,我想知道 KCQL 查询是否支持 json 数组?
我打算将数据放入 influxdb
我将以以下格式每秒获取 JSON 数组流
[{"timestamp":"2017-10-24T12:43:39.359361982+05:30","namespace":"/intel/procfs/meminfo/high_free","data":0,"unit":"","tags":{"plugin_running_on":"AELAB110"},"version":4,"last_advertised_time":"2017-10-24T12:43:39.359519915+05:30"},{"timestamp":"2017-10-24T12:43:39.359406603+05:30","namespace":"/intel/procfs/meminfo/low_free","data":0,"unit":"","tags":{"plugin_running_on":"AELAB110"},"version":4,"last_advertised_time":"2017-10-24T12:43:39.359524142+05:30"},{"timestamp":"2017-10-24T12:43:39.359467873+05:30","namespace":"/intel/procfs/meminfo/shmem","data":35295232,"unit":"","tags":{"plugin_running_on":"AELAB110"},"version":4,"last_advertised_time":"2017-10-24T12:43:39.359526063+05:30"}]
我正在尝试将这个 json 数组放入 influxdb 中....有什么办法可以做到这一点吗?
您可以按原样将数据提取到 Kafka 中,然后使用 Kafka Streams 并通过 flatMap()
将每个数组拆分为单独的消息。结果可以比我们通过 Connect API.
导出到 InfluxDB
我是 kafka 的新手,我想知道 KCQL 查询是否支持 json 数组? 我打算将数据放入 influxdb 我将以以下格式每秒获取 JSON 数组流
[{"timestamp":"2017-10-24T12:43:39.359361982+05:30","namespace":"/intel/procfs/meminfo/high_free","data":0,"unit":"","tags":{"plugin_running_on":"AELAB110"},"version":4,"last_advertised_time":"2017-10-24T12:43:39.359519915+05:30"},{"timestamp":"2017-10-24T12:43:39.359406603+05:30","namespace":"/intel/procfs/meminfo/low_free","data":0,"unit":"","tags":{"plugin_running_on":"AELAB110"},"version":4,"last_advertised_time":"2017-10-24T12:43:39.359524142+05:30"},{"timestamp":"2017-10-24T12:43:39.359467873+05:30","namespace":"/intel/procfs/meminfo/shmem","data":35295232,"unit":"","tags":{"plugin_running_on":"AELAB110"},"version":4,"last_advertised_time":"2017-10-24T12:43:39.359526063+05:30"}]
我正在尝试将这个 json 数组放入 influxdb 中....有什么办法可以做到这一点吗?
您可以按原样将数据提取到 Kafka 中,然后使用 Kafka Streams 并通过 flatMap()
将每个数组拆分为单独的消息。结果可以比我们通过 Connect API.