有什么方法可以让我们在kafka中看到查询运行 for stream/ table？

Question

我想在 Kafka 中查看我的 stream/table 的查询运行。

Create stream foo as select * from bar where distuinguisher='xxx';

 Message                    
----------------------------
 Stream created and running 
----------------------------

一旦有人创建了 stream/table 我只能查询 stream/table。有什么方法可以让我看到流背后的逻辑或完整查询。

Answer 1

DESCRIBE EXTENDED 将为您提供此信息。您还可以使用 SHOW QUERIES 查看所有运行的查询。

例如：

ksql> DESCRIBE EXTENDED FOO;

Name                 : FOO
Type                 : STREAM
Key field            :
Key format           : STRING
Timestamp field      : Not set - using <ROWTIME>
Value format         : JSON
Kafka topic          : FOO (partitions: 1, replication: 1)

 Field   | Type
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ROWTIME | BIGINT           (system)
 ROWKEY  | VARCHAR(STRING)  (system)
 LOGGER  | VARCHAR(STRING)
 LEVEL   | VARCHAR(STRING)
 TIME    | BIGINT
 MESSAGE | STRUCT<TYPE INTEGER, DESERIALIZATIONERROR STRUCT<ERRORMESSAGE VARCHAR(STRING), RECORDB64 VARCHAR(STRING), CAUSE ARRAY<VARCHAR(STRING)>>, RECORDPROCESSINGERROR STRUCT<ERRORMESSAGE VARCHAR(STRING), RECORD VARCHAR(STRING), CAUSE ARRAY<VARCHAR(STRING)>>, PRODUCTIONERROR STRUCT<ERRORMESSAGE VARCHAR(STRING)>>
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Queries that write from this STREAM
-----------------------------------
CSAS_FOO_1 : CREATE STREAM FOO WITH (KAFKA_TOPIC='FOO', PARTITIONS=1, REPLICAS=1) AS SELECT *
FROM KSQL_PROCESSING_LOG KSQL_PROCESSING_LOG
EMIT CHANGES;

For query topology and execution plan please run: EXPLAIN <QueryId>

Local runtime statistics
------------------------


(Statistics of the local KSQL server interaction with the Kafka topic FOO)
ksql>

ksql> SHOW QUERIES;

 Query ID   | Kafka Topic | Query String
-------------------------------------------------------------------------------------------------------------
 CSAS_FOO_1 | FOO         | CREATE STREAM FOO WITH (KAFKA_TOPIC='FOO', PARTITIONS=1, REPLICAS=1) AS SELECT *
FROM KSQL_PROCESSING_LOG KSQL_PROCESSING_LOG
EMIT CHANGES;
-------------------------------------------------------------------------------------------------------------
For detailed information on a Query run: EXPLAIN <Query ID>;
ksql>

有什么方法可以让我们在kafka中看到查询运行 for stream/ table？

Is there any way by which we can see query running for stream/ table in kafka?

apache-kafka

ksqldb

confluent-platform