监控 Snowpipe 的成本(在 Snowflake 中)?

Monitoring the cost of Snowpipe (in Snowflake)?

(一位 Snowflake 用户在我们的传统问答论坛中提出了以下问题)

有没有办法将 snowpipe 置于资源监控之下?或者有没有类似的方法可以监控雪管的成本?


(据 Snowflake 专业服务团队的一位技术客户经理称)

目前似乎没有该功能。来自文档:

https://docs.snowflake.net/manuals/user-guide/resource-monitors.html

"In addition, an account-level resource monitor does not control credit usage by the Snowflake-provided warehouses (used for Snowpipe, automatic reclustering, and materialized views); the monitor only controls the virtual warehouses created in your account."

"An account-level resource monitor only controls the virtual warehouses explicitly created in your account; it does not control credit usage by the Snowflake-provided warehouses (for Snowpipe, Automatic Clustering, and materialized views)."

您可以在 PIPE_USAGE_HISTORY table 中监控您的学分。

信息架构

https://docs.snowflake.net/manuals/sql-reference/functions/pipe_usage_history.html

帐户使用情况

https://docs.snowflake.net/manuals/sql-reference/account-usage/pipe_usage_history.html

使用该信息,您可以使用 PIPE_EXECUTION_PAUSED

暂停 PIPE

https://docs.snowflake.net/manuals/sql-reference/sql/alter-pipe.html

也许是一个预定的存储过程来监视和 notify/pause 在存储过程中设置的级别?我没有这样做,但认为它应该在理论上可行。希望对您有所帮助。


有兴趣看看其他人是否有任何 "outside of the box" 解决上述问题的想法...也许是一种解决方法?