雪花外部函数 - Parallel/Concurrent
Snowflake External Function - Parallel/Concurrent
我对雪花外部函数的并行性有疑问。这是我的理解:
- 外部函数将一组要处理的行发送到远程服务(在我的例子中是 azure 函数 httpTrigger)。
- 远程服务处理这些行并发送输出 - 每行一个输出。
我的问题是外部函数是否发送多个 httpTrigger 请求,并为每个请求异步发送一组行。 snowflake 外部函数请求中是否预置并发?我知道 Azure 中的并发功能可以扩展。能指导一下吗
来自文档:
Furthermore, the concurrency estimate should take into account that Snowflake can parallelize external function calls. A single query from a single user might cause multiple calls to the remote service in parallel. Several factors affect the number of concurrent calls from Snowflake to a proxy service or remote service, including:
https://docs.snowflake.com/en/sql-reference/external-functions-implementation.html#concurrency
我对雪花外部函数的并行性有疑问。这是我的理解:
- 外部函数将一组要处理的行发送到远程服务(在我的例子中是 azure 函数 httpTrigger)。
- 远程服务处理这些行并发送输出 - 每行一个输出。
我的问题是外部函数是否发送多个 httpTrigger 请求,并为每个请求异步发送一组行。 snowflake 外部函数请求中是否预置并发?我知道 Azure 中的并发功能可以扩展。能指导一下吗
来自文档:
Furthermore, the concurrency estimate should take into account that Snowflake can parallelize external function calls. A single query from a single user might cause multiple calls to the remote service in parallel. Several factors affect the number of concurrent calls from Snowflake to a proxy service or remote service, including:
https://docs.snowflake.com/en/sql-reference/external-functions-implementation.html#concurrency