EMR 上的检查点 s3p flink
Checkpoint s3p flink on EMR
我在 EMR 的 flink 中使用 s3p 的检查点有问题。
创建 EMR 集群时,我在 Presto 中打勾并按照 https://ci.apache.org/projects/flink/flink-docs-stable/ops/plugins.html 中的说明添加了 jar 文件。
但是flink中s3p查点的时候,还是报错
Caused by: org.apache.flink.core.fs.UnsupportedFileSystemSchemeException: Could not find a file system implementation for scheme 's3p'. The scheme is directly supported by Flink through the following plugin: flink-s3-fs-presto. Please ensure that each plugin resides within its own subfolder within the plugins directory. See https://ci.apache.org/projects/flink/flink-docs-stable/ops/plugins.html for more information. If you want to use a Hadoop file system for that scheme, please add the scheme to the configuration fs.allowed-fallback-filesystems. For a full list of supported file systems, please see https://ci.apache.org/projects/flink/flink-docs-stable/ops/filesystems/.
能帮我看看EMR的flink上的checkpoint s3p吗?
谢谢
EMR中的Presto与Flink中的flink-s3-fs-presto
插件无关。以后你可以不勾选它(除了炸毁东西外也没有坏处)。
最可能的原因是您忘记在插件文件夹中创建子文件夹。你能给我一个你的 Flink 发行版的 ls
吗?
我在 EMR 的 flink 中使用 s3p 的检查点有问题。
创建 EMR 集群时,我在 Presto 中打勾并按照 https://ci.apache.org/projects/flink/flink-docs-stable/ops/plugins.html 中的说明添加了 jar 文件。
但是flink中s3p查点的时候,还是报错
Caused by: org.apache.flink.core.fs.UnsupportedFileSystemSchemeException: Could not find a file system implementation for scheme 's3p'. The scheme is directly supported by Flink through the following plugin: flink-s3-fs-presto. Please ensure that each plugin resides within its own subfolder within the plugins directory. See https://ci.apache.org/projects/flink/flink-docs-stable/ops/plugins.html for more information. If you want to use a Hadoop file system for that scheme, please add the scheme to the configuration fs.allowed-fallback-filesystems. For a full list of supported file systems, please see https://ci.apache.org/projects/flink/flink-docs-stable/ops/filesystems/.
能帮我看看EMR的flink上的checkpoint s3p吗? 谢谢
EMR中的Presto与Flink中的flink-s3-fs-presto
插件无关。以后你可以不勾选它(除了炸毁东西外也没有坏处)。
最可能的原因是您忘记在插件文件夹中创建子文件夹。你能给我一个你的 Flink 发行版的 ls
吗?