EMR 上的检查点 s3p flink

Checkpoint s3p flink on EMR

我在 EMR 的 flink 中使用 s3p 的检查点有问题。

创建 EMR 集群时,我在 Presto 中打勾并按照 https://ci.apache.org/projects/flink/flink-docs-stable/ops/plugins.html 中的说明添加了 jar 文件。

但是flink中s3p查点的时候,还是报错

Caused by: org.apache.flink.core.fs.UnsupportedFileSystemSchemeException: Could not find a file system implementation for scheme 's3p'. The scheme is directly supported by Flink through the following plugin: flink-s3-fs-presto. Please ensure that each plugin resides within its own subfolder within the plugins directory. See https://ci.apache.org/projects/flink/flink-docs-stable/ops/plugins.html for more information. If you want to use a Hadoop file system for that scheme, please add the scheme to the configuration fs.allowed-fallback-filesystems. For a full list of supported file systems, please see https://ci.apache.org/projects/flink/flink-docs-stable/ops/filesystems/.

能帮我看看EMR的flink上的checkpoint s3p吗? 谢谢

EMR中的Presto与Flink中的flink-s3-fs-presto插件无关。以后你可以不勾选它(除了炸毁东西外也没有坏处)。

最可能的原因是您忘记在插件文件夹中创建子文件夹。你能给我一个你的 Flink 发行版的 ls 吗?