storm ui 中的拓扑没有发出或传输任何元组
No tuples is emitted or transffered by topology in storm ui
我正在使用带有 elasticsearch 7.2.0 的 stormcrawler 1.16。我有一个带有 acrhetype 的 built 项目。
命令 i 运行 提交拓扑
storm jar target/stormcrawler-1.0-SNAPSHOT.jar org.apache.storm.flux.Flux --remote es-crawler.flux
我在输出中得到这个 -
Parsing file: /home/ubuntu/stormcrawler/es-crawler.flux
835 [main] INFO o.a.s.f.p.FluxParser - loading YAML from input
stream...
841 [main] INFO o.a.s.f.p.FluxParser - Not performing property
substitution.
841 [main] INFO o.a.s.f.p.FluxParser - Not performing environment
variable substitution.
900 [main] INFO o.a.s.f.p.FluxParser - Loading includes from
resource: /crawler-default.yaml
901 [main] INFO o.a.s.f.p.FluxParser - loading YAML from input
stream...
903 [main] INFO o.a.s.f.p.FluxParser - Not performing property
substitution.
903 [main] INFO o.a.s.f.p.FluxParser - Not performing environment
variable substitution.
Configuration (interpreted):
然后我最后输出行 -
2014 [main] WARN o.a.s.u.Utils - STORM-VERSION new 1.2.3 old 1.2.3
2376 [main] INFO o.a.s.StormSubmitter - Finished submitting topology: crawler
但是当我在 storm ui 中检查这个爬虫拓扑时，然后在拓扑统计中，这个爬虫拓扑没有发出或传输任何元组。
我在下面的 link 中提供了风暴 ui 的快照。
[在拓扑统计中，没有发出或传输元组。我该如何解决这个问题？ 1
您的 POM 文件可能缺少 storm-crawler-elasticsearch 依赖项。
您可以将您的代码与 storm-crawler-elasticsearch-archetype 生成的代码进行比较，这应该会给您一个有效的配置。
Use the archetype for Elasticsearch with:
mvn archetype:generate
-DarchetypeGroupId=com.digitalpebble.stormcrawler -DarchetypeArtifactId=storm-crawler-elasticsearch-archetype -DarchetypeVersion=LATEST
You'll be asked to enter a groupId (e.g. com.mycompany.crawler), an
artefactId (e.g. stormcrawler), a version and package name.
This will not only create a fully formed project containing a POM with
the dependency above but also a set of resources, configuration files
and a topology class. Enter the directory you just created (should be
the same as the artefactId you specified earlier) and follow the
instructions on the README file.
我正在使用带有 elasticsearch 7.2.0 的 stormcrawler 1.16。我有一个带有 acrhetype 的 built 项目。 命令 i 运行 提交拓扑
storm jar target/stormcrawler-1.0-SNAPSHOT.jar org.apache.storm.flux.Flux --remote es-crawler.flux
我在输出中得到这个 -
Parsing file: /home/ubuntu/stormcrawler/es-crawler.flux
835 [main] INFO o.a.s.f.p.FluxParser - loading YAML from input
stream...
841 [main] INFO o.a.s.f.p.FluxParser - Not performing property
substitution.
841 [main] INFO o.a.s.f.p.FluxParser - Not performing environment
variable substitution.
900 [main] INFO o.a.s.f.p.FluxParser - Loading includes from
resource: /crawler-default.yaml
901 [main] INFO o.a.s.f.p.FluxParser - loading YAML from input
stream...
903 [main] INFO o.a.s.f.p.FluxParser - Not performing property
substitution.
903 [main] INFO o.a.s.f.p.FluxParser - Not performing environment
variable substitution.
Configuration (interpreted):
然后我最后输出行 -
2014 [main] WARN o.a.s.u.Utils - STORM-VERSION new 1.2.3 old 1.2.3
2376 [main] INFO o.a.s.StormSubmitter - Finished submitting topology: crawler
但是当我在 storm ui 中检查这个爬虫拓扑时，然后在拓扑统计中，这个爬虫拓扑没有发出或传输任何元组。
我在下面的 link 中提供了风暴 ui 的快照。
[在拓扑统计中，没有发出或传输元组。我该如何解决这个问题？ 1
您的 POM 文件可能缺少 storm-crawler-elasticsearch 依赖项。
您可以将您的代码与 storm-crawler-elasticsearch-archetype 生成的代码进行比较，这应该会给您一个有效的配置。
Use the archetype for Elasticsearch with:
mvn archetype:generate -DarchetypeGroupId=com.digitalpebble.stormcrawler -DarchetypeArtifactId=storm-crawler-elasticsearch-archetype -DarchetypeVersion=LATEST
You'll be asked to enter a groupId (e.g. com.mycompany.crawler), an artefactId (e.g. stormcrawler), a version and package name.
This will not only create a fully formed project containing a POM with the dependency above but also a set of resources, configuration files and a topology class. Enter the directory you just created (should be the same as the artefactId you specified earlier) and follow the instructions on the README file.