运行 本地模式的风暴爬虫,不依赖zookeeper,nimbus
running storm crawler in local mode without the dependency of zookeeper ,nimbus
我将 url 存储在 mysql 中,将索引数据存储在 lucene 中。我是 运行 风暴爬虫作为使用 tomcat 的多台机器中的应用程序服务器。我真的需要 zookeeper、nimbus 和 storm 来在服务器之间分发 url(来自 mysql)..??
Q: Do I need a Storm cluster to run StormCrawler?
A: No. It can run in local mode and will just use the Storm libraries as dependencies. It makes sense to install Storm in pseudo-distributed mode though so that you can use its UI to monitor the topologies.
另见
我将 url 存储在 mysql 中,将索引数据存储在 lucene 中。我是 运行 风暴爬虫作为使用 tomcat 的多台机器中的应用程序服务器。我真的需要 zookeeper、nimbus 和 storm 来在服务器之间分发 url(来自 mysql)..??
Q: Do I need a Storm cluster to run StormCrawler?
A: No. It can run in local mode and will just use the Storm libraries as dependencies. It makes sense to install Storm in pseudo-distributed mode though so that you can use its UI to monitor the topologies.
另见