使用 elasticsearch 的 jupyter python 笔记本

jupyter python notebook using elasticsearch

我在 DSX 中将 elasticsearch 与 jupyter python 笔记本一起使用。当我将数据帧写入对象存储时,出现错误:

ratings_df.write.format("org.elasticsearch.spark.sql").save("swift://DSConnections.spark/ratings.es")

Py4JJavaError: An error occurred while calling o96.save. : java.lang.ClassNotFoundException: Failed to find data source: org.elasticsearch.spark.sql. Please find packages at http://spark-packages.org

您需要安装elasticsearch连接器。

import pixiedust pixiedust.installPackage("org.elasticsearch:elasticsearch-spark_2.10:2.4.4")

PixiedustManager 参考资料

http://datascience.ibm.com/docs/content/analyze-data/Package-Manager.html#installfrommavensearch

谢谢, 查尔斯.