最新 (master/snapshot) Spark 文档 - 在线或 运行 本地
Latest (master/snapshot) Spark documentation - either online or run locally
是否有最新的 spark 文档已构建并可用的位置？
例如，1.3.0 候选发布分支在五天前被删除，但无法从 apache 站点获得 - 最新的是已经在生产中的 1.2.0。
更好的是 Amplab Jenkins 构建的输出。但也许有人只是定期将其发布在可公开访问的位置？
或者从 Spark markdown 生成 html 的过程是什么？我可以很容易地建立一个本地网络服务器来为他们服务。
对于我的问题的第二部分 - 如何在本地生成文档 - docs/README.md 确实有说明。
结果显示在这里；
我们在这里（注意 localhost:4000 和 Spark 1.3.0 版 - 尚未发布）
说明复制在这里：
The markdown code can be compiled to HTML using the Jekyll
tool. Jekyll and a few dependencies must be
installed for this to work. We recommend installing via the Ruby Gem
dependency manager. Since the exact HTML output varies between
versions of Jekyll and its dependencies, we list specific versions
here in some cases:
$ sudo gem install jekyll
$ sudo gem install jekyll-redirect-from
Execute jekyll from the docs/ directory. Compiling the site with
Jekyll will create a directory called _site containing index.html as
well as the rest of the compiled files.
You can modify the default Jekyll build as follows:
# Skip generating API docs (which takes a while)
$ SKIP_API=1 jekyll build
# Serve content locally on port 4000
$ jekyll serve --watch
# Build the site with extra features used on the live page
$ PRODUCTION=1 jekyll build
Pygments
We also use pygments (http://pygments.org) for syntax highlighting in
documentation markdown pages, so you will also need to install that
(it requires Python) by running sudo pip install Pygments.
To mark a block of code in your markdown to be syntax highlighted by
jekyll during the compile phase, use the following sytax:
{% highlight scala %}
// Your scala code goes here, you can replace scala with many other
// supported languages too.
{% endhighlight %}
Sphinx
We use Sphinx to generate Python API docs, so you will need to install
it by running sudo pip install sphinx.
每晚发布文档快照和构建工件在 Spark 路线图上；参见 https://issues.apache.org/jira/browse/SPARK-1517。
是否有最新的 spark 文档已构建并可用的位置？
例如，1.3.0 候选发布分支在五天前被删除，但无法从 apache 站点获得 - 最新的是已经在生产中的 1.2.0。
更好的是 Amplab Jenkins 构建的输出。但也许有人只是定期将其发布在可公开访问的位置？
或者从 Spark markdown 生成 html 的过程是什么？我可以很容易地建立一个本地网络服务器来为他们服务。
对于我的问题的第二部分 - 如何在本地生成文档 - docs/README.md 确实有说明。
结果显示在这里；
我们在这里（注意 localhost:4000 和 Spark 1.3.0 版 - 尚未发布）
说明复制在这里：
The markdown code can be compiled to HTML using the Jekyll tool.
Jekylland a few dependencies must be installed for this to work. We recommend installing via the Ruby Gem dependency manager. Since the exact HTML output varies between versions of Jekyll and its dependencies, we list specific versions here in some cases:$ sudo gem install jekyll $ sudo gem install jekyll-redirect-fromExecute
jekyllfrom thedocs/directory. Compiling the site with Jekyll will create a directory called_sitecontaining index.html as well as the rest of the compiled files.You can modify the default Jekyll build as follows:
# Skip generating API docs (which takes a while) $ SKIP_API=1 jekyll build # Serve content locally on port 4000 $ jekyll serve --watch # Build the site with extra features used on the live page $ PRODUCTION=1 jekyll buildPygments
We also use pygments (http://pygments.org) for syntax highlighting in documentation markdown pages, so you will also need to install that (it requires Python) by running
sudo pip install Pygments.To mark a block of code in your markdown to be syntax highlighted by jekyll during the compile phase, use the following sytax:
{% highlight scala %} // Your scala code goes here, you can replace scala with many other // supported languages too. {% endhighlight %}Sphinx
We use Sphinx to generate Python API docs, so you will need to install it by running
sudo pip install sphinx.
每晚发布文档快照和构建工件在 Spark 路线图上；参见 https://issues.apache.org/jira/browse/SPARK-1517。