http://git-wip-us.apache.org/repos/asf/spark-website/blob/8781cd3c/site/news/spark-mailing-lists-moving-to-apache.html ---------------------------------------------------------------------- diff --git a/site/news/spark-mailing-lists-moving-to-apache.html b/site/news/spark-mailing-lists-moving-to-apache.html index 2c10518..45d067b 100644 --- a/site/news/spark-mailing-lists-moving-to-apache.html +++ b/site/news/spark-mailing-lists-moving-to-apache.html @@ -150,6 +150,9 @@ <h5>Latest News</h5> <ul class="list-unstyled"> + <li><a href="/news/spark-wins-cloudsort-100tb-benchmark.html">Spark wins CloudSort Benchmark as the most efficient engine</a> + <span class="small">(Nov 15, 2016)</span></li> + <li><a href="/news/spark-2-0-2-released.html">Spark 2.0.2 released</a> <span class="small">(Nov 14, 2016)</span></li> @@ -159,9 +162,6 @@ <li><a href="/news/spark-2-0-1-released.html">Spark 2.0.1 released</a> <span class="small">(Oct 03, 2016)</span></li> - <li><a href="/news/spark-2-0-0-released.html">Spark 2.0.0 released</a> - <span class="small">(Jul 26, 2016)</span></li> - </ul> <p class="small" style="text-align: right;"><a href="/news/index.html">Archive</a></p> </div>
http://git-wip-us.apache.org/repos/asf/spark-website/blob/8781cd3c/site/news/spark-meetups.html ---------------------------------------------------------------------- diff --git a/site/news/spark-meetups.html b/site/news/spark-meetups.html index 5dc78fa..5e2eadc 100644 --- a/site/news/spark-meetups.html +++ b/site/news/spark-meetups.html @@ -150,6 +150,9 @@ <h5>Latest News</h5> <ul class="list-unstyled"> + <li><a href="/news/spark-wins-cloudsort-100tb-benchmark.html">Spark wins CloudSort Benchmark as the most efficient engine</a> + <span class="small">(Nov 15, 2016)</span></li> + <li><a href="/news/spark-2-0-2-released.html">Spark 2.0.2 released</a> <span class="small">(Nov 14, 2016)</span></li> @@ -159,9 +162,6 @@ <li><a href="/news/spark-2-0-1-released.html">Spark 2.0.1 released</a> <span class="small">(Oct 03, 2016)</span></li> - <li><a href="/news/spark-2-0-0-released.html">Spark 2.0.0 released</a> - <span class="small">(Jul 26, 2016)</span></li> - </ul> <p class="small" style="text-align: right;"><a href="/news/index.html">Archive</a></p> </div> http://git-wip-us.apache.org/repos/asf/spark-website/blob/8781cd3c/site/news/spark-screencasts-published.html ---------------------------------------------------------------------- diff --git a/site/news/spark-screencasts-published.html b/site/news/spark-screencasts-published.html index 829ce81..5b57d16 100644 --- a/site/news/spark-screencasts-published.html +++ b/site/news/spark-screencasts-published.html @@ -150,6 +150,9 @@ <h5>Latest News</h5> <ul class="list-unstyled"> + <li><a href="/news/spark-wins-cloudsort-100tb-benchmark.html">Spark wins CloudSort Benchmark as the most efficient engine</a> + <span class="small">(Nov 15, 2016)</span></li> + <li><a href="/news/spark-2-0-2-released.html">Spark 2.0.2 released</a> <span class="small">(Nov 14, 2016)</span></li> @@ -159,9 +162,6 @@ <li><a href="/news/spark-2-0-1-released.html">Spark 2.0.1 released</a> <span class="small">(Oct 03, 2016)</span></li> - <li><a href="/news/spark-2-0-0-released.html">Spark 2.0.0 released</a> - <span class="small">(Jul 26, 2016)</span></li> - </ul> <p class="small" style="text-align: right;"><a href="/news/index.html">Archive</a></p> </div> http://git-wip-us.apache.org/repos/asf/spark-website/blob/8781cd3c/site/news/spark-summit-2013-is-a-wrap.html ---------------------------------------------------------------------- diff --git a/site/news/spark-summit-2013-is-a-wrap.html b/site/news/spark-summit-2013-is-a-wrap.html index d068281..ba84c36 100644 --- a/site/news/spark-summit-2013-is-a-wrap.html +++ b/site/news/spark-summit-2013-is-a-wrap.html @@ -150,6 +150,9 @@ <h5>Latest News</h5> <ul class="list-unstyled"> + <li><a href="/news/spark-wins-cloudsort-100tb-benchmark.html">Spark wins CloudSort Benchmark as the most efficient engine</a> + <span class="small">(Nov 15, 2016)</span></li> + <li><a href="/news/spark-2-0-2-released.html">Spark 2.0.2 released</a> <span class="small">(Nov 14, 2016)</span></li> @@ -159,9 +162,6 @@ <li><a href="/news/spark-2-0-1-released.html">Spark 2.0.1 released</a> <span class="small">(Oct 03, 2016)</span></li> - <li><a href="/news/spark-2-0-0-released.html">Spark 2.0.0 released</a> - <span class="small">(Jul 26, 2016)</span></li> - </ul> <p class="small" style="text-align: right;"><a href="/news/index.html">Archive</a></p> </div> http://git-wip-us.apache.org/repos/asf/spark-website/blob/8781cd3c/site/news/spark-summit-2014-videos-posted.html ---------------------------------------------------------------------- diff --git a/site/news/spark-summit-2014-videos-posted.html b/site/news/spark-summit-2014-videos-posted.html index 4b6133f..dffeacd 100644 --- a/site/news/spark-summit-2014-videos-posted.html +++ b/site/news/spark-summit-2014-videos-posted.html @@ -150,6 +150,9 @@ <h5>Latest News</h5> <ul class="list-unstyled"> + <li><a href="/news/spark-wins-cloudsort-100tb-benchmark.html">Spark wins CloudSort Benchmark as the most efficient engine</a> + <span class="small">(Nov 15, 2016)</span></li> + <li><a href="/news/spark-2-0-2-released.html">Spark 2.0.2 released</a> <span class="small">(Nov 14, 2016)</span></li> @@ -159,9 +162,6 @@ <li><a href="/news/spark-2-0-1-released.html">Spark 2.0.1 released</a> <span class="small">(Oct 03, 2016)</span></li> - <li><a href="/news/spark-2-0-0-released.html">Spark 2.0.0 released</a> - <span class="small">(Jul 26, 2016)</span></li> - </ul> <p class="small" style="text-align: right;"><a href="/news/index.html">Archive</a></p> </div> http://git-wip-us.apache.org/repos/asf/spark-website/blob/8781cd3c/site/news/spark-summit-2015-videos-posted.html ---------------------------------------------------------------------- diff --git a/site/news/spark-summit-2015-videos-posted.html b/site/news/spark-summit-2015-videos-posted.html index f211d33..32aecea 100644 --- a/site/news/spark-summit-2015-videos-posted.html +++ b/site/news/spark-summit-2015-videos-posted.html @@ -150,6 +150,9 @@ <h5>Latest News</h5> <ul class="list-unstyled"> + <li><a href="/news/spark-wins-cloudsort-100tb-benchmark.html">Spark wins CloudSort Benchmark as the most efficient engine</a> + <span class="small">(Nov 15, 2016)</span></li> + <li><a href="/news/spark-2-0-2-released.html">Spark 2.0.2 released</a> <span class="small">(Nov 14, 2016)</span></li> @@ -159,9 +162,6 @@ <li><a href="/news/spark-2-0-1-released.html">Spark 2.0.1 released</a> <span class="small">(Oct 03, 2016)</span></li> - <li><a href="/news/spark-2-0-0-released.html">Spark 2.0.0 released</a> - <span class="small">(Jul 26, 2016)</span></li> - </ul> <p class="small" style="text-align: right;"><a href="/news/index.html">Archive</a></p> </div> http://git-wip-us.apache.org/repos/asf/spark-website/blob/8781cd3c/site/news/spark-summit-agenda-posted.html ---------------------------------------------------------------------- diff --git a/site/news/spark-summit-agenda-posted.html b/site/news/spark-summit-agenda-posted.html index 5e2baad..2970d73 100644 --- a/site/news/spark-summit-agenda-posted.html +++ b/site/news/spark-summit-agenda-posted.html @@ -150,6 +150,9 @@ <h5>Latest News</h5> <ul class="list-unstyled"> + <li><a href="/news/spark-wins-cloudsort-100tb-benchmark.html">Spark wins CloudSort Benchmark as the most efficient engine</a> + <span class="small">(Nov 15, 2016)</span></li> + <li><a href="/news/spark-2-0-2-released.html">Spark 2.0.2 released</a> <span class="small">(Nov 14, 2016)</span></li> @@ -159,9 +162,6 @@ <li><a href="/news/spark-2-0-1-released.html">Spark 2.0.1 released</a> <span class="small">(Oct 03, 2016)</span></li> - <li><a href="/news/spark-2-0-0-released.html">Spark 2.0.0 released</a> - <span class="small">(Jul 26, 2016)</span></li> - </ul> <p class="small" style="text-align: right;"><a href="/news/index.html">Archive</a></p> </div> http://git-wip-us.apache.org/repos/asf/spark-website/blob/8781cd3c/site/news/spark-summit-east-2015-videos-posted.html ---------------------------------------------------------------------- diff --git a/site/news/spark-summit-east-2015-videos-posted.html b/site/news/spark-summit-east-2015-videos-posted.html index 0c8cd4e..981ff5a 100644 --- a/site/news/spark-summit-east-2015-videos-posted.html +++ b/site/news/spark-summit-east-2015-videos-posted.html @@ -150,6 +150,9 @@ <h5>Latest News</h5> <ul class="list-unstyled"> + <li><a href="/news/spark-wins-cloudsort-100tb-benchmark.html">Spark wins CloudSort Benchmark as the most efficient engine</a> + <span class="small">(Nov 15, 2016)</span></li> + <li><a href="/news/spark-2-0-2-released.html">Spark 2.0.2 released</a> <span class="small">(Nov 14, 2016)</span></li> @@ -159,9 +162,6 @@ <li><a href="/news/spark-2-0-1-released.html">Spark 2.0.1 released</a> <span class="small">(Oct 03, 2016)</span></li> - <li><a href="/news/spark-2-0-0-released.html">Spark 2.0.0 released</a> - <span class="small">(Jul 26, 2016)</span></li> - </ul> <p class="small" style="text-align: right;"><a href="/news/index.html">Archive</a></p> </div> @@ -186,7 +186,7 @@ <h2>Spark Summit East 2015 Videos Posted</h2> -<p>The videos and slides for Spark Summit East 2015 are now all <a href="http://spark-summit.org/east/2015";>available online</a>. Watch them to get the latest news from the Spark community as well as use cases and applications built on top.</p> +<p>The videos and slides for Spark Summit East 2015 are now all <a href="http://spark-summit.org/east/2015";>available online</a>. Watch them to get the latest news from the Spark community as well as use cases and applications built on top. </p> <p>If you like what you see, consider joining us at the <a href="http://spark-summit.org/2015/agenda";>2015 Spark Summit</a> in San Francisco.</p> http://git-wip-us.apache.org/repos/asf/spark-website/blob/8781cd3c/site/news/spark-summit-east-2016-cfp-closing.html ---------------------------------------------------------------------- diff --git a/site/news/spark-summit-east-2016-cfp-closing.html b/site/news/spark-summit-east-2016-cfp-closing.html index 5a51938..bec8c2b 100644 --- a/site/news/spark-summit-east-2016-cfp-closing.html +++ b/site/news/spark-summit-east-2016-cfp-closing.html @@ -150,6 +150,9 @@ <h5>Latest News</h5> <ul class="list-unstyled"> + <li><a href="/news/spark-wins-cloudsort-100tb-benchmark.html">Spark wins CloudSort Benchmark as the most efficient engine</a> + <span class="small">(Nov 15, 2016)</span></li> + <li><a href="/news/spark-2-0-2-released.html">Spark 2.0.2 released</a> <span class="small">(Nov 14, 2016)</span></li> @@ -159,9 +162,6 @@ <li><a href="/news/spark-2-0-1-released.html">Spark 2.0.1 released</a> <span class="small">(Oct 03, 2016)</span></li> - <li><a href="/news/spark-2-0-0-released.html">Spark 2.0.0 released</a> - <span class="small">(Jul 26, 2016)</span></li> - </ul> <p class="small" style="text-align: right;"><a href="/news/index.html">Archive</a></p> </div> http://git-wip-us.apache.org/repos/asf/spark-website/blob/8781cd3c/site/news/spark-summit-east-agenda-posted.html ---------------------------------------------------------------------- diff --git a/site/news/spark-summit-east-agenda-posted.html b/site/news/spark-summit-east-agenda-posted.html index 2fc7a4c..1328dc9 100644 --- a/site/news/spark-summit-east-agenda-posted.html +++ b/site/news/spark-summit-east-agenda-posted.html @@ -150,6 +150,9 @@ <h5>Latest News</h5> <ul class="list-unstyled"> + <li><a href="/news/spark-wins-cloudsort-100tb-benchmark.html">Spark wins CloudSort Benchmark as the most efficient engine</a> + <span class="small">(Nov 15, 2016)</span></li> + <li><a href="/news/spark-2-0-2-released.html">Spark 2.0.2 released</a> <span class="small">(Nov 14, 2016)</span></li> @@ -159,9 +162,6 @@ <li><a href="/news/spark-2-0-1-released.html">Spark 2.0.1 released</a> <span class="small">(Oct 03, 2016)</span></li> - <li><a href="/news/spark-2-0-0-released.html">Spark 2.0.0 released</a> - <span class="small">(Jul 26, 2016)</span></li> - </ul> <p class="small" style="text-align: right;"><a href="/news/index.html">Archive</a></p> </div> http://git-wip-us.apache.org/repos/asf/spark-website/blob/8781cd3c/site/news/spark-summit-europe-agenda-posted.html ---------------------------------------------------------------------- diff --git a/site/news/spark-summit-europe-agenda-posted.html b/site/news/spark-summit-europe-agenda-posted.html index 4392c07..9eb164b 100644 --- a/site/news/spark-summit-europe-agenda-posted.html +++ b/site/news/spark-summit-europe-agenda-posted.html @@ -150,6 +150,9 @@ <h5>Latest News</h5> <ul class="list-unstyled"> + <li><a href="/news/spark-wins-cloudsort-100tb-benchmark.html">Spark wins CloudSort Benchmark as the most efficient engine</a> + <span class="small">(Nov 15, 2016)</span></li> + <li><a href="/news/spark-2-0-2-released.html">Spark 2.0.2 released</a> <span class="small">(Nov 14, 2016)</span></li> @@ -159,9 +162,6 @@ <li><a href="/news/spark-2-0-1-released.html">Spark 2.0.1 released</a> <span class="small">(Oct 03, 2016)</span></li> - <li><a href="/news/spark-2-0-0-released.html">Spark 2.0.0 released</a> - <span class="small">(Jul 26, 2016)</span></li> - </ul> <p class="small" style="text-align: right;"><a href="/news/index.html">Archive</a></p> </div> http://git-wip-us.apache.org/repos/asf/spark-website/blob/8781cd3c/site/news/spark-summit-europe.html ---------------------------------------------------------------------- diff --git a/site/news/spark-summit-europe.html b/site/news/spark-summit-europe.html index 2004f74..a147124 100644 --- a/site/news/spark-summit-europe.html +++ b/site/news/spark-summit-europe.html @@ -150,6 +150,9 @@ <h5>Latest News</h5> <ul class="list-unstyled"> + <li><a href="/news/spark-wins-cloudsort-100tb-benchmark.html">Spark wins CloudSort Benchmark as the most efficient engine</a> + <span class="small">(Nov 15, 2016)</span></li> + <li><a href="/news/spark-2-0-2-released.html">Spark 2.0.2 released</a> <span class="small">(Nov 14, 2016)</span></li> @@ -159,9 +162,6 @@ <li><a href="/news/spark-2-0-1-released.html">Spark 2.0.1 released</a> <span class="small">(Oct 03, 2016)</span></li> - <li><a href="/news/spark-2-0-0-released.html">Spark 2.0.0 released</a> - <span class="small">(Jul 26, 2016)</span></li> - </ul> <p class="small" style="text-align: right;"><a href="/news/index.html">Archive</a></p> </div> http://git-wip-us.apache.org/repos/asf/spark-website/blob/8781cd3c/site/news/spark-summit-june-2016-agenda-posted.html ---------------------------------------------------------------------- diff --git a/site/news/spark-summit-june-2016-agenda-posted.html b/site/news/spark-summit-june-2016-agenda-posted.html index 7f77ec5..c6c1959 100644 --- a/site/news/spark-summit-june-2016-agenda-posted.html +++ b/site/news/spark-summit-june-2016-agenda-posted.html @@ -150,6 +150,9 @@ <h5>Latest News</h5> <ul class="list-unstyled"> + <li><a href="/news/spark-wins-cloudsort-100tb-benchmark.html">Spark wins CloudSort Benchmark as the most efficient engine</a> + <span class="small">(Nov 15, 2016)</span></li> + <li><a href="/news/spark-2-0-2-released.html">Spark 2.0.2 released</a> <span class="small">(Nov 14, 2016)</span></li> @@ -159,9 +162,6 @@ <li><a href="/news/spark-2-0-1-released.html">Spark 2.0.1 released</a> <span class="small">(Oct 03, 2016)</span></li> - <li><a href="/news/spark-2-0-0-released.html">Spark 2.0.0 released</a> - <span class="small">(Jul 26, 2016)</span></li> - </ul> <p class="small" style="text-align: right;"><a href="/news/index.html">Archive</a></p> </div> http://git-wip-us.apache.org/repos/asf/spark-website/blob/8781cd3c/site/news/spark-tips-from-quantifind.html ---------------------------------------------------------------------- diff --git a/site/news/spark-tips-from-quantifind.html b/site/news/spark-tips-from-quantifind.html index a00073a..8d7338d 100644 --- a/site/news/spark-tips-from-quantifind.html +++ b/site/news/spark-tips-from-quantifind.html @@ -150,6 +150,9 @@ <h5>Latest News</h5> <ul class="list-unstyled"> + <li><a href="/news/spark-wins-cloudsort-100tb-benchmark.html">Spark wins CloudSort Benchmark as the most efficient engine</a> + <span class="small">(Nov 15, 2016)</span></li> + <li><a href="/news/spark-2-0-2-released.html">Spark 2.0.2 released</a> <span class="small">(Nov 14, 2016)</span></li> @@ -159,9 +162,6 @@ <li><a href="/news/spark-2-0-1-released.html">Spark 2.0.1 released</a> <span class="small">(Oct 03, 2016)</span></li> - <li><a href="/news/spark-2-0-0-released.html">Spark 2.0.0 released</a> - <span class="small">(Jul 26, 2016)</span></li> - </ul> <p class="small" style="text-align: right;"><a href="/news/index.html">Archive</a></p> </div> http://git-wip-us.apache.org/repos/asf/spark-website/blob/8781cd3c/site/news/spark-user-survey-and-powered-by-page.html ---------------------------------------------------------------------- diff --git a/site/news/spark-user-survey-and-powered-by-page.html b/site/news/spark-user-survey-and-powered-by-page.html index 111a637..10d0b21 100644 --- a/site/news/spark-user-survey-and-powered-by-page.html +++ b/site/news/spark-user-survey-and-powered-by-page.html @@ -150,6 +150,9 @@ <h5>Latest News</h5> <ul class="list-unstyled"> + <li><a href="/news/spark-wins-cloudsort-100tb-benchmark.html">Spark wins CloudSort Benchmark as the most efficient engine</a> + <span class="small">(Nov 15, 2016)</span></li> + <li><a href="/news/spark-2-0-2-released.html">Spark 2.0.2 released</a> <span class="small">(Nov 14, 2016)</span></li> @@ -159,9 +162,6 @@ <li><a href="/news/spark-2-0-1-released.html">Spark 2.0.1 released</a> <span class="small">(Oct 03, 2016)</span></li> - <li><a href="/news/spark-2-0-0-released.html">Spark 2.0.0 released</a> - <span class="small">(Jul 26, 2016)</span></li> - </ul> <p class="small" style="text-align: right;"><a href="/news/index.html">Archive</a></p> </div> http://git-wip-us.apache.org/repos/asf/spark-website/blob/8781cd3c/site/news/spark-version-0-6-0-released.html ---------------------------------------------------------------------- diff --git a/site/news/spark-version-0-6-0-released.html b/site/news/spark-version-0-6-0-released.html index d158357..63a6214 100644 --- a/site/news/spark-version-0-6-0-released.html +++ b/site/news/spark-version-0-6-0-released.html @@ -150,6 +150,9 @@ <h5>Latest News</h5> <ul class="list-unstyled"> + <li><a href="/news/spark-wins-cloudsort-100tb-benchmark.html">Spark wins CloudSort Benchmark as the most efficient engine</a> + <span class="small">(Nov 15, 2016)</span></li> + <li><a href="/news/spark-2-0-2-released.html">Spark 2.0.2 released</a> <span class="small">(Nov 14, 2016)</span></li> @@ -159,9 +162,6 @@ <li><a href="/news/spark-2-0-1-released.html">Spark 2.0.1 released</a> <span class="small">(Oct 03, 2016)</span></li> - <li><a href="/news/spark-2-0-0-released.html">Spark 2.0.0 released</a> - <span class="small">(Jul 26, 2016)</span></li> - </ul> <p class="small" style="text-align: right;"><a href="/news/index.html">Archive</a></p> </div> http://git-wip-us.apache.org/repos/asf/spark-website/blob/8781cd3c/site/news/spark-wins-cloudsort-100tb-benchmark.html ---------------------------------------------------------------------- diff --git a/site/news/spark-wins-cloudsort-100tb-benchmark.html b/site/news/spark-wins-cloudsort-100tb-benchmark.html new file mode 100644 index 0000000..ad15b0f --- /dev/null +++ b/site/news/spark-wins-cloudsort-100tb-benchmark.html @@ -0,0 +1,218 @@ +<!DOCTYPE html> +<html lang="en"> +<head> + <meta charset="utf-8"> + <meta http-equiv="X-UA-Compatible" content="IE=edge"> + <meta name="viewport" content="width=device-width, initial-scale=1.0"> + + <title> + Spark wins CloudSort Benchmark as the most efficient engine | Apache Spark + + </title> + + + + + + <!-- Bootstrap core CSS --> + <link href="/css/cerulean.min.css" rel="stylesheet"> + <link href="/css/custom.css" rel="stylesheet"> + + <!-- Code highlighter CSS --> + <link href="/css/pygments-default.css" rel="stylesheet"> + + <script type="text/javascript"> + <!-- Google Analytics initialization --> + var _gaq = _gaq || []; + _gaq.push(['_setAccount', 'UA-32518208-2']); + _gaq.push(['_trackPageview']); + (function() { + var ga = document.createElement('script'); ga.type = 'text/javascript'; ga.async = true; + ga.src = ('https:' == document.location.protocol ? 'https://ssl' : 'http://www') + '.google-analytics.com/ga.js'; + var s = document.getElementsByTagName('script')[0]; s.parentNode.insertBefore(ga, s); + })(); + + <!-- Adds slight delay to links to allow async reporting --> + function trackOutboundLink(link, category, action) { + try { + _gaq.push(['_trackEvent', category , action]); + } catch(err){} + + setTimeout(function() { + document.location.href = link.href; + }, 100); + } + </script> + + <!-- HTML5 shim and Respond.js IE8 support of HTML5 elements and media queries --> + <!--[if lt IE 9]> + <script src="https://oss.maxcdn.com/libs/html5shiv/3.7.0/html5shiv.js";></script> + <script src="https://oss.maxcdn.com/libs/respond.js/1.3.0/respond.min.js";></script> + <![endif]--> +</head> + +<body> + +<script src="https://code.jquery.com/jquery.js";></script> +<script src="https://netdna.bootstrapcdn.com/bootstrap/3.0.3/js/bootstrap.min.js";></script> +<script src="/js/lang-tabs.js"></script> +<script src="/js/downloads.js"></script> + +<div class="container" style="max-width: 1200px;"> + +<div class="masthead"> + + <p class="lead"> + <a href="/"> + <img src="/images/spark-logo-trademark.png" + style="height:100px; width:auto; vertical-align: bottom; margin-top: 20px;"></a><span class="tagline"> + Lightning-fast cluster computing + </span> + </p> + +</div> + +<nav class="navbar navbar-default" role="navigation"> + <!-- Brand and toggle get grouped for better mobile display --> + <div class="navbar-header"> + <button type="button" class="navbar-toggle" data-toggle="collapse" + data-target="#navbar-collapse-1"> + <span class="sr-only">Toggle navigation</span> + <span class="icon-bar"></span> + <span class="icon-bar"></span> + <span class="icon-bar"></span> + </button> + </div> + + <!-- Collect the nav links, forms, and other content for toggling --> + <div class="collapse navbar-collapse" id="navbar-collapse-1"> + <ul class="nav navbar-nav"> + <li><a href="/downloads.html">Download</a></li> + <li class="dropdown"> + <a href="#" class="dropdown-toggle" data-toggle="dropdown"> + Libraries <b class="caret"></b> + </a> + <ul class="dropdown-menu"> + <li><a href="/sql/">SQL and DataFrames</a></li> + <li><a href="/streaming/">Spark Streaming</a></li> + <li><a href="/mllib/">MLlib (machine learning)</a></li> + <li><a href="/graphx/">GraphX (graph)</a></li> + <li class="divider"></li> + <li><a href="https://cwiki.apache.org/confluence/display/SPARK/Third+Party+Projects";>Third-Party Packages</a></li> + </ul> + </li> + <li class="dropdown"> + <a href="#" class="dropdown-toggle" data-toggle="dropdown"> + Documentation <b class="caret"></b> + </a> + <ul class="dropdown-menu"> + <li><a href="/docs/latest/">Latest Release (Spark 2.0.2)</a></li> + <li><a href="/documentation.html">Older Versions and Other Resources</a></li> + </ul> + </li> + <li><a href="/examples.html">Examples</a></li> + <li class="dropdown"> + <a href="/community.html" class="dropdown-toggle" data-toggle="dropdown"> + Community <b class="caret"></b> + </a> + <ul class="dropdown-menu"> + <li><a href="/community.html">Mailing Lists</a></li> + <li><a href="/community.html#events">Events and Meetups</a></li> + <li><a href="/community.html#history">Project History</a></li> + <li><a href="https://cwiki.apache.org/confluence/display/SPARK/Powered+By+Spark";>Powered By</a></li> + <li><a href="https://cwiki.apache.org/confluence/display/SPARK/Committers";>Project Committers</a></li> + <li><a href="https://issues.apache.org/jira/browse/SPARK";>Issue Tracker</a></li> + </ul> + </li> + <li><a href="/faq.html">FAQ</a></li> + </ul> + <ul class="nav navbar-nav navbar-right"> + <li class="dropdown"> + <a href="http://www.apache.org/"; class="dropdown-toggle" data-toggle="dropdown"> + Apache Software Foundation <b class="caret"></b></a> + <ul class="dropdown-menu"> + <li><a href="http://www.apache.org/";>Apache Homepage</a></li> + <li><a href="http://www.apache.org/licenses/";>License</a></li> + <li><a href="http://www.apache.org/foundation/sponsorship.html";>Sponsorship</a></li> + <li><a href="http://www.apache.org/foundation/thanks.html";>Thanks</a></li> + <li><a href="http://www.apache.org/security/";>Security</a></li> + </ul> + </li> + </ul> + </div> + <!-- /.navbar-collapse --> +</nav> + + +<div class="row"> + <div class="col-md-3 col-md-push-9"> + <div class="news" style="margin-bottom: 20px;"> + <h5>Latest News</h5> + <ul class="list-unstyled"> + + <li><a href="/news/spark-wins-cloudsort-100tb-benchmark.html">Spark wins CloudSort Benchmark as the most efficient engine</a> + <span class="small">(Nov 15, 2016)</span></li> + + <li><a href="/news/spark-2-0-2-released.html">Spark 2.0.2 released</a> + <span class="small">(Nov 14, 2016)</span></li> + + <li><a href="/news/spark-1-6-3-released.html">Spark 1.6.3 released</a> + <span class="small">(Nov 07, 2016)</span></li> + + <li><a href="/news/spark-2-0-1-released.html">Spark 2.0.1 released</a> + <span class="small">(Oct 03, 2016)</span></li> + + </ul> + <p class="small" style="text-align: right;"><a href="/news/index.html">Archive</a></p> + </div> + <div class="hidden-xs hidden-sm"> + <a href="/downloads.html" class="btn btn-success btn-lg btn-block" style="margin-bottom: 30px;"> + Download Spark + </a> + <p style="font-size: 16px; font-weight: 500; color: #555;"> + Built-in Libraries: + </p> + <ul class="list-none"> + <li><a href="/sql/">SQL and DataFrames</a></li> + <li><a href="/streaming/">Spark Streaming</a></li> + <li><a href="/mllib/">MLlib (machine learning)</a></li> + <li><a href="/graphx/">GraphX (graph)</a></li> + </ul> + <a href="https://cwiki.apache.org/confluence/display/SPARK/Third+Party+Projects";>Third-Party Packages</a> + </div> + </div> + + <div class="col-md-9 col-md-pull-3"> + <h2>Spark wins CloudSort Benchmark as the most efficient engine</h2> + + +<p>We are proud to announce that Apache Spark won the <a href="http://sortbenchmark.org/";>2016 CloudSort Benchmark</a> (both Daytona and Indy category). A joint team from Nanjing University, Alibaba Group, and Databricks Inc. entered the competition using NADSort, a distributed sorting program built on top of Spark, and set a new world record as the most cost-efficient way to sort 100TB of data.</p> + +<p>They sorted 100TB of data using only $144 USD worth of public cloud resources, beating the previous record that cost $451 USD by the University of California, San Diego.</p> + +<p>This adds to the 2014 GraySort record Spark won, and validates Spark as the most efficient data processing engine.</p> + +<p>For more information, see the <a href="https://databricks.com/blog/2016/11/14/setting-new-world-record-apache-spark.html";>Databricks blog article (in English)</a> written by Spark committer Reynold Xin, or the Nanjing University <a href="http://scit.nju.edu.cn/Item/1193.aspx";>press release (in Chinese)</a>.</p> + + + +<p> +<br/> +<a href="/news/">Spark News Archive</a> +</p> + + </div> +</div> + + + +<footer class="small"> + <hr> + Apache Spark, Spark, Apache, and the Spark logo are <a href="/trademarks.html">trademarks</a> of + <a href="http://www.apache.org";>The Apache Software Foundation</a>. +</footer> + +</div> + +</body> +</html> http://git-wip-us.apache.org/repos/asf/spark-website/blob/8781cd3c/site/news/spark-wins-daytona-gray-sort-100tb-benchmark.html ---------------------------------------------------------------------- diff --git a/site/news/spark-wins-daytona-gray-sort-100tb-benchmark.html b/site/news/spark-wins-daytona-gray-sort-100tb-benchmark.html index 57b16c9..eaa17a3 100644 --- a/site/news/spark-wins-daytona-gray-sort-100tb-benchmark.html +++ b/site/news/spark-wins-daytona-gray-sort-100tb-benchmark.html @@ -150,6 +150,9 @@ <h5>Latest News</h5> <ul class="list-unstyled"> + <li><a href="/news/spark-wins-cloudsort-100tb-benchmark.html">Spark wins CloudSort Benchmark as the most efficient engine</a> + <span class="small">(Nov 15, 2016)</span></li> + <li><a href="/news/spark-2-0-2-released.html">Spark 2.0.2 released</a> <span class="small">(Nov 14, 2016)</span></li> @@ -159,9 +162,6 @@ <li><a href="/news/spark-2-0-1-released.html">Spark 2.0.1 released</a> <span class="small">(Oct 03, 2016)</span></li> - <li><a href="/news/spark-2-0-0-released.html">Spark 2.0.0 released</a> - <span class="small">(Jul 26, 2016)</span></li> - </ul> <p class="small" style="text-align: right;"><a href="/news/index.html">Archive</a></p> </div> http://git-wip-us.apache.org/repos/asf/spark-website/blob/8781cd3c/site/news/strata-exercises-now-available-online.html ---------------------------------------------------------------------- diff --git a/site/news/strata-exercises-now-available-online.html b/site/news/strata-exercises-now-available-online.html index d6eae90..46d8516 100644 --- a/site/news/strata-exercises-now-available-online.html +++ b/site/news/strata-exercises-now-available-online.html @@ -150,6 +150,9 @@ <h5>Latest News</h5> <ul class="list-unstyled"> + <li><a href="/news/spark-wins-cloudsort-100tb-benchmark.html">Spark wins CloudSort Benchmark as the most efficient engine</a> + <span class="small">(Nov 15, 2016)</span></li> + <li><a href="/news/spark-2-0-2-released.html">Spark 2.0.2 released</a> <span class="small">(Nov 14, 2016)</span></li> @@ -159,9 +162,6 @@ <li><a href="/news/spark-2-0-1-released.html">Spark 2.0.1 released</a> <span class="small">(Oct 03, 2016)</span></li> - <li><a href="/news/spark-2-0-0-released.html">Spark 2.0.0 released</a> - <span class="small">(Jul 26, 2016)</span></li> - </ul> <p class="small" style="text-align: right;"><a href="/news/index.html">Archive</a></p> </div> http://git-wip-us.apache.org/repos/asf/spark-website/blob/8781cd3c/site/news/submit-talks-to-spark-summit-2014.html ---------------------------------------------------------------------- diff --git a/site/news/submit-talks-to-spark-summit-2014.html b/site/news/submit-talks-to-spark-summit-2014.html index 24586cf..46c9c95 100644 --- a/site/news/submit-talks-to-spark-summit-2014.html +++ b/site/news/submit-talks-to-spark-summit-2014.html @@ -150,6 +150,9 @@ <h5>Latest News</h5> <ul class="list-unstyled"> + <li><a href="/news/spark-wins-cloudsort-100tb-benchmark.html">Spark wins CloudSort Benchmark as the most efficient engine</a> + <span class="small">(Nov 15, 2016)</span></li> + <li><a href="/news/spark-2-0-2-released.html">Spark 2.0.2 released</a> <span class="small">(Nov 14, 2016)</span></li> @@ -159,9 +162,6 @@ <li><a href="/news/spark-2-0-1-released.html">Spark 2.0.1 released</a> <span class="small">(Oct 03, 2016)</span></li> - <li><a href="/news/spark-2-0-0-released.html">Spark 2.0.0 released</a> - <span class="small">(Jul 26, 2016)</span></li> - </ul> <p class="small" style="text-align: right;"><a href="/news/index.html">Archive</a></p> </div> http://git-wip-us.apache.org/repos/asf/spark-website/blob/8781cd3c/site/news/submit-talks-to-spark-summit-2016.html ---------------------------------------------------------------------- diff --git a/site/news/submit-talks-to-spark-summit-2016.html b/site/news/submit-talks-to-spark-summit-2016.html index d4d5ab0..1aa9f8c 100644 --- a/site/news/submit-talks-to-spark-summit-2016.html +++ b/site/news/submit-talks-to-spark-summit-2016.html @@ -150,6 +150,9 @@ <h5>Latest News</h5> <ul class="list-unstyled"> + <li><a href="/news/spark-wins-cloudsort-100tb-benchmark.html">Spark wins CloudSort Benchmark as the most efficient engine</a> + <span class="small">(Nov 15, 2016)</span></li> + <li><a href="/news/spark-2-0-2-released.html">Spark 2.0.2 released</a> <span class="small">(Nov 14, 2016)</span></li> @@ -159,9 +162,6 @@ <li><a href="/news/spark-2-0-1-released.html">Spark 2.0.1 released</a> <span class="small">(Oct 03, 2016)</span></li> - <li><a href="/news/spark-2-0-0-released.html">Spark 2.0.0 released</a> - <span class="small">(Jul 26, 2016)</span></li> - </ul> <p class="small" style="text-align: right;"><a href="/news/index.html">Archive</a></p> </div> http://git-wip-us.apache.org/repos/asf/spark-website/blob/8781cd3c/site/news/submit-talks-to-spark-summit-east-2016.html ---------------------------------------------------------------------- diff --git a/site/news/submit-talks-to-spark-summit-east-2016.html b/site/news/submit-talks-to-spark-summit-east-2016.html index 588ca05..30a059d 100644 --- a/site/news/submit-talks-to-spark-summit-east-2016.html +++ b/site/news/submit-talks-to-spark-summit-east-2016.html @@ -150,6 +150,9 @@ <h5>Latest News</h5> <ul class="list-unstyled"> + <li><a href="/news/spark-wins-cloudsort-100tb-benchmark.html">Spark wins CloudSort Benchmark as the most efficient engine</a> + <span class="small">(Nov 15, 2016)</span></li> + <li><a href="/news/spark-2-0-2-released.html">Spark 2.0.2 released</a> <span class="small">(Nov 14, 2016)</span></li> @@ -159,9 +162,6 @@ <li><a href="/news/spark-2-0-1-released.html">Spark 2.0.1 released</a> <span class="small">(Oct 03, 2016)</span></li> - <li><a href="/news/spark-2-0-0-released.html">Spark 2.0.0 released</a> - <span class="small">(Jul 26, 2016)</span></li> - </ul> <p class="small" style="text-align: right;"><a href="/news/index.html">Archive</a></p> </div> http://git-wip-us.apache.org/repos/asf/spark-website/blob/8781cd3c/site/news/submit-talks-to-spark-summit-eu-2016.html ---------------------------------------------------------------------- diff --git a/site/news/submit-talks-to-spark-summit-eu-2016.html b/site/news/submit-talks-to-spark-summit-eu-2016.html index 119ad99..210799d 100644 --- a/site/news/submit-talks-to-spark-summit-eu-2016.html +++ b/site/news/submit-talks-to-spark-summit-eu-2016.html @@ -150,6 +150,9 @@ <h5>Latest News</h5> <ul class="list-unstyled"> + <li><a href="/news/spark-wins-cloudsort-100tb-benchmark.html">Spark wins CloudSort Benchmark as the most efficient engine</a> + <span class="small">(Nov 15, 2016)</span></li> + <li><a href="/news/spark-2-0-2-released.html">Spark 2.0.2 released</a> <span class="small">(Nov 14, 2016)</span></li> @@ -159,9 +162,6 @@ <li><a href="/news/spark-2-0-1-released.html">Spark 2.0.1 released</a> <span class="small">(Oct 03, 2016)</span></li> - <li><a href="/news/spark-2-0-0-released.html">Spark 2.0.0 released</a> - <span class="small">(Jul 26, 2016)</span></li> - </ul> <p class="small" style="text-align: right;"><a href="/news/index.html">Archive</a></p> </div> http://git-wip-us.apache.org/repos/asf/spark-website/blob/8781cd3c/site/news/two-weeks-to-spark-summit-2014.html ---------------------------------------------------------------------- diff --git a/site/news/two-weeks-to-spark-summit-2014.html b/site/news/two-weeks-to-spark-summit-2014.html index 3ca485e..9b1bd04 100644 --- a/site/news/two-weeks-to-spark-summit-2014.html +++ b/site/news/two-weeks-to-spark-summit-2014.html @@ -150,6 +150,9 @@ <h5>Latest News</h5> <ul class="list-unstyled"> + <li><a href="/news/spark-wins-cloudsort-100tb-benchmark.html">Spark wins CloudSort Benchmark as the most efficient engine</a> + <span class="small">(Nov 15, 2016)</span></li> + <li><a href="/news/spark-2-0-2-released.html">Spark 2.0.2 released</a> <span class="small">(Nov 14, 2016)</span></li> @@ -159,9 +162,6 @@ <li><a href="/news/spark-2-0-1-released.html">Spark 2.0.1 released</a> <span class="small">(Oct 03, 2016)</span></li> - <li><a href="/news/spark-2-0-0-released.html">Spark 2.0.0 released</a> - <span class="small">(Jul 26, 2016)</span></li> - </ul> <p class="small" style="text-align: right;"><a href="/news/index.html">Archive</a></p> </div> http://git-wip-us.apache.org/repos/asf/spark-website/blob/8781cd3c/site/news/video-from-first-spark-development-meetup.html ---------------------------------------------------------------------- diff --git a/site/news/video-from-first-spark-development-meetup.html b/site/news/video-from-first-spark-development-meetup.html index 97a2457..b223762 100644 --- a/site/news/video-from-first-spark-development-meetup.html +++ b/site/news/video-from-first-spark-development-meetup.html @@ -150,6 +150,9 @@ <h5>Latest News</h5> <ul class="list-unstyled"> + <li><a href="/news/spark-wins-cloudsort-100tb-benchmark.html">Spark wins CloudSort Benchmark as the most efficient engine</a> + <span class="small">(Nov 15, 2016)</span></li> + <li><a href="/news/spark-2-0-2-released.html">Spark 2.0.2 released</a> <span class="small">(Nov 14, 2016)</span></li> @@ -159,9 +162,6 @@ <li><a href="/news/spark-2-0-1-released.html">Spark 2.0.1 released</a> <span class="small">(Oct 03, 2016)</span></li> - <li><a href="/news/spark-2-0-0-released.html">Spark 2.0.0 released</a> - <span class="small">(Jul 26, 2016)</span></li> - </ul> <p class="small" style="text-align: right;"><a href="/news/index.html">Archive</a></p> </div> http://git-wip-us.apache.org/repos/asf/spark-website/blob/8781cd3c/site/releases/spark-release-0-3.html ---------------------------------------------------------------------- diff --git a/site/releases/spark-release-0-3.html b/site/releases/spark-release-0-3.html index a9c070d..5baab50 100644 --- a/site/releases/spark-release-0-3.html +++ b/site/releases/spark-release-0-3.html @@ -150,6 +150,9 @@ <h5>Latest News</h5> <ul class="list-unstyled"> + <li><a href="/news/spark-wins-cloudsort-100tb-benchmark.html">Spark wins CloudSort Benchmark as the most efficient engine</a> + <span class="small">(Nov 15, 2016)</span></li> + <li><a href="/news/spark-2-0-2-released.html">Spark 2.0.2 released</a> <span class="small">(Nov 14, 2016)</span></li> @@ -159,9 +162,6 @@ <li><a href="/news/spark-2-0-1-released.html">Spark 2.0.1 released</a> <span class="small">(Oct 03, 2016)</span></li> - <li><a href="/news/spark-2-0-0-released.html">Spark 2.0.0 released</a> - <span class="small">(Jul 26, 2016)</span></li> - </ul> <p class="small" style="text-align: right;"><a href="/news/index.html">Archive</a></p> </div> http://git-wip-us.apache.org/repos/asf/spark-website/blob/8781cd3c/site/releases/spark-release-0-5-0.html ---------------------------------------------------------------------- diff --git a/site/releases/spark-release-0-5-0.html b/site/releases/spark-release-0-5-0.html index 7c3b735..b063ec0 100644 --- a/site/releases/spark-release-0-5-0.html +++ b/site/releases/spark-release-0-5-0.html @@ -150,6 +150,9 @@ <h5>Latest News</h5> <ul class="list-unstyled"> + <li><a href="/news/spark-wins-cloudsort-100tb-benchmark.html">Spark wins CloudSort Benchmark as the most efficient engine</a> + <span class="small">(Nov 15, 2016)</span></li> + <li><a href="/news/spark-2-0-2-released.html">Spark 2.0.2 released</a> <span class="small">(Nov 14, 2016)</span></li> @@ -159,9 +162,6 @@ <li><a href="/news/spark-2-0-1-released.html">Spark 2.0.1 released</a> <span class="small">(Oct 03, 2016)</span></li> - <li><a href="/news/spark-2-0-0-released.html">Spark 2.0.0 released</a> - <span class="small">(Jul 26, 2016)</span></li> - </ul> <p class="small" style="text-align: right;"><a href="/news/index.html">Archive</a></p> </div> http://git-wip-us.apache.org/repos/asf/spark-website/blob/8781cd3c/site/releases/spark-release-0-5-1.html ---------------------------------------------------------------------- diff --git a/site/releases/spark-release-0-5-1.html b/site/releases/spark-release-0-5-1.html index d9c9412..3f8d37e 100644 --- a/site/releases/spark-release-0-5-1.html +++ b/site/releases/spark-release-0-5-1.html @@ -150,6 +150,9 @@ <h5>Latest News</h5> <ul class="list-unstyled"> + <li><a href="/news/spark-wins-cloudsort-100tb-benchmark.html">Spark wins CloudSort Benchmark as the most efficient engine</a> + <span class="small">(Nov 15, 2016)</span></li> + <li><a href="/news/spark-2-0-2-released.html">Spark 2.0.2 released</a> <span class="small">(Nov 14, 2016)</span></li> @@ -159,9 +162,6 @@ <li><a href="/news/spark-2-0-1-released.html">Spark 2.0.1 released</a> <span class="small">(Oct 03, 2016)</span></li> - <li><a href="/news/spark-2-0-0-released.html">Spark 2.0.0 released</a> - <span class="small">(Jul 26, 2016)</span></li> - </ul> <p class="small" style="text-align: right;"><a href="/news/index.html">Archive</a></p> </div> http://git-wip-us.apache.org/repos/asf/spark-website/blob/8781cd3c/site/releases/spark-release-0-5-2.html ---------------------------------------------------------------------- diff --git a/site/releases/spark-release-0-5-2.html b/site/releases/spark-release-0-5-2.html index 650c5f8..c2535e2 100644 --- a/site/releases/spark-release-0-5-2.html +++ b/site/releases/spark-release-0-5-2.html @@ -150,6 +150,9 @@ <h5>Latest News</h5> <ul class="list-unstyled"> + <li><a href="/news/spark-wins-cloudsort-100tb-benchmark.html">Spark wins CloudSort Benchmark as the most efficient engine</a> + <span class="small">(Nov 15, 2016)</span></li> + <li><a href="/news/spark-2-0-2-released.html">Spark 2.0.2 released</a> <span class="small">(Nov 14, 2016)</span></li> @@ -159,9 +162,6 @@ <li><a href="/news/spark-2-0-1-released.html">Spark 2.0.1 released</a> <span class="small">(Oct 03, 2016)</span></li> - <li><a href="/news/spark-2-0-0-released.html">Spark 2.0.0 released</a> - <span class="small">(Jul 26, 2016)</span></li> - </ul> <p class="small" style="text-align: right;"><a href="/news/index.html">Archive</a></p> </div> http://git-wip-us.apache.org/repos/asf/spark-website/blob/8781cd3c/site/releases/spark-release-0-6-0.html ---------------------------------------------------------------------- diff --git a/site/releases/spark-release-0-6-0.html b/site/releases/spark-release-0-6-0.html index 2945b24..93decf8 100644 --- a/site/releases/spark-release-0-6-0.html +++ b/site/releases/spark-release-0-6-0.html @@ -150,6 +150,9 @@ <h5>Latest News</h5> <ul class="list-unstyled"> + <li><a href="/news/spark-wins-cloudsort-100tb-benchmark.html">Spark wins CloudSort Benchmark as the most efficient engine</a> + <span class="small">(Nov 15, 2016)</span></li> + <li><a href="/news/spark-2-0-2-released.html">Spark 2.0.2 released</a> <span class="small">(Nov 14, 2016)</span></li> @@ -159,9 +162,6 @@ <li><a href="/news/spark-2-0-1-released.html">Spark 2.0.1 released</a> <span class="small">(Oct 03, 2016)</span></li> - <li><a href="/news/spark-2-0-0-released.html">Spark 2.0.0 released</a> - <span class="small">(Jul 26, 2016)</span></li> - </ul> <p class="small" style="text-align: right;"><a href="/news/index.html">Archive</a></p> </div> http://git-wip-us.apache.org/repos/asf/spark-website/blob/8781cd3c/site/releases/spark-release-0-6-1.html ---------------------------------------------------------------------- diff --git a/site/releases/spark-release-0-6-1.html b/site/releases/spark-release-0-6-1.html index b397122..6603912 100644 --- a/site/releases/spark-release-0-6-1.html +++ b/site/releases/spark-release-0-6-1.html @@ -150,6 +150,9 @@ <h5>Latest News</h5> <ul class="list-unstyled"> + <li><a href="/news/spark-wins-cloudsort-100tb-benchmark.html">Spark wins CloudSort Benchmark as the most efficient engine</a> + <span class="small">(Nov 15, 2016)</span></li> + <li><a href="/news/spark-2-0-2-released.html">Spark 2.0.2 released</a> <span class="small">(Nov 14, 2016)</span></li> @@ -159,9 +162,6 @@ <li><a href="/news/spark-2-0-1-released.html">Spark 2.0.1 released</a> <span class="small">(Oct 03, 2016)</span></li> - <li><a href="/news/spark-2-0-0-released.html">Spark 2.0.0 released</a> - <span class="small">(Jul 26, 2016)</span></li> - </ul> <p class="small" style="text-align: right;"><a href="/news/index.html">Archive</a></p> </div> http://git-wip-us.apache.org/repos/asf/spark-website/blob/8781cd3c/site/releases/spark-release-0-6-2.html ---------------------------------------------------------------------- diff --git a/site/releases/spark-release-0-6-2.html b/site/releases/spark-release-0-6-2.html index 95a8a5b..935b0e2 100644 --- a/site/releases/spark-release-0-6-2.html +++ b/site/releases/spark-release-0-6-2.html @@ -150,6 +150,9 @@ <h5>Latest News</h5> <ul class="list-unstyled"> + <li><a href="/news/spark-wins-cloudsort-100tb-benchmark.html">Spark wins CloudSort Benchmark as the most efficient engine</a> + <span class="small">(Nov 15, 2016)</span></li> + <li><a href="/news/spark-2-0-2-released.html">Spark 2.0.2 released</a> <span class="small">(Nov 14, 2016)</span></li> @@ -159,9 +162,6 @@ <li><a href="/news/spark-2-0-1-released.html">Spark 2.0.1 released</a> <span class="small">(Oct 03, 2016)</span></li> - <li><a href="/news/spark-2-0-0-released.html">Spark 2.0.0 released</a> - <span class="small">(Jul 26, 2016)</span></li> - </ul> <p class="small" style="text-align: right;"><a href="/news/index.html">Archive</a></p> </div> http://git-wip-us.apache.org/repos/asf/spark-website/blob/8781cd3c/site/releases/spark-release-0-7-0.html ---------------------------------------------------------------------- diff --git a/site/releases/spark-release-0-7-0.html b/site/releases/spark-release-0-7-0.html index 8965132..e893372 100644 --- a/site/releases/spark-release-0-7-0.html +++ b/site/releases/spark-release-0-7-0.html @@ -150,6 +150,9 @@ <h5>Latest News</h5> <ul class="list-unstyled"> + <li><a href="/news/spark-wins-cloudsort-100tb-benchmark.html">Spark wins CloudSort Benchmark as the most efficient engine</a> + <span class="small">(Nov 15, 2016)</span></li> + <li><a href="/news/spark-2-0-2-released.html">Spark 2.0.2 released</a> <span class="small">(Nov 14, 2016)</span></li> @@ -159,9 +162,6 @@ <li><a href="/news/spark-2-0-1-released.html">Spark 2.0.1 released</a> <span class="small">(Oct 03, 2016)</span></li> - <li><a href="/news/spark-2-0-0-released.html">Spark 2.0.0 released</a> - <span class="small">(Jul 26, 2016)</span></li> - </ul> <p class="small" style="text-align: right;"><a href="/news/index.html">Archive</a></p> </div> http://git-wip-us.apache.org/repos/asf/spark-website/blob/8781cd3c/site/releases/spark-release-0-7-2.html ---------------------------------------------------------------------- diff --git a/site/releases/spark-release-0-7-2.html b/site/releases/spark-release-0-7-2.html index 8faba3b..2506300 100644 --- a/site/releases/spark-release-0-7-2.html +++ b/site/releases/spark-release-0-7-2.html @@ -150,6 +150,9 @@ <h5>Latest News</h5> <ul class="list-unstyled"> + <li><a href="/news/spark-wins-cloudsort-100tb-benchmark.html">Spark wins CloudSort Benchmark as the most efficient engine</a> + <span class="small">(Nov 15, 2016)</span></li> + <li><a href="/news/spark-2-0-2-released.html">Spark 2.0.2 released</a> <span class="small">(Nov 14, 2016)</span></li> @@ -159,9 +162,6 @@ <li><a href="/news/spark-2-0-1-released.html">Spark 2.0.1 released</a> <span class="small">(Oct 03, 2016)</span></li> - <li><a href="/news/spark-2-0-0-released.html">Spark 2.0.0 released</a> - <span class="small">(Jul 26, 2016)</span></li> - </ul> <p class="small" style="text-align: right;"><a href="/news/index.html">Archive</a></p> </div> http://git-wip-us.apache.org/repos/asf/spark-website/blob/8781cd3c/site/releases/spark-release-0-7-3.html ---------------------------------------------------------------------- diff --git a/site/releases/spark-release-0-7-3.html b/site/releases/spark-release-0-7-3.html index 2df5db2..0d04344 100644 --- a/site/releases/spark-release-0-7-3.html +++ b/site/releases/spark-release-0-7-3.html @@ -150,6 +150,9 @@ <h5>Latest News</h5> <ul class="list-unstyled"> + <li><a href="/news/spark-wins-cloudsort-100tb-benchmark.html">Spark wins CloudSort Benchmark as the most efficient engine</a> + <span class="small">(Nov 15, 2016)</span></li> + <li><a href="/news/spark-2-0-2-released.html">Spark 2.0.2 released</a> <span class="small">(Nov 14, 2016)</span></li> @@ -159,9 +162,6 @@ <li><a href="/news/spark-2-0-1-released.html">Spark 2.0.1 released</a> <span class="small">(Oct 03, 2016)</span></li> - <li><a href="/news/spark-2-0-0-released.html">Spark 2.0.0 released</a> - <span class="small">(Jul 26, 2016)</span></li> - </ul> <p class="small" style="text-align: right;"><a href="/news/index.html">Archive</a></p> </div> http://git-wip-us.apache.org/repos/asf/spark-website/blob/8781cd3c/site/releases/spark-release-0-8-0.html ---------------------------------------------------------------------- diff --git a/site/releases/spark-release-0-8-0.html b/site/releases/spark-release-0-8-0.html index 41922b7..2a551ab 100644 --- a/site/releases/spark-release-0-8-0.html +++ b/site/releases/spark-release-0-8-0.html @@ -150,6 +150,9 @@ <h5>Latest News</h5> <ul class="list-unstyled"> + <li><a href="/news/spark-wins-cloudsort-100tb-benchmark.html">Spark wins CloudSort Benchmark as the most efficient engine</a> + <span class="small">(Nov 15, 2016)</span></li> + <li><a href="/news/spark-2-0-2-released.html">Spark 2.0.2 released</a> <span class="small">(Nov 14, 2016)</span></li> @@ -159,9 +162,6 @@ <li><a href="/news/spark-2-0-1-released.html">Spark 2.0.1 released</a> <span class="small">(Oct 03, 2016)</span></li> - <li><a href="/news/spark-2-0-0-released.html">Spark 2.0.0 released</a> - <span class="small">(Jul 26, 2016)</span></li> - </ul> <p class="small" style="text-align: right;"><a href="/news/index.html">Archive</a></p> </div> @@ -210,13 +210,13 @@ <p>Sparkâs internal job scheduler has been refactored and extended to include more sophisticated scheduling policies. In particular, a <a href="http://spark.incubator.apache.org/docs/0.8.0/job-scheduling.html#scheduling-within-an-application";>fair scheduler</a> implementation now allows multiple users to share an instance of Spark, which helps users running shorter jobs to achieve good performance, even when longer-running jobs are running in parallel. Support for topology-aware scheduling has been extended, including the ability to take into account rack locality and support for multiple executors on a single machine.</p> <h3 id="easier-deployment-and-linking">Easier Deployment and Linking</h3> -<p>User programs can now link to Spark no matter which Hadoop version they need, without having to publish a version of <code>spark-core</code> specifically for that Hadoop version. An explanation of how to link against different Hadoop versions is provided <a href="http://spark.incubator.apache.org/docs/0.8.0/scala-programming-guide.html#linking-with-spark";>here</a>.</p> +<p>User programs can now link to Spark no matter which Hadoop version they need, without having to publish a version of <code>spark-core</code> specifically for that Hadoop version. An explanation of how to link against different Hadoop versions is provided <a href="http://spark.incubator.apache.org/docs/0.8.0/scala-programming-guide.html#linking-with-spark";>here</a>. </p> <h3 id="expanded-ec2-capabilities">Expanded EC2 Capabilities</h3> <p>Sparkâs EC2 scripts now support launching in any availability zone. Support has also been added for EC2 instance types which use the newer âHVMâ architecture. This includes the cluster compute (cc1/cc2) family of instance types. Weâve also added support for running newer versions of HDFS alongside Spark. Finally, weâve added the ability to launch clusters with maintenance releases of Spark in addition to launching the newest release.</p> <h3 id="improved-documentation">Improved Documentation</h3> -<p>This release adds documentation about cluster hardware provisioning and inter-operation with common Hadoop distributions. Docs are also included to cover the MLlib machine learning functions and new cluster monitoring features. Existing documentation has been updated to reflect changes in building and deploying Spark.</p> +<p>This release adds documentation about cluster hardware provisioning and inter-operation with common Hadoop distributions. Docs are also included to cover the MLlib machine learning functions and new cluster monitoring features. Existing documentation has been updated to reflect changes in building and deploying Spark. </p> <h3 id="other-improvements">Other Improvements</h3> <ul> http://git-wip-us.apache.org/repos/asf/spark-website/blob/8781cd3c/site/releases/spark-release-0-8-1.html ---------------------------------------------------------------------- diff --git a/site/releases/spark-release-0-8-1.html b/site/releases/spark-release-0-8-1.html index a4a9460..9279f5d 100644 --- a/site/releases/spark-release-0-8-1.html +++ b/site/releases/spark-release-0-8-1.html @@ -150,6 +150,9 @@ <h5>Latest News</h5> <ul class="list-unstyled"> + <li><a href="/news/spark-wins-cloudsort-100tb-benchmark.html">Spark wins CloudSort Benchmark as the most efficient engine</a> + <span class="small">(Nov 15, 2016)</span></li> + <li><a href="/news/spark-2-0-2-released.html">Spark 2.0.2 released</a> <span class="small">(Nov 14, 2016)</span></li> @@ -159,9 +162,6 @@ <li><a href="/news/spark-2-0-1-released.html">Spark 2.0.1 released</a> <span class="small">(Oct 03, 2016)</span></li> - <li><a href="/news/spark-2-0-0-released.html">Spark 2.0.0 released</a> - <span class="small">(Jul 26, 2016)</span></li> - </ul> <p class="small" style="text-align: right;"><a href="/news/index.html">Archive</a></p> </div> http://git-wip-us.apache.org/repos/asf/spark-website/blob/8781cd3c/site/releases/spark-release-0-9-0.html ---------------------------------------------------------------------- diff --git a/site/releases/spark-release-0-9-0.html b/site/releases/spark-release-0-9-0.html index 2922864..5de4f0b 100644 --- a/site/releases/spark-release-0-9-0.html +++ b/site/releases/spark-release-0-9-0.html @@ -150,6 +150,9 @@ <h5>Latest News</h5> <ul class="list-unstyled"> + <li><a href="/news/spark-wins-cloudsort-100tb-benchmark.html">Spark wins CloudSort Benchmark as the most efficient engine</a> + <span class="small">(Nov 15, 2016)</span></li> + <li><a href="/news/spark-2-0-2-released.html">Spark 2.0.2 released</a> <span class="small">(Nov 14, 2016)</span></li> @@ -159,9 +162,6 @@ <li><a href="/news/spark-2-0-1-released.html">Spark 2.0.1 released</a> <span class="small">(Oct 03, 2016)</span></li> - <li><a href="/news/spark-2-0-0-released.html">Spark 2.0.0 released</a> - <span class="small">(Jul 26, 2016)</span></li> - </ul> <p class="small" style="text-align: right;"><a href="/news/index.html">Archive</a></p> </div> http://git-wip-us.apache.org/repos/asf/spark-website/blob/8781cd3c/site/releases/spark-release-0-9-1.html ---------------------------------------------------------------------- diff --git a/site/releases/spark-release-0-9-1.html b/site/releases/spark-release-0-9-1.html index 0597fa0..2161ee8 100644 --- a/site/releases/spark-release-0-9-1.html +++ b/site/releases/spark-release-0-9-1.html @@ -150,6 +150,9 @@ <h5>Latest News</h5> <ul class="list-unstyled"> + <li><a href="/news/spark-wins-cloudsort-100tb-benchmark.html">Spark wins CloudSort Benchmark as the most efficient engine</a> + <span class="small">(Nov 15, 2016)</span></li> + <li><a href="/news/spark-2-0-2-released.html">Spark 2.0.2 released</a> <span class="small">(Nov 14, 2016)</span></li> @@ -159,9 +162,6 @@ <li><a href="/news/spark-2-0-1-released.html">Spark 2.0.1 released</a> <span class="small">(Oct 03, 2016)</span></li> - <li><a href="/news/spark-2-0-0-released.html">Spark 2.0.0 released</a> - <span class="small">(Jul 26, 2016)</span></li> - </ul> <p class="small" style="text-align: right;"><a href="/news/index.html">Archive</a></p> </div> @@ -201,9 +201,9 @@ <li>Fixed hash collision bug in external spilling [<a href="https://issues.apache.org/jira/browse/SPARK-1113";>SPARK-1113</a>]</li> <li>Fixed conflict with Sparkâs log4j for users relying on other logging backends [<a href="https://issues.apache.org/jira/browse/SPARK-1190";>SPARK-1190</a>]</li> <li>Fixed Graphx missing from Spark assembly jar in maven builds</li> - <li>Fixed silent failures due to map output status exceeding Akka frame size [<a href="https://issues.apache.org/jira/browse/SPARK-1244";>SPARK-1244</a>]</li> - <li>Removed Sparkâs unnecessary direct dependency on ASM [<a href="https://issues.apache.org/jira/browse/SPARK-782";>SPARK-782</a>]</li> - <li>Removed metrics-ganglia from default build due to LGPL license conflict [<a href="https://issues.apache.org/jira/browse/SPARK-1167";>SPARK-1167</a>]</li> + <li>Fixed silent failures due to map output status exceeding Akka frame size [<a href="https://issues.apache.org/jira/browse/SPARK-1244";>SPARK-1244</a>] </li> + <li>Removed Sparkâs unnecessary direct dependency on ASM [<a href="https://issues.apache.org/jira/browse/SPARK-782";>SPARK-782</a>] </li> + <li>Removed metrics-ganglia from default build due to LGPL license conflict [<a href="https://issues.apache.org/jira/browse/SPARK-1167";>SPARK-1167</a>] </li> <li>Fixed bug in distribution tarball not containing spark assembly jar [<a href="https://issues.apache.org/jira/browse/SPARK-1184";>SPARK-1184</a>]</li> <li>Fixed bug causing infinite NullPointerException failures due to a null in map output locations [<a href="https://issues.apache.org/jira/browse/SPARK-1124";>SPARK-1124</a>]</li> <li>Fixed bugs in post-job cleanup of schedulerâs data structures</li> @@ -219,7 +219,7 @@ <li>Fixed bug making Spark application stall when YARN registration fails [<a href="https://issues.apache.org/jira/browse/SPARK-1032";>SPARK-1032</a>]</li> <li>Race condition in getting HDFS delegation tokens in yarn-client mode [<a href="https://issues.apache.org/jira/browse/SPARK-1203";>SPARK-1203</a>]</li> <li>Fixed bug in yarn-client mode not exiting properly [<a href="https://issues.apache.org/jira/browse/SPARK-1049";>SPARK-1049</a>]</li> - <li>Fixed regression bug in ADD_JAR environment variable not correctly adding custom jars [<a href="https://issues.apache.org/jira/browse/SPARK-1089";>SPARK-1089</a>]</li> + <li>Fixed regression bug in ADD_JAR environment variable not correctly adding custom jars [<a href="https://issues.apache.org/jira/browse/SPARK-1089";>SPARK-1089</a>] </li> </ul> <h3 id="improvements-to-other-deployment-scenarios">Improvements to other deployment scenarios</h3> @@ -230,19 +230,19 @@ <h3 id="optimizations-to-mllib">Optimizations to MLLib</h3> <ul> - <li>Optimized memory usage of ALS [<a href="https://issues.apache.org/jira/browse/MLLIB-25";>MLLIB-25</a>]</li> + <li>Optimized memory usage of ALS [<a href="https://issues.apache.org/jira/browse/MLLIB-25";>MLLIB-25</a>] </li> <li>Optimized computation of YtY for implicit ALS [<a href="https://issues.apache.org/jira/browse/SPARK-1237";>SPARK-1237</a>]</li> <li>Support for negative implicit input in ALS [<a href="https://issues.apache.org/jira/browse/MLLIB-22";>MLLIB-22</a>]</li> <li>Setting of a random seed in ALS [<a href="https://issues.apache.org/jira/browse/SPARK-1238";>SPARK-1238</a>]</li> - <li>Faster construction of features with intercept [<a href="https://issues.apache.org/jira/browse/SPARK-1260";>SPARK-1260</a>]</li> + <li>Faster construction of features with intercept [<a href="https://issues.apache.org/jira/browse/SPARK-1260";>SPARK-1260</a>] </li> <li>Check for intercept and weight in GLMâs addIntercept [<a href="https://issues.apache.org/jira/browse/SPARK-1327";>SPARK-1327</a>]</li> </ul> <h3 id="bug-fixes-and-better-api-parity-for-pyspark">Bug fixes and better API parity for PySpark</h3> <ul> <li>Fixed bug in Python de-pickling [<a href="https://issues.apache.org/jira/browse/SPARK-1135";>SPARK-1135</a>]</li> - <li>Fixed bug in serialization of strings longer than 64K [<a href="https://issues.apache.org/jira/browse/SPARK-1043";>SPARK-1043</a>]</li> - <li>Fixed bug that made jobs hang when base file is not available [<a href="https://issues.apache.org/jira/browse/SPARK-1025";>SPARK-1025</a>]</li> + <li>Fixed bug in serialization of strings longer than 64K [<a href="https://issues.apache.org/jira/browse/SPARK-1043";>SPARK-1043</a>] </li> + <li>Fixed bug that made jobs hang when base file is not available [<a href="https://issues.apache.org/jira/browse/SPARK-1025";>SPARK-1025</a>] </li> <li>Added Missing RDD operations to PySpark - top, zip, foldByKey, repartition, coalesce, getStorageLevel, setName and toDebugString</li> </ul> @@ -274,13 +274,13 @@ <li>Kay Ousterhout - Multiple bug fixes in scheduler’s handling of task failures</li> <li>Kousuke Saruta - Use of https to access github</li> <li>Mark Grover - Bug fix in distribution tar.gz</li> - <li>Matei Zaharia - Bug fixes in handling of task failures due to NPE, and cleaning up of scheduler data structures</li> + <li>Matei Zaharia - Bug fixes in handling of task failures due to NPE, and cleaning up of scheduler data structures </li> <li>Nan Zhu - Bug fixes in PySpark RDD.takeSample and adding of JARs using ADD_JAR - and improvements to docs</li> <li>Nick Lanham - Added ability to make distribution tarballs with Tachyon</li> <li>Patrick Wendell - Bug fixes in ASM shading, fixes for log4j initialization, removing Ganglia due to LGPL license, and other miscallenous bug fixes</li> <li>Prabin Banka - RDD.zip and other missing RDD operations in PySpark</li> <li>Prashant Sharma - RDD.foldByKey in PySpark, and other PySpark doc improvements</li> - <li>Qiuzhuang - Bug fix in standalone worker</li> + <li>Qiuzhuang - Bug fix in standalone worker </li> <li>Raymond Liu - Changed working directory in ZookeeperPersistenceEngine</li> <li>Reynold Xin - Improvements to docs and test infrastructure</li> <li>Sandy Ryza - Multiple important Yarn bug fixes and improvements</li> http://git-wip-us.apache.org/repos/asf/spark-website/blob/8781cd3c/site/releases/spark-release-0-9-2.html ---------------------------------------------------------------------- diff --git a/site/releases/spark-release-0-9-2.html b/site/releases/spark-release-0-9-2.html index 6ea336e..f6e68e9 100644 --- a/site/releases/spark-release-0-9-2.html +++ b/site/releases/spark-release-0-9-2.html @@ -150,6 +150,9 @@ <h5>Latest News</h5> <ul class="list-unstyled"> + <li><a href="/news/spark-wins-cloudsort-100tb-benchmark.html">Spark wins CloudSort Benchmark as the most efficient engine</a> + <span class="small">(Nov 15, 2016)</span></li> + <li><a href="/news/spark-2-0-2-released.html">Spark 2.0.2 released</a> <span class="small">(Nov 14, 2016)</span></li> @@ -159,9 +162,6 @@ <li><a href="/news/spark-2-0-1-released.html">Spark 2.0.1 released</a> <span class="small">(Oct 03, 2016)</span></li> - <li><a href="/news/spark-2-0-0-released.html">Spark 2.0.0 released</a> - <span class="small">(Jul 26, 2016)</span></li> - </ul> <p class="small" style="text-align: right;"><a href="/news/index.html">Archive</a></p> </div> http://git-wip-us.apache.org/repos/asf/spark-website/blob/8781cd3c/site/releases/spark-release-1-0-0.html ---------------------------------------------------------------------- diff --git a/site/releases/spark-release-1-0-0.html b/site/releases/spark-release-1-0-0.html index 90a1715..e6e8291 100644 --- a/site/releases/spark-release-1-0-0.html +++ b/site/releases/spark-release-1-0-0.html @@ -150,6 +150,9 @@ <h5>Latest News</h5> <ul class="list-unstyled"> + <li><a href="/news/spark-wins-cloudsort-100tb-benchmark.html">Spark wins CloudSort Benchmark as the most efficient engine</a> + <span class="small">(Nov 15, 2016)</span></li> + <li><a href="/news/spark-2-0-2-released.html">Spark 2.0.2 released</a> <span class="small">(Nov 14, 2016)</span></li> @@ -159,9 +162,6 @@ <li><a href="/news/spark-2-0-1-released.html">Spark 2.0.1 released</a> <span class="small">(Oct 03, 2016)</span></li> - <li><a href="/news/spark-2-0-0-released.html">Spark 2.0.0 released</a> - <span class="small">(Jul 26, 2016)</span></li> - </ul> <p class="small" style="text-align: right;"><a href="/news/index.html">Archive</a></p> </div> http://git-wip-us.apache.org/repos/asf/spark-website/blob/8781cd3c/site/releases/spark-release-1-0-1.html ---------------------------------------------------------------------- diff --git a/site/releases/spark-release-1-0-1.html b/site/releases/spark-release-1-0-1.html index f1fcfbf..76e3d54 100644 --- a/site/releases/spark-release-1-0-1.html +++ b/site/releases/spark-release-1-0-1.html @@ -150,6 +150,9 @@ <h5>Latest News</h5> <ul class="list-unstyled"> + <li><a href="/news/spark-wins-cloudsort-100tb-benchmark.html">Spark wins CloudSort Benchmark as the most efficient engine</a> + <span class="small">(Nov 15, 2016)</span></li> + <li><a href="/news/spark-2-0-2-released.html">Spark 2.0.2 released</a> <span class="small">(Nov 14, 2016)</span></li> @@ -159,9 +162,6 @@ <li><a href="/news/spark-2-0-1-released.html">Spark 2.0.1 released</a> <span class="small">(Oct 03, 2016)</span></li> - <li><a href="/news/spark-2-0-0-released.html">Spark 2.0.0 released</a> - <span class="small">(Jul 26, 2016)</span></li> - </ul> <p class="small" style="text-align: right;"><a href="/news/index.html">Archive</a></p> </div> @@ -258,8 +258,8 @@ <li>Cheng Hao – SQL features</li> <li>Cheng Lian – SQL features</li> <li>Christian Tzolov – build improvmenet</li> - <li>Clément MATHIEU – doc updates</li> - <li>CodingCat – doc updates and bug fix</li> + <li>Clément MATHIEU – doc updates </li> + <li>CodingCat – doc updates and bug fix </li> <li>Colin McCabe – bug fix</li> <li>Daoyuan – SQL joins</li> <li>David Lemieux – bug fix</li> @@ -275,7 +275,7 @@ <li>Kan Zhang – PySpark SQL features</li> <li>Kay Ousterhout – documentation fix</li> <li>LY Lai – bug fix</li> - <li>Lars Albertsson – bug fix</li> + <li>Lars Albertsson – bug fix </li> <li>Lei Zhang – SQL fix and feature</li> <li>Mark Hamstra – bug fix</li> <li>Matei Zaharia – doc updates and bug fix</li> @@ -297,7 +297,7 @@ <li>Shixiong Zhu – code clean-up</li> <li>Szul, Piotr – bug fix</li> <li>Takuya UESHIN – bug fixes and SQL features</li> - <li>Thomas Graves – bug fix</li> + <li>Thomas Graves – bug fix </li> <li>Uri Laserson – bug fix</li> <li>Vadim Chekan – bug fix</li> <li>Varakhedi Sujeet – ec2 r3 support</li> http://git-wip-us.apache.org/repos/asf/spark-website/blob/8781cd3c/site/releases/spark-release-1-0-2.html ---------------------------------------------------------------------- diff --git a/site/releases/spark-release-1-0-2.html b/site/releases/spark-release-1-0-2.html index 9b9090f..a167d53 100644 --- a/site/releases/spark-release-1-0-2.html +++ b/site/releases/spark-release-1-0-2.html @@ -150,6 +150,9 @@ <h5>Latest News</h5> <ul class="list-unstyled"> + <li><a href="/news/spark-wins-cloudsort-100tb-benchmark.html">Spark wins CloudSort Benchmark as the most efficient engine</a> + <span class="small">(Nov 15, 2016)</span></li> + <li><a href="/news/spark-2-0-2-released.html">Spark 2.0.2 released</a> <span class="small">(Nov 14, 2016)</span></li> @@ -159,9 +162,6 @@ <li><a href="/news/spark-2-0-1-released.html">Spark 2.0.1 released</a> <span class="small">(Oct 03, 2016)</span></li> - <li><a href="/news/spark-2-0-0-released.html">Spark 2.0.0 released</a> - <span class="small">(Jul 26, 2016)</span></li> - </ul> <p class="small" style="text-align: right;"><a href="/news/index.html">Archive</a></p> </div> @@ -268,7 +268,7 @@ <li>johnnywalleye - Bug fixes in MLlib</li> <li>joyyoj - Bug fix in Streaming</li> <li>kballou - Doc fix</li> - <li>lianhuiwang - Doc fix</li> + <li>lianhuiwang - Doc fix </li> <li>witgo - Bug fix in sbt</li> </ul> http://git-wip-us.apache.org/repos/asf/spark-website/blob/8781cd3c/site/releases/spark-release-1-1-0.html ---------------------------------------------------------------------- diff --git a/site/releases/spark-release-1-1-0.html b/site/releases/spark-release-1-1-0.html index f5789ca..739f973 100644 --- a/site/releases/spark-release-1-1-0.html +++ b/site/releases/spark-release-1-1-0.html @@ -150,6 +150,9 @@ <h5>Latest News</h5> <ul class="list-unstyled"> + <li><a href="/news/spark-wins-cloudsort-100tb-benchmark.html">Spark wins CloudSort Benchmark as the most efficient engine</a> + <span class="small">(Nov 15, 2016)</span></li> + <li><a href="/news/spark-2-0-2-released.html">Spark 2.0.2 released</a> <span class="small">(Nov 14, 2016)</span></li> @@ -159,9 +162,6 @@ <li><a href="/news/spark-2-0-1-released.html">Spark 2.0.1 released</a> <span class="small">(Oct 03, 2016)</span></li> - <li><a href="/news/spark-2-0-0-released.html">Spark 2.0.0 released</a> - <span class="small">(Jul 26, 2016)</span></li> - </ul> <p class="small" style="text-align: right;"><a href="/news/index.html">Archive</a></p> </div> @@ -197,7 +197,7 @@ <p>Spark SQL adds a number of new features and performance improvements in this release. A <a href="http://spark.apache.org/docs/1.1.0/sql-programming-guide.html#running-the-thrift-jdbc-server";>JDBC/ODBC server</a> allows users to connect to SparkSQL from many different applications and provides shared access to cached tables. A new module provides <a href="http://spark.apache.org/docs/1.1.0/sql-programming-guide.html#json-datasets";>support for loading JSON data</a> directly into Sparkâs SchemaRDD format, including automatic schema inference. Spark SQL introduces <a href="http://spark.apache.org/docs/1.1.0/sql-programming-guide.html#other-configuration-options";>dynamic bytecode generation</a> in this release, a technique which significantly speeds up execution for queries that perform complex expression evaluation. This release also adds support for registering Python, Scala, and Java lambda functions as UDFs, which can then be called directly in SQL. Spark 1.1 adds a <a href="ht tp://spark.apache.org/docs/1.1.0/sql-programming-guide.html#programmatically-specifying-the-schema">public types API to allow users to create SchemaRDDâs from custom data sources</a>. Finally, many optimizations have been added to the native Parquet support as well as throughout the engine.</p> <h3 id="mllib">MLlib</h3> -<p>MLlib adds several new algorithms and optimizations in this release. 1.1 introduces a <a href="https://issues.apache.org/jira/browse/SPARK-2359";>new library of statistical packages</a> which provides exploratory analytic functions. These include stratified sampling, correlations, chi-squared tests and support for creating random datasets. This release adds utilities for feature extraction (<a href="https://issues.apache.org/jira/browse/SPARK-2510";>Word2Vec</a> and <a href="https://issues.apache.org/jira/browse/SPARK-2511";>TF-IDF</a>) and feature transformation (<a href="https://issues.apache.org/jira/browse/SPARK-2272";>normalization and standard scaling</a>). Also new are support for <a href="https://issues.apache.org/jira/browse/SPARK-1553";>nonnegative matrix factorization</a> and <a href="https://issues.apache.org/jira/browse/SPARK-1782";>SVD via Lanczos</a>. The decision tree algorithm has been <a href="https://issues.apache.org/jira/browse/SPARK-2478";>added in Python and Java< /a>. A tree aggregation primitive has been added to help optimize many existing algorithms. Performance improves across the board in MLlib 1.1, with improvements of around 2-3X for many algorithms and up to 5X for large scale decision tree problems.</p> +<p>MLlib adds several new algorithms and optimizations in this release. 1.1 introduces a <a href="https://issues.apache.org/jira/browse/SPARK-2359";>new library of statistical packages</a> which provides exploratory analytic functions. These include stratified sampling, correlations, chi-squared tests and support for creating random datasets. This release adds utilities for feature extraction (<a href="https://issues.apache.org/jira/browse/SPARK-2510";>Word2Vec</a> and <a href="https://issues.apache.org/jira/browse/SPARK-2511";>TF-IDF</a>) and feature transformation (<a href="https://issues.apache.org/jira/browse/SPARK-2272";>normalization and standard scaling</a>). Also new are support for <a href="https://issues.apache.org/jira/browse/SPARK-1553";>nonnegative matrix factorization</a> and <a href="https://issues.apache.org/jira/browse/SPARK-1782";>SVD via Lanczos</a>. The decision tree algorithm has been <a href="https://issues.apache.org/jira/browse/SPARK-2478";>added in Python and Java< /a>. A tree aggregation primitive has been added to help optimize many existing algorithms. Performance improves across the board in MLlib 1.1, with improvements of around 2-3X for many algorithms and up to 5X for large scale decision tree problems. </p> <h3 id="graphx-and-spark-streaming">GraphX and Spark Streaming</h3> <p>Spark streaming adds a new data source <a href="https://issues.apache.org/jira/browse/SPARK-1981";>Amazon Kinesis</a>. For the Apache Flume, a new mode is supported which <a href="https://issues.apache.org/jira/browse/SPARK-1729";>pulls data from Flume</a>, simplifying deployment and providing high availability. The first of a set of <a href="https://issues.apache.org/jira/browse/SPARK-2438";>streaming machine learning algorithms</a> is introduced with streaming linear regression. Finally, <a href="https://issues.apache.org/jira/browse/SPARK-1341";>rate limiting</a> has been added for streaming inputs. GraphX adds <a href="https://issues.apache.org/jira/browse/SPARK-1991";>custom storage levels for vertices and edges</a> along with <a href="https://issues.apache.org/jira/browse/SPARK-2748";>improved numerical precision</a> across the board. Finally, GraphX adds a new label propagation algorithm.</p> @@ -215,7 +215,7 @@ <ul> <li>The default value of <code>spark.io.compression.codec</code> is now <code>snappy</code> for improved memory usage. Old behavior can be restored by switching to <code>lzf</code>.</li> - <li>The default value of <code>spark.broadcast.factory</code> is now <code>org.apache.spark.broadcast.TorrentBroadcastFactory</code> for improved efficiency of broadcasts. Old behavior can be restored by switching to <code>org.apache.spark.broadcast.HttpBroadcastFactory</code>.</li> + <li>The default value of <code>spark.broadcast.factory</code> is now <code>org.apache.spark.broadcast.TorrentBroadcastFactory</code> for improved efficiency of broadcasts. Old behavior can be restored by switching to <code>org.apache.spark.broadcast.HttpBroadcastFactory</code>. </li> <li>PySpark now performs external spilling during aggregations. Old behavior can be restored by setting <code>spark.shuffle.spill</code> to <code>false</code>.</li> <li>PySpark uses a new heuristic for determining the parallelism of shuffle operations. Old behavior can be restored by setting <code>spark.default.parallelism</code> to the number of cores in the cluster.</li> </ul> @@ -275,7 +275,7 @@ <li>Daneil Darabos – bug fixes and UI enhancements</li> <li>Daoyuan Wang – SQL fixes</li> <li>David Lemieux – bug fix</li> - <li>Davies Liu – PySpark fixes and spilling</li> + <li>Davies Liu – PySpark fixes and spilling </li> <li>DB Tsai – online summaries in MLlib and other MLlib features</li> <li>Derek Ma – bug fix</li> <li>Doris Xin – MLlib stats library and several fixes</li> http://git-wip-us.apache.org/repos/asf/spark-website/blob/8781cd3c/site/releases/spark-release-1-1-1.html ---------------------------------------------------------------------- diff --git a/site/releases/spark-release-1-1-1.html b/site/releases/spark-release-1-1-1.html index a730ce3..1795346 100644 --- a/site/releases/spark-release-1-1-1.html +++ b/site/releases/spark-release-1-1-1.html @@ -150,6 +150,9 @@ <h5>Latest News</h5> <ul class="list-unstyled"> + <li><a href="/news/spark-wins-cloudsort-100tb-benchmark.html">Spark wins CloudSort Benchmark as the most efficient engine</a> + <span class="small">(Nov 15, 2016)</span></li> + <li><a href="/news/spark-2-0-2-released.html">Spark 2.0.2 released</a> <span class="small">(Nov 14, 2016)</span></li> @@ -159,9 +162,6 @@ <li><a href="/news/spark-2-0-1-released.html">Spark 2.0.1 released</a> <span class="small">(Oct 03, 2016)</span></li> - <li><a href="/news/spark-2-0-0-released.html">Spark 2.0.0 released</a> - <span class="small">(Jul 26, 2016)</span></li> - </ul> <p class="small" style="text-align: right;"><a href="/news/index.html">Archive</a></p> </div> http://git-wip-us.apache.org/repos/asf/spark-website/blob/8781cd3c/site/releases/spark-release-1-2-0.html ---------------------------------------------------------------------- diff --git a/site/releases/spark-release-1-2-0.html b/site/releases/spark-release-1-2-0.html index 3cc6385..a07ece5 100644 --- a/site/releases/spark-release-1-2-0.html +++ b/site/releases/spark-release-1-2-0.html @@ -150,6 +150,9 @@ <h5>Latest News</h5> <ul class="list-unstyled"> + <li><a href="/news/spark-wins-cloudsort-100tb-benchmark.html">Spark wins CloudSort Benchmark as the most efficient engine</a> + <span class="small">(Nov 15, 2016)</span></li> + <li><a href="/news/spark-2-0-2-released.html">Spark 2.0.2 released</a> <span class="small">(Nov 14, 2016)</span></li> @@ -159,9 +162,6 @@ <li><a href="/news/spark-2-0-1-released.html">Spark 2.0.1 released</a> <span class="small">(Oct 03, 2016)</span></li> - <li><a href="/news/spark-2-0-0-released.html">Spark 2.0.0 released</a> - <span class="small">(Jul 26, 2016)</span></li> - </ul> <p class="small" style="text-align: right;"><a href="/news/index.html">Archive</a></p> </div> @@ -194,7 +194,7 @@ <p>In 1.2 Spark core upgrades two major subsystems to improve the performance and stability of very large scale shuffles. The first is Sparkâs communication manager used during bulk transfers, which upgrades to a <a href="https://issues.apache.org/jira/browse/SPARK-2468";>netty-based implementation</a>. The second is Sparkâs shuffle mechanism, which upgrades to the <a href="https://issues.apache.org/jira/browse/SPARK-3280";>âsort basedâ shuffle initially released in Spark 1.1</a>. These both improve the performance and stability of very large scale shuffles. Spark also adds an <a href="https://issues.apache.org/jira/browse/SPARK-3174";>elastic scaling mechanism</a> designed to improve cluster utilization during long running ETL-style jobs. This is currently supported on YARN and will make its way to other cluster managers in future versions. Finally, Spark 1.2 adds support for Scala 2.11. For instructions on building for Scala 2.11 see the <a href="/docs/1.2.0/building-spark.ht ml#building-for-scala-211">build documentation</a>.</p> <h3 id="spark-streaming">Spark Streaming</h3> -<p>This release includes two major feature additions to Sparkâs streaming library, a Python API and a write ahead log for full driver H/A. The <a href="https://issues.apache.org/jira/browse/SPARK-2377";>Python API</a> covers almost all the DStream transformations and output operations. Input sources based on text files and text over sockets are currently supported. Support for Kafka and Flume input streams in Python will be added in the next release. Second, Spark streaming now features H/A driver support through a <a href="https://issues.apache.org/jira/browse/SPARK-3129";>write ahead log (WAL)</a>. In Spark 1.1 and earlier, some buffered (received but not yet processed) data can be lost during driver restarts. To prevent this Spark 1.2 adds an optional WAL, which buffers received data into a fault-tolerant file system (e.g. HDFS). See the <a href="/docs/1.2.0/streaming-programming-guide.html">streaming programming guide</a> for more details.</p> +<p>This release includes two major feature additions to Sparkâs streaming library, a Python API and a write ahead log for full driver H/A. The <a href="https://issues.apache.org/jira/browse/SPARK-2377";>Python API</a> covers almost all the DStream transformations and output operations. Input sources based on text files and text over sockets are currently supported. Support for Kafka and Flume input streams in Python will be added in the next release. Second, Spark streaming now features H/A driver support through a <a href="https://issues.apache.org/jira/browse/SPARK-3129";>write ahead log (WAL)</a>. In Spark 1.1 and earlier, some buffered (received but not yet processed) data can be lost during driver restarts. To prevent this Spark 1.2 adds an optional WAL, which buffers received data into a fault-tolerant file system (e.g. HDFS). See the <a href="/docs/1.2.0/streaming-programming-guide.html">streaming programming guide</a> for more details. </p> <h3 id="mllib">MLLib</h3> <p>Spark 1.2 previews a new set of machine learning APIâs in a package called spark.ml that <a href="https://issues.apache.org/jira/browse/SPARK-3530";>supports learning pipelines</a>, where multiple algorithms are run in sequence with varying parameters. This type of pipeline is common in practical machine learning deployments. The new ML package uses Sparkâs SchemaRDD to represent <a href="https://issues.apache.org/jira/browse/SPARK-3573";>ML datasets</a>, providing direct interoperability with Spark SQL. In addition to the new API, Spark 1.2 extends decision trees with two tree ensemble methods: <a href="https://issues.apache.org/jira/browse/SPARK-1545";>random forests</a> and <a href="https://issues.apache.org/jira/browse/SPARK-1547";>gradient-boosted trees</a>, among the most successful tree-based models for classification and regression. Finally, MLlib’s Python implementation receives a major update in 1.2 to simplify the process of adding Python APIs, along with better Python API coverage.</p> --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
