[spark-website] branch asf-site updated: Fix broken link on 3rd party projects page and add more projects

2019-05-21 Thread matei
This is an automated email from the ASF dual-hosted git repository. matei pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/spark-website.git The following commit(s) were added to refs/heads/asf-site by this push: new 8a612a8 Fix broken link on 3rd party

spark-website git commit: Small updates to Powered By page

2018-06-16 Thread matei
cbf Parents: eb97812 Author: Matei Zaharia Authored: Sat Jun 16 10:02:09 2018 -0700 Committer: Matei Zaharia Committed: Sat Jun 16 10:02:09 2018 -0700 -- powered-by.md| 31 +++ site/doap.

spark-website git commit: Update Hive compatibility wording

2017-08-07 Thread matei
wip-us.apache.org/repos/asf/spark-website/tree/eb51b33f Diff: http://git-wip-us.apache.org/repos/asf/spark-website/diff/eb51b33f Branch: refs/heads/asf-site Commit: eb51b33f07b633acc70534ca022f0952d5b00d66 Parents: 8899096 Author: Matei Zaharia Authored: Sun Aug 6 12:46:03 2017 +0200 Committer: Ma

[1/3] spark-website git commit: Trademarks page and some FAQ cleanup

2016-08-03 Thread matei
SparkR + Streaming + Dependency, Packaging, and Operations + Removals, Behavior Changes and Deprecations + Removals + Behavior Changes + Deprecations - Known Issues - Credits + Known Issues + Credits API Stability @@ -394,7 +394,7 @@ - Apache Spark

[3/3] spark-website git commit: Trademarks page and some FAQ cleanup

2016-08-03 Thread matei
/asf/spark-website/diff/9700f2f4 Branch: refs/heads/asf-site Commit: 9700f2f4afe566412bdb73b443b3aad99b375af1 Parents: 6123834 Author: Matei Zaharia Authored: Wed Aug 3 19:12:55 2016 -0700 Committer: Matei Zaharia Committed: Wed Aug 3 19:12:55 2016 -0700

[2/3] spark-website git commit: Trademarks page and some FAQ cleanup

2016-08-03 Thread matei
http://git-wip-us.apache.org/repos/asf/spark-website/blob/9700f2f4/site/news/proposals-open-for-spark-summit-east.html -- diff --git a/site/news/proposals-open-for-spark-summit-east.html b/site/news/proposals-open-for-spark-summit

svn commit: r1747764 - in /spark: css/ site/ site/css/ site/images/

2016-06-10 Thread matei
Author: matei Date: Fri Jun 10 18:15:52 2016 New Revision: 1747764 URL: http://svn.apache.org/viewvc?rev=1747764&view=rev Log: CSS tweaks Modified: spark/css/custom.css spark/site/css/custom.css spark/site/documentation.html spark/site/images/spark-logo-reverse.eps spark/

svn commit: r1747763 - in /spark/images: spark-logo-reverse.eps spark-logo-trademark.png spark-logo.eps spark-logo.png spark-runs-everywhere.png

2016-06-10 Thread matei
Author: matei Date: Fri Jun 10 18:15:35 2016 New Revision: 1747763 URL: http://svn.apache.org/viewvc?rev=1747763&view=rev Log: Version of logo with Apache Modified: spark/images/spark-logo-reverse.eps spark/images/spark-logo-trademark.png spark/images/spark-logo.eps spark/im

svn commit: r1745631 [1/2] - in /spark: news/_posts/ site/ site/graphx/ site/mllib/ site/news/ site/releases/ site/screencasts/ site/sql/ site/streaming/

2016-05-26 Thread matei
Author: matei Date: Thu May 26 18:03:49 2016 New Revision: 1745631 URL: http://svn.apache.org/viewvc?rev=1745631&view=rev Log: 2.0 preview news item Added: spark/news/_posts/2016-05-26-spark-2.0.0-preview.md spark/site/news/spark-2.0.0-preview.html Modified: spark/site/community.

svn commit: r1745631 [2/2] - in /spark: news/_posts/ site/ site/graphx/ site/mllib/ site/news/ site/releases/ site/screencasts/ site/sql/ site/streaming/

2016-05-26 Thread matei
Modified: spark/site/news/spark-summit-2014-videos-posted.html URL: http://svn.apache.org/viewvc/spark/site/news/spark-summit-2014-videos-posted.html?rev=1745631&r1=1745630&r2=1745631&view=diff == --- spark/site/news/spark

svn commit: r1744474 - in /spark/site/images: spark-logo-reverse.eps spark-logo.eps

2016-05-18 Thread matei
Author: matei Date: Thu May 19 00:17:34 2016 New Revision: 1744474 URL: http://svn.apache.org/viewvc?rev=1744474&view=rev Log: EPS logos on live site Added: spark/site/images/spark-logo-reverse.eps (with props) spark/site/images/spark-logo.eps (with props) Added: spark/site/im

svn commit: r1744473 [1/2] - in /spark: ./ _layouts/ graphx/ images/ mllib/ site/ site/graphx/ site/images/ site/mllib/ site/news/ site/releases/ site/screencasts/ site/sql/ site/streaming/ sql/ strea

2016-05-18 Thread matei
Author: matei Date: Thu May 19 00:14:26 2016 New Revision: 1744473 URL: http://svn.apache.org/viewvc?rev=1744473&view=rev Log: Improvements to branding, some general updates, and EPS logos Added: spark/images/spark-logo-reverse.eps (with props) spark/images/spark-logo.eps (with p

svn commit: r1744473 [2/2] - in /spark: ./ _layouts/ graphx/ images/ mllib/ site/ site/graphx/ site/images/ site/mllib/ site/news/ site/releases/ site/screencasts/ site/sql/ site/streaming/ sql/ strea

2016-05-18 Thread matei
Modified: spark/site/releases/spark-release-1-0-0.html URL: http://svn.apache.org/viewvc/spark/site/releases/spark-release-1-0-0.html?rev=1744473&r1=1744472&r2=1744473&view=diff == --- spark/site/releases/spark-release-1-0

svn commit: r1731310 [1/2] - in /spark: ./ site/ site/news/ site/releases/

2016-02-19 Thread matei
Author: matei Date: Fri Feb 19 23:14:46 2016 New Revision: 1731310 URL: http://svn.apache.org/viewvc?rev=1731310&view=rev Log: Reference full software name on download page Modified: spark/downloads.md spark/site/documentation.html spark/site/downloads.html spark/

svn commit: r1731310 [2/2] - in /spark: ./ site/ site/news/ site/releases/

2016-02-19 Thread matei
Modified: spark/site/releases/spark-release-1-2-0.html URL: http://svn.apache.org/viewvc/spark/site/releases/spark-release-1-2-0.html?rev=1731310&r1=1731309&r2=1731310&view=diff == --- spark/site/releases/spark-release-1-2

svn commit: r1725819 - in /spark: ./ site/ site/news/ site/releases/

2016-01-20 Thread matei
Author: matei Date: Wed Jan 20 21:40:26 2016 New Revision: 1725819 URL: http://svn.apache.org/viewvc?rev=1725819&view=rev Log: Add TM symbol to download page Modified: spark/downloads.md spark/site/documentation.html spark/site/downloads.html spark/site/news/index.html s

spark git commit: [SPARK-9852] Let reduce tasks fetch multiple map output partitions

2015-09-24 Thread matei
nding on multiple map output partitions. Author: Matei Zaharia Closes #8844 from mateiz/spark-9852. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/21fd12cb Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/21fd12cb Di

spark git commit: [SPARK-9851] Support submitting map stages individually in DAGScheduler

2015-09-14 Thread matei
eresting decisions. The main entry point is SparkContext.submitMapStage, which lets you run a map stage and see stats about the map output sizes. Other stats could also be collected through accumulators. See AdaptiveSchedulingSuite for a short example. Author: Matei Zaharia Closes #8180 from mateiz/sp

spark git commit: [SPARK-10008] Ensure shuffle locality doesn't take precedence over narrow deps

2015-08-16 Thread matei
ndencies, it can cause them to place tasks based on the shuffle dependency instead of the narrow one. This case is common in iterative join-based algorithms like PageRank and ALS, where one RDD is hash-partitioned and one isn't. Author: Matei Zaharia Closes #8220 from mateiz/shuffle-loc-

spark git commit: [SPARK-10008] Ensure shuffle locality doesn't take precedence over narrow deps

2015-08-16 Thread matei
cies, it can cause them to place tasks based on the shuffle dependency instead of the narrow one. This case is common in iterative join-based algorithms like PageRank and ALS, where one RDD is hash-partitioned and one isn't. Author: Matei Zaharia Closes #8220 from mateiz/shuffle-loc-fix.

svn commit: r1692749 - in /spark: site/sql/index.html sql/index.md

2015-07-26 Thread matei
Author: matei Date: Sun Jul 26 19:11:45 2015 New Revision: 1692749 URL: http://svn.apache.org/r1692749 Log: Fix Python Modified: spark/site/sql/index.html spark/sql/index.md Modified: spark/site/sql/index.html URL: http://svn.apache.org/viewvc/spark/site/sql/index.html?rev=1692749&am

svn commit: r1692748 - in /spark: _layouts/ site/ site/graphx/ site/mllib/ site/news/ site/releases/ site/screencasts/ site/sql/ site/streaming/ sql/

2015-07-26 Thread matei
Author: matei Date: Sun Jul 26 19:10:57 2015 New Revision: 1692748 URL: http://svn.apache.org/r1692748 Log: Further improvements to site Modified: spark/_layouts/global.html spark/site/community.html spark/site/documentation.html spark/site/downloads.html spark/site

svn commit: r1692669 - in /spark: index.md site/index.html

2015-07-25 Thread matei
Author: matei Date: Sat Jul 25 23:15:18 2015 New Revision: 1692669 URL: http://svn.apache.org/r1692669 Log: Homepage tweak Modified: spark/index.md spark/site/index.html Modified: spark/index.md URL: http://svn.apache.org/viewvc/spark/index.md?rev=1692669&r1=1692668&r2=1692

svn commit: r1692668 [2/2] - in /spark: _layouts/ site/ site/graphx/ site/mllib/ site/news/ site/releases/ site/screencasts/ site/sql/ site/streaming/ sql/

2015-07-25 Thread matei
Modified: spark/site/releases/spark-release-0-8-0.html URL: http://svn.apache.org/viewvc/spark/site/releases/spark-release-0-8-0.html?rev=1692668&r1=1692667&r2=1692668&view=diff == --- spark/site/releases/spark-release-0-8

svn commit: r1692668 [1/2] - in /spark: _layouts/ site/ site/graphx/ site/mllib/ site/news/ site/releases/ site/screencasts/ site/sql/ site/streaming/ sql/

2015-07-25 Thread matei
Author: matei Date: Sat Jul 25 23:10:48 2015 New Revision: 1692668 URL: http://svn.apache.org/r1692668 Log: Updates to SQL page Modified: spark/_layouts/global.html spark/site/community.html spark/site/documentation.html spark/site/downloads.html spark/site/examples.html

svn commit: r1692667 - in /spark: community.md index.md site/community.html site/index.html

2015-07-25 Thread matei
Author: matei Date: Sat Jul 25 22:51:21 2015 New Revision: 1692667 URL: http://svn.apache.org/r1692667 Log: Updated with new meetups Modified: spark/community.md spark/index.md spark/site/community.html spark/site/index.html Modified: spark/community.md URL: http

spark git commit: [SPARK-9244] Increase some memory defaults

2015-07-22 Thread matei
We increase it to 1g. Author: Matei Zaharia Closes #7586 from mateiz/configs and squashes the following commits: ce0038a [Matei Zaharia] [SPARK-9244] Increase some memory defaults Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/sp

svn commit: r1691757 - in /spark: documentation.md site/documentation.html

2015-07-18 Thread matei
Author: matei Date: Sat Jul 18 17:17:39 2015 New Revision: 1691757 URL: http://svn.apache.org/r1691757 Log: Fix author of Packt book Modified: spark/documentation.md spark/site/documentation.html Modified: spark/documentation.md URL: http://svn.apache.org/viewvc/spark/documentation.md

svn commit: r1691756 - in /spark: documentation.md research.md site/documentation.html site/research.html

2015-07-18 Thread matei
Author: matei Date: Sat Jul 18 17:16:22 2015 New Revision: 1691756 URL: http://svn.apache.org/r1691756 Log: Updates to documentation and research pages Modified: spark/documentation.md spark/research.md spark/site/documentation.html spark/site/research.html Modified: spark

svn commit: r1682773 - in /spark: _layouts/ site/ site/graphx/ site/mllib/ site/news/ site/releases/ site/screencasts/ site/sql/ site/streaming/

2015-05-31 Thread matei
Author: matei Date: Sun May 31 19:06:00 2015 New Revision: 1682773 URL: http://svn.apache.org/r1682773 Log: Consistent wording of packages link Modified: spark/_layouts/global.html spark/site/community.html spark/site/documentation.html spark/site/downloads.html spark/site

svn commit: r1682772 - in /spark: faq.md site/faq.html site/streaming/index.html streaming/index.md

2015-05-31 Thread matei
Author: matei Date: Sun May 31 19:04:53 2015 New Revision: 1682772 URL: http://svn.apache.org/r1682772 Log: Some updates to FAQ on streaming Modified: spark/faq.md spark/site/faq.html spark/site/streaming/index.html spark/streaming/index.md Modified: spark/faq.md URL: http

spark git commit: [SPARK-7298] Harmonize style of new visualizations

2015-05-08 Thread matei
ler - DAG visualization text and colors are more consistent throughout - Fix some JavaScript style issues - Various small fixes throughout (e.g. inconsistent capitalization, some confusing names, HTML escaping, etc) Author: Matei Zaharia Closes #5942 from mateiz/ui and squashes the following comm

spark git commit: [SPARK-7298] Harmonize style of new visualizations

2015-05-08 Thread matei
DAG visualization text and colors are more consistent throughout - Fix some JavaScript style issues - Various small fixes throughout (e.g. inconsistent capitalization, some confusing names, HTML escaping, etc) Author: Matei Zaharia Closes #5942 from mateiz/ui and squashes the following comm

svn commit: r1677482 [2/2] - in /spark: ./ _layouts/ css/ site/ site/css/ site/graphx/ site/mllib/ site/news/ site/releases/ site/screencasts/ site/sql/ site/streaming/

2015-05-03 Thread matei
Modified: spark/site/news/video-from-first-spark-development-meetup.html URL: http://svn.apache.org/viewvc/spark/site/news/video-from-first-spark-development-meetup.html?rev=1677482&r1=1677481&r2=1677482&view=diff == --- s

svn commit: r1677482 [1/2] - in /spark: ./ _layouts/ css/ site/ site/css/ site/graphx/ site/mllib/ site/news/ site/releases/ site/screencasts/ site/sql/ site/streaming/

2015-05-03 Thread matei
Author: matei Date: Sun May 3 20:48:43 2015 New Revision: 1677482 URL: http://svn.apache.org/r1677482 Log: Some updates to FAQ and homepage Modified: spark/_layouts/global.html spark/css/custom.css spark/faq.md spark/index.md spark/site/community.html spark/site/css

svn commit: r1660555 - in /spark: community.md site/community.html

2015-02-17 Thread matei
Author: matei Date: Wed Feb 18 01:08:19 2015 New Revision: 1660555 URL: http://svn.apache.org/r1660555 Log: Berlin meetup and cleaning up meetup page Modified: spark/community.md spark/site/community.html Modified: spark/community.md URL: http://svn.apache.org/viewvc/spark/community.md

svn commit: r1658279 - in /spark: robots.txt sitemap.xml

2015-02-08 Thread matei
Author: matei Date: Sun Feb 8 23:59:49 2015 New Revision: 1658279 URL: http://svn.apache.org/r1658279 Log: Add robots.txt and sitemap.xml to top-level folder too so they get generated Added: spark/robots.txt spark/sitemap.xml Added: spark/robots.txt URL: http://svn.apache.org/viewvc

svn commit: r1658278 - in /spark: ./ _layouts/ graphx/ mllib/ site/ site/graphx/ site/mllib/ site/news/ site/releases/ site/screencasts/ site/sql/ site/streaming/ sql/ streaming/

2015-02-08 Thread matei
Author: matei Date: Sun Feb 8 23:58:24 2015 New Revision: 1658278 URL: http://svn.apache.org/r1658278 Log: Add meta description tags Modified: spark/_layouts/global.html spark/graphx/index.md spark/index.md spark/mllib/index.md spark/site/community.html spark/site

spark git commit: [SPARK-5608] Improve SEO of Spark documentation pages

2015-02-05 Thread matei
e's no reason to have "Spark SQL Programming Guide - Spark 1.2.0 documentation", we can just say "Spark SQL - Spark 1.2.0 documentation". Author: Matei Zaharia Closes #4381 from mateiz/docs-seo and squashes the following commits: 4940563 [Matei Zaharia] [SPAR

spark git commit: [SPARK-5608] Improve SEO of Spark documentation pages

2015-02-05 Thread matei
x27;s no reason to have "Spark SQL Programming Guide - Spark 1.2.0 documentation", we can just say "Spark SQL - Spark 1.2.0 documentation". Author: Matei Zaharia Closes #4381 from mateiz/docs-seo and squashes the following commits: 4940563 [Matei Zaharia] [SPARK-5608] Improv

svn commit: r1657457 - in /spark/site: robots.txt sitemap.xml

2015-02-04 Thread matei
Author: matei Date: Thu Feb 5 02:01:47 2015 New Revision: 1657457 URL: http://svn.apache.org/r1657457 Log: Add a sitemap to try to let Google more easily find docs/latest Added: spark/site/robots.txt spark/site/sitemap.xml Added: spark/site/robots.txt URL: http://svn.apache.org/viewvc

svn commit: r1653723 [2/2] - in /spark: news/_posts/ site/ site/graphx/ site/mllib/ site/news/ site/releases/ site/screencasts/ site/sql/ site/streaming/

2015-01-21 Thread matei
Modified: spark/site/releases/spark-release-0-5-2.html URL: http://svn.apache.org/viewvc/spark/site/releases/spark-release-0-5-2.html?rev=1653723&r1=1653722&r2=1653723&view=diff == --- spark/site/releases/spark-release-0-5

svn commit: r1653723 [1/2] - in /spark: news/_posts/ site/ site/graphx/ site/mllib/ site/news/ site/releases/ site/screencasts/ site/sql/ site/streaming/

2015-01-21 Thread matei
Author: matei Date: Thu Jan 22 00:27:22 2015 New Revision: 1653723 URL: http://svn.apache.org/r1653723 Log: Add Summit East news item Added: spark/news/_posts/2015-01-21-spark-summit-east-agenda-posted.md spark/site/news/spark-summit-east-agenda-posted.html Modified: spark/site

spark git commit: [SPARK-3619] Upgrade to Mesos 0.21 to work around MESOS-1688

2015-01-09 Thread matei
ri Jan 9 10:47:08 2015 -0800 Committer: Matei Zaharia Committed: Fri Jan 9 10:47:08 2015 -0800 -- pom.xml | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) -

svn commit: r1642753 - in /spark: community.md site/community.html

2014-12-01 Thread matei
Author: matei Date: Mon Dec 1 21:01:25 2014 New Revision: 1642753 URL: http://svn.apache.org/r1642753 Log: tweaks Modified: spark/community.md spark/site/community.html Modified: spark/community.md URL: http://svn.apache.org/viewvc/spark/community.md?rev=1642753&r1=1642752&r2

svn commit: r1642751 - in /spark: community.md site/community.html

2014-12-01 Thread matei
Author: matei Date: Mon Dec 1 20:56:05 2014 New Revision: 1642751 URL: http://svn.apache.org/r1642751 Log: tweaks to conferences Modified: spark/community.md spark/site/community.html Modified: spark/community.md URL: http://svn.apache.org/viewvc/spark/community.md?rev=1642751&am

spark git commit: [SPARK-4613][Core] Java API for JdbcRDD

2014-11-27 Thread matei
herry picked from commit 120a350240f58196eafcb038ca3a353636d89239) Signed-off-by: Matei Zaharia Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/09280043 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/09280043 Diff: http://git-wip

spark git commit: [SPARK-4613][Core] Java API for JdbcRDD

2014-11-27 Thread matei
ca3a353636d89239 Parents: 84376d3 Author: Cheng Lian Authored: Thu Nov 27 18:01:14 2014 -0800 Committer: Matei Zaharia Committed: Thu Nov 27 18:01:14 2014 -0800 -- .../scala/org/apache/spark/rdd/JdbcRDD.scala| 84 ++

svn commit: r1642004 - in /spark: news/_posts/2014-11-26-registration-open-for-spark-summit-east.md site/news/index.html site/news/registration-open-for-spark-summit-east.html

2014-11-26 Thread matei
Author: matei Date: Thu Nov 27 02:09:19 2014 New Revision: 1642004 URL: http://svn.apache.org/r1642004 Log: Fixed text Modified: spark/news/_posts/2014-11-26-registration-open-for-spark-summit-east.md spark/site/news/index.html spark/site/news/registration-open-for-spark-summit

svn commit: r1642003 [2/3] - in /spark: ./ _layouts/ news/_posts/ site/ site/graphx/ site/mllib/ site/news/ site/releases/ site/screencasts/ site/sql/ site/streaming/

2014-11-26 Thread matei
Modified: spark/site/news/spark-1-0-1-released.html URL: http://svn.apache.org/viewvc/spark/site/news/spark-1-0-1-released.html?rev=1642003&r1=1642002&r2=1642003&view=diff == --- spark/site/news/spark-1-0-1-released.html (

svn commit: r1642003 [3/3] - in /spark: ./ _layouts/ news/_posts/ site/ site/graphx/ site/mllib/ site/news/ site/releases/ site/screencasts/ site/sql/ site/streaming/

2014-11-26 Thread matei
Modified: spark/site/releases/spark-release-0-9-0.html URL: http://svn.apache.org/viewvc/spark/site/releases/spark-release-0-9-0.html?rev=1642003&r1=1642002&r2=1642003&view=diff == --- spark/site/releases/spark-release-0-9

svn commit: r1642003 [1/3] - in /spark: ./ _layouts/ news/_posts/ site/ site/graphx/ site/mllib/ site/news/ site/releases/ site/screencasts/ site/sql/ site/streaming/

2014-11-26 Thread matei
Author: matei Date: Thu Nov 27 02:07:18 2014 New Revision: 1642003 URL: http://svn.apache.org/r1642003 Log: tweak nav bar and add registration for Spark Summit East Added: spark/news/_posts/2014-11-26-registration-open-for-spark-summit-east.md spark/site/news/registration-open-for-spark

spark git commit: [SPARK-732][SPARK-3628][CORE][RESUBMIT] eliminate duplicate update on accmulator

2014-11-26 Thread matei
case for resubmitted result stage 5cf586f [CodingCat] de-duplicate on task level 138f9b3 [CodingCat] make MIMA happy 67593d2 [CodingCat] make if allowing duplicate update as an option of accumulator (cherry picked from commit 5af53ada65f62e6b5987eada288fb48e9211ef9d) Signed-off-by: Matei Zaharia

spark git commit: [SPARK-732][SPARK-3628][CORE][RESUBMIT] eliminate duplicate update on accmulator

2014-11-26 Thread matei
14 -0800 Committer: Matei Zaharia Committed: Wed Nov 26 16:52:04 2014 -0800 -- .../scala/org/apache/spark/Accumulators.scala | 4 +- .../apache/spark/scheduler/DAGScheduler.scala | 53 +++- .../spark/s

spark git commit: [SPARK-4330][Doc] Link to proper URL for YARN overview

2014-11-10 Thread matei
es #3196 from sarutak/SPARK-4330 and squashes the following commits: 30baa21 [Kousuke Saruta] Fixed running-on-yarn.md to point proper URL for YARN (cherry picked from commit 3c07b8f08240bafcdff5d174989fb433f4bc80b6) Signed-off-by: Matei Zaharia Project: http://git-wip-us.apache.org/repos/asf/spar

spark git commit: [SPARK-4330][Doc] Link to proper URL for YARN overview

2014-11-10 Thread matei
es #3196 from sarutak/SPARK-4330 and squashes the following commits: 30baa21 [Kousuke Saruta] Fixed running-on-yarn.md to point proper URL for YARN (cherry picked from commit 3c07b8f08240bafcdff5d174989fb433f4bc80b6) Signed-off-by: Matei Zaharia Project: http://git-wip-us.apache.org/repos/asf/spar

spark git commit: [SPARK-4330][Doc] Link to proper URL for YARN overview

2014-11-10 Thread matei
che.org/repos/asf/spark/tree/3c07b8f0 Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/3c07b8f0 Branch: refs/heads/master Commit: 3c07b8f08240bafcdff5d174989fb433f4bc80b6 Parents: 300887b Author: Kousuke Saruta Authored: Mon Nov 10 22:18:00 2014 -0800 Committer: Matei Zaharia Committed: Mon

git commit: [SPARK-4186] add binaryFiles and binaryRecords in Python

2014-11-06 Thread matei
[Davies Liu] add binaryFiles and binaryRecords in Python (cherry picked from commit b41a39e24038876359aeb7ce24de2234e5f3) Signed-off-by: Matei Zaharia Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/01484455 Tree: http://git-

git commit: [SPARK-4186] add binaryFiles and binaryRecords in Python

2014-11-06 Thread matei
1a39e2 Branch: refs/heads/master Commit: b41a39e24038876359aeb7ce24de2234e5f3 Parents: 5f27ae1 Author: Davies Liu Authored: Thu Nov 6 00:22:19 2014 -0800 Committer: Matei Zaharia Committed: Thu Nov 6 00:22:19 2014 -0800 -

git commit: SPARK-4040. Update documentation to exemplify use of local (n) value, fo...

2014-11-05 Thread matei
964 from jayunit100/SPARK-4040 and squashes the following commits: 35b5a5e [j...@apache.org] SPARK-4040: Update documentation to exemplify use of local (n) value. (cherry picked from commit 868cd4c3ca11e6ecc4425b972d9a20c360b52425) Signed-off-by: Matei Zaharia Project: http://git-

git commit: SPARK-4040. Update documentation to exemplify use of local (n) value, fo...

2014-11-05 Thread matei
ttp://git-wip-us.apache.org/repos/asf/spark/tree/868cd4c3 Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/868cd4c3 Branch: refs/heads/master Commit: 868cd4c3ca11e6ecc4425b972d9a20c360b52425 Parents: 61a5cce Author: j...@apache.org Authored: Wed Nov 5 15:45:34 2014 -0800 Committer: Matei Zaha

git commit: SPARK-4222 [CORE] use readFully in FixedLengthBinaryRecordReader

2014-11-05 Thread matei
and squashes the following commits: a245c8a [industrial-sloth] use readFully in FixedLengthBinaryRecordReader (cherry picked from commit 6844e7a8219ac78790a422ffd5054924e7d2bea1) Signed-off-by: Matei Zaharia Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.

git commit: SPARK-4222 [CORE] use readFully in FixedLengthBinaryRecordReader

2014-11-05 Thread matei
7a8 Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/6844e7a8 Branch: refs/heads/branch-1.2 Commit: 6844e7a8219ac78790a422ffd5054924e7d2bea1 Parents: f4beb77 Author: industrial-sloth Authored: Wed Nov 5 15:38:48 2014 -0800 Committer: Matei Zaharia Committed: Wed Nov 5 15:38:48 2014 -0

git commit: [SPARK-3466] Limit size of results that a driver collects for each action

2014-11-02 Thread matei
ts: 23f966f Author: Davies Liu Authored: Sun Nov 2 00:03:51 2014 -0700 Committer: Matei Zaharia Committed: Sun Nov 2 00:03:51 2014 -0700 -- .../org/apache/spark/executor/Executor.scala| 25 +-- .../org/apac

git commit: [SPARK-2759][CORE] Generic Binary File Support in Spark

2014-11-01 Thread matei
ranch: refs/heads/master Commit: 7136719b7d53ee1360abaa5e178ba9f8b00f3da8 Parents: ee29ef3 Author: Kevin Mader Authored: Sat Nov 1 11:22:46 2014 -0700 Committer: Matei Zaharia Committed: Sat Nov 1 11:59:39 2014 -0700 ---

svn commit: r1632873 [1/2] - in /spark: news/_posts/ site/ site/graphx/ site/mllib/ site/news/ site/releases/ site/screencasts/ site/sql/ site/streaming/

2014-10-18 Thread matei
Author: matei Date: Sun Oct 19 04:49:55 2014 New Revision: 1632873 URL: http://svn.apache.org/r1632873 Log: Added Spark Summit East call for submissions Added: spark/news/_posts/2014-10-18-proposals-open-for-spark-summit-east.md spark/site/news/proposals-open-for-spark-summit-east.html

svn commit: r1632873 [2/2] - in /spark: news/_posts/ site/ site/graphx/ site/mllib/ site/news/ site/releases/ site/screencasts/ site/sql/ site/streaming/

2014-10-18 Thread matei
Modified: spark/site/releases/spark-release-0-9-0.html URL: http://svn.apache.org/viewvc/spark/site/releases/spark-release-0-9-0.html?rev=1632873&r1=1632872&r2=1632873&view=diff == --- spark/site/releases/spark-release-0-9

svn commit: r1631016 - in /spark: community.md site/community.html

2014-10-10 Thread matei
Author: matei Date: Sat Oct 11 03:44:25 2014 New Revision: 1631016 URL: http://svn.apache.org/r1631016 Log: Added Maryland meetup Modified: spark/community.md spark/site/community.html Modified: spark/community.md URL: http://svn.apache.org/viewvc/spark/community.md?rev=1631016&am

svn commit: r1631015 - in /spark: community.md site/community.html

2014-10-10 Thread matei
Author: matei Date: Sat Oct 11 03:42:52 2014 New Revision: 1631015 URL: http://svn.apache.org/r1631015 Log: Added Beijing meetup Modified: spark/community.md spark/site/community.html Modified: spark/community.md URL: http://svn.apache.org/viewvc/spark/community.md?rev=1631015&am

svn commit: r1631014 - in /spark: community.md site/community.html

2014-10-10 Thread matei
Author: matei Date: Sat Oct 11 03:07:06 2014 New Revision: 1631014 URL: http://svn.apache.org/r1631014 Log: Added Boulder meetup Modified: spark/community.md spark/site/community.html Modified: spark/community.md URL: http://svn.apache.org/viewvc/spark/community.md?rev=1631014&am

git commit: [SPARK-3762] clear reference of SparkEnv after stop

2014-10-07 Thread matei
:06:12 2014 -0700 Committer: Matei Zaharia Committed: Tue Oct 7 12:06:12 2014 -0700 -- .../main/scala/org/apache/spark/SparkEnv.scala | 19 --- .../org/apache/spark/api/python/PythonRDD.scala | 1 - .../org/apa

git commit: [SPARK-3356] [DOCS] Document when RDD elements' ordering within partitions is nondeterministic

2014-09-30 Thread matei
0b Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/ab6dd80b Branch: refs/heads/master Commit: ab6dd80ba0f7e1042ea270d10400109a467fe40e Parents: 157e7d0 Author: Sean Owen Authored: Tue Sep 30 11:15:38 2014 -0700 Committer: Matei Zaharia Committed: Tue Sep 30 11:15:

git commit: [SPARK-3032][Shuffle] Fix key comparison integer overflow introduced sorting exception

2014-09-29 Thread matei
1e6 [jerryshao] Change the test to show the contract violate exception 83acb38 [jerryshao] Minor changes according to comments fa2a08f [jerryshao] Fix key comparison integer overflow introduced sorting exception (cherry picked from commit dab1b0ae29a6d3017bdca23464f22a51d51eaae1) Signed-off-by: Ma

git commit: [SPARK-3032][Shuffle] Fix key comparison integer overflow introduced sorting exception

2014-09-29 Thread matei
11:25:32 2014 -0700 Committer: Matei Zaharia Committed: Mon Sep 29 11:25:32 2014 -0700 -- .../spark/util/collection/ExternalSorter.scala | 2 +- .../util/collection/ExternalSorterSuite.scala | 55 2 fi

git commit: [SPARK-3389] Add Converter for ease of Parquet reading in PySpark

2014-09-27 Thread matei
red: Sat Sep 27 21:48:05 2014 -0700 Committer: Matei Zaharia Committed: Sat Sep 27 21:48:05 2014 -0700 -- examples/src/main/python/parquet_inputformat.py | 59 ++ examples/src/main/resources/full_user.avsc

git commit: SPARK-2745 [STREAMING] Add Java friendly methods to Duration class

2014-09-23 Thread matei
wip-us.apache.org/repos/asf/spark/tree/e73b48ac Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/e73b48ac Branch: refs/heads/master Commit: e73b48ace0a7e0f249221240140235d33eeac36b Parents: 3b8eefa Author: Sean Owen Authored: Tue Sep 23 11:58:05 2014 -0700 Committer: Matei Zaharia Committ

git commit: SPARK-2978. Transformation with MR shuffle semantics

2014-09-08 Thread matei
ents: e16a8e7 Author: Sandy Ryza Authored: Mon Sep 8 11:20:00 2014 -0700 Committer: Matei Zaharia Committed: Mon Sep 8 11:20:00 2014 -0700 -- .../org/apache/spark/api/java/JavaPairRDD.scala | 26 + .../apa

git commit: [SPARK-3394] [SQL] Fix crash in TakeOrdered when limit is 0

2014-09-07 Thread matei
ing commits: c87355b [Eric Liang] refactor bfb6140 [Eric Liang] change RDD takeOrdered instead 7a51528 [Eric Liang] fix takeordered when limit = 0 (cherry picked from commit 6754570d83044c4fbaf0d2ac2378a0e081a93629) Signed-off-by: Matei Zaharia Project: http://git-wip-us.apache.org/repos/asf/spark/r

git commit: [SPARK-3394] [SQL] Fix crash in TakeOrdered when limit is 0

2014-09-07 Thread matei
org/repos/asf/spark/tree/6754570d Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/6754570d Branch: refs/heads/master Commit: 6754570d83044c4fbaf0d2ac2378a0e081a93629 Parents: 3fb57a0 Author: Eric Liang Authored: Sun Sep 7 17:57:59 2014 -0700 Committer: Matei Zaharia Committed: Sun Sep 7 17

git commit: [SPARK-3394] [SQL] Fix crash in TakeOrdered when limit is 0

2014-09-07 Thread matei
ing commits: c87355b [Eric Liang] refactor bfb6140 [Eric Liang] change RDD takeOrdered instead 7a51528 [Eric Liang] fix takeordered when limit = 0 (cherry picked from commit 6754570d83044c4fbaf0d2ac2378a0e081a93629) Signed-off-by: Matei Zaharia Project: http://git-wip-us.apache.org/repos/asf/spark/r

git commit: [SPARK-3353] parent stage should have lower stage id.

2014-09-06 Thread matei
/repos/asf/spark/tree/3fb57a0a Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/3fb57a0a Branch: refs/heads/master Commit: 3fb57a0ab3d76fda2301dbe9f2f3fa6743b4ed78 Parents: 110fb8b Author: Reynold Xin Authored: Sat Sep 6 19:06:30 2014 -0700 Committer: Matei Zaharia Committed: Sat Sep 6 19

git commit: SPARK-3211 .take() is OOM-prone with empty partitions

2014-09-05 Thread matei
Spark to be less OOM-prone as well 3a156b8 [Andrew Ash] SPARK-3211 .take() is OOM-prone with empty partitions (cherry picked from commit ba5bcaddecd54811d45c5fc79a013b3857d4c633) Signed-off-by: Matei Zaharia Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.ap

git commit: SPARK-3211 .take() is OOM-prone with empty partitions

2014-09-05 Thread matei
add Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/ba5bcadd Branch: refs/heads/master Commit: ba5bcaddecd54811d45c5fc79a013b3857d4c633 Parents: 7ff8c45 Author: Andrew Ash Authored: Fri Sep 5 18:52:05 2014 -0700 Committer: Matei Zaharia Committed: Fri Sep 5 18:52:05 20

git commit: Manually close old PR

2014-09-04 Thread matei
ark/tree/90b17a70 Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/90b17a70 Branch: refs/heads/master Commit: 90b17a70c703c403d397e24cfbc20da22a32102d Parents: 0fdf2f5 Author: Matei Zaharia Authored: Thu Sep 4 17:51:14 2014 -0700 Committer: Matei Zaharia Committed: Thu Sep 4 17:51:14 2014 -0

git commit: Manually close old PR

2014-09-04 Thread matei
ark/tree/0fdf2f5a Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/0fdf2f5a Branch: refs/heads/master Commit: 0fdf2f5a18d88a600ca1ab7b4bf02fb0537e9411 Parents: dc1ba9e Author: Matei Zaharia Authored: Thu Sep 4 17:47:16 2014 -0700 Committer: Matei Zaharia Committed: Thu Sep 4 17:47:16 2

git commit: SPARK-3052. Misleading and spurious FileSystem closed errors whenever a ...

2014-09-02 Thread matei
pos/asf/spark/tree/81b9d5b6 Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/81b9d5b6 Branch: refs/heads/master Commit: 81b9d5b628229ed69aa9dae45ec4c94068dcd71e Parents: 066f31a Author: Sandy Ryza Authored: Tue Sep 2 11:34:55 2014 -0700 Committer: Matei Zaharia Committed: Tue Sep 2 11:34

git commit: [SPARK-3342] Add SSDs to block device mapping

2014-09-01 Thread matei
pos/asf/spark/diff/e1363129 Branch: refs/heads/branch-1.1 Commit: e136312913517f0e2cbce3742076e955fc237c42 Parents: 865e6f6 Author: Daniel Darabos Authored: Mon Sep 1 22:14:28 2014 -0700 Committer: Matei Zaharia Committed: Mon Sep 1 22:18:

git commit: [SPARK-3342] Add SSDs to block device mapping

2014-09-01 Thread matei
pos/asf/spark/diff/44d3a6a7 Branch: refs/heads/master Commit: 44d3a6a75209370b1648e2dfedaa4c895923dae5 Parents: db16067 Author: Daniel Darabos Authored: Mon Sep 1 22:14:28 2014 -0700 Committer: Matei Zaharia Committed: Mon Sep 1 22:16:

git commit: [SPARK-3010] fix redundant conditional

2014-08-31 Thread matei
ark/commit/725715cb Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/725715cb Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/725715cb Branch: refs/heads/master Commit: 725715cbf3c1834b81aa91ea751fd04d307f504d Parents: c567a68 Author: scwf Authored: Sun Aug 31 14:02:11 2014 -0700 Comm

git commit: SPARK-3318: Documentation update in addFile on how to use SparkFiles.get

2014-08-30 Thread matei
83b Branch: refs/heads/master Commit: ba78383bace52b13ee931c6f2df445f721d5080a Parents: b6cf134 Author: Holden Karau Authored: Sat Aug 30 16:58:17 2014 -0700 Committer: Matei Zaharia Committed: Sat Aug 30 16:58:17 2014 -0700 -- c

git commit: [SPARK-2889] Create Hadoop config objects consistently.

2014-08-30 Thread matei
master Commit: b6cf1348170951396a6a5d8a65fb670382304f5b Parents: d90434c Author: Marcelo Vanzin Authored: Sat Aug 30 14:48:07 2014 -0700 Committer: Matei Zaharia Committed: Sat Aug 30 14:48:07 2014 -0700 -- .../scala/org/apache/spark/

git commit: SPARK-3265 Allow using custom ipython executable with pyspark

2014-08-27 Thread matei
uthored: Wed Aug 27 19:47:33 2014 -0700 Committer: Matei Zaharia Committed: Wed Aug 27 19:47:33 2014 -0700 -- bin/pyspark | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) --

git commit: [SPARK-3271] delete unused methods in Utils

2014-08-27 Thread matei
mit: b86277c13232c3e65ce6c6cf7f6ede6a00546485 Parents: 64d8ecb Author: scwf Authored: Wed Aug 27 19:44:26 2014 -0700 Committer: Matei Zaharia Committed: Wed Aug 27 19:44:30 2014 -0700 -- .../scala/org/apache/spark/util/Utils.sc

git commit: [SPARK-3256] Added support for :cp that was broken in Scala 2.10.x for REPL

2014-08-27 Thread matei
ed: Wed Aug 27 13:01:11 2014 -0700 Committer: Matei Zaharia Committed: Wed Aug 27 13:01:11 2014 -0700 -- .../org/apache/spark/repl/SparkILoop.scala | 19 +++--- .../org/apache/spark/repl/SparkIMain.scala | 65 ++

git commit: [SPARK-3239] [PySpark] randomize the dirs for each process

2014-08-27 Thread matei
wip-us.apache.org/repos/asf/spark/diff/092121e4 Branch: refs/heads/branch-1.1 Commit: 092121e477bcd2e474440dbdfdfa69cbd15c4803 Parents: 8f8e2a4 Author: Davies Liu Authored: Wed Aug 27 10:40:35 2014 -0700 Committer: Matei Zaharia Committed: Wed Aug 27 10:40:35 2014 -0

git commit: Manually close old pull requests

2014-08-26 Thread matei
wip-us.apache.org/repos/asf/spark/tree/e70aff6c Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/e70aff6c Branch: refs/heads/master Commit: e70aff6c2d7f216060def0bd02be6a3d9017cd13 Parents: ee91eb8 Author: Matei Zaharia Authored: Tue Aug 26 19:35:19 2014 -0700 Committer: Matei Zaharia Committed:

git commit: Manually close some old pull requests

2014-08-26 Thread matei
mit/ee91eb8c Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/ee91eb8c Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/ee91eb8c Branch: refs/heads/master Commit: ee91eb8c53da84f8875fb5cec5820a6e189057b9 Parents: d834547 Author: Matei Zaharia Authored: Tue Aug 26 19:29:54 2014 -0700 Commit

git commit: [SPARK-3240] Adding known issue for MESOS-1688

2014-08-26 Thread matei
26 18:30:39 2014 -0700 Committer: Matei Zaharia Committed: Tue Aug 26 18:30:45 2014 -0700 -- docs/running-on-mesos.md | 2 ++ 1 file changed, 2 insertions(+) --

git commit: [SPARK-3225]Typo in script

2014-08-26 Thread matei
Commit: 2ffd3290fe30c23df8da1efe153b84c23eb2e1cd Parents: f1e71d4 Author: WangTao Authored: Tue Aug 26 17:30:59 2014 -0700 Committer: Matei Zaharia Committed: Tue Aug 26 17:30:59 2014 -0700 -- bin/load-spark-env.sh | 6 +++--- 1 file c

git commit: [SPARK-3073] [PySpark] use external sort in sortBy() and sortByKey()

2014-08-26 Thread matei
e71d4c Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/f1e71d4c Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/f1e71d4c Branch: refs/heads/master Commit: f1e71d4c3ba678fc108effb05cf2d6101dadc0ce Parents: c4787a3 Author: Davies Liu Authored: Tue Aug 26 16:57:40 2014 -0700 Committer: M

  1   2   3   4   >