spark git commit: [SPARK-6278][MLLIB] Mention the change of objective in linear regression

2015-03-13 Thread meng
Repository: spark Updated Branches: refs/heads/branch-1.3 dc287f38f - 214f68103 [SPARK-6278][MLLIB] Mention the change of objective in linear regression As discussed in the RC3 vote thread, we should mention the change of objective in linear regression in the migration guide. srowen Author:

spark git commit: [SPARK-6252] [mllib] Added getLambda to Scala NaiveBayes

2015-03-13 Thread meng
Repository: spark Updated Branches: refs/heads/master ea3d2eed9 - dc4abd4dc [SPARK-6252] [mllib] Added getLambda to Scala NaiveBayes Note: not relevant for Python API since it only has a static train method Author: Joseph K. Bradley joseph.kurata.brad...@gmail.com Author: Joseph K. Bradley

spark git commit: SPARK-4044 [CORE] Thriftserver fails to start when JAVA_HOME points to JRE instead of JDK

2015-03-13 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-1.3 a3493eb77 - 4aa41327d SPARK-4044 [CORE] Thriftserver fails to start when JAVA_HOME points to JRE instead of JDK Don't use JAR_CMD unless present in archive check. Add datanucleus always if present, to avoid needing a check involving

spark git commit: [SPARK-6036][CORE] avoid race condition between eventlogListener and akka actor system

2015-03-13 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-1.3 4aa41327d - f81611dca [SPARK-6036][CORE] avoid race condition between eventlogListener and akka actor system For detail description, pls refer to [SPARK-6036](https://issues.apache.org/jira/browse/SPARK-6036). Author: Zhang, Liye

spark git commit: [SPARK-6087][CORE] Provide actionable exception if Kryo buffer is not large enough

2015-03-13 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-1.3 f81611dca - 9846790f4 [SPARK-6087][CORE] Provide actionable exception if Kryo buffer is not large enough A simple try-catch wrapping KryoException to be more informative. Author: Lev Khomich levkhom...@gmail.com Closes #4947 from

spark git commit: [SPARK-4600][GraphX]: org.apache.spark.graphx.VertexRDD.diff does not work

2015-03-13 Thread srowen
Repository: spark Updated Branches: refs/heads/master 7f13434a5 - b943f5d90 [SPARK-4600][GraphX]: org.apache.spark.graphx.VertexRDD.diff does not work Turns out, per the [convo on the JIRA](https://issues.apache.org/jira/browse/SPARK-4600), `diff` is acting exactly as should. It became a

spark git commit: [SPARK-6133] Make sc.stop() idempotent

2015-03-13 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-1.3 338bea7b3 - a08588c7e [SPARK-6133] Make sc.stop() idempotent Before we would get the following (benign) error if we called `sc.stop()` twice. This is because the listener bus would try to post the end event again even after it has

svn commit: r1666516 - in /spark: releases/_posts/2015-03-13-spark-release-1-3-0.md site/releases/spark-release-1-3-0.html

2015-03-13 Thread pwendell
Author: pwendell Date: Fri Mar 13 17:15:41 2015 New Revision: 1666516 URL: http://svn.apache.org/r1666516 Log: Incorrect link in Kafka API in 1.3 release notes Modified: spark/releases/_posts/2015-03-13-spark-release-1-3-0.md spark/site/releases/spark-release-1-3-0.html Modified:

spark git commit: SPARK-4300 [CORE] Race condition during SparkWorker shutdown

2015-03-13 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-1.3 170af49bb - a3493eb77 SPARK-4300 [CORE] Race condition during SparkWorker shutdown Close appender saving stdout/stderr before destroying process to avoid exception on reading closed input stream. (This also removes a redundant

spark git commit: [SPARK-6275][Documentation]Miss toDF() function in docs/sql-programming-guide.md

2015-03-13 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-1.3 a08588c7e - 301278126 [SPARK-6275][Documentation]Miss toDF() function in docs/sql-programming-guide.md Miss `toDF()` function in docs/sql-programming-guide.md Author: zzcclp xm_...@sina.com Closes #4977 from zzcclp/SPARK-6275 and

svn commit: r1666542 - in /spark: documentation.md site/documentation.html

2015-03-13 Thread pwendell
Author: pwendell Date: Fri Mar 13 18:49:38 2015 New Revision: 1666542 URL: http://svn.apache.org/r1666542 Log: Fixing latest doc link (some how I reverted changes) Modified: spark/documentation.md spark/site/documentation.html Modified: spark/documentation.md URL:

spark git commit: [SPARK-6194] [SPARK-677] [PySpark] fix memory leak in collect()

2015-03-13 Thread joshrosen
Repository: spark Updated Branches: refs/heads/branch-1.3 dbee7e16c - 170af49bb [SPARK-6194] [SPARK-677] [PySpark] fix memory leak in collect() Because circular reference between JavaObject and JavaMember, an Java object can not be released until Python GC kick in, then it will cause memory

spark git commit: SPARK-4704 [CORE] SparkSubmitDriverBootstrap doesn't flush output

2015-03-13 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-1.3 214f68103 - dbee7e16c SPARK-4704 [CORE] SparkSubmitDriverBootstrap doesn't flush output Join on output threads to make sure any lingering output from process reaches stdout, stderr before exiting CC andrewor14 since I believe he

[1/2] spark git commit: [SPARK-6132] ContextCleaner race condition across SparkContexts

2015-03-13 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-1.3 9846790f4 - 338bea7b3 [SPARK-6132] ContextCleaner race condition across SparkContexts The problem is that `ContextCleaner` may clean variables that belong to a different `SparkContext`. This can happen if the `SparkContext` to which

svn commit: r1666540 - in /spark: news/_posts/2015-03-13-spark-1-3-0-released.md site/documentation.html site/news/index.html site/news/spark-1-3-0-released.html

2015-03-13 Thread pwendell
Author: pwendell Date: Fri Mar 13 18:47:57 2015 New Revision: 1666540 URL: http://svn.apache.org/r1666540 Log: Fixing old link in release news item Modified: spark/news/_posts/2015-03-13-spark-1-3-0-released.md spark/site/documentation.html spark/site/news/index.html

spark git commit: [SPARK-6278][MLLIB] Mention the change of objective in linear regression

2015-03-13 Thread meng
Repository: spark Updated Branches: refs/heads/master dc4abd4dc - 7f13434a5 [SPARK-6278][MLLIB] Mention the change of objective in linear regression As discussed in the RC3 vote thread, we should mention the change of objective in linear regression in the migration guide. srowen Author:

[2/2] spark git commit: [SPARK-6132][HOTFIX] ContextCleaner InterruptedException should be quiet

2015-03-13 Thread srowen
[SPARK-6132][HOTFIX] ContextCleaner InterruptedException should be quiet If the cleaner is stopped, we shouldn't print a huge stack trace when the cleaner thread is interrupted because we purposefully did this. Author: Andrew Or and...@databricks.com Closes #4882 from

spark git commit: [SPARK-6285] [SQL] Removes unused ParquetTestData and duplicated TestGroupWriteSupport

2015-03-13 Thread lian
Repository: spark Updated Branches: refs/heads/master b943f5d90 - cdc34ed91 [SPARK-6285] [SQL] Removes unused ParquetTestData and duplicated TestGroupWriteSupport All the contents in this file are not referenced anywhere and should have been removed in #4116 when I tried to get rid of the

spark git commit: [SPARK-6317][SQL]Fixed HIVE console startup issue

2015-03-13 Thread lian
Repository: spark Updated Branches: refs/heads/master cdc34ed91 - e360d5e4a [SPARK-6317][SQL]Fixed HIVE console startup issue Author: vinodkc vinod.kc...@gmail.com Author: Vinod K C vinod...@huawei.com Closes #5011 from vinodkc/HIVE_console_startupError and squashes the following commits:

spark git commit: [SPARK-5845][Shuffle] Time to cleanup spilled shuffle files not included in shuffle write time

2015-03-13 Thread srowen
Repository: spark Updated Branches: refs/heads/master 3980ebdf1 - 0af9ea74a [SPARK-5845][Shuffle] Time to cleanup spilled shuffle files not included in shuffle write time I've added a timer in the right place to fix this inaccuracy. Author: Ilya Ganelin ilya.gane...@capitalone.com Closes

svn commit: r1666484 - in /spark: downloads.md js/downloads.js site/community.html site/docs/latest site/downloads.html site/examples.html site/index.html site/js/downloads.js

2015-03-13 Thread pwendell
Author: pwendell Date: Fri Mar 13 15:48:06 2015 New Revision: 1666484 URL: http://svn.apache.org/r1666484 Log: Initial 1.3.0 code Modified: spark/downloads.md spark/js/downloads.js spark/site/community.html spark/site/docs/latest spark/site/downloads.html

svn commit: r1666486 [2/2] - in /spark: _layouts/ site/ site/graphx/ site/mllib/ site/news/ site/releases/ site/screencasts/ site/sql/ site/streaming/

2015-03-13 Thread pwendell
Modified: spark/site/releases/spark-release-0-3.html URL: http://svn.apache.org/viewvc/spark/site/releases/spark-release-0-3.html?rev=1666486r1=1666485r2=1666486view=diff == --- spark/site/releases/spark-release-0-3.html

spark git commit: [CORE][minor] remove unnecessary ClassTag in `DAGScheduler`

2015-03-13 Thread srowen
Repository: spark Updated Branches: refs/heads/master 9048e8102 - ea3d2eed9 [CORE][minor] remove unnecessary ClassTag in `DAGScheduler` This existed at the very beginning, but became unnecessary after [this

spark git commit: [SPARK-6197][CORE] handle json exception when hisotry file not finished writing

2015-03-13 Thread srowen
Repository: spark Updated Branches: refs/heads/master 69ff8e8cf - 9048e8102 [SPARK-6197][CORE] handle json exception when hisotry file not finished writing For details, please refer to [SPARK-6197](https://issues.apache.org/jira/browse/SPARK-6197) Author: Zhang, Liye liye.zh...@intel.com

spark git commit: [SPARK-5310] [SQL] [DOC] Parquet section for the SQL programming guide

2015-03-13 Thread lian
Repository: spark Updated Branches: refs/heads/branch-1.3 23069bd02 - dc287f38f [SPARK-5310] [SQL] [DOC] Parquet section for the SQL programming guide Also fixed a bunch of minor styling issues. !-- Reviewable:start -- [img src=https://reviewable.io/review_button.png; height=40 alt=Review on

spark git commit: [SPARK-5310] [SQL] [DOC] Parquet section for the SQL programming guide

2015-03-13 Thread lian
Repository: spark Updated Branches: refs/heads/master 0af9ea74a - 69ff8e8cf [SPARK-5310] [SQL] [DOC] Parquet section for the SQL programming guide Also fixed a bunch of minor styling issues. !-- Reviewable:start -- [img src=https://reviewable.io/review_button.png; height=40 alt=Review on

Git Push Summary

2015-03-13 Thread pwendell
Repository: spark Updated Tags: refs/tags/v1.3.0 [created] 4aaf48d46 - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org