spark git commit: [SPARK-9015] [BUILD] Clean project import in scala ide

2015-07-16 Thread srowen
Repository: spark Updated Branches: refs/heads/master 4ea6480a3 - b536d5dc6 [SPARK-9015] [BUILD] Clean project import in scala ide Cleanup maven for a clean import in scala-ide / eclipse. * remove groovy plugin which is really not needed at all * add-source from build-helper-maven-plugin is

spark git commit: [SPARK-6941] [SQL] Provide a better error message to when inserting into RDD based table

2015-07-16 Thread yhuai
Repository: spark Updated Branches: refs/heads/master b536d5dc6 - 43dac2c88 [SPARK-6941] [SQL] Provide a better error message to when inserting into RDD based table JIRA: https://issues.apache.org/jira/browse/SPARK-6941 Author: Yijie Shen henry.yijies...@gmail.com Closes #7342 from

spark git commit: [SPARK-8807] [SPARKR] Add between operator in SparkR

2015-07-16 Thread shivaram
Repository: spark Updated Branches: refs/heads/master e27212317 - 0a795336d [SPARK-8807] [SPARKR] Add between operator in SparkR JIRA: https://issues.apache.org/jira/browse/SPARK-8807 Add between operator in SparkR. Author: Liang-Chi Hsieh vii...@appier.com Closes #7356 from

spark git commit: [SPARK-8972] [SQL] Incorrect result for rollup

2015-07-16 Thread yhuai
Repository: spark Updated Branches: refs/heads/master ba3309684 - e27212317 [SPARK-8972] [SQL] Incorrect result for rollup We don't support the complex expression keys in the rollup/cube, and we even will not report it if we have the complex group by keys, that will cause very

spark git commit: [SPARK-8893] Add runtime checks against non-positive number of partitions

2015-07-16 Thread srowen
Repository: spark Updated Branches: refs/heads/master 0a795336d - 011551620 [SPARK-8893] Add runtime checks against non-positive number of partitions https://issues.apache.org/jira/browse/SPARK-8893 What does `sc.parallelize(1 to 3).repartition(p).collect` return? I would expect `Array(1,

spark git commit: [SPARK-8995] [SQL] cast date strings like '2015-01-01 12:15:31' to date

2015-07-16 Thread davies
Repository: spark Updated Branches: refs/heads/master 011551620 - 4ea6480a3 [SPARK-8995] [SQL] cast date strings like '2015-01-01 12:15:31' to date Jira https://issues.apache.org/jira/browse/SPARK-8995 In PR #6981we noticed that we cannot cast date strings that contains a time, like

spark git commit: [SPARK-8646] PySpark does not run on YARN if master not provided in command line

2015-07-16 Thread andrewor14
Repository: spark Updated Branches: refs/heads/master 57e9b13bf - 49351c7f5 [SPARK-8646] PySpark does not run on YARN if master not provided in command line andrewor14 davies vanzin can you take a look at this? thanks Author: Lianhui Wang lianhuiwan...@gmail.com Closes #7438 from

spark git commit: [SPARK-8119] HeartbeatReceiver should replace executors, not kill

2015-07-16 Thread andrewor14
Repository: spark Updated Branches: refs/heads/master d86bbb4e2 - 96aa3340f [SPARK-8119] HeartbeatReceiver should replace executors, not kill **Symptom.** If an executor in an application times out, `HeartbeatReceiver` attempts to kill it. After this happens, however, the application never

spark git commit: [SPARK-6284] [MESOS] Add mesos role, principal and secret

2015-07-16 Thread andrewor14
Repository: spark Updated Branches: refs/heads/master 49351c7f5 - d86bbb4e2 [SPARK-6284] [MESOS] Add mesos role, principal and secret Mesos supports framework authentication and role to be set per framework, which the role is used to identify the framework's role which impacts the sharing

spark git commit: [SPARK-6304] [STREAMING] Fix checkpointing doesn't retain driver port issue.

2015-07-16 Thread tdas
Repository: spark Updated Branches: refs/heads/master fec10f0c6 - 031d7d414 [SPARK-6304] [STREAMING] Fix checkpointing doesn't retain driver port issue. Author: jerryshao saisai.s...@intel.com Author: Saisai Shao saisai.s...@intel.com Closes #5060 from jerryshao/SPARK-6304 and squashes the

spark git commit: [SPARK-8644] Include call site in SparkException stack traces thrown by job failures

2015-07-16 Thread adav
Repository: spark Updated Branches: refs/heads/master 031d7d414 - 57e9b13bf [SPARK-8644] Include call site in SparkException stack traces thrown by job failures Example exception (new part at bottom, clearly demarcated): ``` org.apache.spark.SparkException: Job aborted due to stage failure: