spark git commit: [SPARK-8121] [SQL] Fixes InsertIntoHadoopFsRelation job initialization for Hadoop 1.x

Repository: spark Updated Branches: refs/heads/master ed5c2dccd - bbdfc0a40 [SPARK-8121] [SQL] Fixes InsertIntoHadoopFsRelation job initialization for Hadoop 1.x For Hadoop 1.x, `TaskAttemptContext` constructor clones the `Configuration` argument, thus configurations done in

spark git commit: [SQL][minor] remove duplicated cases in `DecimalPrecision`

Repository: spark Updated Branches: refs/heads/master bbdfc0a40 - fe7669d30 [SQL][minor] remove duplicated cases in `DecimalPrecision` We already have a rule to do type coercion for fixed decimal and unlimited decimal in `WidenTypes`, so we don't need to handle them in `DecimalPrecision`.

spark git commit: [SPARK-8062] Fix NullPointerException in SparkHadoopUtil.getFileSystemThreadStatistics (branch-1.2)

Repository: spark Updated Branches: refs/heads/branch-1.2 23bf3071f - 30789f6ef [SPARK-8062] Fix NullPointerException in SparkHadoopUtil.getFileSystemThreadStatistics (branch-1.2) This patch adds a regression test for an extremely rare bug where

spark git commit: [SPARK-8158] [SQL] several fix for HiveShim

Repository: spark Updated Branches: refs/heads/master 49f19b954 - ed5c2dccd [SPARK-8158] [SQL] several fix for HiveShim 1. explicitly import implicit conversion support. 2. use .nonEmpty instead of .size 0 3. use val instead of var 4. comment indention Author: Daoyuan Wang

spark git commit: [SPARK-8121] [SQL] Fixes InsertIntoHadoopFsRelation job initialization for Hadoop 1.x (branch 1.4 backport based on https://github.com/apache/spark/pull/6669)

Repository: spark Updated Branches: refs/heads/branch-1.4 a3afc2cba - 69197c3e3 [SPARK-8121] [SQL] Fixes InsertIntoHadoopFsRelation job initialization for Hadoop 1.x (branch 1.4 backport based on https://github.com/apache/spark/pull/6669) Project:

spark git commit: [SPARK-8126] [BUILD] Use custom temp directory during build.

Repository: spark Updated Branches: refs/heads/branch-1.4 69197c3e3 - 99c2a5734 [SPARK-8126] [BUILD] Use custom temp directory during build. Even with all the efforts to cleanup the temp directories created by unit tests, Spark leaves a lot of garbage in /tmp after a test run. This change

spark git commit: [SPARK-8148] Do not use FloatType in partition column inference.

Repository: spark Updated Branches: refs/heads/master fe7669d30 - 518538916 [SPARK-8148] Do not use FloatType in partition column inference. Use DoubleType instead to be more stable and robust. Author: Reynold Xin r...@databricks.com Closes #6692 from rxin/SPARK-8148 and squashes the

spark git commit: [SPARK-8162] [HOTFIX] Fix NPE in spark-shell

Repository: spark Updated Branches: refs/heads/master 518538916 - f3eec92ce [SPARK-8162] [HOTFIX] Fix NPE in spark-shell This was caused by this commit: f271347 This patch does not attempt to fix the root cause of why the `VisibleForTesting` annotation causes a NPE in the shell. We should

spark git commit: [SPARK-8162] [HOTFIX] Fix NPE in spark-shell

Repository: spark Updated Branches: refs/heads/branch-1.4 99c2a5734 - e9a837236 [SPARK-8162] [HOTFIX] Fix NPE in spark-shell This was caused by this commit: f271347 This patch does not attempt to fix the root cause of why the `VisibleForTesting` annotation causes a NPE in the shell. We

spark git commit: [SPARK-8168] [MLLIB] Add Python friendly constructor to PipelineModel

Repository: spark Updated Branches: refs/heads/master f3eec92ce - 82870d507 [SPARK-8168] [MLLIB] Add Python friendly constructor to PipelineModel This makes the constructor callable in Python. dbtsai Author: Xiangrui Meng m...@databricks.com Closes #6709 from mengxr/SPARK-8168 and squashes

spark git commit: [SPARK-6820] [SPARKR] Convert NAs to null type in SparkR DataFrames

Repository: spark Updated Branches: refs/heads/master 82870d507 - a5c52c1a3 [SPARK-6820] [SPARKR] Convert NAs to null type in SparkR DataFrames Author: hqzizania qian.hu...@intel.com Closes #6190 from hqzizania/R and squashes the following commits: 1641f9e [hqzizania] fixes and add test

spark git commit: [SPARK-4761] [DOC] [SQL] kryo default setting in SQL Thrift server

Repository: spark Updated Branches: refs/heads/master 72ba0fc4f - 10fc2f6f5 [SPARK-4761] [DOC] [SQL] kryo default setting in SQL Thrift server this is a follow up of #3621 /cc liancheng pwendell Author: Daoyuan Wang daoyuan.w...@intel.com Closes #6639 from adrian-wang/kryodoc and squashes

spark git commit: [SPARK-4761] [DOC] [SQL] kryo default setting in SQL Thrift server

Repository: spark Updated Branches: refs/heads/branch-1.4 b9c046f6d - 58bfdd621 [SPARK-4761] [DOC] [SQL] kryo default setting in SQL Thrift server this is a follow up of #3621 /cc liancheng pwendell Author: Daoyuan Wang daoyuan.w...@intel.com Closes #6639 from adrian-wang/kryodoc and

spark git commit: [SPARK-8154][SQL] Remove Term/Code type aliases in code generation.

Repository: spark Updated Branches: refs/heads/master f74be744d - 72ba0fc4f [SPARK-8154][SQL] Remove Term/Code type aliases in code generation. From my perspective as a code reviewer, I find them more confusing than using String directly. Author: Reynold Xin r...@databricks.com Closes

spark git commit: [SPARK-7705] [YARN] Cleanup of .sparkStaging directory fails if application is killed

Repository: spark Updated Branches: refs/heads/master 10fc2f6f5 - eacd4a929 [SPARK-7705] [YARN] Cleanup of .sparkStaging directory fails if application is killed As I have tested, if we cancel or kill the app then the final status may be undefined, killed or succeeded, so clean up staging

spark git commit: [SPARK-7939] [SQL] Add conf to enable/disable partition column type inference

Repository: spark Updated Branches: refs/heads/master eacd4a929 - 03ef6be9c [SPARK-7939] [SQL] Add conf to enable/disable partition column type inference JIRA: https://issues.apache.org/jira/browse/SPARK-7939 Author: Liang-Chi Hsieh vii...@gmail.com Closes #6503 from

spark git commit: [SPARK-7705] [YARN] Cleanup of .sparkStaging directory fails if application is killed

Repository: spark Updated Branches: refs/heads/branch-1.4 58bfdd621 - a3afc2cba [SPARK-7705] [YARN] Cleanup of .sparkStaging directory fails if application is killed As I have tested, if we cancel or kill the app then the final status may be undefined, killed or succeeded, so clean up

spark git commit: [SPARK-8126] [BUILD] Use custom temp directory during build.

Repository: spark Updated Branches: refs/heads/master 03ef6be9c - a1d9e5cc6 [SPARK-8126] [BUILD] Use custom temp directory during build. Even with all the efforts to cleanup the temp directories created by unit tests, Spark leaves a lot of garbage in /tmp after a test run. This change

spark git commit: [SMALL FIX] Return null if catch EOFException

Repository: spark Updated Branches: refs/heads/master e3e9c7038 - 149d1b28e [SMALL FIX] Return null if catch EOFException Return null if catch EOFException, just like function asKeyValueIterator in this class Author: Mingfei mingfei@intel.com Closes #6703 from shimingfei/returnNull and

spark git commit: [SPARK-8140] [MLLIB] Remove empty model check in StreamingLinearAlgorithm

Repository: spark Updated Branches: refs/heads/master a1d9e5cc6 - e3e9c7038 [SPARK-8140] [MLLIB] Remove empty model check in StreamingLinearAlgorithm 1. Prevent creating a map of data to find numFeatures 2. If model is empty, then initialize with a zero vector of numFeature Author: MechCoder

spark git commit: [MINOR] change new Exception to IllegalArgumentException

Repository: spark Updated Branches: refs/heads/master 149d1b28e - 49f19b954 [MINOR] change new Exception to IllegalArgumentException Author: Daoyuan Wang daoyuan.w...@intel.com Closes #6434 from adrian-wang/joinerr and squashes the following commits: ee1b64f [Daoyuan Wang] break line