spark git commit: [MINOR][DOCS] Minor doc fixes related with doc build and uses script dir in SQL doc gen script

2017-08-25 Thread gurwls223
Repository: spark Updated Branches: refs/heads/master 522e1f80d -> 3b66b1c44 [MINOR][DOCS] Minor doc fixes related with doc build and uses script dir in SQL doc gen script ## What changes were proposed in this pull request? This PR proposes both: - Add information about Javadoc, SQL docs

spark git commit: [SPARK-21831][TEST] Remove `spark.sql.hive.convertMetastoreOrc` config in HiveCompatibilitySuite

2017-08-25 Thread lixiao
Repository: spark Updated Branches: refs/heads/master 1a598d717 -> 522e1f80d [SPARK-21831][TEST] Remove `spark.sql.hive.convertMetastoreOrc` config in HiveCompatibilitySuite ## What changes were proposed in this pull request? [SPARK-19025](https://github.com/apache/spark/pull/16869) removes

spark git commit: [SPARK-21837][SQL][TESTS] UserDefinedTypeSuite Local UDTs not actually testing what it intends

2017-08-25 Thread lixiao
Repository: spark Updated Branches: refs/heads/master 51620e288 -> 1a598d717 [SPARK-21837][SQL][TESTS] UserDefinedTypeSuite Local UDTs not actually testing what it intends ## What changes were proposed in this pull request? Adjust Local UDTs test to assert about results, and fix index of

spark git commit: [SPARK-21756][SQL] Add JSON option to allow unquoted control characters

2017-08-25 Thread lixiao
Repository: spark Updated Branches: refs/heads/master 628bdeabd -> 51620e288 [SPARK-21756][SQL] Add JSON option to allow unquoted control characters ## What changes were proposed in this pull request? This patch adds allowUnquotedControlChars option in JSON data source to allow JSON Strings

spark git commit: [SPARK-17742][CORE] Fail launcher app handle if child process exits with error.

2017-08-25 Thread vanzin
Repository: spark Updated Branches: refs/heads/master 1813c4a8d -> 628bdeabd [SPARK-17742][CORE] Fail launcher app handle if child process exits with error. This is a follow up to cba826d0; that commit set the app handle state to "LOST" when the child process exited, but that can be

spark git commit: [SPARK-21714][CORE][YARN] Avoiding re-uploading remote resources in yarn client mode

2017-08-25 Thread vanzin
Repository: spark Updated Branches: refs/heads/master 1f24ceee6 -> 1813c4a8d [SPARK-21714][CORE][YARN] Avoiding re-uploading remote resources in yarn client mode ## What changes were proposed in this pull request? With SPARK-10643, Spark supports download resources from remote in client

spark git commit: [SPARK-21832][TEST] Merge SQLBuilderTest into ExpressionSQLBuilderSuite

2017-08-25 Thread lixiao
Repository: spark Updated Branches: refs/heads/master de7af295c -> 1f24ceee6 [SPARK-21832][TEST] Merge SQLBuilderTest into ExpressionSQLBuilderSuite ## What changes were proposed in this pull request? After [SPARK-19025](https://github.com/apache/spark/pull/16869), there is no need to keep

spark git commit: [MINOR][BUILD] Fix build warnings and Java lint errors

2017-08-25 Thread srowen
Repository: spark Updated Branches: refs/heads/master 574ef6c98 -> de7af295c [MINOR][BUILD] Fix build warnings and Java lint errors ## What changes were proposed in this pull request? Fix build warnings and Java lint errors. This just helps a bit in evaluating (new) warnings in another PR I

spark git commit: [SPARK-21527][CORE] Use buffer limit in order to use JAVA NIO Util's buffercache

2017-08-25 Thread wenchen
Repository: spark Updated Branches: refs/heads/master 7d16776d2 -> 574ef6c98 [SPARK-21527][CORE] Use buffer limit in order to use JAVA NIO Util's buffercache ## What changes were proposed in this pull request? Right now, ChunkedByteBuffer#writeFully do not slice bytes first.We observe code

spark git commit: [SPARK-21255][SQL][WIP] Fixed NPE when creating encoder for enum

2017-08-25 Thread srowen
Repository: spark Updated Branches: refs/heads/master f3676d639 -> 7d16776d2 [SPARK-21255][SQL][WIP] Fixed NPE when creating encoder for enum ## What changes were proposed in this pull request? Fixed NPE when creating encoder for enum. When you try to create an encoder for Enum type (or