spark git commit: [SPARK-11318] Include hive profile in make-distribution.sh command

2015-10-29 Thread srowen
Repository: spark Updated Branches: refs/heads/master f79ebf2a9 -> f304f9c9a [SPARK-11318] Include hive profile in make-distribution.sh command Author: tedyu Closes #9281 from tedyu/master. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit:

spark git commit: [SPARK-11246] [SQL] Table cache for Parquet broken in 1.5

2015-10-29 Thread yhuai
Repository: spark Updated Branches: refs/heads/branch-1.5 9e3197aaa -> 76d742386 [SPARK-11246] [SQL] Table cache for Parquet broken in 1.5 The root cause is that when spark.sql.hive.convertMetastoreParquet=true by default, the cached InMemoryRelation of the ParquetRelation can not be looked

spark git commit: [SPARK-11032] [SQL] correctly handle having

2015-10-29 Thread yhuai
Repository: spark Updated Branches: refs/heads/branch-1.5 76d742386 -> bb3b3627a [SPARK-11032] [SQL] correctly handle having We should not stop resolving having when the having condtion is resolved, or something like `count(1)` will crash. Author: Wenchen Fan Closes

spark git commit: [SPARK-10641][SQL] Add Skewness and Kurtosis Support

2015-10-29 Thread meng
Repository: spark Updated Branches: refs/heads/master 8185f038c -> a01cbf5da [SPARK-10641][SQL] Add Skewness and Kurtosis Support Implementing skewness and kurtosis support based on following algorithm: https://en.wikipedia.org/wiki/Algorithms_for_calculating_variance#Higher-order_statistics

spark git commit: [SPARK-10532][EC2] Added --profile option to specify the name of profile

2015-10-29 Thread joshrosen
Repository: spark Updated Branches: refs/heads/master a01cbf5da -> f21ef8dbb [SPARK-10532][EC2] Added --profile option to specify the name of profile "profiles" give us the way that you can specify the set of credentials you want to use when you initialize a connection to AWS. You can keep

spark git commit: [SPARK-11236][CORE] Update Tachyon dependency from 0.7.1 -> 0.8.0.

2015-10-29 Thread haoyuan
Repository: spark Updated Branches: refs/heads/master f21ef8dbb -> 4f5e60c64 [SPARK-11236][CORE] Update Tachyon dependency from 0.7.1 -> 0.8.0. Upgrades the tachyon-client version to the latest release. No new dependencies are added and no spark facing APIs are changed. The removal of the

spark git commit: [SPARK-11188][SQL] Elide stacktraces in bin/spark-sql for AnalysisExceptions

2015-10-29 Thread marmbrus
Repository: spark Updated Branches: refs/heads/master f7a51deeb -> 8185f038c [SPARK-11188][SQL] Elide stacktraces in bin/spark-sql for AnalysisExceptions Only print the error message to the console for Analysis Exceptions in sql-shell. Author: Dilip Biswal Closes #9194

spark git commit: [SPARK-11370] [SQL] fix a bug in GroupedIterator and create unit test for it

2015-10-29 Thread marmbrus
Repository: spark Updated Branches: refs/heads/master 87f28fc24 -> f79ebf2a9 [SPARK-11370] [SQL] fix a bug in GroupedIterator and create unit test for it Before this PR, user has to consume the iterator of one group before process next group, or we will get into infinite loops. Author:

spark git commit: [SPARK-11379][SQL] ExpressionEncoder can't handle top level primitive type correctly

2015-10-29 Thread marmbrus
Repository: spark Updated Branches: refs/heads/master 3dfa4ea52 -> 87f28fc24 [SPARK-11379][SQL] ExpressionEncoder can't handle top level primitive type correctly For inner primitive type(e.g. inside `Product`), we use `schemaFor` to get the catalyst type for it,