spark git commit: [SPARK-13866] [SQL] Handle decimal type in CSV inference at CSV data source.

2016-05-12 Thread davies
Repository: spark Updated Branches: refs/heads/master eda2800d4 -> 51841d77d [SPARK-13866] [SQL] Handle decimal type in CSV inference at CSV data source. ## What changes were proposed in this pull request? https://issues.apache.org/jira/browse/SPARK-13866 This PR adds the support to infer

spark git commit: [SPARK-14541][SQL] Support IFNULL, NULLIF, NVL and NVL2

2016-05-12 Thread yhuai
Repository: spark Updated Branches: refs/heads/branch-2.0 d73ce364e -> 51706f8a4 [SPARK-14541][SQL] Support IFNULL, NULLIF, NVL and NVL2 ## What changes were proposed in this pull request? This patch adds support for a few SQL functions to improve compatibility with other databases: IFNULL,

spark git commit: [SPARK-14541][SQL] Support IFNULL, NULLIF, NVL and NVL2

2016-05-12 Thread yhuai
Repository: spark Updated Branches: refs/heads/master ba169c323 -> eda2800d4 [SPARK-14541][SQL] Support IFNULL, NULLIF, NVL and NVL2 ## What changes were proposed in this pull request? This patch adds support for a few SQL functions to improve compatibility with other databases: IFNULL,

spark git commit: [SPARK-15306][SQL] Move object expressions into expressions.objects package

2016-05-12 Thread rxin
Repository: spark Updated Branches: refs/heads/master b3930f74a -> ba169c323 [SPARK-15306][SQL] Move object expressions into expressions.objects package ## What changes were proposed in this pull request? This patch moves all the object related expressions into expressions.objects package,

spark git commit: [SPARK-15306][SQL] Move object expressions into expressions.objects package

2016-05-12 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.0 54c04aa5d -> d73ce364e [SPARK-15306][SQL] Move object expressions into expressions.objects package ## What changes were proposed in this pull request? This patch moves all the object related expressions into expressions.objects

spark git commit: [SPARK-15202][SPARKR] add dapplyCollect() method for DataFrame in SparkR.

2016-05-12 Thread shivaram
Repository: spark Updated Branches: refs/heads/branch-2.0 0d24fe09a -> 54c04aa5d [SPARK-15202][SPARKR] add dapplyCollect() method for DataFrame in SparkR. ## What changes were proposed in this pull request? dapplyCollect() applies an R function on each partition of a SparkDataFrame and

spark git commit: [SPARK-15202][SPARKR] add dapplyCollect() method for DataFrame in SparkR.

2016-05-12 Thread shivaram
Repository: spark Updated Branches: refs/heads/master bb1362eb3 -> b3930f74a [SPARK-15202][SPARKR] add dapplyCollect() method for DataFrame in SparkR. ## What changes were proposed in this pull request? dapplyCollect() applies an R function on each partition of a SparkDataFrame and collects

spark git commit: [SPARK-10605][SQL] Create native collect_list/collect_set aggregates

2016-05-12 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.0 ac6e9a8d9 -> 31ea3c7bd [SPARK-10605][SQL] Create native collect_list/collect_set aggregates ## What changes were proposed in this pull request? We currently use the Hive implementations for the collect_list/collect_set aggregate

spark git commit: [SPARK-13902][SCHEDULER] Make DAGScheduler not to create duplicate stage.

2016-05-12 Thread kayousterhout
Repository: spark Updated Branches: refs/heads/master 81e3bfc16 -> a57aadae8 [SPARK-13902][SCHEDULER] Make DAGScheduler not to create duplicate stage. ## What changes were proposed in this pull request? `DAGScheduler`sometimes generate incorrect stage graph. Suppose you have the following

spark git commit: [SPARK-14421] Upgrades protobuf dependency to 2.6.1 for the new version of KCL, and…

2016-05-12 Thread srowen
Repository: spark Updated Branches: refs/heads/master 81bf87084 -> 81e3bfc16 [SPARK-14421] Upgrades protobuf dependency to 2.6.1 for the new version of KCL, and… ## What changes were proposed in this pull request? When running with Kinesis Consumer Library (KCL), against a stream that

spark git commit: [SPARK-14421] Upgrades protobuf dependency to 2.6.1 for the new version of KCL, and…

2016-05-12 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-2.0 7a14d28cb -> ac6e9a8d9 [SPARK-14421] Upgrades protobuf dependency to 2.6.1 for the new version of KCL, and… ## What changes were proposed in this pull request? When running with Kinesis Consumer Library (KCL), against a stream that

spark git commit: [SPARK-14897][SQL] upgrade to jetty 9.2.16

2016-05-12 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-2.0 9c5c9013d -> 7a14d28cb [SPARK-14897][SQL] upgrade to jetty 9.2.16 ## What changes were proposed in this pull request? Since Jetty 8 is EOL (end of life) and has critical security issue

spark git commit: [SPARK-14897][SQL] upgrade to jetty 9.2.16

2016-05-12 Thread srowen
Repository: spark Updated Branches: refs/heads/master be617f3d0 -> 81bf87084 [SPARK-14897][SQL] upgrade to jetty 9.2.16 ## What changes were proposed in this pull request? Since Jetty 8 is EOL (end of life) and has critical security issue

spark git commit: [SPARK-14684][SPARK-15277][SQL] Partition Spec Validation in SessionCatalog and Checking Partition Spec Existence Before Dropping

2016-05-12 Thread andrewor14
Repository: spark Updated Branches: refs/heads/branch-2.0 68617e1ad -> 9c5c9013d [SPARK-14684][SPARK-15277][SQL] Partition Spec Validation in SessionCatalog and Checking Partition Spec Existence Before Dropping What changes were proposed in this pull request? ~~Currently, multiple

spark git commit: [SPARK-14684][SPARK-15277][SQL] Partition Spec Validation in SessionCatalog and Checking Partition Spec Existence Before Dropping

2016-05-12 Thread andrewor14
Repository: spark Updated Branches: refs/heads/master 470de743e -> be617f3d0 [SPARK-14684][SPARK-15277][SQL] Partition Spec Validation in SessionCatalog and Checking Partition Spec Existence Before Dropping What changes were proposed in this pull request? ~~Currently, multiple

spark git commit: [SPARK-15094][SPARK-14803][SQL] Remove extra Project added in EliminateSerialization

2016-05-12 Thread yhuai
Repository: spark Updated Branches: refs/heads/master 5bb62b893 -> 470de743e [SPARK-15094][SPARK-14803][SQL] Remove extra Project added in EliminateSerialization ## What changes were proposed in this pull request? We will eliminate the pair of `DeserializeToObject` and `SerializeFromObject`

spark git commit: [SPARK-15094][SPARK-14803][SQL] Remove extra Project added in EliminateSerialization

2016-05-12 Thread yhuai
Repository: spark Updated Branches: refs/heads/branch-2.0 b3f145442 -> 68617e1ad [SPARK-15094][SPARK-14803][SQL] Remove extra Project added in EliminateSerialization ## What changes were proposed in this pull request? We will eliminate the pair of `DeserializeToObject` and

spark git commit: [HOTFIX] SQL test compilation error from merge conflict

2016-05-12 Thread andrewor14
Repository: spark Updated Branches: refs/heads/branch-2.0 9098b1a17 -> b3f145442 [HOTFIX] SQL test compilation error from merge conflict Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/b3f14544 Tree:

spark git commit: [BUILD] Test closing stale PRs

2016-05-12 Thread srowen
Repository: spark Updated Branches: refs/heads/master 33c6eb521 -> 5bb62b893 [BUILD] Test closing stale PRs ## What changes were proposed in this pull request? Here I'm seeing if we can close stale PRs via a PR message, as I'd expect. See thread

spark git commit: [SPARK-15171][SQL] Deprecate registerTempTable and add dataset.createTempView

2016-05-12 Thread lian
Repository: spark Updated Branches: refs/heads/branch-2.0 6b69b8c0c -> 9098b1a17 [SPARK-15171][SQL] Deprecate registerTempTable and add dataset.createTempView ## What changes were proposed in this pull request? Deprecates registerTempTable and add dataset.createTempView,

spark git commit: [SPARK-15171][SQL] Deprecate registerTempTable and add dataset.createTempView

2016-05-12 Thread lian
Repository: spark Updated Branches: refs/heads/master 5207a005c -> 33c6eb521 [SPARK-15171][SQL] Deprecate registerTempTable and add dataset.createTempView ## What changes were proposed in this pull request? Deprecates registerTempTable and add dataset.createTempView,

spark git commit: [SPARK-15281][PYSPARK][ML][TRIVIAL] Add impurity param to GBTRegressor & add experimental inside of regression.py

2016-05-12 Thread mlnick
Repository: spark Updated Branches: refs/heads/branch-2.0 beda3938c -> 6b69b8c0c [SPARK-15281][PYSPARK][ML][TRIVIAL] Add impurity param to GBTRegressor & add experimental inside of regression.py ## What changes were proposed in this pull request? Add impurity param to GBTRegressor and mark

spark git commit: [SPARK-15281][PYSPARK][ML][TRIVIAL] Add impurity param to GBTRegressor & add experimental inside of regression.py

2016-05-12 Thread mlnick
Repository: spark Updated Branches: refs/heads/master 46991448a -> 5207a005c [SPARK-15281][PYSPARK][ML][TRIVIAL] Add impurity param to GBTRegressor & add experimental inside of regression.py ## What changes were proposed in this pull request? Add impurity param to GBTRegressor and mark the

spark git commit: [SPARK-15160][SQL] support data source table in InMemoryCatalog

2016-05-12 Thread yhuai
Repository: spark Updated Branches: refs/heads/branch-2.0 86acb5efd -> beda3938c [SPARK-15160][SQL] support data source table in InMemoryCatalog ## What changes were proposed in this pull request? This PR adds a new rule to convert `SimpleCatalogRelation` to data source table if its table

spark git commit: [SPARK-15160][SQL] support data source table in InMemoryCatalog

2016-05-12 Thread yhuai
Repository: spark Updated Branches: refs/heads/master 9e266d07a -> 46991448a [SPARK-15160][SQL] support data source table in InMemoryCatalog ## What changes were proposed in this pull request? This PR adds a new rule to convert `SimpleCatalogRelation` to data source table if its table