[GitHub] spark issue #15055: [SPARK-17462][MLLIB]use VersionUtils to parse Spark vers...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15055 **[Test build #65241 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65241/consoleFull)** for PR 15055 at commit [`72a87b0`](https://github.com/apache/spark/commit/7

[GitHub] spark pull request #15055: [SPARK-17462][MLLIB]use VersionUtils to parse Spa...

GitHub user VinceShieh opened a pull request: https://github.com/apache/spark/pull/15055 [SPARK-17462][MLLIB]use VersionUtils to parse Spark version strings ## What changes were proposed in this pull request? Several places in MLlib use custom regexes or other approaches to

[GitHub] spark pull request #14834: [SPARK-17163][ML] Unified LogisticRegression inte...

Github user dbtsai commented on a diff in the pull request: https://github.com/apache/spark/pull/14834#discussion_r78321887 --- Diff: mllib/src/main/scala/org/apache/spark/ml/classification/LogisticRegression.scala --- @@ -460,33 +577,74 @@ class LogisticRegression @Since("1.2.0")

[GitHub] spark issue #13758: [SPARK-16043][SQL] Prepare GenericArrayData implementati...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13758 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65239/ Test FAILed. ---

[GitHub] spark pull request #14834: [SPARK-17163][ML] Unified LogisticRegression inte...

Github user dbtsai commented on a diff in the pull request: https://github.com/apache/spark/pull/14834#discussion_r78321247 --- Diff: mllib/src/main/scala/org/apache/spark/ml/classification/LogisticRegression.scala --- @@ -323,32 +382,33 @@ class LogisticRegression @Since("1.2.0")

[GitHub] spark issue #13758: [SPARK-16043][SQL] Prepare GenericArrayData implementati...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13758 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13758: [SPARK-16043][SQL] Prepare GenericArrayData implementati...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13758 **[Test build #65239 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65239/consoleFull)** for PR 13758 at commit [`deb363a`](https://github.com/apache/spark/commit/

[GitHub] spark pull request #14834: [SPARK-17163][ML] Unified LogisticRegression inte...

Github user dbtsai commented on a diff in the pull request: https://github.com/apache/spark/pull/14834#discussion_r78321146 --- Diff: mllib/src/main/scala/org/apache/spark/ml/classification/LogisticRegression.scala --- @@ -311,8 +350,28 @@ class LogisticRegression @Since("1.2.0")

[GitHub] spark issue #11729: [SPARK-13073] [MLib] [WIP] creating R like summary for l...

Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/11729 gentle ping @mbaddar1 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wish

[GitHub] spark issue #11079: [SPARK-13197][SQL] When trying to select from the data f...

Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/11079 +1 for not a problem. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishe

[GitHub] spark issue #15054: [SPARK-17502] [SQL] Fix Multiple Bugs in DDL Statements ...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15054 **[Test build #65240 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65240/consoleFull)** for PR 15054 at commit [`cc47c3e`](https://github.com/apache/spark/commit/c

[GitHub] spark pull request #15054: [SPARK-17502] [SQL] Fix Multiple Bugs in DDL Stat...

GitHub user gatorsmile opened a pull request: https://github.com/apache/spark/pull/15054 [SPARK-17502] [SQL] Fix Multiple Bugs in DDL Statements on Temporary Views [WIP] ### What changes were proposed in this pull request? - When the permanent tables/views do not exist but the t

[GitHub] spark issue #15020: Spark 2.0 error in Intellij

Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/15020 ping @bigdatatraining --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wish

[GitHub] spark issue #15052: [SPARK-17500][PySpark]Make DiskBytesSpilled metric in Py...

Github user djvulee commented on the issue: https://github.com/apache/spark/pull/15052 @srowen @davies mind taking a look? This PR is very simple. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark issue #11119: [SPARK-10780][ML] Add an initial model to kmeans

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/9 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65237/ Test PASSed. ---

[GitHub] spark issue #11119: [SPARK-10780][ML] Add an initial model to kmeans

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/9 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #11119: [SPARK-10780][ML] Add an initial model to kmeans

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/9 **[Test build #65237 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65237/consoleFull)** for PR 9 at commit [`78ed9a1`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15045: [Spark Core][MINOR] fix "default partitioner cannot part...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15045 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15045: [Spark Core][MINOR] fix "default partitioner cannot part...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15045 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65236/ Test PASSed. ---

[GitHub] spark issue #15045: [Spark Core][MINOR] fix "default partitioner cannot part...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15045 **[Test build #65236 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65236/consoleFull)** for PR 15045 at commit [`f53ad51`](https://github.com/apache/spark/commit/

[GitHub] spark pull request #14834: [SPARK-17163][ML] Unified LogisticRegression inte...

Github user dbtsai commented on a diff in the pull request: https://github.com/apache/spark/pull/14834#discussion_r78316060 --- Diff: mllib/src/main/scala/org/apache/spark/ml/classification/LogisticRegression.scala --- @@ -311,8 +350,28 @@ class LogisticRegression @Since("1.2.0")

[GitHub] spark issue #13758: [SPARK-16043][SQL] Prepare GenericArrayData implementati...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13758 **[Test build #65239 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65239/consoleFull)** for PR 13758 at commit [`deb363a`](https://github.com/apache/spark/commit/d

[GitHub] spark pull request #15051: [SPARK-17499][ML][MLLib] make the default params ...

Github user WeichenXu123 commented on a diff in the pull request: https://github.com/apache/spark/pull/15051#discussion_r78315909 --- Diff: R/pkg/R/mllib.R --- @@ -694,8 +694,8 @@ setMethod("predict", signature(object = "KMeansModel"), #' } #' @note spark.mlp since 2.1.0

[GitHub] spark pull request #15051: [SPARK-17499][ML][MLLib] make the default params ...

Github user WeichenXu123 commented on a diff in the pull request: https://github.com/apache/spark/pull/15051#discussion_r78315763 --- Diff: R/pkg/R/mllib.R --- @@ -694,8 +694,8 @@ setMethod("predict", signature(object = "KMeansModel"), #' } #' @note spark.mlp since 2.1.0

[GitHub] spark issue #13758: [SPARK-16043][SQL] Prepare GenericArrayData implementati...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13758 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65238/ Test FAILed. ---

[GitHub] spark issue #13758: [SPARK-16043][SQL] Prepare GenericArrayData implementati...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13758 **[Test build #65238 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65238/consoleFull)** for PR 13758 at commit [`56d6730`](https://github.com/apache/spark/commit/

[GitHub] spark issue #13758: [SPARK-16043][SQL] Prepare GenericArrayData implementati...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13758 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark pull request #14834: [SPARK-17163][ML] Unified LogisticRegression inte...

Github user dbtsai commented on a diff in the pull request: https://github.com/apache/spark/pull/14834#discussion_r78315600 --- Diff: mllib/src/main/scala/org/apache/spark/ml/classification/LogisticRegression.scala --- @@ -261,6 +299,7 @@ class LogisticRegression @Since("1.2.0") (

[GitHub] spark issue #13758: [SPARK-16043][SQL] Prepare GenericArrayData implementati...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13758 **[Test build #65238 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65238/consoleFull)** for PR 13758 at commit [`56d6730`](https://github.com/apache/spark/commit/5

[GitHub] spark pull request #15038: [SPARK-17486] Remove unused TaskMetricsUIData.upd...

Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/15038 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark issue #7266: [SPARK-8764][ML] string indexer should take option to han...

Github user miro-balaz commented on the issue: https://github.com/apache/spark/pull/7266 thank you for directions On Monday, 12 September 2016, Holden Karau wrote: > @miro-balaz : This probably isn't the > best place for a new featu

[GitHub] spark issue #11119: [SPARK-10780][ML] Add an initial model to kmeans

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/9 **[Test build #65237 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65237/consoleFull)** for PR 9 at commit [`78ed9a1`](https://github.com/apache/spark/commit/7

[GitHub] spark issue #15038: [SPARK-17486] Remove unused TaskMetricsUIData.updatedBlo...

Github user zsxwing commented on the issue: https://github.com/apache/spark/pull/15038 LGTM. Merging to master and 2.0 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #14452: [SPARK-16849][SQL] Improve subquery execution by dedupli...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14452 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65235/ Test PASSed. ---

[GitHub] spark issue #14452: [SPARK-16849][SQL] Improve subquery execution by dedupli...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14452 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14452: [SPARK-16849][SQL] Improve subquery execution by dedupli...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14452 **[Test build #65235 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65235/consoleFull)** for PR 14452 at commit [`64ff37b`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14912: [SPARK-17357][SQL] Fix current predicate pushdown

Github user viirya commented on the issue: https://github.com/apache/spark/pull/14912 To maintain the predicate sets may increase much complexity as I can think. I don't know how big the set could be. But once you change one of the predicates, you need to construct all equivalent pred

[GitHub] spark issue #15045: [Spark Core][MINOR] fix "default partitioner cannot part...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15045 **[Test build #65236 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65236/consoleFull)** for PR 15045 at commit [`f53ad51`](https://github.com/apache/spark/commit/f

[GitHub] spark issue #15045: [Spark Core][MINOR] fix "default partitioner cannot part...

Github user WeichenXu123 commented on the issue: https://github.com/apache/spark/pull/15045 Jenkins, test this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #14947: [SPARK-17388][SQL] Support for inferring type date/times...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14947 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65234/ Test PASSed. ---

[GitHub] spark issue #14947: [SPARK-17388][SQL] Support for inferring type date/times...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14947 **[Test build #65234 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65234/consoleFull)** for PR 14947 at commit [`e9dea77`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14947: [SPARK-17388][SQL] Support for inferring type date/times...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14947 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark pull request #15051: [SPARK-17499][ML][MLLib] make the default params ...

Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/15051#discussion_r78310476 --- Diff: R/pkg/R/mllib.R --- @@ -694,8 +694,8 @@ setMethod("predict", signature(object = "KMeansModel"), #' } #' @note spark.mlp since 2.1.0

[GitHub] spark pull request #15051: [SPARK-17499][ML][MLLib] make the default params ...

Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/15051#discussion_r78310368 --- Diff: R/pkg/R/mllib.R --- @@ -694,8 +694,8 @@ setMethod("predict", signature(object = "KMeansModel"), #' } #' @note spark.mlp since 2.1.0

[GitHub] spark issue #14452: [SPARK-16849][SQL] Improve subquery execution by dedupli...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14452 **[Test build #65235 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65235/consoleFull)** for PR 14452 at commit [`64ff37b`](https://github.com/apache/spark/commit/6

[GitHub] spark pull request #14988: [SPARK-17425][SQL] Override sameResult in HiveTab...

Github user watermen commented on a diff in the pull request: https://github.com/apache/spark/pull/14988#discussion_r78309372 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/execution/HiveTableScanExec.scala --- @@ -164,4 +164,11 @@ case class HiveTableScanExec(

[GitHub] spark pull request #15051: [SPARK-17499][ML][MLLib] make the default params ...

Github user WeichenXu123 commented on a diff in the pull request: https://github.com/apache/spark/pull/15051#discussion_r78309230 --- Diff: R/pkg/R/mllib.R --- @@ -694,8 +694,8 @@ setMethod("predict", signature(object = "KMeansModel"), #' } #' @note spark.mlp since 2.1.0

[GitHub] spark issue #15048: [SPARK-17409] [SQL] Do Not Optimize Query in CTAS More T...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15048 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15048: [SPARK-17409] [SQL] Do Not Optimize Query in CTAS More T...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15048 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65233/ Test PASSed. ---

[GitHub] spark issue #15048: [SPARK-17409] [SQL] Do Not Optimize Query in CTAS More T...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15048 **[Test build #65233 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65233/consoleFull)** for PR 15048 at commit [`ae335ae`](https://github.com/apache/spark/commit/

[GitHub] spark pull request #15051: [SPARK-17499][ML][MLLib] make the default params ...

Github user WeichenXu123 commented on a diff in the pull request: https://github.com/apache/spark/pull/15051#discussion_r78308116 --- Diff: R/pkg/R/mllib.R --- @@ -694,8 +694,8 @@ setMethod("predict", signature(object = "KMeansModel"), #' } #' @note spark.mlp since 2.1.0

[GitHub] spark issue #14388: [SPARK-16362][SQL] Support ArrayType and StructType in v...

Github user viirya commented on the issue: https://github.com/apache/spark/pull/14388 @mallman Not yet. I am working on another PR recently. I will return back when that is solved. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub

[GitHub] spark pull request #15051: [SPARK-17499][ML][MLLib] make the default params ...

Github user WeichenXu123 commented on a diff in the pull request: https://github.com/apache/spark/pull/15051#discussion_r78307552 --- Diff: R/pkg/R/mllib.R --- @@ -694,8 +694,8 @@ setMethod("predict", signature(object = "KMeansModel"), #' } #' @note spark.mlp since 2.1.0

[GitHub] spark issue #14947: [SPARK-17388][SQL] Support for inferring type date/times...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14947 **[Test build #65234 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65234/consoleFull)** for PR 14947 at commit [`e9dea77`](https://github.com/apache/spark/commit/e

[GitHub] spark pull request #14947: [SPARK-17388][SQL] Support for inferring type dat...

Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/14947#discussion_r78306768 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/PartitioningUtils.scala --- @@ -307,20 +308,34 @@ object PartitioningUtils

[GitHub] spark issue #7266: [SPARK-8764][ML] string indexer should take option to han...

Github user holdenk commented on the issue: https://github.com/apache/spark/pull/7266 @miro-balaz : This probably isn't the best place for a new feature request - but if you head over to the ASF JIRA you can create a new ticket and cc the people who worked on this. --- If your proje

[GitHub] spark pull request #14971: [SPARK-17410] [SPARK-17284] Move Hive-generated S...

Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/14971#discussion_r78305536 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/StatisticsSuite.scala --- @@ -259,6 +259,156 @@ class StatisticsSuite extends QueryTest with

[GitHub] spark pull request #14971: [SPARK-17410] [SPARK-17284] Move Hive-generated S...

Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/14971#discussion_r78305513 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/StatisticsSuite.scala --- @@ -259,6 +259,156 @@ class StatisticsSuite extends QueryTest with

[GitHub] spark issue #15048: [SPARK-17409] [SQL] Do Not Optimize Query in CTAS More T...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15048 **[Test build #65233 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65233/consoleFull)** for PR 15048 at commit [`ae335ae`](https://github.com/apache/spark/commit/a

[GitHub] spark issue #14971: [SPARK-17410] [SPARK-17284] Move Hive-generated Stats In...

Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/14971 cc @hvanhovell @cloud-fan Now, the code is ready for review. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does n

[GitHub] spark issue #14971: [SPARK-17410] [SPARK-17284] Move Hive-generated Stats In...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14971 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14971: [SPARK-17410] [SPARK-17284] Move Hive-generated Stats In...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14971 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65232/ Test PASSed. ---

[GitHub] spark issue #14971: [SPARK-17410] [SPARK-17284] Move Hive-generated Stats In...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14971 **[Test build #65232 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65232/consoleFull)** for PR 14971 at commit [`9e18ba1`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15045: [Spark Core][MINOR] fix "default partitioner cannot part...

Github user WeichenXu123 commented on the issue: https://github.com/apache/spark/pull/15045 jenkins test please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #15028: [SPARK-17336][PYSPARK] Fix appending multiple times to P...

Github user holdenk commented on the issue: https://github.com/apache/spark/pull/15028 Since the search order is defined the old behavior probably worked cross versions (albeit in an ugly fashion) - I'll follow up with some checks for spark-perf and fix there if necessary since I thin

[GitHub] spark pull request #14947: [WIP][SPARK-17388][SQL] Support for inferring typ...

Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/14947#discussion_r78304894 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/PartitioningUtils.scala --- @@ -307,20 +308,34 @@ object PartitioningUtils

[GitHub] spark issue #14828: [SPARK-17258][SQL] Parse scientific decimal literals as ...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14828 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65230/ Test PASSed. ---

[GitHub] spark issue #14828: [SPARK-17258][SQL] Parse scientific decimal literals as ...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14828 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14828: [SPARK-17258][SQL] Parse scientific decimal literals as ...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14828 **[Test build #65230 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65230/consoleFull)** for PR 14828 at commit [`44c1b4b`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14083: [SPARK-16406][SQL] Improve performance of LogicalPlan.re...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14083 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14083: [SPARK-16406][SQL] Improve performance of LogicalPlan.re...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14083 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65231/ Test PASSed. ---

[GitHub] spark issue #14083: [SPARK-16406][SQL] Improve performance of LogicalPlan.re...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14083 **[Test build #65231 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65231/consoleFull)** for PR 14083 at commit [`a1e5312`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15048: [SPARK-17409] [SQL] Do Not Optimize Query in CTAS More T...

Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/15048 @hvanhovell Sure, will do it. Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14971: [SPARK-17410] [SPARK-17284] Move Hive-generated Stats In...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14971 **[Test build #65232 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65232/consoleFull)** for PR 14971 at commit [`9e18ba1`](https://github.com/apache/spark/commit/9

[GitHub] spark issue #15048: [SPARK-17409] [SQL] Do Not Optimize Query in CTAS More T...

Github user hvanhovell commented on the issue: https://github.com/apache/spark/pull/15048 @gatorsmile so should we check all commands? It might also be an idea to have `Command` extend `LeafNode` (and make children `final`). I think @davies did something similar for https://github.com

[GitHub] spark issue #15053: [Doc] improve python API docstrings

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15053 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feat

[GitHub] spark pull request #15053: [Doc] improve python API docstrings

GitHub user mortada opened a pull request: https://github.com/apache/spark/pull/15053 [Doc] improve python API docstrings ## What changes were proposed in this pull request? a lot of the python API functions show example usage that is incomplete. The docstring shows output

[GitHub] spark issue #14828: [SPARK-17258][SQL] Parse scientific decimal literals as ...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14828 **[Test build #65230 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65230/consoleFull)** for PR 14828 at commit [`44c1b4b`](https://github.com/apache/spark/commit/4

[GitHub] spark issue #14083: [SPARK-16406][SQL] Improve performance of LogicalPlan.re...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14083 **[Test build #65231 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65231/consoleFull)** for PR 14083 at commit [`a1e5312`](https://github.com/apache/spark/commit/a

[GitHub] spark issue #14083: [SPARK-16406][SQL] Improve performance of LogicalPlan.re...

Github user hvanhovell commented on the issue: https://github.com/apache/spark/pull/14083 @JoshRosen I have moved the implementation into `AttributeSeq`. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project doe

[GitHub] spark issue #15045: [Spark Core][MINOR] fix "default partitioner cannot part...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15045 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65227/ Test FAILed. ---

[GitHub] spark issue #15045: [Spark Core][MINOR] fix "default partitioner cannot part...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15045 **[Test build #65227 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65227/consoleFull)** for PR 15045 at commit [`25f1f8c`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15045: [Spark Core][MINOR] fix "default partitioner cannot part...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15045 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15052: [SPARK-17500][PySpark]Make DiskBytesSpilled metric in Py...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15052 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feat

[GitHub] spark pull request #15052: [SPARK-17500][PySpark]Make DiskBytesSpilled metri...

GitHub user djvulee opened a pull request: https://github.com/apache/spark/pull/15052 [SPARK-17500][PySpark]Make DiskBytesSpilled metric in PySpark shuffle right ## What changes were proposed in this pull request? The origin way increases the DiskBytesSpilled metric with the

[GitHub] spark issue #14980: [SPARK-17317][SparkR] Add SparkR vignette

Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/14980 I think having another PR on the branch-2.0 is a good idea. Also should we have forward looking statements like [this](https://github.com/apache/spark/pull/14980/files#r5442) in the vers

[GitHub] spark pull request #14980: [SPARK-17317][SparkR] Add SparkR vignette

Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/14980#discussion_r78301288 --- Diff: R/pkg/vignettes/sparkr-vignettes.Rmd --- @@ -0,0 +1,853 @@ +--- +title: "SparkR - Practical Guide" +output: + html_document:

[GitHub] spark pull request #14980: [SPARK-17317][SparkR] Add SparkR vignette

Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/14980#discussion_r78301238 --- Diff: R/pkg/vignettes/sparkr-vignettes.Rmd --- @@ -0,0 +1,853 @@ +--- +title: "SparkR - Practical Guide" +output: + html_document:

[GitHub] spark pull request #14980: [SPARK-17317][SparkR] Add SparkR vignette

Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/14980#discussion_r78301233 --- Diff: R/pkg/vignettes/sparkr-vignettes.Rmd --- @@ -0,0 +1,853 @@ +--- +title: "SparkR - Practical Guide" +output: + html_document:

[GitHub] spark pull request #15051: [SPARK-17499][ML][MLLib] make the default params ...

Github user shivaram commented on a diff in the pull request: https://github.com/apache/spark/pull/15051#discussion_r78301160 --- Diff: R/pkg/R/mllib.R --- @@ -694,8 +694,8 @@ setMethod("predict", signature(object = "KMeansModel"), #' } #' @note spark.mlp since 2.1.0

[GitHub] spark pull request #15051: [SPARK-17499][ML][MLLib] make the default params ...

Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/15051#discussion_r78301071 --- Diff: R/pkg/R/mllib.R --- @@ -694,8 +694,8 @@ setMethod("predict", signature(object = "KMeansModel"), #' } #' @note spark.mlp since 2.1.0

[GitHub] spark issue #15051: [SPARK-17499][ML][MLLib] make the default params in spar...

Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/15051 thanks - could you add some tests that use these default values? (esp. layers as NULL) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark pull request #15051: [SPARK-17499][ML][MLLib] make the default params ...

Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/15051#discussion_r78301008 --- Diff: R/pkg/R/mllib.R --- @@ -694,8 +694,8 @@ setMethod("predict", signature(object = "KMeansModel"), #' } #' @note spark.mlp since 2.1.0

[GitHub] spark issue #15045: [Spark Core][MINOR] fix "default partitioner cannot part...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15045 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15045: [Spark Core][MINOR] fix "default partitioner cannot part...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15045 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65229/ Test PASSed. ---

[GitHub] spark issue #15045: [Spark Core][MINOR] fix "default partitioner cannot part...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15045 **[Test build #65229 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65229/consoleFull)** for PR 15045 at commit [`f53ad51`](https://github.com/apache/spark/commit/

[GitHub] spark pull request #15047: [SPARK-17495] [SQL] Add Hash capability semantica...

Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/15047#discussion_r78299559 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveHash.scala --- @@ -0,0 +1,145 @@ +/* + * Licensed to the Apache Software Foundatio

[GitHub] spark pull request #15048: [SPARK-17409] [SQL] Do Not Optimize Query in CTAS...

Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/15048#discussion_r78299463 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/ddl.scala --- @@ -37,7 +38,9 @@ case class CreateTable(tableDesc: CatalogTabl

[GitHub] spark pull request #15047: [SPARK-17495] [SQL] Add Hash capability semantica...

Github user tejasapatil commented on a diff in the pull request: https://github.com/apache/spark/pull/15047#discussion_r78299323 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveHash.scala --- @@ -0,0 +1,145 @@ +/* + * Licensed to the Apache Software Foundati

[GitHub] spark pull request #15047: [SPARK-17495] [SQL] Add Hash capability semantica...

Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/15047#discussion_r78299210 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveHash.scala --- @@ -0,0 +1,145 @@ +/* + * Licensed to the Apache Software Foundatio

  1   2   >