[GitHub] spark issue #22385: [SPARK-25400][CORE] Increase test timeouts

2018-09-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22385 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #22385: [SPARK-25400][CORE] Increase test timeouts

2018-09-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22385 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/2990/

[GitHub] spark issue #22192: [SPARK-24918][Core] Executor Plugin API

2018-09-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/22192 **[Test build #4333 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/4333/testReport)** for PR 22192 at commit [`447c5e5`](https://github.com/apache/spark/commit/4

[GitHub] spark pull request #22385: [SPARK-25400][CORE] Increase test timeouts

2018-09-10 Thread squito
GitHub user squito opened a pull request: https://github.com/apache/spark/pull/22385 [SPARK-25400][CORE] Increase test timeouts We've seen some flakiness in jenkins which looks like it just needs a longer timeout. You can merge this pull request into a Git repository by running

[GitHub] spark issue #22192: [SPARK-24918][Core] Executor Plugin API

2018-09-10 Thread squito
Github user squito commented on the issue: https://github.com/apache/spark/pull/22192 retest this please. I took a look at the failures, pretty certain its unrelated, and I filed https://issues.apache.org/jira/browse/SPARK-25400 to increase the timeouts in one of those failur

[GitHub] spark issue #21688: [SPARK-21809] : Change Stage Page to use datatables to s...

2018-09-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21688 **[Test build #95902 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95902/testReport)** for PR 21688 at commit [`573390d`](https://github.com/apache/spark/commit/57

[GitHub] spark issue #22379: [SPARK-25393][SQL] Adding new function from_csv()

2018-09-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/22379 **[Test build #95901 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95901/testReport)** for PR 22379 at commit [`d2bfd94`](https://github.com/apache/spark/commit/d2

[GitHub] spark issue #22379: [SPARK-25393][SQL] Adding new function from_csv()

2018-09-10 Thread MaxGekk
Github user MaxGekk commented on the issue: https://github.com/apache/spark/pull/22379 jenkins, retest this, please --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #22192: [SPARK-24918][Core] Executor Plugin API

2018-09-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22192 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #22365: [SPARK-25381][SQL] Stratified sampling by Column argumen...

2018-09-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/22365 **[Test build #95900 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95900/testReport)** for PR 22365 at commit [`e85175e`](https://github.com/apache/spark/commit/e8

[GitHub] spark issue #22192: [SPARK-24918][Core] Executor Plugin API

2018-09-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22192 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/95887/ Test FAILed. ---

[GitHub] spark pull request #22365: [SPARK-25381][SQL] Stratified sampling by Column ...

2018-09-10 Thread MaxGekk
Github user MaxGekk commented on a diff in the pull request: https://github.com/apache/spark/pull/22365#discussion_r216482340 --- Diff: python/pyspark/sql/dataframe.py --- @@ -880,18 +880,23 @@ def sampleBy(self, col, fractions, seed=None): | 0|5| | 1

[GitHub] spark issue #22192: [SPARK-24918][Core] Executor Plugin API

2018-09-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/22192 **[Test build #95887 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95887/testReport)** for PR 22192 at commit [`447c5e5`](https://github.com/apache/spark/commit/4

[GitHub] spark pull request #21433: [SPARK-23820][CORE] Enable use of long form of ca...

2018-09-10 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/21433#discussion_r216478593 --- Diff: core/src/main/scala/org/apache/spark/internal/config/package.scala --- @@ -72,6 +72,9 @@ package object config { private[spark] val EVENT_LO

[GitHub] spark issue #22379: [SPARK-25393][SQL] Adding new function from_csv()

2018-09-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22379 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #22379: [SPARK-25393][SQL] Adding new function from_csv()

2018-09-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22379 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/95885/ Test FAILed. ---

[GitHub] spark issue #22379: [SPARK-25393][SQL] Adding new function from_csv()

2018-09-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/22379 **[Test build #95885 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95885/testReport)** for PR 22379 at commit [`d2bfd94`](https://github.com/apache/spark/commit/d

[GitHub] spark pull request #22381: [SPARK-25394][CORE] Add an application status met...

2018-09-10 Thread skonto
Github user skonto commented on a diff in the pull request: https://github.com/apache/spark/pull/22381#discussion_r216476831 --- Diff: core/src/main/scala/org/apache/spark/status/AppStatusListener.scala --- @@ -382,11 +392,37 @@ private[spark] class AppStatusListener( }

[GitHub] spark issue #22378: [SPARK-25389][SQL] INSERT OVERWRITE DIRECTORY STORED AS ...

2018-09-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22378 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/95891/ Test PASSed. ---

[GitHub] spark issue #22378: [SPARK-25389][SQL] INSERT OVERWRITE DIRECTORY STORED AS ...

2018-09-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22378 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #22378: [SPARK-25389][SQL] INSERT OVERWRITE DIRECTORY STORED AS ...

2018-09-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/22378 **[Test build #95891 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95891/testReport)** for PR 22378 at commit [`0242576`](https://github.com/apache/spark/commit/0

[GitHub] spark issue #22381: [SPARK-25394][CORE] Add an application status metrics so...

2018-09-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22381 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/95881/ Test PASSed. ---

[GitHub] spark issue #22381: [SPARK-25394][CORE] Add an application status metrics so...

2018-09-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22381 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #22381: [SPARK-25394][CORE] Add an application status metrics so...

2018-09-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22381 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/95880/ Test PASSed. ---

[GitHub] spark issue #22381: [SPARK-25394][CORE] Add an application status metrics so...

2018-09-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22381 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #22381: [SPARK-25394][CORE] Add an application status metrics so...

2018-09-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/22381 **[Test build #95881 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95881/testReport)** for PR 22381 at commit [`b43190d`](https://github.com/apache/spark/commit/b

[GitHub] spark issue #22381: [SPARK-25394][CORE] Add an application status metrics so...

2018-09-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/22381 **[Test build #95880 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95880/testReport)** for PR 22381 at commit [`b43190d`](https://github.com/apache/spark/commit/b

[GitHub] spark pull request #22381: [SPARK-25394][CORE] Add an application status met...

2018-09-10 Thread skonto
Github user skonto commented on a diff in the pull request: https://github.com/apache/spark/pull/22381#discussion_r216472252 --- Diff: core/src/main/scala/org/apache/spark/status/AppStatusListener.scala --- @@ -382,11 +392,37 @@ private[spark] class AppStatusListener( }

[GitHub] spark issue #22227: [SPARK-25202] [SQL] Implements split with limit sql func...

2018-09-10 Thread phegstrom
Github user phegstrom commented on the issue: https://github.com/apache/spark/pull/7 hey @HyukjinKwon, I'm seeing two tests fail in the most recent run, but traces don't seem related to any of my changes -- not to mention the test name is `(It is not a test it is a sbt.testing.Sui

[GitHub] spark pull request #22381: [SPARK-25394][CORE] Add an application status met...

2018-09-10 Thread skonto
Github user skonto commented on a diff in the pull request: https://github.com/apache/spark/pull/22381#discussion_r216470277 --- Diff: core/src/main/scala/org/apache/spark/status/AppStatusSource.scala --- @@ -0,0 +1,55 @@ +/* + * Licensed to the Apache Software Foundation (

[GitHub] spark issue #22231: [SPARK-25238][PYTHON] lint-python: Upgrade pycodestyle t...

2018-09-10 Thread holdenk
Github user holdenk commented on the issue: https://github.com/apache/spark/pull/22231 I'm a little slammed this week until Friday, I'll try and cycle back then. --- - To unsubscribe, e-mail: reviews-unsubscr...@spar

[GitHub] spark pull request #22381: [SPARK-25394][CORE] Add an application status met...

2018-09-10 Thread skonto
Github user skonto commented on a diff in the pull request: https://github.com/apache/spark/pull/22381#discussion_r216469838 --- Diff: core/src/main/scala/org/apache/spark/status/AppStatusListener.scala --- @@ -382,11 +392,37 @@ private[spark] class AppStatusListener( }

[GitHub] spark issue #21433: [SPARK-23820][CORE] Enable use of long form of callsite ...

2018-09-10 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/21433 @michaelmior Since Spark 2.4 is branch cut, this PR still needs more review. I would revert this PR from branch 2.4 and master first. We can discuss the conf and implementation in the master bran

[GitHub] spark issue #22231: [SPARK-25238][PYTHON] lint-python: Upgrade pycodestyle t...

2018-09-10 Thread cclauss
Github user cclauss commented on the issue: https://github.com/apache/spark/pull/22231 @srowen Could you please provide some test cases in Python 2 and Python 3 to prove that the changes that you propose will be properly interpreted without side effects in both? --- ---

[GitHub] spark pull request #22381: [SPARK-25394][CORE] Add an application status met...

2018-09-10 Thread skonto
Github user skonto commented on a diff in the pull request: https://github.com/apache/spark/pull/22381#discussion_r216465915 --- Diff: core/src/main/scala/org/apache/spark/status/AppStatusListener.scala --- @@ -382,11 +392,37 @@ private[spark] class AppStatusListener( }

[GitHub] spark issue #21080: [SPARK-23986][SQL] freshName can generate non-unique nam...

2018-09-10 Thread dzanozin
Github user dzanozin commented on the issue: https://github.com/apache/spark/pull/21080 The code still generated method signatures like this in Spark v2.3.1 (and obviously fails because of `agg_expr_21` duplication): ```Java private void agg_doConsume1(byte agg_expr_01, boolean

[GitHub] spark pull request #22367: [SPARK-17916][SPARK-25241][SQL][FOLLOWUP] Fix emp...

2018-09-10 Thread MaxGekk
Github user MaxGekk commented on a diff in the pull request: https://github.com/apache/spark/pull/22367#discussion_r216463293 --- Diff: docs/sql-programming-guide.md --- @@ -1897,6 +1897,7 @@ working with timestamps in `pandas_udf`s to get the best performance, see - In vers

[GitHub] spark issue #22367: [SPARK-17916][SPARK-25241][SQL][FOLLOWUP] Fix empty stri...

2018-09-10 Thread MaxGekk
Github user MaxGekk commented on the issue: https://github.com/apache/spark/pull/22367 > mind adding Closes #22234 at the end of PR description so that we can automatically close that one? Just in case, this PR for `branch-2.4` but the original #22234 for `master`. --- ---

[GitHub] spark issue #22227: [SPARK-25202] [SQL] Implements split with limit sql func...

2018-09-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/7 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/95872/ Test FAILed. ---

[GitHub] spark issue #22227: [SPARK-25202] [SQL] Implements split with limit sql func...

2018-09-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/7 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #22367: [SPARK-17916][SPARK-25241][SQL][FOLLOWUP] Fix empty stri...

2018-09-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/22367 **[Test build #95899 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95899/testReport)** for PR 22367 at commit [`a56d001`](https://github.com/apache/spark/commit/a5

[GitHub] spark issue #22227: [SPARK-25202] [SQL] Implements split with limit sql func...

2018-09-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/7 **[Test build #95872 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95872/testReport)** for PR 7 at commit [`b12ee88`](https://github.com/apache/spark/commit/b

[GitHub] spark issue #22364: [SPARK-25379][SQL] Improve AttributeSet and ColumnPrunin...

2018-09-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22364 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/95869/ Test PASSed. ---

[GitHub] spark issue #22364: [SPARK-25379][SQL] Improve AttributeSet and ColumnPrunin...

2018-09-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22364 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #22364: [SPARK-25379][SQL] Improve AttributeSet and ColumnPrunin...

2018-09-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/22364 **[Test build #95869 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95869/testReport)** for PR 22364 at commit [`2afbe9b`](https://github.com/apache/spark/commit/2

[GitHub] spark issue #17650: [SPARK-20350] Add optimization rules to apply Complement...

2018-09-10 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/17650 I am fixing it now. Thanks! --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail

[GitHub] spark issue #22367: [SPARK-17916][SPARK-25241][SQL][FOLLOWUP] Fix empty stri...

2018-09-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/22367 **[Test build #95898 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95898/testReport)** for PR 22367 at commit [`40cfa28`](https://github.com/apache/spark/commit/40

[GitHub] spark issue #22357: [SPARK-25363][SQL] Fix schema pruning in where clause by...

2018-09-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22357 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/95871/ Test PASSed. ---

[GitHub] spark issue #22357: [SPARK-25363][SQL] Fix schema pruning in where clause by...

2018-09-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22357 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #22357: [SPARK-25363][SQL] Fix schema pruning in where clause by...

2018-09-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/22357 **[Test build #95871 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95871/testReport)** for PR 22357 at commit [`d0b82e6`](https://github.com/apache/spark/commit/d

[GitHub] spark issue #22140: [SPARK-25072][PySpark] Forbid extra value for custom Row

2018-09-10 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/22140 We are very conservative when backporting the PR to the released version. --- - To unsubscribe, e-mail: reviews-unsubscr...@s

[GitHub] spark issue #22376: [SPARK-25021][K8S][BACKPORT] Add spark.executor.pyspark....

2018-09-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22376 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #22376: [SPARK-25021][K8S][BACKPORT] Add spark.executor.pyspark....

2018-09-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22376 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/95883/ Test FAILed. ---

[GitHub] spark issue #21860: [SPARK-24901][SQL]Merge the codegen of RegularHashMap an...

2018-09-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21860 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #21860: [SPARK-24901][SQL]Merge the codegen of RegularHashMap an...

2018-09-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21860 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/95873/ Test PASSed. ---

[GitHub] spark issue #22376: [SPARK-25021][K8S][BACKPORT] Add spark.executor.pyspark....

2018-09-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/22376 **[Test build #95883 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95883/testReport)** for PR 22376 at commit [`4a0cffb`](https://github.com/apache/spark/commit/4

[GitHub] spark issue #21860: [SPARK-24901][SQL]Merge the codegen of RegularHashMap an...

2018-09-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21860 **[Test build #95873 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95873/testReport)** for PR 21860 at commit [`1c599f0`](https://github.com/apache/spark/commit/1

[GitHub] spark issue #22384: [SPARK-25398][CORE][MESOS] Minor bugs from comparing unr...

2018-09-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/22384 **[Test build #95897 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95897/testReport)** for PR 22384 at commit [`9e70b62`](https://github.com/apache/spark/commit/9e

[GitHub] spark pull request #22384: [SPARK-25398][CORE][MESOS] Minor bugs from compar...

2018-09-10 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/22384#discussion_r216454727 --- Diff: core/src/main/scala/org/apache/spark/status/LiveEntity.scala --- @@ -584,8 +583,7 @@ private object LiveEntityHelpers { .filter { acc =>

[GitHub] spark pull request #22384: [SPARK-25398][CORE][MESOS] Minor bugs from compar...

2018-09-10 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/22384#discussion_r216455205 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/util/UnsafeArraySuite.scala --- @@ -114,15 +114,15 @@ class UnsafeArraySuite extends Spa

[GitHub] spark issue #22384: [SPARK-25398][CORE][MESOS] Minor bugs from comparing unr...

2018-09-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22384 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #22380: [SPARK-25278][SQL][followup] remove the hack in Progress...

2018-09-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22380 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/95875/ Test PASSed. ---

[GitHub] spark issue #22380: [SPARK-25278][SQL][followup] remove the hack in Progress...

2018-09-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22380 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark pull request #22384: [SPARK-25398][CORE][MESOS] Minor bugs from compar...

2018-09-10 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/22384#discussion_r216454783 --- Diff: core/src/main/scala/org/apache/spark/util/ClosureCleaner.scala --- @@ -175,7 +175,7 @@ private[spark] object ClosureCleaner extends Logging {

[GitHub] spark issue #22384: [SPARK-25398][CORE][MESOS] Minor bugs from comparing unr...

2018-09-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22384 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/2989/

[GitHub] spark pull request #22384: [SPARK-25398][CORE][MESOS] Minor bugs from compar...

2018-09-10 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/22384#discussion_r216454913 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/optimizer/PropagateEmptyRelationSuite.scala --- @@ -147,7 +147,7 @@ class PropagateEmpty

[GitHub] spark issue #22357: [SPARK-25363][SQL] Fix schema pruning in where clause by...

2018-09-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22357 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #22357: [SPARK-25363][SQL] Fix schema pruning in where clause by...

2018-09-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22357 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/95884/ Test PASSed. ---

[GitHub] spark pull request #22384: [SPARK-25398][CORE][MESOS] Minor bugs from compar...

2018-09-10 Thread srowen
GitHub user srowen opened a pull request: https://github.com/apache/spark/pull/22384 [SPARK-25398][CORE][MESOS] Minor bugs from comparing unrelated types ## What changes were proposed in this pull request? Correct some comparisons between unrelated types to what they seem to

[GitHub] spark issue #22357: [SPARK-25363][SQL] Fix schema pruning in where clause by...

2018-09-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/22357 **[Test build #95884 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95884/testReport)** for PR 22357 at commit [`d0b82e6`](https://github.com/apache/spark/commit/d

[GitHub] spark issue #22380: [SPARK-25278][SQL][followup] remove the hack in Progress...

2018-09-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/22380 **[Test build #95875 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95875/testReport)** for PR 22380 at commit [`ee0df17`](https://github.com/apache/spark/commit/e

[GitHub] spark issue #21899: [SPARK-24912][SQL] Don't obscure source of OOM during br...

2018-09-10 Thread bersprockets
Github user bersprockets commented on the issue: https://github.com/apache/spark/pull/21899 cc @jinxing64 @hvanhovell @MaxGekk --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #22382: [SPARK-23243] [SPARK-20715][CORE][2.2] Fix RDD.repartiti...

2018-09-10 Thread bersprockets
Github user bersprockets commented on the issue: https://github.com/apache/spark/pull/22382 cc @cloud-fan @JoshRosen --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail

[GitHub] spark issue #22237: [SPARK-25243][SQL] Use FailureSafeParser in from_json

2018-09-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/22237 **[Test build #95896 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95896/testReport)** for PR 22237 at commit [`26287a5`](https://github.com/apache/spark/commit/26

[GitHub] spark issue #22366: [SPARK-25384][SQL] Removing of spark.sql.fromJsonForceNu...

2018-09-10 Thread MaxGekk
Github user MaxGekk commented on the issue: https://github.com/apache/spark/pull/22366 > If this targets for 3.0, can we postpone this until the master branch get 3.0.0-SNAPSHOT? @dongjoon-hyun Yes, sure. ---

[GitHub] spark issue #22366: [SPARK-25384][SQL] Removing of spark.sql.fromJsonForceNu...

2018-09-10 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/22366 @MaxGekk . If this targets for 3.0, can we postpone this until the master branch get `3.0.0-SNAPSHOT`? > The PR targets Spark 3.0 in which the flag can be removed. --- --

[GitHub] spark issue #22373: [SPARK-25371][SQL] struct() should allow being called wi...

2018-09-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/22373 **[Test build #95895 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95895/testReport)** for PR 22373 at commit [`69ff3cb`](https://github.com/apache/spark/commit/69

[GitHub] spark issue #22373: [SPARK-25371][SQL] struct() should allow being called wi...

2018-09-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22373 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/2988/

[GitHub] spark pull request #22379: [SPARK-25393][SQL] Adding new function from_csv()

2018-09-10 Thread MaxGekk
Github user MaxGekk commented on a diff in the pull request: https://github.com/apache/spark/pull/22379#discussion_r216446691 --- Diff: sql/catalyst/pom.xml --- @@ -103,6 +103,12 @@ commons-codec commons-codec + + com.univocity +

[GitHub] spark issue #22373: [SPARK-25371][SQL] struct() should allow being called wi...

2018-09-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22373 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #22010: [SPARK-21436][CORE] Take advantage of known partitioner ...

2018-09-10 Thread holdenk
Github user holdenk commented on the issue: https://github.com/apache/spark/pull/22010 @cloud-fan yeah that's totally an option. Since @rxin asked for it to use `reduceByKey` I went with that approach, but I'd be happy to use the `ExternalAppendOnlyMap` if that's ok with folks. ---

[GitHub] spark issue #22373: [SPARK-25371][SQL] struct() should allow being called wi...

2018-09-10 Thread mgaido91
Github user mgaido91 commented on the issue: https://github.com/apache/spark/pull/22373 retest this please --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h

[GitHub] spark pull request #22237: [SPARK-25243][SQL] Use FailureSafeParser in from_...

2018-09-10 Thread MaxGekk
Github user MaxGekk commented on a diff in the pull request: https://github.com/apache/spark/pull/22237#discussion_r21650 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/JsonFunctionsSuite.scala --- @@ -469,4 +470,26 @@ class JsonFunctionsSuite extends QueryTest with Sh

[GitHub] spark issue #22373: [SPARK-25371][SQL] struct() should allow being called wi...

2018-09-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22373 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #22373: [SPARK-25371][SQL] struct() should allow being called wi...

2018-09-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22373 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/95877/ Test FAILed. ---

[GitHub] spark issue #22382: [SPARK-23243] [SPARK-20715][CORE][2.2] Fix RDD.repartiti...

2018-09-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22382 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/95882/ Test PASSed. ---

[GitHub] spark issue #22382: [SPARK-23243] [SPARK-20715][CORE][2.2] Fix RDD.repartiti...

2018-09-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22382 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #22373: [SPARK-25371][SQL] struct() should allow being called wi...

2018-09-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/22373 **[Test build #95877 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95877/testReport)** for PR 22373 at commit [`69ff3cb`](https://github.com/apache/spark/commit/6

[GitHub] spark pull request #22379: [SPARK-25393][SQL] Adding new function from_csv()

2018-09-10 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/22379#discussion_r216443482 --- Diff: sql/catalyst/pom.xml --- @@ -103,6 +103,12 @@ commons-codec commons-codec + + com.univocity

[GitHub] spark issue #22382: [SPARK-23243] [SPARK-20715][CORE][2.2] Fix RDD.repartiti...

2018-09-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/22382 **[Test build #95882 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95882/testReport)** for PR 22382 at commit [`efd58ed`](https://github.com/apache/spark/commit/e

[GitHub] spark issue #22381: [SPARK-25394][CORE] Add an application status metrics so...

2018-09-10 Thread dbrinegar
Github user dbrinegar commented on the issue: https://github.com/apache/spark/pull/22381 This is quite a nice improvement for monitoring. The rest api is great for UI and consolidated analytics, but monitoring through it is not as straightforward as when the data emits directly from

[GitHub] spark issue #21465: [SPARK-24333][ML][PYTHON]Add fit with validation set to ...

2018-09-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21465 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/95893/ Test PASSed. ---

[GitHub] spark issue #21465: [SPARK-24333][ML][PYTHON]Add fit with validation set to ...

2018-09-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21465 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #21465: [SPARK-24333][ML][PYTHON]Add fit with validation set to ...

2018-09-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21465 **[Test build #95893 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95893/testReport)** for PR 21465 at commit [`1169db8`](https://github.com/apache/spark/commit/1

[GitHub] spark issue #21596: [SPARK-24601] Bump Jackson version

2018-09-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21596 **[Test build #95894 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95894/testReport)** for PR 21596 at commit [`bb8b661`](https://github.com/apache/spark/commit/bb

[GitHub] spark pull request #22381: [SPARK-25394][CORE] Add an application status met...

2018-09-10 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/22381#discussion_r216433852 --- Diff: core/src/main/scala/org/apache/spark/status/AppStatusListener.scala --- @@ -382,11 +392,37 @@ private[spark] class AppStatusListener( }

[GitHub] spark issue #22295: [SPARK-25255][PYTHON]Add getActiveSession to SparkSessio...

2018-09-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22295 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/95889/ Test PASSed. ---

[GitHub] spark issue #22295: [SPARK-25255][PYTHON]Add getActiveSession to SparkSessio...

2018-09-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22295 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #22295: [SPARK-25255][PYTHON]Add getActiveSession to SparkSessio...

2018-09-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/22295 **[Test build #95889 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95889/testReport)** for PR 22295 at commit [`2345e55`](https://github.com/apache/spark/commit/2

[GitHub] spark issue #22231: [SPARK-25238][PYTHON] lint-python: Upgrade pycodestyle t...

2018-09-10 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/22231 @holdenk what do you think about the change I proposed above? I didn't know enough to know whether this was the right fix --- - T

<    1   2   3   4   5   6   7   >