[GitHub] [spark] HyukjinKwon commented on a change in pull request #25847: [SPARK-21045][PYTHON] Allow non-ascii string as an exception message from python execution in Python 2

2019-09-19 Thread GitBox
HyukjinKwon commented on a change in pull request #25847: [SPARK-21045][PYTHON] Allow non-ascii string as an exception message from python execution in Python 2 URL: https://github.com/apache/spark/pull/25847#discussion_r326441374 ## File path: python/pyspark/worker.py ##

[GitHub] [spark] AmplabJenkins removed a comment on issue #25862: [SPARK-23197][STREAMING][TESTS] Fix ReceiverSuite."receiver_life_cycle" to not rely on timing

2019-09-19 Thread GitBox
AmplabJenkins removed a comment on issue #25862: [SPARK-23197][STREAMING][TESTS] Fix ReceiverSuite."receiver_life_cycle" to not rely on timing URL: https://github.com/apache/spark/pull/25862#issuecomment-533365024 Can one of the admins verify this patch?

[GitHub] [spark] SparkQA commented on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API

2019-09-19 Thread GitBox
SparkQA commented on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API URL: https://github.com/apache/spark/pull/24232#issuecomment-533366185 **[Test build #111034 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/111034/testReport)**

[GitHub] [spark] SparkQA commented on issue #25862: [SPARK-23197][STREAMING][TESTS] Fix ReceiverSuite."receiver_life_cycle" to not rely on timing

2019-09-19 Thread GitBox
SparkQA commented on issue #25862: [SPARK-23197][STREAMING][TESTS] Fix ReceiverSuite."receiver_life_cycle" to not rely on timing URL: https://github.com/apache/spark/pull/25862#issuecomment-533366165 **[Test build #111033 has

[GitHub] [spark] nvander1 commented on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API

2019-09-19 Thread GitBox
nvander1 commented on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API URL: https://github.com/apache/spark/pull/24232#issuecomment-533366074 retest this please This is an automated message from

[GitHub] [spark] HyukjinKwon commented on issue #25861: [SPARK-27460][TESTS][2.4] Running slowest test suites in their own forked JVMs for higher parallelism

2019-09-19 Thread GitBox
HyukjinKwon commented on issue #25861: [SPARK-27460][TESTS][2.4] Running slowest test suites in their own forked JVMs for higher parallelism URL: https://github.com/apache/spark/pull/25861#issuecomment-533365978 Looks fine to me.

[GitHub] [spark] AmplabJenkins commented on issue #25862: [SPARK-23197][STREAMING][TESTS] Fix ReceiverSuite."receiver_life_cycle" to not rely on timing

2019-09-19 Thread GitBox
AmplabJenkins commented on issue #25862: [SPARK-23197][STREAMING][TESTS] Fix ReceiverSuite."receiver_life_cycle" to not rely on timing URL: https://github.com/apache/spark/pull/25862#issuecomment-533365024 Can one of the admins verify this patch?

[GitHub] [spark] HeartSaVioR opened a new pull request #25862: [SPARK-23197][STREAMING] Fix ReceiverSuite."receiver_life_cycle" to not rely on timing

2019-09-19 Thread GitBox
HeartSaVioR opened a new pull request #25862: [SPARK-23197][STREAMING] Fix ReceiverSuite."receiver_life_cycle" to not rely on timing URL: https://github.com/apache/spark/pull/25862 ### What changes were proposed in this pull request? This patch changes

[GitHub] [spark] itskals commented on a change in pull request #25840: [SPARK-29166][SQL] Add parameters to limit the number of dynamic partitions for data source table

2019-09-19 Thread GitBox
itskals commented on a change in pull request #25840: [SPARK-29166][SQL] Add parameters to limit the number of dynamic partitions for data source table URL: https://github.com/apache/spark/pull/25840#discussion_r326437238 ## File path:

[GitHub] [spark] SparkQA commented on issue #25861: [SPARK-27460][TESTS] Running slowest test suites in their own forked JVMs for higher parallelism

2019-09-19 Thread GitBox
SparkQA commented on issue #25861: [SPARK-27460][TESTS] Running slowest test suites in their own forked JVMs for higher parallelism URL: https://github.com/apache/spark/pull/25861#issuecomment-533361313 **[Test build #111032 has

[GitHub] [spark] dongjoon-hyun commented on issue #25805: [SPARK-29082][core] Skip delegation token generation if no credentials are available.

2019-09-19 Thread GitBox
dongjoon-hyun commented on issue #25805: [SPARK-29082][core] Skip delegation token generation if no credentials are available. URL: https://github.com/apache/spark/pull/25805#issuecomment-533361125 Sorry guys. Until now, I cannot find a solution for this. I'll revert this one to unblock

[GitHub] [spark] maropu commented on issue #25854: [SPARK-29145][SQL]Spark SQL cannot handle "NOT IN" condition when using "JOIN"

2019-09-19 Thread GitBox
maropu commented on issue #25854: [SPARK-29145][SQL]Spark SQL cannot handle "NOT IN" condition when using "JOIN" URL: https://github.com/apache/spark/pull/25854#issuecomment-533361041 Also, can you add end-to-end tests in `SQLQueryTestSuite` or somewhere?

[GitHub] [spark] maropu commented on issue #25854: [SPARK-29145][SQL]Spark SQL cannot handle "NOT IN" condition when using "JOIN"

2019-09-19 Thread GitBox
maropu commented on issue #25854: [SPARK-29145][SQL]Spark SQL cannot handle "NOT IN" condition when using "JOIN" URL: https://github.com/apache/spark/pull/25854#issuecomment-533360935 > Does this PR introduce any user-facing change? No? It seems ths pr intends to accept a

[GitHub] [spark] dongjoon-hyun edited a comment on issue #25861: [SPARK-27460][TESTS] Running slowest test suites in their own forked JVMs for higher parallelism

2019-09-19 Thread GitBox
dongjoon-hyun edited a comment on issue #25861: [SPARK-27460][TESTS] Running slowest test suites in their own forked JVMs for higher parallelism URL: https://github.com/apache/spark/pull/25861#issuecomment-533354263 cc @gengliangwang , @srowen , @cloud-fan , @gatorsmile , @HyukjinKwon .

[GitHub] [spark] AmplabJenkins removed a comment on issue #25861: [SPARK-27460][TESTS] Running slowest test suites in their own forked JVMs for higher parallelism

2019-09-19 Thread GitBox
AmplabJenkins removed a comment on issue #25861: [SPARK-27460][TESTS] Running slowest test suites in their own forked JVMs for higher parallelism URL: https://github.com/apache/spark/pull/25861#issuecomment-533360381 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] AmplabJenkins removed a comment on issue #25861: [SPARK-27460][TESTS] Running slowest test suites in their own forked JVMs for higher parallelism

2019-09-19 Thread GitBox
AmplabJenkins removed a comment on issue #25861: [SPARK-27460][TESTS] Running slowest test suites in their own forked JVMs for higher parallelism URL: https://github.com/apache/spark/pull/25861#issuecomment-533360377 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #25861: [SPARK-27460][TESTS] Running slowest test suites in their own forked JVMs for higher parallelism

2019-09-19 Thread GitBox
AmplabJenkins commented on issue #25861: [SPARK-27460][TESTS] Running slowest test suites in their own forked JVMs for higher parallelism URL: https://github.com/apache/spark/pull/25861#issuecomment-533360381 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins commented on issue #25861: [SPARK-27460][TESTS] Running slowest test suites in their own forked JVMs for higher parallelism

2019-09-19 Thread GitBox
AmplabJenkins commented on issue #25861: [SPARK-27460][TESTS] Running slowest test suites in their own forked JVMs for higher parallelism URL: https://github.com/apache/spark/pull/25861#issuecomment-533360377 Merged build finished. Test PASSed.

[GitHub] [spark] viirya commented on a change in pull request #25847: [SPARK-21045][PYTHON] Allow non-ascii string as an exception message from python execution in Python 2

2019-09-19 Thread GitBox
viirya commented on a change in pull request #25847: [SPARK-21045][PYTHON] Allow non-ascii string as an exception message from python execution in Python 2 URL: https://github.com/apache/spark/pull/25847#discussion_r326435508 ## File path: python/pyspark/tests/test_worker.py

[GitHub] [spark] HyukjinKwon commented on a change in pull request #25847: [SPARK-21045][PYTHON] Allow non-ascii string as an exception message from python execution in Python 2

2019-09-19 Thread GitBox
HyukjinKwon commented on a change in pull request #25847: [SPARK-21045][PYTHON] Allow non-ascii string as an exception message from python execution in Python 2 URL: https://github.com/apache/spark/pull/25847#discussion_r326435255 ## File path: python/pyspark/worker.py ##

[GitHub] [spark] HyukjinKwon commented on a change in pull request #25847: [SPARK-21045][PYTHON] Allow non-ascii string as an exception message from python execution in Python 2

2019-09-19 Thread GitBox
HyukjinKwon commented on a change in pull request #25847: [SPARK-21045][PYTHON] Allow non-ascii string as an exception message from python execution in Python 2 URL: https://github.com/apache/spark/pull/25847#discussion_r326435016 ## File path: python/pyspark/worker.py ##

[GitHub] [spark] AmplabJenkins removed a comment on issue #23747: [SPARK-26848][SQL][SS] Introduce new option to Kafka source: offset by timestamp (starting/ending)

2019-09-19 Thread GitBox
AmplabJenkins removed a comment on issue #23747: [SPARK-26848][SQL][SS] Introduce new option to Kafka source: offset by timestamp (starting/ending) URL: https://github.com/apache/spark/pull/23747#issuecomment-533357869 Test PASSed. Refer to this link for build results (access rights to

[GitHub] [spark] AmplabJenkins removed a comment on issue #25861: [WIP][SPARK-27460][TESTS] Running slowest test suites in their own forked JVMs for higher parallelism

2019-09-19 Thread GitBox
AmplabJenkins removed a comment on issue #25861: [WIP][SPARK-27460][TESTS] Running slowest test suites in their own forked JVMs for higher parallelism URL: https://github.com/apache/spark/pull/25861#issuecomment-533357923 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #23747: [SPARK-26848][SQL][SS] Introduce new option to Kafka source: offset by timestamp (starting/ending)

2019-09-19 Thread GitBox
AmplabJenkins removed a comment on issue #23747: [SPARK-26848][SQL][SS] Introduce new option to Kafka source: offset by timestamp (starting/ending) URL: https://github.com/apache/spark/pull/23747#issuecomment-533357859 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #25861: [WIP][SPARK-27460][TESTS] Running slowest test suites in their own forked JVMs for higher parallelism

2019-09-19 Thread GitBox
AmplabJenkins removed a comment on issue #25861: [WIP][SPARK-27460][TESTS] Running slowest test suites in their own forked JVMs for higher parallelism URL: https://github.com/apache/spark/pull/25861#issuecomment-533357930 Test PASSed. Refer to this link for build results (access rights

[GitHub] [spark] AmplabJenkins commented on issue #23747: [SPARK-26848][SQL][SS] Introduce new option to Kafka source: offset by timestamp (starting/ending)

2019-09-19 Thread GitBox
AmplabJenkins commented on issue #23747: [SPARK-26848][SQL][SS] Introduce new option to Kafka source: offset by timestamp (starting/ending) URL: https://github.com/apache/spark/pull/23747#issuecomment-533357859 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #25861: [WIP][SPARK-27460][TESTS] Running slowest test suites in their own forked JVMs for higher parallelism

2019-09-19 Thread GitBox
AmplabJenkins commented on issue #25861: [WIP][SPARK-27460][TESTS] Running slowest test suites in their own forked JVMs for higher parallelism URL: https://github.com/apache/spark/pull/25861#issuecomment-533357930 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] AmplabJenkins commented on issue #23747: [SPARK-26848][SQL][SS] Introduce new option to Kafka source: offset by timestamp (starting/ending)

2019-09-19 Thread GitBox
AmplabJenkins commented on issue #23747: [SPARK-26848][SQL][SS] Introduce new option to Kafka source: offset by timestamp (starting/ending) URL: https://github.com/apache/spark/pull/23747#issuecomment-533357869 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] AmplabJenkins commented on issue #25861: [WIP][SPARK-27460][TESTS] Running slowest test suites in their own forked JVMs for higher parallelism

2019-09-19 Thread GitBox
AmplabJenkins commented on issue #25861: [WIP][SPARK-27460][TESTS] Running slowest test suites in their own forked JVMs for higher parallelism URL: https://github.com/apache/spark/pull/25861#issuecomment-533357923 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA commented on issue #25861: [WIP][SPARK-27460][TESTS] Running slowest test suites in their own forked JVMs for higher parallelism

2019-09-19 Thread GitBox
SparkQA commented on issue #25861: [WIP][SPARK-27460][TESTS] Running slowest test suites in their own forked JVMs for higher parallelism URL: https://github.com/apache/spark/pull/25861#issuecomment-533357701 **[Test build #111031 has

[GitHub] [spark] SparkQA removed a comment on issue #23747: [SPARK-26848][SQL][SS] Introduce new option to Kafka source: offset by timestamp (starting/ending)

2019-09-19 Thread GitBox
SparkQA removed a comment on issue #23747: [SPARK-26848][SQL][SS] Introduce new option to Kafka source: offset by timestamp (starting/ending) URL: https://github.com/apache/spark/pull/23747#issuecomment-533297739 **[Test build #111023 has

[GitHub] [spark] dongjoon-hyun closed pull request #25857: [MINOR][BUILD][2.4] Fix 4 misc build warnings

2019-09-19 Thread GitBox
dongjoon-hyun closed pull request #25857: [MINOR][BUILD][2.4] Fix 4 misc build warnings URL: https://github.com/apache/spark/pull/25857 This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] SparkQA commented on issue #23747: [SPARK-26848][SQL][SS] Introduce new option to Kafka source: offset by timestamp (starting/ending)

2019-09-19 Thread GitBox
SparkQA commented on issue #23747: [SPARK-26848][SQL][SS] Introduce new option to Kafka source: offset by timestamp (starting/ending) URL: https://github.com/apache/spark/pull/23747#issuecomment-533357544 **[Test build #111023 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #25857: [MINOR][BUILD][2.4] Fix 4 misc build warnings

2019-09-19 Thread GitBox
AmplabJenkins removed a comment on issue #25857: [MINOR][BUILD][2.4] Fix 4 misc build warnings URL: https://github.com/apache/spark/pull/25857#issuecomment-533357205 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #25857: [MINOR][BUILD][2.4] Fix 4 misc build warnings

2019-09-19 Thread GitBox
AmplabJenkins removed a comment on issue #25857: [MINOR][BUILD][2.4] Fix 4 misc build warnings URL: https://github.com/apache/spark/pull/25857#issuecomment-533357203 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] dongjoon-hyun commented on issue #25857: [MINOR][BUILD][2.4] Fix 4 misc build warnings

2019-09-19 Thread GitBox
dongjoon-hyun commented on issue #25857: [MINOR][BUILD][2.4] Fix 4 misc build warnings URL: https://github.com/apache/spark/pull/25857#issuecomment-533357253 Merged to `branch-2.4`. This is an automated message from the

[GitHub] [spark] AmplabJenkins commented on issue #25857: [MINOR][BUILD][2.4] Fix 4 misc build warnings

2019-09-19 Thread GitBox
AmplabJenkins commented on issue #25857: [MINOR][BUILD][2.4] Fix 4 misc build warnings URL: https://github.com/apache/spark/pull/25857#issuecomment-533357203 Merged build finished. Test PASSed. This is an automated message

[GitHub] [spark] AmplabJenkins commented on issue #25857: [MINOR][BUILD][2.4] Fix 4 misc build warnings

2019-09-19 Thread GitBox
AmplabJenkins commented on issue #25857: [MINOR][BUILD][2.4] Fix 4 misc build warnings URL: https://github.com/apache/spark/pull/25857#issuecomment-533357205 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on issue #25857: [MINOR][BUILD][2.4] Fix 4 misc build warnings

2019-09-19 Thread GitBox
SparkQA removed a comment on issue #25857: [MINOR][BUILD][2.4] Fix 4 misc build warnings URL: https://github.com/apache/spark/pull/25857#issuecomment-533275884 **[Test build #111022 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/111022/testReport)** for

[GitHub] [spark] SparkQA commented on issue #25857: [MINOR][BUILD][2.4] Fix 4 misc build warnings

2019-09-19 Thread GitBox
SparkQA commented on issue #25857: [MINOR][BUILD][2.4] Fix 4 misc build warnings URL: https://github.com/apache/spark/pull/25857#issuecomment-533356895 **[Test build #111022 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/111022/testReport)** for PR 25857

[GitHub] [spark] dongjoon-hyun edited a comment on issue #25861: [WIP][SPARK-27460][TESTS] Running slowest test suites in their own forked JVMs for higher parallelism

2019-09-19 Thread GitBox
dongjoon-hyun edited a comment on issue #25861: [WIP][SPARK-27460][TESTS] Running slowest test suites in their own forked JVMs for higher parallelism URL: https://github.com/apache/spark/pull/25861#issuecomment-533355456 I'll add the follow-up PR, too. BTW, @gatorsmile , do we need

[GitHub] [spark] AmplabJenkins removed a comment on issue #25861: [WIP][SPARK-27460][TESTS] Running slowest test suites in their own forked JVMs for higher parallelism

2019-09-19 Thread GitBox
AmplabJenkins removed a comment on issue #25861: [WIP][SPARK-27460][TESTS] Running slowest test suites in their own forked JVMs for higher parallelism URL: https://github.com/apache/spark/pull/25861#issuecomment-533355365 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #25861: [WIP][SPARK-27460][TESTS] Running slowest test suites in their own forked JVMs for higher parallelism

2019-09-19 Thread GitBox
AmplabJenkins removed a comment on issue #25861: [WIP][SPARK-27460][TESTS] Running slowest test suites in their own forked JVMs for higher parallelism URL: https://github.com/apache/spark/pull/25861#issuecomment-533355368 Test PASSed. Refer to this link for build results (access rights

[GitHub] [spark] dongjoon-hyun commented on issue #25861: [WIP][SPARK-27460][TESTS] Running slowest test suites in their own forked JVMs for higher parallelism

2019-09-19 Thread GitBox
dongjoon-hyun commented on issue #25861: [WIP][SPARK-27460][TESTS] Running slowest test suites in their own forked JVMs for higher parallelism URL: https://github.com/apache/spark/pull/25861#issuecomment-533355456 I'll add the follow-up PR, too. BTW, @gatorsmile , do we need

[GitHub] [spark] AmplabJenkins commented on issue #25861: [WIP][SPARK-27460][TESTS] Running slowest test suites in their own forked JVMs for higher parallelism

2019-09-19 Thread GitBox
AmplabJenkins commented on issue #25861: [WIP][SPARK-27460][TESTS] Running slowest test suites in their own forked JVMs for higher parallelism URL: https://github.com/apache/spark/pull/25861#issuecomment-533355368 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] AmplabJenkins commented on issue #25861: [WIP][SPARK-27460][TESTS] Running slowest test suites in their own forked JVMs for higher parallelism

2019-09-19 Thread GitBox
AmplabJenkins commented on issue #25861: [WIP][SPARK-27460][TESTS] Running slowest test suites in their own forked JVMs for higher parallelism URL: https://github.com/apache/spark/pull/25861#issuecomment-533355365 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA commented on issue #25861: [SPARK-27460][TESTS] Running slowest test suites in their own forked JVMs for higher parallelism

2019-09-19 Thread GitBox
SparkQA commented on issue #25861: [SPARK-27460][TESTS] Running slowest test suites in their own forked JVMs for higher parallelism URL: https://github.com/apache/spark/pull/25861#issuecomment-533355155 **[Test build #111030 has

[GitHub] [spark] dongjoon-hyun commented on issue #25861: [SPARK-27460][TESTS] Running slowest test suites in their own forked JVMs for higher parallelism

2019-09-19 Thread GitBox
dongjoon-hyun commented on issue #25861: [SPARK-27460][TESTS] Running slowest test suites in their own forked JVMs for higher parallelism URL: https://github.com/apache/spark/pull/25861#issuecomment-533354263 cc @gengliangwang , @srowen , @cloud-fan , @gatorsmile

[GitHub] [spark] dongjoon-hyun opened a new pull request #25861: [SPARK-27460][TESTS] Running slowest test suites in their own forked JVMs for higher parallelism

2019-09-19 Thread GitBox
dongjoon-hyun opened a new pull request #25861: [SPARK-27460][TESTS] Running slowest test suites in their own forked JVMs for higher parallelism URL: https://github.com/apache/spark/pull/25861 ## What changes were proposed in this pull request? This patch modifies SparkBuild so that

[GitHub] [spark] advancedxy commented on a change in pull request #25847: [SPARK-21045][PYTHON] Allow non-ascii string as an exception message from python execution in Python 2

2019-09-19 Thread GitBox
advancedxy commented on a change in pull request #25847: [SPARK-21045][PYTHON] Allow non-ascii string as an exception message from python execution in Python 2 URL: https://github.com/apache/spark/pull/25847#discussion_r326429893 ## File path: python/pyspark/tests/test_worker.py

[GitHub] [spark] dongjoon-hyun commented on issue #24373: [SPARK-27460][TESTS] Running slowest test suites in their own forked JVMs for higher parallelism

2019-09-19 Thread GitBox
dongjoon-hyun commented on issue #24373: [SPARK-27460][TESTS] Running slowest test suites in their own forked JVMs for higher parallelism URL: https://github.com/apache/spark/pull/24373#issuecomment-533353830 Hi, All. We are hitting the timeout in `branch-2.4` SBT build, too. Instead

[GitHub] [spark] maropu commented on issue #25827: [SPARK-29128][SQL] Split predicate code in OR expressions

2019-09-19 Thread GitBox
maropu commented on issue #25827: [SPARK-29128][SQL] Split predicate code in OR expressions URL: https://github.com/apache/spark/pull/25827#issuecomment-533353507 Anyone could check this? @cloud-fan @viirya @kiszk This is

[GitHub] [spark] maropu commented on issue #25831: [SPARK-29122][SQL] Propagate all the SQL conf to executors in SQLQueryTestSuite

2019-09-19 Thread GitBox
maropu commented on issue #25831: [SPARK-29122][SQL] Propagate all the SQL conf to executors in SQLQueryTestSuite URL: https://github.com/apache/spark/pull/25831#issuecomment-533353266 Can you check? @gengliangwang @cloud-fan

[GitHub] [spark] maropu commented on a change in pull request #25666: [SPARK-28962][SQL] Provide index argument to filter lambda functions

2019-09-19 Thread GitBox
maropu commented on a change in pull request #25666: [SPARK-28962][SQL] Provide index argument to filter lambda functions URL: https://github.com/apache/spark/pull/25666#discussion_r326428122 ## File path:

[GitHub] [spark] maropu commented on a change in pull request #25666: [SPARK-28962][SQL] Provide index argument to filter lambda functions

2019-09-19 Thread GitBox
maropu commented on a change in pull request #25666: [SPARK-28962][SQL] Provide index argument to filter lambda functions URL: https://github.com/apache/spark/pull/25666#discussion_r326428122 ## File path:

[GitHub] [spark] AmplabJenkins removed a comment on issue #25854: [SPARK-29145][SQL]Spark SQL cannot handle "NOT IN" condition when using "JOIN"

2019-09-19 Thread GitBox
AmplabJenkins removed a comment on issue #25854: [SPARK-29145][SQL]Spark SQL cannot handle "NOT IN" condition when using "JOIN" URL: https://github.com/apache/spark/pull/25854#issuecomment-533351395 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #25854: [SPARK-29145][SQL]Spark SQL cannot handle "NOT IN" condition when using "JOIN"

2019-09-19 Thread GitBox
AmplabJenkins removed a comment on issue #25854: [SPARK-29145][SQL]Spark SQL cannot handle "NOT IN" condition when using "JOIN" URL: https://github.com/apache/spark/pull/25854#issuecomment-533351398 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25854: [SPARK-29145][SQL]Spark SQL cannot handle "NOT IN" condition when using "JOIN"

2019-09-19 Thread GitBox
AmplabJenkins commented on issue #25854: [SPARK-29145][SQL]Spark SQL cannot handle "NOT IN" condition when using "JOIN" URL: https://github.com/apache/spark/pull/25854#issuecomment-533351395 Merged build finished. Test PASSed.

[GitHub] [spark] maropu commented on a change in pull request #25666: [SPARK-28962][SQL] Provide index argument to filter lambda functions

2019-09-19 Thread GitBox
maropu commented on a change in pull request #25666: [SPARK-28962][SQL] Provide index argument to filter lambda functions URL: https://github.com/apache/spark/pull/25666#discussion_r326427579 ## File path:

[GitHub] [spark] AmplabJenkins commented on issue #25854: [SPARK-29145][SQL]Spark SQL cannot handle "NOT IN" condition when using "JOIN"

2019-09-19 Thread GitBox
AmplabJenkins commented on issue #25854: [SPARK-29145][SQL]Spark SQL cannot handle "NOT IN" condition when using "JOIN" URL: https://github.com/apache/spark/pull/25854#issuecomment-533351398 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #25854: [SPARK-29145][SQL]Spark SQL cannot handle "NOT IN" condition when using "JOIN"

2019-09-19 Thread GitBox
SparkQA commented on issue #25854: [SPARK-29145][SQL]Spark SQL cannot handle "NOT IN" condition when using "JOIN" URL: https://github.com/apache/spark/pull/25854#issuecomment-533351174 **[Test build #111029 has

[GitHub] [spark] maropu commented on a change in pull request #25666: [SPARK-28962][SQL] Provide index argument to filter lambda functions

2019-09-19 Thread GitBox
maropu commented on a change in pull request #25666: [SPARK-28962][SQL] Provide index argument to filter lambda functions URL: https://github.com/apache/spark/pull/25666#discussion_r326427367 ## File path:

[GitHub] [spark] viirya commented on issue #25858: [SPARK-19926][PYSPARK][Followup] Add unicode for flake8 check

2019-09-19 Thread GitBox
viirya commented on issue #25858: [SPARK-19926][PYSPARK][Followup] Add unicode for flake8 check URL: https://github.com/apache/spark/pull/25858#issuecomment-533350584 close this as @advancedxy responses to original PR. This

[GitHub] [spark] viirya closed pull request #25858: [SPARK-19926][PYSPARK][Followup] Add unicode for flake8 check

2019-09-19 Thread GitBox
viirya closed pull request #25858: [SPARK-19926][PYSPARK][Followup] Add unicode for flake8 check URL: https://github.com/apache/spark/pull/25858 This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] viirya commented on a change in pull request #25847: [SPARK-21045][PYTHON] Allow non-ascii string as an exception message from python execution in Python 2

2019-09-19 Thread GitBox
viirya commented on a change in pull request #25847: [SPARK-21045][PYTHON] Allow non-ascii string as an exception message from python execution in Python 2 URL: https://github.com/apache/spark/pull/25847#discussion_r326426609 ## File path: python/pyspark/tests/test_worker.py

[GitHub] [spark] viirya commented on a change in pull request #25847: [SPARK-21045][PYTHON] Allow non-ascii string as an exception message from python execution in Python 2

2019-09-19 Thread GitBox
viirya commented on a change in pull request #25847: [SPARK-21045][PYTHON] Allow non-ascii string as an exception message from python execution in Python 2 URL: https://github.com/apache/spark/pull/25847#discussion_r326425526 ## File path: python/pyspark/tests/test_worker.py

[GitHub] [spark] advancedxy commented on a change in pull request #25847: [SPARK-21045][PYTHON] Allow non-ascii string as an exception message from python execution in Python 2

2019-09-19 Thread GitBox
advancedxy commented on a change in pull request #25847: [SPARK-21045][PYTHON] Allow non-ascii string as an exception message from python execution in Python 2 URL: https://github.com/apache/spark/pull/25847#discussion_r326425005 ## File path: python/pyspark/tests/test_worker.py

[GitHub] [spark] AmplabJenkins removed a comment on issue #25767: [SPARK-29062][SQL] Add V1_BATCH_WRITE to the TableCapabilityChecks

2019-09-19 Thread GitBox
AmplabJenkins removed a comment on issue #25767: [SPARK-29062][SQL] Add V1_BATCH_WRITE to the TableCapabilityChecks URL: https://github.com/apache/spark/pull/25767#issuecomment-59208 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on issue #25767: [SPARK-29062][SQL] Add V1_BATCH_WRITE to the TableCapabilityChecks

2019-09-19 Thread GitBox
SparkQA removed a comment on issue #25767: [SPARK-29062][SQL] Add V1_BATCH_WRITE to the TableCapabilityChecks URL: https://github.com/apache/spark/pull/25767#issuecomment-533310389 **[Test build #111024 has

[GitHub] [spark] AmplabJenkins commented on issue #25767: [SPARK-29062][SQL] Add V1_BATCH_WRITE to the TableCapabilityChecks

2019-09-19 Thread GitBox
AmplabJenkins commented on issue #25767: [SPARK-29062][SQL] Add V1_BATCH_WRITE to the TableCapabilityChecks URL: https://github.com/apache/spark/pull/25767#issuecomment-59204 Merged build finished. Test FAILed. This is

[GitHub] [spark] AmplabJenkins commented on issue #25767: [SPARK-29062][SQL] Add V1_BATCH_WRITE to the TableCapabilityChecks

2019-09-19 Thread GitBox
AmplabJenkins commented on issue #25767: [SPARK-29062][SQL] Add V1_BATCH_WRITE to the TableCapabilityChecks URL: https://github.com/apache/spark/pull/25767#issuecomment-59208 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #25767: [SPARK-29062][SQL] Add V1_BATCH_WRITE to the TableCapabilityChecks

2019-09-19 Thread GitBox
AmplabJenkins removed a comment on issue #25767: [SPARK-29062][SQL] Add V1_BATCH_WRITE to the TableCapabilityChecks URL: https://github.com/apache/spark/pull/25767#issuecomment-59204 Merged build finished. Test FAILed.

[GitHub] [spark] SparkQA commented on issue #25767: [SPARK-29062][SQL] Add V1_BATCH_WRITE to the TableCapabilityChecks

2019-09-19 Thread GitBox
SparkQA commented on issue #25767: [SPARK-29062][SQL] Add V1_BATCH_WRITE to the TableCapabilityChecks URL: https://github.com/apache/spark/pull/25767#issuecomment-59061 **[Test build #111024 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #25514: [SPARK-28784][SS] Use CheckpointFileManager in StreamExecution/StreamingQueryManager for checkpoint dirs

2019-09-19 Thread GitBox
AmplabJenkins removed a comment on issue #25514: [SPARK-28784][SS] Use CheckpointFileManager in StreamExecution/StreamingQueryManager for checkpoint dirs URL: https://github.com/apache/spark/pull/25514#issuecomment-58313 Test PASSed. Refer to this link for build results (access

[GitHub] [spark] AmplabJenkins removed a comment on issue #25514: [SPARK-28784][SS] Use CheckpointFileManager in StreamExecution/StreamingQueryManager for checkpoint dirs

2019-09-19 Thread GitBox
AmplabJenkins removed a comment on issue #25514: [SPARK-28784][SS] Use CheckpointFileManager in StreamExecution/StreamingQueryManager for checkpoint dirs URL: https://github.com/apache/spark/pull/25514#issuecomment-58311 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #25514: [SPARK-28784][SS] Use CheckpointFileManager in StreamExecution/StreamingQueryManager for checkpoint dirs

2019-09-19 Thread GitBox
AmplabJenkins commented on issue #25514: [SPARK-28784][SS] Use CheckpointFileManager in StreamExecution/StreamingQueryManager for checkpoint dirs URL: https://github.com/apache/spark/pull/25514#issuecomment-58311 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #25514: [SPARK-28784][SS] Use CheckpointFileManager in StreamExecution/StreamingQueryManager for checkpoint dirs

2019-09-19 Thread GitBox
AmplabJenkins commented on issue #25514: [SPARK-28784][SS] Use CheckpointFileManager in StreamExecution/StreamingQueryManager for checkpoint dirs URL: https://github.com/apache/spark/pull/25514#issuecomment-58313 Test PASSed. Refer to this link for build results (access rights to

[GitHub] [spark] SparkQA removed a comment on issue #25514: [SPARK-28784][SS] Use CheckpointFileManager in StreamExecution/StreamingQueryManager for checkpoint dirs

2019-09-19 Thread GitBox
SparkQA removed a comment on issue #25514: [SPARK-28784][SS] Use CheckpointFileManager in StreamExecution/StreamingQueryManager for checkpoint dirs URL: https://github.com/apache/spark/pull/25514#issuecomment-533258497 **[Test build #111021 has

[GitHub] [spark] SparkQA commented on issue #25514: [SPARK-28784][SS] Use CheckpointFileManager in StreamExecution/StreamingQueryManager for checkpoint dirs

2019-09-19 Thread GitBox
SparkQA commented on issue #25514: [SPARK-28784][SS] Use CheckpointFileManager in StreamExecution/StreamingQueryManager for checkpoint dirs URL: https://github.com/apache/spark/pull/25514#issuecomment-57775 **[Test build #111021 has

[GitHub] [spark] dongjoon-hyun closed pull request #25842: [SPARK-28208][SQL][FOLLOWUP] Use `tryWithResource` pattern

2019-09-19 Thread GitBox
dongjoon-hyun closed pull request #25842: [SPARK-28208][SQL][FOLLOWUP] Use `tryWithResource` pattern URL: https://github.com/apache/spark/pull/25842 This is an automated message from the Apache Git Service. To respond to

[GitHub] [spark] dongjoon-hyun commented on issue #25842: [SPARK-28208][SQL][FOLLOWUP] Use `tryWithResource` pattern

2019-09-19 Thread GitBox
dongjoon-hyun commented on issue #25842: [SPARK-28208][SQL][FOLLOWUP] Use `tryWithResource` pattern URL: https://github.com/apache/spark/pull/25842#issuecomment-52655 Thank you, @HyukjinKwon , @srowen , @HeartSaVioR . Merged to master.

[GitHub] [spark] AmplabJenkins removed a comment on issue #25859: [SPARK-29142][PYTHON][ML] Pyspark clustering models support column setters/getters/predict

2019-09-19 Thread GitBox
AmplabJenkins removed a comment on issue #25859: [SPARK-29142][PYTHON][ML] Pyspark clustering models support column setters/getters/predict URL: https://github.com/apache/spark/pull/25859#issuecomment-51432 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #25859: [SPARK-29142][PYTHON][ML] Pyspark clustering models support column setters/getters/predict

2019-09-19 Thread GitBox
AmplabJenkins removed a comment on issue #25859: [SPARK-29142][PYTHON][ML] Pyspark clustering models support column setters/getters/predict URL: https://github.com/apache/spark/pull/25859#issuecomment-51435 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] AmplabJenkins commented on issue #25859: [SPARK-29142][PYTHON][ML] Pyspark clustering models support column setters/getters/predict

2019-09-19 Thread GitBox
AmplabJenkins commented on issue #25859: [SPARK-29142][PYTHON][ML] Pyspark clustering models support column setters/getters/predict URL: https://github.com/apache/spark/pull/25859#issuecomment-51432 Merged build finished. Test PASSed.

[GitHub] [spark] dongjoon-hyun closed pull request #25843: [SPARK-29101][SQL][2.4] Fix count API for csv file when DROPMALFORMED mode is selected

2019-09-19 Thread GitBox
dongjoon-hyun closed pull request #25843: [SPARK-29101][SQL][2.4] Fix count API for csv file when DROPMALFORMED mode is selected URL: https://github.com/apache/spark/pull/25843 This is an automated message from the Apache

[GitHub] [spark] AmplabJenkins commented on issue #25859: [SPARK-29142][PYTHON][ML] Pyspark clustering models support column setters/getters/predict

2019-09-19 Thread GitBox
AmplabJenkins commented on issue #25859: [SPARK-29142][PYTHON][ML] Pyspark clustering models support column setters/getters/predict URL: https://github.com/apache/spark/pull/25859#issuecomment-51435 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] SparkQA commented on issue #25859: [SPARK-29142][PYTHON][ML] Pyspark clustering models support column setters/getters/predict

2019-09-19 Thread GitBox
SparkQA commented on issue #25859: [SPARK-29142][PYTHON][ML] Pyspark clustering models support column setters/getters/predict URL: https://github.com/apache/spark/pull/25859#issuecomment-51259 **[Test build #111028 has

[GitHub] [spark] SparkQA removed a comment on issue #25859: [SPARK-29142][PYTHON][ML] Pyspark clustering models support column setters/getters/predict

2019-09-19 Thread GitBox
SparkQA removed a comment on issue #25859: [SPARK-29142][PYTHON][ML] Pyspark clustering models support column setters/getters/predict URL: https://github.com/apache/spark/pull/25859#issuecomment-533325275 **[Test build #111028 has

[GitHub] [spark] viirya commented on issue #25858: [SPARK-19926][PYSPARK][Followup] Add unicode for flake8 check

2019-09-19 Thread GitBox
viirya commented on issue #25858: [SPARK-19926][PYSPARK][Followup] Add unicode for flake8 check URL: https://github.com/apache/spark/pull/25858#issuecomment-533329901 @dongjoon-hyun @srowen Can you check if this looks good for you. thanks.

[GitHub] [spark] AmplabJenkins removed a comment on issue #25858: [SPARK-19926][PYSPARK][Followup] Add unicode for flake8 check

2019-09-19 Thread GitBox
AmplabJenkins removed a comment on issue #25858: [SPARK-19926][PYSPARK][Followup] Add unicode for flake8 check URL: https://github.com/apache/spark/pull/25858#issuecomment-533329302 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #25858: [SPARK-19926][PYSPARK][Followup] Add unicode for flake8 check

2019-09-19 Thread GitBox
AmplabJenkins removed a comment on issue #25858: [SPARK-19926][PYSPARK][Followup] Add unicode for flake8 check URL: https://github.com/apache/spark/pull/25858#issuecomment-533329296 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins commented on issue #25858: [SPARK-19926][PYSPARK][Followup] Add unicode for flake8 check

2019-09-19 Thread GitBox
AmplabJenkins commented on issue #25858: [SPARK-19926][PYSPARK][Followup] Add unicode for flake8 check URL: https://github.com/apache/spark/pull/25858#issuecomment-533329302 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25858: [SPARK-19926][PYSPARK][Followup] Add unicode for flake8 check

2019-09-19 Thread GitBox
AmplabJenkins commented on issue #25858: [SPARK-19926][PYSPARK][Followup] Add unicode for flake8 check URL: https://github.com/apache/spark/pull/25858#issuecomment-533329296 Merged build finished. Test PASSed. This is an

[GitHub] [spark] SparkQA removed a comment on issue #25858: [SPARK-19926][PYSPARK][Followup] Add unicode for flake8 check

2019-09-19 Thread GitBox
SparkQA removed a comment on issue #25858: [SPARK-19926][PYSPARK][Followup] Add unicode for flake8 check URL: https://github.com/apache/spark/pull/25858#issuecomment-533321134 **[Test build #111026 has

[GitHub] [spark] SparkQA commented on issue #25858: [SPARK-19926][PYSPARK][Followup] Add unicode for flake8 check

2019-09-19 Thread GitBox
SparkQA commented on issue #25858: [SPARK-19926][PYSPARK][Followup] Add unicode for flake8 check URL: https://github.com/apache/spark/pull/25858#issuecomment-533329006 **[Test build #111026 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #25860: [SPARK-26003] [Backport-2.4] Improve SQLAppStatusListener.aggregateMetrics performance

2019-09-19 Thread GitBox
AmplabJenkins removed a comment on issue #25860: [SPARK-26003] [Backport-2.4] Improve SQLAppStatusListener.aggregateMetrics performance URL: https://github.com/apache/spark/pull/25860#issuecomment-533325612 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins removed a comment on issue #25860: [SPARK-26003] [Backport-2.4] Improve SQLAppStatusListener.aggregateMetrics performance

2019-09-19 Thread GitBox
AmplabJenkins removed a comment on issue #25860: [SPARK-26003] [Backport-2.4] Improve SQLAppStatusListener.aggregateMetrics performance URL: https://github.com/apache/spark/pull/25860#issuecomment-533325604 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #25860: [SPARK-26003] [Backport-2.4] Improve SQLAppStatusListener.aggregateMetrics performance

2019-09-19 Thread GitBox
AmplabJenkins commented on issue #25860: [SPARK-26003] [Backport-2.4] Improve SQLAppStatusListener.aggregateMetrics performance URL: https://github.com/apache/spark/pull/25860#issuecomment-533325612 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] zero323 edited a comment on issue #25776: [SPARK-28985][PYTHON][ML] Add common classes (JavaPredictor/JavaClassificationModel/JavaProbabilisticClassifier) in PYTHON

2019-09-19 Thread GitBox
zero323 edited a comment on issue #25776: [SPARK-28985][PYTHON][ML] Add common classes (JavaPredictor/JavaClassificationModel/JavaProbabilisticClassifier) in PYTHON URL: https://github.com/apache/spark/pull/25776#issuecomment-533319112 @huaxingao @srowen @zhengruifeng What about

[GitHub] [spark] AmplabJenkins commented on issue #25860: [SPARK-26003] [Backport-2.4] Improve SQLAppStatusListener.aggregateMetrics performance

2019-09-19 Thread GitBox
AmplabJenkins commented on issue #25860: [SPARK-26003] [Backport-2.4] Improve SQLAppStatusListener.aggregateMetrics performance URL: https://github.com/apache/spark/pull/25860#issuecomment-533325604 Merged build finished. Test PASSed.

<    1   2   3   4   5   6   7   8   9   10   >