[GitHub] [spark] AmplabJenkins commented on issue #25648: [SPARK-28947][K8S] Status logging not happens at an interval for liveness

AmplabJenkins commented on issue #25648: [SPARK-28947][K8S] Status logging not happens at an interval for liveness URL: https://github.com/apache/spark/pull/25648#issuecomment-535921723 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA commented on issue #25648: [SPARK-28947][K8S] Status logging not happens at an interval for liveness

SparkQA commented on issue #25648: [SPARK-28947][K8S] Status logging not happens at an interval for liveness URL: https://github.com/apache/spark/pull/25648#issuecomment-535921703 Kubernetes integration test status success URL:

[GitHub] [spark] AmplabJenkins removed a comment on issue #25648: [SPARK-28947][K8S] Status logging not happens at an interval for liveness

AmplabJenkins removed a comment on issue #25648: [SPARK-28947][K8S] Status logging not happens at an interval for liveness URL: https://github.com/apache/spark/pull/25648#issuecomment-535921728 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25648: [SPARK-28947][K8S] Status logging not happens at an interval for liveness

AmplabJenkins commented on issue #25648: [SPARK-28947][K8S] Status logging not happens at an interval for liveness URL: https://github.com/apache/spark/pull/25648#issuecomment-535921728 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] MaxGekk opened a new pull request #25948: [SPARK-29275][SQL][DOC] Describe special date/timestamp values in the SQL migration guide

MaxGekk opened a new pull request #25948: [SPARK-29275][SQL][DOC] Describe special date/timestamp values in the SQL migration guide URL: https://github.com/apache/spark/pull/25948 ### What changes were proposed in this pull request? Updated the SQL migration guide regarding to

[GitHub] [spark] gaborgsomogyi commented on issue #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming

gaborgsomogyi commented on issue #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming URL: https://github.com/apache/spark/pull/22282#issuecomment-535920337 Just gone through, good job @dongjinleekr

[GitHub] [spark] HyukjinKwon commented on issue #25942: [SPARK-21914][SQL][TESTS] Check results of expression examples

HyukjinKwon commented on issue #25942: [SPARK-21914][SQL][TESTS] Check results of expression examples URL: https://github.com/apache/spark/pull/25942#issuecomment-535918738 Merged to master. This is an automated message from

[GitHub] [spark] HyukjinKwon closed pull request #25942: [SPARK-21914][SQL][TESTS] Check results of expression examples

HyukjinKwon closed pull request #25942: [SPARK-21914][SQL][TESTS] Check results of expression examples URL: https://github.com/apache/spark/pull/25942 This is an automated message from the Apache Git Service. To respond to

[GitHub] [spark] HyukjinKwon commented on a change in pull request #25942: [SPARK-21914][SQL][TESTS] Check results of expression examples

HyukjinKwon commented on a change in pull request #25942: [SPARK-21914][SQL][TESTS] Check results of expression examples URL: https://github.com/apache/spark/pull/25942#discussion_r329047682 ## File path: sql/core/src/test/scala/org/apache/spark/sql/SQLQuerySuite.scala ##

[GitHub] [spark] SparkQA commented on issue #25648: [SPARK-28947][K8S] Status logging not happens at an interval for liveness

SparkQA commented on issue #25648: [SPARK-28947][K8S] Status logging not happens at an interval for liveness URL: https://github.com/apache/spark/pull/25648#issuecomment-535916299 Kubernetes integration test starting URL:

[GitHub] [spark] ConstantinRuhdorfer commented on issue #24869: [SPARK-28045][ML][PYTHON] add missing RankingEvaluator

ConstantinRuhdorfer commented on issue #24869: [SPARK-28045][ML][PYTHON] add missing RankingEvaluator URL: https://github.com/apache/spark/pull/24869#issuecomment-535916067 This looks great! Sorry, maybe I am overlooking something but is this supposed to be used with the .transform() or

[GitHub] [spark] AmplabJenkins removed a comment on issue #25848: [SPARK-29172][SQL] Fix some exception issue of explain commands

AmplabJenkins removed a comment on issue #25848: [SPARK-29172][SQL] Fix some exception issue of explain commands URL: https://github.com/apache/spark/pull/25848#issuecomment-533018559 Can one of the admins verify this patch?

[GitHub] [spark] SparkQA commented on issue #25848: [SPARK-29172][SQL] Fix some exception issue of explain commands

SparkQA commented on issue #25848: [SPARK-29172][SQL] Fix some exception issue of explain commands URL: https://github.com/apache/spark/pull/25848#issuecomment-535912418 **[Test build #4885 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #25648: [SPARK-28947][K8S] Status logging not happens at an interval for liveness

AmplabJenkins removed a comment on issue #25648: [SPARK-28947][K8S] Status logging not happens at an interval for liveness URL: https://github.com/apache/spark/pull/25648#issuecomment-535907169 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #25648: [SPARK-28947][K8S] Status logging not happens at an interval for liveness

AmplabJenkins removed a comment on issue #25648: [SPARK-28947][K8S] Status logging not happens at an interval for liveness URL: https://github.com/apache/spark/pull/25648#issuecomment-535907165 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA removed a comment on issue #25648: [SPARK-28947][K8S] Status logging not happens at an interval for liveness

SparkQA removed a comment on issue #25648: [SPARK-28947][K8S] Status logging not happens at an interval for liveness URL: https://github.com/apache/spark/pull/25648#issuecomment-535903968 **[Test build #111480 has

[GitHub] [spark] SparkQA commented on issue #25648: [SPARK-28947][K8S] Status logging not happens at an interval for liveness

SparkQA commented on issue #25648: [SPARK-28947][K8S] Status logging not happens at an interval for liveness URL: https://github.com/apache/spark/pull/25648#issuecomment-535907063 **[Test build #111480 has

[GitHub] [spark] AmplabJenkins commented on issue #25648: [SPARK-28947][K8S] Status logging not happens at an interval for liveness

AmplabJenkins commented on issue #25648: [SPARK-28947][K8S] Status logging not happens at an interval for liveness URL: https://github.com/apache/spark/pull/25648#issuecomment-535907169 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25648: [SPARK-28947][K8S] Status logging not happens at an interval for liveness

AmplabJenkins commented on issue #25648: [SPARK-28947][K8S] Status logging not happens at an interval for liveness URL: https://github.com/apache/spark/pull/25648#issuecomment-535907165 Merged build finished. Test PASSed.

[GitHub] [spark] HyukjinKwon commented on issue #25942: [SPARK-29242][SQL][TEST] Check results of expression examples

HyukjinKwon commented on issue #25942: [SPARK-29242][SQL][TEST] Check results of expression examples URL: https://github.com/apache/spark/pull/25942#issuecomment-535904027 This is actually a duplicate JIRA of [SPARK-21914](https://issues.apache.org/jira/browse/SPARK-21914) I guess.

[GitHub] [spark] steveloughran commented on issue #25899: [SPARK-29089][SQL] Parallelize blocking FileSystem calls in DataSource#checkAndGlobPathIfNecessary

steveloughran commented on issue #25899: [SPARK-29089][SQL] Parallelize blocking FileSystem calls in DataSource#checkAndGlobPathIfNecessary URL: https://github.com/apache/spark/pull/25899#issuecomment-535903963 > it seems like the sweet spot is somewhere between 20-30 threads (for my

[GitHub] [spark] SparkQA commented on issue #25648: [SPARK-28947][K8S] Status logging not happens at an interval for liveness

SparkQA commented on issue #25648: [SPARK-28947][K8S] Status logging not happens at an interval for liveness URL: https://github.com/apache/spark/pull/25648#issuecomment-535903968 **[Test build #111480 has

[GitHub] [spark] gaborgsomogyi commented on a change in pull request #25760: [SPARK-29054][SS] Invalidate Kafka consumer when new delegation token available

gaborgsomogyi commented on a change in pull request #25760: [SPARK-29054][SS] Invalidate Kafka consumer when new delegation token available URL: https://github.com/apache/spark/pull/25760#discussion_r329029986 ## File path:

[GitHub] [spark] HyukjinKwon commented on issue #25934: [SPARK-29253][SQL] Add agg(String, String*) to Dataset

HyukjinKwon commented on issue #25934: [SPARK-29253][SQL] Add agg(String, String*) to Dataset URL: https://github.com/apache/spark/pull/25934#issuecomment-535902864 Closing this. This is an automated message from the Apache

[GitHub] [spark] HyukjinKwon closed pull request #25934: [SPARK-29253][SQL] Add agg(String, String*) to Dataset

HyukjinKwon closed pull request #25934: [SPARK-29253][SQL] Add agg(String, String*) to Dataset URL: https://github.com/apache/spark/pull/25934 This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] SparkQA commented on issue #25760: [SPARK-29054][SS] Invalidate Kafka consumer when new delegation token available

SparkQA commented on issue #25760: [SPARK-29054][SS] Invalidate Kafka consumer when new delegation token available URL: https://github.com/apache/spark/pull/25760#issuecomment-535899983 **[Test build #111479 has

[GitHub] [spark] AmplabJenkins commented on issue #24890: [SPARK-28074][SS] Log warn message on possible correctness issue for multiple stateful operations in single query

AmplabJenkins commented on issue #24890: [SPARK-28074][SS] Log warn message on possible correctness issue for multiple stateful operations in single query URL: https://github.com/apache/spark/pull/24890#issuecomment-535895244 Test PASSed. Refer to this link for build results (access

[GitHub] [spark] AmplabJenkins removed a comment on issue #24890: [SPARK-28074][SS] Log warn message on possible correctness issue for multiple stateful operations in single query

AmplabJenkins removed a comment on issue #24890: [SPARK-28074][SS] Log warn message on possible correctness issue for multiple stateful operations in single query URL: https://github.com/apache/spark/pull/24890#issuecomment-535895236 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #24890: [SPARK-28074][SS] Log warn message on possible correctness issue for multiple stateful operations in single query

AmplabJenkins removed a comment on issue #24890: [SPARK-28074][SS] Log warn message on possible correctness issue for multiple stateful operations in single query URL: https://github.com/apache/spark/pull/24890#issuecomment-535895244 Test PASSed. Refer to this link for build results

[GitHub] [spark] AmplabJenkins commented on issue #24890: [SPARK-28074][SS] Log warn message on possible correctness issue for multiple stateful operations in single query

AmplabJenkins commented on issue #24890: [SPARK-28074][SS] Log warn message on possible correctness issue for multiple stateful operations in single query URL: https://github.com/apache/spark/pull/24890#issuecomment-535895236 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA removed a comment on issue #24890: [SPARK-28074][SS] Log warn message on possible correctness issue for multiple stateful operations in single query

SparkQA removed a comment on issue #24890: [SPARK-28074][SS] Log warn message on possible correctness issue for multiple stateful operations in single query URL: https://github.com/apache/spark/pull/24890#issuecomment-535821973 **[Test build #111475 has

[GitHub] [spark] SparkQA commented on issue #24890: [SPARK-28074][SS] Log warn message on possible correctness issue for multiple stateful operations in single query

SparkQA commented on issue #24890: [SPARK-28074][SS] Log warn message on possible correctness issue for multiple stateful operations in single query URL: https://github.com/apache/spark/pull/24890#issuecomment-535894766 **[Test build #111475 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #25942: [SPARK-29242][SQL][TEST] Check results of expression examples

AmplabJenkins removed a comment on issue #25942: [SPARK-29242][SQL][TEST] Check results of expression examples URL: https://github.com/apache/spark/pull/25942#issuecomment-535893167 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #25942: [SPARK-29242][SQL][TEST] Check results of expression examples

AmplabJenkins removed a comment on issue #25942: [SPARK-29242][SQL][TEST] Check results of expression examples URL: https://github.com/apache/spark/pull/25942#issuecomment-535893162 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins commented on issue #25942: [SPARK-29242][SQL][TEST] Check results of expression examples

AmplabJenkins commented on issue #25942: [SPARK-29242][SQL][TEST] Check results of expression examples URL: https://github.com/apache/spark/pull/25942#issuecomment-535893167 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25942: [SPARK-29242][SQL][TEST] Check results of expression examples

AmplabJenkins commented on issue #25942: [SPARK-29242][SQL][TEST] Check results of expression examples URL: https://github.com/apache/spark/pull/25942#issuecomment-535893162 Merged build finished. Test PASSed. This is an

[GitHub] [spark] SparkQA removed a comment on issue #25942: [SPARK-29242][SQL][TEST] Check results of expression examples

SparkQA removed a comment on issue #25942: [SPARK-29242][SQL][TEST] Check results of expression examples URL: https://github.com/apache/spark/pull/25942#issuecomment-535819621 **[Test build #111473 has

[GitHub] [spark] SparkQA commented on issue #25942: [SPARK-29242][SQL][TEST] Check results of expression examples

SparkQA commented on issue #25942: [SPARK-29242][SQL][TEST] Check results of expression examples URL: https://github.com/apache/spark/pull/25942#issuecomment-535892614 **[Test build #111473 has

[GitHub] [spark] hehuiyuan commented on issue #24839: [SPARK-27258][K8S]Deal with the k8s resource names that don't match their own regular expression

hehuiyuan commented on issue #24839: [SPARK-27258][K8S]Deal with the k8s resource names that don't match their own regular expression URL: https://github.com/apache/spark/pull/24839#issuecomment-535890055 > Hi @hehuiyuan I don't completely understand your response. Let me write my

[GitHub] [spark] rahij commented on issue #25928: [SPARK-29259][SQL] call fs.exists only when necessary

rahij commented on issue #25928: [SPARK-29259][SQL] call fs.exists only when necessary URL: https://github.com/apache/spark/pull/25928#issuecomment-535889796 Thanks @dongjoon-hyun, will do! This is an automated message from

[GitHub] [spark] AmplabJenkins removed a comment on issue #25946: [SPARK-29263][SCHEDULER] Update `availableSlots` in `resourceOffers()` before checking available slots for barrier taskSet

AmplabJenkins removed a comment on issue #25946: [SPARK-29263][SCHEDULER] Update `availableSlots` in `resourceOffers()` before checking available slots for barrier taskSet URL: https://github.com/apache/spark/pull/25946#issuecomment-535888123 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #25946: [SPARK-29263][SCHEDULER] Update `availableSlots` in `resourceOffers()` before checking available slots for barrier taskSet

AmplabJenkins removed a comment on issue #25946: [SPARK-29263][SCHEDULER] Update `availableSlots` in `resourceOffers()` before checking available slots for barrier taskSet URL: https://github.com/apache/spark/pull/25946#issuecomment-535888132 Test PASSed. Refer to this link for build

[GitHub] [spark] AmplabJenkins commented on issue #25946: [SPARK-29263][SCHEDULER] Update `availableSlots` in `resourceOffers()` before checking available slots for barrier taskSet

AmplabJenkins commented on issue #25946: [SPARK-29263][SCHEDULER] Update `availableSlots` in `resourceOffers()` before checking available slots for barrier taskSet URL: https://github.com/apache/spark/pull/25946#issuecomment-535888132 Test PASSed. Refer to this link for build results

[GitHub] [spark] AmplabJenkins commented on issue #25946: [SPARK-29263][SCHEDULER] Update `availableSlots` in `resourceOffers()` before checking available slots for barrier taskSet

AmplabJenkins commented on issue #25946: [SPARK-29263][SCHEDULER] Update `availableSlots` in `resourceOffers()` before checking available slots for barrier taskSet URL: https://github.com/apache/spark/pull/25946#issuecomment-535888123 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA commented on issue #25946: [SPARK-29263][SCHEDULER] Update `availableSlots` in `resourceOffers()` before checking available slots for barrier taskSet

SparkQA commented on issue #25946: [SPARK-29263][SCHEDULER] Update `availableSlots` in `resourceOffers()` before checking available slots for barrier taskSet URL: https://github.com/apache/spark/pull/25946#issuecomment-535887791 **[Test build #111478 has

[GitHub] [spark] juliuszsompolski commented on issue #25946: [SPARK-29263][SCHEDULER] Update `availableSlots` in `resourceOffers()` before checking available slots for barrier taskSet

juliuszsompolski commented on issue #25946: [SPARK-29263][SCHEDULER] Update `availableSlots` in `resourceOffers()` before checking available slots for barrier taskSet URL: https://github.com/apache/spark/pull/25946#issuecomment-535887125 @dongjoon-hyun I added UT now. The fix in this

[GitHub] [spark] AmplabJenkins removed a comment on issue #25863: [SPARK-28945][SPARK-29037][CORE][SQL] Fix the issue that spark gives duplicate result and support concurrent file source write operati

AmplabJenkins removed a comment on issue #25863: [SPARK-28945][SPARK-29037][CORE][SQL] Fix the issue that spark gives duplicate result and support concurrent file source write operations write to different partitions in the same table. URL:

[GitHub] [spark] AmplabJenkins removed a comment on issue #25863: [SPARK-28945][SPARK-29037][CORE][SQL] Fix the issue that spark gives duplicate result and support concurrent file source write operati

AmplabJenkins removed a comment on issue #25863: [SPARK-28945][SPARK-29037][CORE][SQL] Fix the issue that spark gives duplicate result and support concurrent file source write operations write to different partitions in the same table. URL:

[GitHub] [spark] AmplabJenkins commented on issue #25863: [SPARK-28945][SPARK-29037][CORE][SQL] Fix the issue that spark gives duplicate result and support concurrent file source write operations writ

AmplabJenkins commented on issue #25863: [SPARK-28945][SPARK-29037][CORE][SQL] Fix the issue that spark gives duplicate result and support concurrent file source write operations write to different partitions in the same table. URL:

[GitHub] [spark] AmplabJenkins commented on issue #25863: [SPARK-28945][SPARK-29037][CORE][SQL] Fix the issue that spark gives duplicate result and support concurrent file source write operations writ

AmplabJenkins commented on issue #25863: [SPARK-28945][SPARK-29037][CORE][SQL] Fix the issue that spark gives duplicate result and support concurrent file source write operations write to different partitions in the same table. URL:

[GitHub] [spark] SparkQA removed a comment on issue #25863: [SPARK-28945][SPARK-29037][CORE][SQL] Fix the issue that spark gives duplicate result and support concurrent file source write operations wr

SparkQA removed a comment on issue #25863: [SPARK-28945][SPARK-29037][CORE][SQL] Fix the issue that spark gives duplicate result and support concurrent file source write operations write to different partitions in the same table. URL:

[GitHub] [spark] SparkQA commented on issue #25863: [SPARK-28945][SPARK-29037][CORE][SQL] Fix the issue that spark gives duplicate result and support concurrent file source write operations write to d

SparkQA commented on issue #25863: [SPARK-28945][SPARK-29037][CORE][SQL] Fix the issue that spark gives duplicate result and support concurrent file source write operations write to different partitions in the same table. URL: https://github.com/apache/spark/pull/25863#issuecomment-535886377

[GitHub] [spark] AmplabJenkins removed a comment on issue #25771: [SPARK-28970][SQL] Implement USE CATALOG/NAMESPACE for Data Source V2

AmplabJenkins removed a comment on issue #25771: [SPARK-28970][SQL] Implement USE CATALOG/NAMESPACE for Data Source V2 URL: https://github.com/apache/spark/pull/25771#issuecomment-535877034 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #25771: [SPARK-28970][SQL] Implement USE CATALOG/NAMESPACE for Data Source V2

AmplabJenkins removed a comment on issue #25771: [SPARK-28970][SQL] Implement USE CATALOG/NAMESPACE for Data Source V2 URL: https://github.com/apache/spark/pull/25771#issuecomment-535877030 Merged build finished. Test FAILed.

[GitHub] [spark] SparkQA removed a comment on issue #25771: [SPARK-28970][SQL] Implement USE CATALOG/NAMESPACE for Data Source V2

SparkQA removed a comment on issue #25771: [SPARK-28970][SQL] Implement USE CATALOG/NAMESPACE for Data Source V2 URL: https://github.com/apache/spark/pull/25771#issuecomment-535819661 **[Test build #111474 has

[GitHub] [spark] AmplabJenkins commented on issue #25771: [SPARK-28970][SQL] Implement USE CATALOG/NAMESPACE for Data Source V2

AmplabJenkins commented on issue #25771: [SPARK-28970][SQL] Implement USE CATALOG/NAMESPACE for Data Source V2 URL: https://github.com/apache/spark/pull/25771#issuecomment-535877034 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25771: [SPARK-28970][SQL] Implement USE CATALOG/NAMESPACE for Data Source V2

AmplabJenkins commented on issue #25771: [SPARK-28970][SQL] Implement USE CATALOG/NAMESPACE for Data Source V2 URL: https://github.com/apache/spark/pull/25771#issuecomment-535877030 Merged build finished. Test FAILed. This

[GitHub] [spark] SparkQA commented on issue #25771: [SPARK-28970][SQL] Implement USE CATALOG/NAMESPACE for Data Source V2

SparkQA commented on issue #25771: [SPARK-28970][SQL] Implement USE CATALOG/NAMESPACE for Data Source V2 URL: https://github.com/apache/spark/pull/25771#issuecomment-535876764 **[Test build #111474 has

[GitHub] [spark] edrevo commented on issue #25945: [SPARK-29248][SQL] Pass in number of partitions to WriteBuilder

edrevo commented on issue #25945: [SPARK-29248][SQL] Pass in number of partitions to WriteBuilder URL: https://github.com/apache/spark/pull/25945#issuecomment-535869821 @rdblue, I have modified the tests This is an automated

[GitHub] [spark] SparkQA commented on issue #24890: [SPARK-28074][SS] Log warn message on possible correctness issue for multiple stateful operations in single query

SparkQA commented on issue #24890: [SPARK-28074][SS] Log warn message on possible correctness issue for multiple stateful operations in single query URL: https://github.com/apache/spark/pull/24890#issuecomment-535864933 **[Test build #111477 has

[GitHub] [spark] cloud-fan commented on issue #25747: [SPARK-29039][SQL] centralize the catalog and table lookup logic

cloud-fan commented on issue #25747: [SPARK-29039][SQL] centralize the catalog and table lookup logic URL: https://github.com/apache/spark/pull/25747#issuecomment-535862464 After playing with the code a bit more, I think we should write the code in a way that is future-proof. In the

[GitHub] [spark] edrevo commented on a change in pull request #25945: [SPARK-29248][SQL] Pass in number of partitions to WriteBuilder

edrevo commented on a change in pull request #25945: [SPARK-29248][SQL] Pass in number of partitions to WriteBuilder URL: https://github.com/apache/spark/pull/25945#discussion_r328979974 ## File path:

[GitHub] [spark] zhengruifeng commented on a change in pull request #25908: [SPARK-29143][PYTHON][ML] Pyspark feature models support column setters/getters

zhengruifeng commented on a change in pull request #25908: [SPARK-29143][PYTHON][ML] Pyspark feature models support column setters/getters URL: https://github.com/apache/spark/pull/25908#discussion_r328979198 ## File path: python/pyspark/ml/tests/test_param.py ## @@

[GitHub] [spark] zhengruifeng commented on a change in pull request #25908: [SPARK-29143][PYTHON][ML] Pyspark feature models support column setters/getters

zhengruifeng commented on a change in pull request #25908: [SPARK-29143][PYTHON][ML] Pyspark feature models support column setters/getters URL: https://github.com/apache/spark/pull/25908#discussion_r328973948 ## File path: python/pyspark/ml/feature.py ## @@ -1415,7

[GitHub] [spark] kiszk commented on a change in pull request #24851: [SPARK-27303][GRAPH] Add Spark Graph API

kiszk commented on a change in pull request #24851: [SPARK-27303][GRAPH] Add Spark Graph API URL: https://github.com/apache/spark/pull/24851#discussion_r328976678 ## File path: graph/api/src/test/java/org/apache/spark/graph/api/JavaPropertyGraphSuite.java ## @@ -0,0

[GitHub] [spark] cloud-fan commented on a change in pull request #25771: [SPARK-28970][SQL] Implement USE CATALOG/NAMESPACE for Data Source V2

cloud-fan commented on a change in pull request #25771: [SPARK-28970][SQL] Implement USE CATALOG/NAMESPACE for Data Source V2 URL: https://github.com/apache/spark/pull/25771#discussion_r328971225 ## File path:

[GitHub] [spark] AmplabJenkins removed a comment on issue #25863: [SPARK-28945][SPARK-29037][CORE][SQL] Fix the issue that spark gives duplicate result and support concurrent file source write operati

AmplabJenkins removed a comment on issue #25863: [SPARK-28945][SPARK-29037][CORE][SQL] Fix the issue that spark gives duplicate result and support concurrent file source write operations write to different partitions in the same table. URL:

[GitHub] [spark] AmplabJenkins removed a comment on issue #25863: [SPARK-28945][SPARK-29037][CORE][SQL] Fix the issue that spark gives duplicate result and support concurrent file source write operati

AmplabJenkins removed a comment on issue #25863: [SPARK-28945][SPARK-29037][CORE][SQL] Fix the issue that spark gives duplicate result and support concurrent file source write operations write to different partitions in the same table. URL:

[GitHub] [spark] AmplabJenkins commented on issue #25863: [SPARK-28945][SPARK-29037][CORE][SQL] Fix the issue that spark gives duplicate result and support concurrent file source write operations writ

AmplabJenkins commented on issue #25863: [SPARK-28945][SPARK-29037][CORE][SQL] Fix the issue that spark gives duplicate result and support concurrent file source write operations write to different partitions in the same table. URL:

[GitHub] [spark] AmplabJenkins commented on issue #25863: [SPARK-28945][SPARK-29037][CORE][SQL] Fix the issue that spark gives duplicate result and support concurrent file source write operations writ

AmplabJenkins commented on issue #25863: [SPARK-28945][SPARK-29037][CORE][SQL] Fix the issue that spark gives duplicate result and support concurrent file source write operations write to different partitions in the same table. URL:

[GitHub] [spark] SparkQA commented on issue #25863: [SPARK-28945][SPARK-29037][CORE][SQL] Fix the issue that spark gives duplicate result and support concurrent file source write operations write to d

SparkQA commented on issue #25863: [SPARK-28945][SPARK-29037][CORE][SQL] Fix the issue that spark gives duplicate result and support concurrent file source write operations write to different partitions in the same table. URL: https://github.com/apache/spark/pull/25863#issuecomment-535847000

[GitHub] [spark] cloud-fan commented on a change in pull request #25771: [SPARK-28970][SQL] Implement USE CATALOG/NAMESPACE for Data Source V2

cloud-fan commented on a change in pull request #25771: [SPARK-28970][SQL] Implement USE CATALOG/NAMESPACE for Data Source V2 URL: https://github.com/apache/spark/pull/25771#discussion_r328964046 ## File path:

[GitHub] [spark] cloud-fan commented on a change in pull request #25771: [SPARK-28970][SQL] Implement USE CATALOG/NAMESPACE for Data Source V2

cloud-fan commented on a change in pull request #25771: [SPARK-28970][SQL] Implement USE CATALOG/NAMESPACE for Data Source V2 URL: https://github.com/apache/spark/pull/25771#discussion_r328964046 ## File path:

[GitHub] [spark] cloud-fan commented on a change in pull request #25771: [SPARK-28970][SQL] Implement USE CATALOG/NAMESPACE for Data Source V2

cloud-fan commented on a change in pull request #25771: [SPARK-28970][SQL] Implement USE CATALOG/NAMESPACE for Data Source V2 URL: https://github.com/apache/spark/pull/25771#discussion_r328964046 ## File path:

[GitHub] [spark] cloud-fan commented on a change in pull request #25771: [SPARK-28970][SQL] Implement USE CATALOG/NAMESPACE for Data Source V2

cloud-fan commented on a change in pull request #25771: [SPARK-28970][SQL] Implement USE CATALOG/NAMESPACE for Data Source V2 URL: https://github.com/apache/spark/pull/25771#discussion_r328958608 ## File path:

[GitHub] [spark] cloud-fan commented on a change in pull request #25771: [SPARK-28970][SQL] Implement USE CATALOG/NAMESPACE for Data Source V2

cloud-fan commented on a change in pull request #25771: [SPARK-28970][SQL] Implement USE CATALOG/NAMESPACE for Data Source V2 URL: https://github.com/apache/spark/pull/25771#discussion_r328960957 ## File path:

[GitHub] [spark] cloud-fan commented on a change in pull request #25771: [SPARK-28970][SQL] Implement USE CATALOG/NAMESPACE for Data Source V2

cloud-fan commented on a change in pull request #25771: [SPARK-28970][SQL] Implement USE CATALOG/NAMESPACE for Data Source V2 URL: https://github.com/apache/spark/pull/25771#discussion_r328959278 ## File path:

[GitHub] [spark] cloud-fan commented on a change in pull request #25771: [SPARK-28970][SQL] Implement USE CATALOG/NAMESPACE for Data Source V2

cloud-fan commented on a change in pull request #25771: [SPARK-28970][SQL] Implement USE CATALOG/NAMESPACE for Data Source V2 URL: https://github.com/apache/spark/pull/25771#discussion_r328958608 ## File path:

[GitHub] [spark] cloud-fan commented on a change in pull request #25771: [SPARK-28970][SQL] Implement USE CATALOG/NAMESPACE for Data Source V2

cloud-fan commented on a change in pull request #25771: [SPARK-28970][SQL] Implement USE CATALOG/NAMESPACE for Data Source V2 URL: https://github.com/apache/spark/pull/25771#discussion_r328958183 ## File path:

[GitHub] [spark] cloud-fan commented on a change in pull request #25771: [SPARK-28970][SQL] Implement USE CATALOG/NAMESPACE for Data Source V2

cloud-fan commented on a change in pull request #25771: [SPARK-28970][SQL] Implement USE CATALOG/NAMESPACE for Data Source V2 URL: https://github.com/apache/spark/pull/25771#discussion_r328957876 ## File path:

[GitHub] [spark] cloud-fan commented on a change in pull request #25771: [SPARK-28970][SQL] Implement USE CATALOG/NAMESPACE for Data Source V2

cloud-fan commented on a change in pull request #25771: [SPARK-28970][SQL] Implement USE CATALOG/NAMESPACE for Data Source V2 URL: https://github.com/apache/spark/pull/25771#discussion_r328957615 ## File path:

[GitHub] [spark] turboFei commented on issue #25797: [SPARK-29043][Core] Improve the concurrent performance of History Server

turboFei commented on issue #25797: [SPARK-29043][Core] Improve the concurrent performance of History Server URL: https://github.com/apache/spark/pull/25797#issuecomment-535836589 > By unblocking the cleanForLogs call, you also unblock the cleaner task which may run after it. I didn't see

[GitHub] [spark] cloud-fan commented on a change in pull request #25945: [SPARK-29248][SQL] Pass in number of partitions to WriteBuilder

cloud-fan commented on a change in pull request #25945: [SPARK-29248][SQL] Pass in number of partitions to WriteBuilder URL: https://github.com/apache/spark/pull/25945#discussion_r328954607 ## File path:

[GitHub] [spark] Gschiavon commented on issue #25728: [SPARK-29020][WIP][SQL] Improving array_sort behaviour

Gschiavon commented on issue #25728: [SPARK-29020][WIP][SQL] Improving array_sort behaviour URL: https://github.com/apache/spark/pull/25728#issuecomment-535830980 Some of them yes @kiszk , but I was having some troubles with the tests. I'll try to do them soon.

[GitHub] [spark] kiszk commented on issue #25728: [SPARK-29020][WIP][SQL] Improving array_sort behaviour

kiszk commented on issue #25728: [SPARK-29020][WIP][SQL] Improving array_sort behaviour URL: https://github.com/apache/spark/pull/25728#issuecomment-535827304 @Gschiavon Did you address multiple @ueshin 's comments? This is

[GitHub] [spark] wangshuo128 commented on issue #25902: [SPARK-29213][SQL] Generate extra IsNotNull predicate in FilterExec

wangshuo128 commented on issue #25902: [SPARK-29213][SQL] Generate extra IsNotNull predicate in FilterExec URL: https://github.com/apache/spark/pull/25902#issuecomment-535825281 Thanks! This is an automated message from the

[GitHub] [spark] SparkQA commented on issue #24890: [SPARK-28074][SS] Log warn message on possible correctness issue for multiple stateful operations in single query

SparkQA commented on issue #24890: [SPARK-28074][SS] Log warn message on possible correctness issue for multiple stateful operations in single query URL: https://github.com/apache/spark/pull/24890#issuecomment-535821973 **[Test build #111475 has

[GitHub] [spark] cloud-fan commented on issue #25902: [SPARK-29213][SQL] Generate extra IsNotNull predicate in FilterExec

cloud-fan commented on issue #25902: [SPARK-29213][SQL] Generate extra IsNotNull predicate in FilterExec URL: https://github.com/apache/spark/pull/25902#issuecomment-535821216 thanks, merging to master/2.4! This is an

[GitHub] [spark] cloud-fan closed pull request #25902: [SPARK-29213][SQL] Generate extra IsNotNull predicate in FilterExec

cloud-fan closed pull request #25902: [SPARK-29213][SQL] Generate extra IsNotNull predicate in FilterExec URL: https://github.com/apache/spark/pull/25902 This is an automated message from the Apache Git Service. To respond

[GitHub] [spark] turboFei edited a comment on issue #25797: [SPARK-29043][Core] Improve the concurrent performance of History Server

turboFei edited a comment on issue #25797: [SPARK-29043][Core] Improve the concurrent performance of History Server URL: https://github.com/apache/spark/pull/25797#issuecomment-535820833 > By unblocking the `cleanForLogs` call, you also unblock the cleaner task which may run after it. I

[GitHub] [spark] turboFei commented on issue #25797: [SPARK-29043][Core] Improve the concurrent performance of History Server

turboFei commented on issue #25797: [SPARK-29043][Core] Improve the concurrent performance of History Server URL: https://github.com/apache/spark/pull/25797#issuecomment-535820833 > By unblocking the `cleanForLogs` call, you also unblock the cleaner task which may run after it. I didn't

[GitHub] [spark] HeartSaVioR commented on issue #24890: [SPARK-28074][SS] Log warn message on possible correctness issue for multiple stateful operations in single query

HeartSaVioR commented on issue #24890: [SPARK-28074][SS] Log warn message on possible correctness issue for multiple stateful operations in single query URL: https://github.com/apache/spark/pull/24890#issuecomment-535820815 retest this, please

[GitHub] [spark] AmplabJenkins removed a comment on issue #25771: [SPARK-28970][SQL] Implement USE CATALOG/NAMESPACE for Data Source V2

AmplabJenkins removed a comment on issue #25771: [SPARK-28970][SQL] Implement USE CATALOG/NAMESPACE for Data Source V2 URL: https://github.com/apache/spark/pull/25771#issuecomment-535820120 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #25771: [SPARK-28970][SQL] Implement USE CATALOG/NAMESPACE for Data Source V2

AmplabJenkins removed a comment on issue #25771: [SPARK-28970][SQL] Implement USE CATALOG/NAMESPACE for Data Source V2 URL: https://github.com/apache/spark/pull/25771#issuecomment-535820124 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25771: [SPARK-28970][SQL] Implement USE CATALOG/NAMESPACE for Data Source V2

AmplabJenkins commented on issue #25771: [SPARK-28970][SQL] Implement USE CATALOG/NAMESPACE for Data Source V2 URL: https://github.com/apache/spark/pull/25771#issuecomment-535820124 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #25942: [SPARK-29242][SQL][TEST] Check results of expression examples

AmplabJenkins removed a comment on issue #25942: [SPARK-29242][SQL][TEST] Check results of expression examples URL: https://github.com/apache/spark/pull/25942#issuecomment-535820028 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins commented on issue #25771: [SPARK-28970][SQL] Implement USE CATALOG/NAMESPACE for Data Source V2

AmplabJenkins commented on issue #25771: [SPARK-28970][SQL] Implement USE CATALOG/NAMESPACE for Data Source V2 URL: https://github.com/apache/spark/pull/25771#issuecomment-535820120 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins removed a comment on issue #25942: [SPARK-29242][SQL][TEST] Check results of expression examples

AmplabJenkins removed a comment on issue #25942: [SPARK-29242][SQL][TEST] Check results of expression examples URL: https://github.com/apache/spark/pull/25942#issuecomment-535820035 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25942: [SPARK-29242][SQL][TEST] Check results of expression examples

AmplabJenkins commented on issue #25942: [SPARK-29242][SQL][TEST] Check results of expression examples URL: https://github.com/apache/spark/pull/25942#issuecomment-535820035 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25942: [SPARK-29242][SQL][TEST] Check results of expression examples

AmplabJenkins commented on issue #25942: [SPARK-29242][SQL][TEST] Check results of expression examples URL: https://github.com/apache/spark/pull/25942#issuecomment-535820028 Merged build finished. Test PASSed. This is an

<    2   3   4   5   6   7   8   >