[GitHub] [spark] SparkQA commented on issue #25027: [SPARK-26970][DOC][FOLLOWUP] link doc & example of Interaction

SparkQA commented on issue #25027: [SPARK-26970][DOC][FOLLOWUP] link doc & example of Interaction URL: https://github.com/apache/spark/pull/25027#issuecomment-507530828 **[Test build #107099 has

[GitHub] [spark] maropu commented on issue #24960: [SPARK-28156][SQL] Self-join should not miss cached view

maropu commented on issue #24960: [SPARK-28156][SQL] Self-join should not miss cached view URL: https://github.com/apache/spark/pull/24960#issuecomment-507530671 retest this please This is an automated message from the

[GitHub] [spark] AmplabJenkins commented on issue #25027: [SPARK-26970][DOC][FOLLOWUP] link doc & example of Interaction

AmplabJenkins commented on issue #25027: [SPARK-26970][DOC][FOLLOWUP] link doc & example of Interaction URL: https://github.com/apache/spark/pull/25027#issuecomment-507530345 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25027: [SPARK-26970][DOC][FOLLOWUP] link doc & example of Interaction

AmplabJenkins commented on issue #25027: [SPARK-26970][DOC][FOLLOWUP] link doc & example of Interaction URL: https://github.com/apache/spark/pull/25027#issuecomment-507530338 Merged build finished. Test PASSed. This is an

[GitHub] [spark] HyukjinKwon commented on issue #24971: [SPARK-28054][SQL][FOLLOW-UP] Fix error when insert Hive partitioned table dynamically where partition name is upper case

HyukjinKwon commented on issue #24971: [SPARK-28054][SQL][FOLLOW-UP] Fix error when insert Hive partitioned table dynamically where partition name is upper case URL: https://github.com/apache/spark/pull/24971#issuecomment-507530223 Merged to master.

[GitHub] [spark] zhengruifeng opened a new pull request #25027: [SPARK-26970][DOC][FOLLOWUP] link doc & example of Interaction

zhengruifeng opened a new pull request #25027: [SPARK-26970][DOC][FOLLOWUP] link doc & example of Interaction URL: https://github.com/apache/spark/pull/25027 ## What changes were proposed in this pull request? link doc & example of Interaction ## How was this patch tested?

[GitHub] [spark] maropu commented on issue #22347: [SPARK-25353][SQL] executeTake in SparkPlan is modified to avoid unnecessary decoding.

maropu commented on issue #22347: [SPARK-25353][SQL] executeTake in SparkPlan is modified to avoid unnecessary decoding. URL: https://github.com/apache/spark/pull/22347#issuecomment-507528051 is that bad like this? I like the previous version because that was simple: ``` val rowCount

[GitHub] [spark] AmplabJenkins removed a comment on issue #24960: [SPARK-28156][SQL] Self-join should not miss cached view

AmplabJenkins removed a comment on issue #24960: [SPARK-28156][SQL] Self-join should not miss cached view URL: https://github.com/apache/spark/pull/24960#issuecomment-507527494 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #24960: [SPARK-28156][SQL] Self-join should not miss cached view

AmplabJenkins removed a comment on issue #24960: [SPARK-28156][SQL] Self-join should not miss cached view URL: https://github.com/apache/spark/pull/24960#issuecomment-507527485 Merged build finished. Test FAILed. This is an

[GitHub] [spark] SparkQA removed a comment on issue #24960: [SPARK-28156][SQL] Self-join should not miss cached view

SparkQA removed a comment on issue #24960: [SPARK-28156][SQL] Self-join should not miss cached view URL: https://github.com/apache/spark/pull/24960#issuecomment-507512650 **[Test build #107097 has

[GitHub] [spark] SparkQA commented on issue #24960: [SPARK-28156][SQL] Self-join should not miss cached view

SparkQA commented on issue #24960: [SPARK-28156][SQL] Self-join should not miss cached view URL: https://github.com/apache/spark/pull/24960#issuecomment-507527348 **[Test build #107097 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/107097/testReport)**

[GitHub] [spark] AmplabJenkins commented on issue #24960: [SPARK-28156][SQL] Self-join should not miss cached view

AmplabJenkins commented on issue #24960: [SPARK-28156][SQL] Self-join should not miss cached view URL: https://github.com/apache/spark/pull/24960#issuecomment-507527485 Merged build finished. Test FAILed. This is an

[GitHub] [spark] AmplabJenkins commented on issue #24960: [SPARK-28156][SQL] Self-join should not miss cached view

AmplabJenkins commented on issue #24960: [SPARK-28156][SQL] Self-join should not miss cached view URL: https://github.com/apache/spark/pull/24960#issuecomment-507527494 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] HeartSaVioR commented on issue #24996: [SPARK-28199][SS] Remove deprecated ProcessingTime

HeartSaVioR commented on issue #24996: [SPARK-28199][SS] Remove deprecated ProcessingTime URL: https://github.com/apache/spark/pull/24996#issuecomment-507525156 Looks like everything sorted out. Please take a look again. Thanks!

[GitHub] [spark] HeartSaVioR commented on issue #24999: [SPARK-28142][SS][FOLLOWUP] Use CaseInsensitiveStringMap for KafkaContinuousStream

HeartSaVioR commented on issue #24999: [SPARK-28142][SS][FOLLOWUP] Use CaseInsensitiveStringMap for KafkaContinuousStream URL: https://github.com/apache/spark/pull/24999#issuecomment-507524993 Assuming @gaborgsomogyi thinks the recent change is also good as well... @gatorsmile

[GitHub] [spark] cloud-fan commented on issue #22347: [SPARK-25353][SQL] executeTake in SparkPlan is modified to avoid unnecessary decoding.

cloud-fan commented on issue #22347: [SPARK-25353][SQL] executeTake in SparkPlan is modified to avoid unnecessary decoding. URL: https://github.com/apache/spark/pull/22347#issuecomment-507524532 Ah I see the problem, we should not create the result array ahead, as the limit can be large

[GitHub] [spark] maropu commented on issue #25020: [SPARK-28220][SQL]Fix foldable join condition not pushed down when parent filter is wholly pushed down

maropu commented on issue #25020: [SPARK-28220][SQL]Fix foldable join condition not pushed down when parent filter is wholly pushed down URL: https://github.com/apache/spark/pull/25020#issuecomment-507522355 sorry, but I'm not sure about what's the point you suggested in the description.

[GitHub] [spark] SparkQA commented on issue #22347: [SPARK-25353][SQL] executeTake in SparkPlan is modified to avoid unnecessary decoding.

SparkQA commented on issue #22347: [SPARK-25353][SQL] executeTake in SparkPlan is modified to avoid unnecessary decoding. URL: https://github.com/apache/spark/pull/22347#issuecomment-507521990 **[Test build #107098 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #25026: [WIP][SPARK-28227][SQL] Support TRANSFORM with aggregation.

AmplabJenkins removed a comment on issue #25026: [WIP][SPARK-28227][SQL] Support TRANSFORM with aggregation. URL: https://github.com/apache/spark/pull/25026#issuecomment-507520531 Can one of the admins verify this patch?

[GitHub] [spark] AmplabJenkins commented on issue #25026: [WIP][SPARK-28227][SQL] Support TRANSFORM with aggregation.

AmplabJenkins commented on issue #25026: [WIP][SPARK-28227][SQL] Support TRANSFORM with aggregation. URL: https://github.com/apache/spark/pull/25026#issuecomment-507521407 Can one of the admins verify this patch? This is an

[GitHub] [spark] AmplabJenkins removed a comment on issue #25026: [WIP][SPARK-28227][SQL] Support TRANSFORM with aggregation.

AmplabJenkins removed a comment on issue #25026: [WIP][SPARK-28227][SQL] Support TRANSFORM with aggregation. URL: https://github.com/apache/spark/pull/25026#issuecomment-507520135 Can one of the admins verify this patch?

[GitHub] [spark] AmplabJenkins commented on issue #25026: [WIP][SPARK-28227][SQL] Support TRANSFORM with aggregation.

AmplabJenkins commented on issue #25026: [WIP][SPARK-28227][SQL] Support TRANSFORM with aggregation. URL: https://github.com/apache/spark/pull/25026#issuecomment-507520531 Can one of the admins verify this patch? This is an

[GitHub] [spark] AmplabJenkins commented on issue #25026: [WIP][SPARK-28227][SQL] Support TRANSFORM with aggregation.

AmplabJenkins commented on issue #25026: [WIP][SPARK-28227][SQL] Support TRANSFORM with aggregation. URL: https://github.com/apache/spark/pull/25026#issuecomment-507520135 Can one of the admins verify this patch? This is an

[GitHub] [spark] AngersZhuuuu opened a new pull request #25026: [WIP][SPARK-28227][SQL] Support TRANSFORM with aggregation.

AngersZh opened a new pull request #25026: [WIP][SPARK-28227][SQL] Support TRANSFORM with aggregation. URL: https://github.com/apache/spark/pull/25026 ## What changes were proposed in this pull request? (Please fill in changes proposed in this fix) ## How was this patch

[GitHub] [spark] AmplabJenkins removed a comment on issue #24963: [SPARK-28159][ML] Make the transform natively in ml framework to avoid extra conversion

AmplabJenkins removed a comment on issue #24963: [SPARK-28159][ML] Make the transform natively in ml framework to avoid extra conversion URL: https://github.com/apache/spark/pull/24963#issuecomment-507519673 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #24963: [SPARK-28159][ML] Make the transform natively in ml framework to avoid extra conversion

AmplabJenkins removed a comment on issue #24963: [SPARK-28159][ML] Make the transform natively in ml framework to avoid extra conversion URL: https://github.com/apache/spark/pull/24963#issuecomment-507519675 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins commented on issue #24963: [SPARK-28159][ML] Make the transform natively in ml framework to avoid extra conversion

AmplabJenkins commented on issue #24963: [SPARK-28159][ML] Make the transform natively in ml framework to avoid extra conversion URL: https://github.com/apache/spark/pull/24963#issuecomment-507519673 Merged build finished. Test PASSed.

[GitHub] [spark] AngersZhuuuu commented on issue #24909: [SPARK-28106][SQL] When Spark SQL use "add jar" , before add to SparkContext, check jar path exist first.

AngersZh commented on issue #24909: [SPARK-28106][SQL] When Spark SQL use "add jar" , before add to SparkContext, check jar path exist first. URL: https://github.com/apache/spark/pull/24909#issuecomment-507519704 > I think we've never said that we should keep spark core unaffected,

[GitHub] [spark] AmplabJenkins commented on issue #24963: [SPARK-28159][ML] Make the transform natively in ml framework to avoid extra conversion

AmplabJenkins commented on issue #24963: [SPARK-28159][ML] Make the transform natively in ml framework to avoid extra conversion URL: https://github.com/apache/spark/pull/24963#issuecomment-507519675 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #24963: [SPARK-28159][ML] Make the transform natively in ml framework to avoid extra conversion

SparkQA commented on issue #24963: [SPARK-28159][ML] Make the transform natively in ml framework to avoid extra conversion URL: https://github.com/apache/spark/pull/24963#issuecomment-507519497 **[Test build #107094 has

[GitHub] [spark] SparkQA removed a comment on issue #24963: [SPARK-28159][ML] Make the transform natively in ml framework to avoid extra conversion

SparkQA removed a comment on issue #24963: [SPARK-28159][ML] Make the transform natively in ml framework to avoid extra conversion URL: https://github.com/apache/spark/pull/24963#issuecomment-507508924 **[Test build #107094 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #25025: [SPARK-28226][PYTHON] Rename Pandas UDF SCALAR_ITER to MAP_ITER and fix documentation

AmplabJenkins removed a comment on issue #25025: [SPARK-28226][PYTHON] Rename Pandas UDF SCALAR_ITER to MAP_ITER and fix documentation URL: https://github.com/apache/spark/pull/25025#issuecomment-507515718 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins removed a comment on issue #25025: [SPARK-28226][PYTHON] Rename Pandas UDF SCALAR_ITER to MAP_ITER and fix documentation

AmplabJenkins removed a comment on issue #25025: [SPARK-28226][PYTHON] Rename Pandas UDF SCALAR_ITER to MAP_ITER and fix documentation URL: https://github.com/apache/spark/pull/25025#issuecomment-507515716 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #25025: [SPARK-28226][PYTHON] Rename Pandas UDF SCALAR_ITER to MAP_ITER and fix documentation

AmplabJenkins commented on issue #25025: [SPARK-28226][PYTHON] Rename Pandas UDF SCALAR_ITER to MAP_ITER and fix documentation URL: https://github.com/apache/spark/pull/25025#issuecomment-507515718 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25025: [SPARK-28226][PYTHON] Rename Pandas UDF SCALAR_ITER to MAP_ITER and fix documentation

AmplabJenkins commented on issue #25025: [SPARK-28226][PYTHON] Rename Pandas UDF SCALAR_ITER to MAP_ITER and fix documentation URL: https://github.com/apache/spark/pull/25025#issuecomment-507515716 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA removed a comment on issue #25025: [SPARK-28226][PYTHON] Rename Pandas UDF SCALAR_ITER to MAP_ITER and fix documentation

SparkQA removed a comment on issue #25025: [SPARK-28226][PYTHON] Rename Pandas UDF SCALAR_ITER to MAP_ITER and fix documentation URL: https://github.com/apache/spark/pull/25025#issuecomment-507510151 **[Test build #107096 has

[GitHub] [spark] SparkQA commented on issue #25025: [SPARK-28226][PYTHON] Rename Pandas UDF SCALAR_ITER to MAP_ITER and fix documentation

SparkQA commented on issue #25025: [SPARK-28226][PYTHON] Rename Pandas UDF SCALAR_ITER to MAP_ITER and fix documentation URL: https://github.com/apache/spark/pull/25025#issuecomment-507515527 **[Test build #107096 has

[GitHub] [spark] LantaoJin commented on issue #24984: [SPARK-28183][CORE][UI] Add a task status filter for taskList in REST API

LantaoJin commented on issue #24984: [SPARK-28183][CORE][UI] Add a task status filter for taskList in REST API URL: https://github.com/apache/spark/pull/24984#issuecomment-507513925 @vanzin @srowen I refactor this implementation follow the comments of

[GitHub] [spark] liupc commented on issue #25019: [SPARK-28195][SQL] Fix CheckAnalysis not working for INSERT command and report misleading error message

liupc commented on issue #25019: [SPARK-28195][SQL] Fix CheckAnalysis not working for INSERT command and report misleading error message URL: https://github.com/apache/spark/pull/25019#issuecomment-507513887 OK, I will add some test later.

[GitHub] [spark] LantaoJin closed pull request #24982: [SPARK-28181][CORE] Add a filter interface to KVStore to speed up the entities retrieve

LantaoJin closed pull request #24982: [SPARK-28181][CORE] Add a filter interface to KVStore to speed up the entities retrieve URL: https://github.com/apache/spark/pull/24982 This is an automated message from the Apache Git

[GitHub] [spark] AmplabJenkins removed a comment on issue #25025: [WIP][SPARK-28226][PYTHON] Rename Pandas UDF SCALAR_ITER to MAP_ITER and fix documentation

AmplabJenkins removed a comment on issue #25025: [WIP][SPARK-28226][PYTHON] Rename Pandas UDF SCALAR_ITER to MAP_ITER and fix documentation URL: https://github.com/apache/spark/pull/25025#issuecomment-507512901 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #25025: [WIP][SPARK-28226][PYTHON] Rename Pandas UDF SCALAR_ITER to MAP_ITER and fix documentation

AmplabJenkins removed a comment on issue #25025: [WIP][SPARK-28226][PYTHON] Rename Pandas UDF SCALAR_ITER to MAP_ITER and fix documentation URL: https://github.com/apache/spark/pull/25025#issuecomment-507512902 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] LantaoJin commented on issue #24982: [SPARK-28181][CORE] Add a filter interface to KVStore to speed up the entities retrieve

LantaoJin commented on issue #24982: [SPARK-28181][CORE] Add a filter interface to KVStore to speed up the entities retrieve URL: https://github.com/apache/spark/pull/24982#issuecomment-507513050 @vanzin and @srowen Thanks for your patient and kind review. I will close this since I use

[GitHub] [spark] AmplabJenkins commented on issue #25025: [WIP][SPARK-28226][PYTHON] Rename Pandas UDF SCALAR_ITER to MAP_ITER and fix documentation

AmplabJenkins commented on issue #25025: [WIP][SPARK-28226][PYTHON] Rename Pandas UDF SCALAR_ITER to MAP_ITER and fix documentation URL: https://github.com/apache/spark/pull/25025#issuecomment-507512901 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #25025: [WIP][SPARK-28226][PYTHON] Rename Pandas UDF SCALAR_ITER to MAP_ITER and fix documentation

AmplabJenkins commented on issue #25025: [WIP][SPARK-28226][PYTHON] Rename Pandas UDF SCALAR_ITER to MAP_ITER and fix documentation URL: https://github.com/apache/spark/pull/25025#issuecomment-507512902 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] SparkQA removed a comment on issue #25025: [WIP][SPARK-28226][PYTHON] Rename Pandas UDF SCALAR_ITER to MAP_ITER and fix documentation

SparkQA removed a comment on issue #25025: [WIP][SPARK-28226][PYTHON] Rename Pandas UDF SCALAR_ITER to MAP_ITER and fix documentation URL: https://github.com/apache/spark/pull/25025#issuecomment-507507764 **[Test build #107093 has

[GitHub] [spark] maropu commented on issue #24961: [SPARK-28158][SQL] Hive UDFs supports UDT type

maropu commented on issue #24961: [SPARK-28158][SQL] Hive UDFs supports UDT type URL: https://github.com/apache/spark/pull/24961#issuecomment-507512690 But, the UDF works in Spark and not in Hive, right? I'm not sure that this is a right approach...

[GitHub] [spark] SparkQA commented on issue #24960: [SPARK-28156][SQL] Self-join should not miss cached view

SparkQA commented on issue #24960: [SPARK-28156][SQL] Self-join should not miss cached view URL: https://github.com/apache/spark/pull/24960#issuecomment-507512650 **[Test build #107097 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/107097/testReport)**

[GitHub] [spark] SparkQA commented on issue #25025: [WIP][SPARK-28226][PYTHON] Rename Pandas UDF SCALAR_ITER to MAP_ITER and fix documentation

SparkQA commented on issue #25025: [WIP][SPARK-28226][PYTHON] Rename Pandas UDF SCALAR_ITER to MAP_ITER and fix documentation URL: https://github.com/apache/spark/pull/25025#issuecomment-507512703 **[Test build #107093 has

[GitHub] [spark] AmplabJenkins commented on issue #25024: [SPARK-27296][SQL][WIP] User Defined Aggregators that do not ser/de on each input row

AmplabJenkins commented on issue #25024: [SPARK-27296][SQL][WIP] User Defined Aggregators that do not ser/de on each input row URL: https://github.com/apache/spark/pull/25024#issuecomment-507512395 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #24960: [SPARK-28156][SQL] Self-join should not miss cached view

AmplabJenkins removed a comment on issue #24960: [SPARK-28156][SQL] Self-join should not miss cached view URL: https://github.com/apache/spark/pull/24960#issuecomment-507512331 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins commented on issue #24960: [SPARK-28156][SQL] Self-join should not miss cached view

AmplabJenkins commented on issue #24960: [SPARK-28156][SQL] Self-join should not miss cached view URL: https://github.com/apache/spark/pull/24960#issuecomment-507512331 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins removed a comment on issue #25024: [SPARK-27296][SQL][WIP] User Defined Aggregators that do not ser/de on each input row

AmplabJenkins removed a comment on issue #25024: [SPARK-27296][SQL][WIP] User Defined Aggregators that do not ser/de on each input row URL: https://github.com/apache/spark/pull/25024#issuecomment-507512393 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #24960: [SPARK-28156][SQL] Self-join should not miss cached view

AmplabJenkins commented on issue #24960: [SPARK-28156][SQL] Self-join should not miss cached view URL: https://github.com/apache/spark/pull/24960#issuecomment-507512335 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25024: [SPARK-27296][SQL][WIP] User Defined Aggregators that do not ser/de on each input row

AmplabJenkins commented on issue #25024: [SPARK-27296][SQL][WIP] User Defined Aggregators that do not ser/de on each input row URL: https://github.com/apache/spark/pull/25024#issuecomment-507512393 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #24960: [SPARK-28156][SQL] Self-join should not miss cached view

AmplabJenkins removed a comment on issue #24960: [SPARK-28156][SQL] Self-join should not miss cached view URL: https://github.com/apache/spark/pull/24960#issuecomment-507512335 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #25024: [SPARK-27296][SQL][WIP] User Defined Aggregators that do not ser/de on each input row

AmplabJenkins removed a comment on issue #25024: [SPARK-27296][SQL][WIP] User Defined Aggregators that do not ser/de on each input row URL: https://github.com/apache/spark/pull/25024#issuecomment-507512395 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] SparkQA removed a comment on issue #25024: [SPARK-27296][SQL][WIP] User Defined Aggregators that do not ser/de on each input row

SparkQA removed a comment on issue #25024: [SPARK-27296][SQL][WIP] User Defined Aggregators that do not ser/de on each input row URL: https://github.com/apache/spark/pull/25024#issuecomment-507481534 **[Test build #107090 has

[GitHub] [spark] maropu commented on issue #22347: [SPARK-25353][SQL] executeTake in SparkPlan is modified to avoid unnecessary decoding.

maropu commented on issue #22347: [SPARK-25353][SQL] executeTake in SparkPlan is modified to avoid unnecessary decoding. URL: https://github.com/apache/spark/pull/22347#issuecomment-507512200 oh this pr makes the memory pressure higher in the query?

[GitHub] [spark] SparkQA commented on issue #25024: [SPARK-27296][SQL][WIP] User Defined Aggregators that do not ser/de on each input row

SparkQA commented on issue #25024: [SPARK-27296][SQL][WIP] User Defined Aggregators that do not ser/de on each input row URL: https://github.com/apache/spark/pull/25024#issuecomment-507512094 **[Test build #107090 has

[GitHub] [spark] viirya commented on issue #24971: [SPARK-28054][SQL][FOLLOW-UP] Fix error when insert Hive partitioned table dynamically where partition name is upper case

viirya commented on issue #24971: [SPARK-28054][SQL][FOLLOW-UP] Fix error when insert Hive partitioned table dynamically where partition name is upper case URL: https://github.com/apache/spark/pull/24971#issuecomment-507512129 ping?

[GitHub] [spark] maropu commented on issue #24960: [SPARK-28156][SQL] Self-join should not miss cached view

maropu commented on issue #24960: [SPARK-28156][SQL] Self-join should not miss cached view URL: https://github.com/apache/spark/pull/24960#issuecomment-507511937 (This might be off-topic and this is just a question though...) btw, any reason not to use optimized plans instead of analyzed

[GitHub] [spark] viirya commented on issue #24960: [SPARK-28156][SQL] Self-join should not miss cached view

viirya commented on issue #24960: [SPARK-28156][SQL] Self-join should not miss cached view URL: https://github.com/apache/spark/pull/24960#issuecomment-507511804 Ok. Let's try this approach and see Jenkins results. Thanks.

[GitHub] [spark] Dooyoung-Hwang commented on issue #22347: [SPARK-25353][SQL] executeTake in SparkPlan is modified to avoid unnecessary decoding.

Dooyoung-Hwang commented on issue #22347: [SPARK-25353][SQL] executeTake in SparkPlan is modified to avoid unnecessary decoding. URL: https://github.com/apache/spark/pull/22347#issuecomment-507511257 Maybe this test code in DataFrameSuite causes OOM. ``` // SPARK-12340:

[GitHub] [spark] AmplabJenkins commented on issue #25025: [WIP][SPARK-28226][PYTHON] Rename Pandas UDF SCALAR_ITER to MAP_ITER and fix documentation

AmplabJenkins commented on issue #25025: [WIP][SPARK-28226][PYTHON] Rename Pandas UDF SCALAR_ITER to MAP_ITER and fix documentation URL: https://github.com/apache/spark/pull/25025#issuecomment-507511011 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] gczsjdy commented on issue #24978: [SPARK-28177][SQL] Adjust post shuffle partition number in adaptive execution

gczsjdy commented on issue #24978: [SPARK-28177][SQL] Adjust post shuffle partition number in adaptive execution URL: https://github.com/apache/spark/pull/24978#issuecomment-507511082 @maryannxue I am curious about why do we need a separate switch for SMJ->BHJ? In the new adaptive

[GitHub] [spark] AmplabJenkins removed a comment on issue #25025: [WIP][SPARK-28226][PYTHON] Rename Pandas UDF SCALAR_ITER to MAP_ITER and fix documentation

AmplabJenkins removed a comment on issue #25025: [WIP][SPARK-28226][PYTHON] Rename Pandas UDF SCALAR_ITER to MAP_ITER and fix documentation URL: https://github.com/apache/spark/pull/25025#issuecomment-507511011 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] AmplabJenkins removed a comment on issue #25025: [WIP][SPARK-28226][PYTHON] Rename Pandas UDF SCALAR_ITER to MAP_ITER and fix documentation

AmplabJenkins removed a comment on issue #25025: [WIP][SPARK-28226][PYTHON] Rename Pandas UDF SCALAR_ITER to MAP_ITER and fix documentation URL: https://github.com/apache/spark/pull/25025#issuecomment-507511010 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #25025: [WIP][SPARK-28226][PYTHON] Rename Pandas UDF SCALAR_ITER to MAP_ITER and fix documentation

AmplabJenkins commented on issue #25025: [WIP][SPARK-28226][PYTHON] Rename Pandas UDF SCALAR_ITER to MAP_ITER and fix documentation URL: https://github.com/apache/spark/pull/25025#issuecomment-507511010 Merged build finished. Test PASSed.

[GitHub] [spark] LantaoJin removed a comment on issue #24984: [SPARK-28183][CORE][UI] Add a task status filter for taskList in REST API

LantaoJin removed a comment on issue #24984: [SPARK-28183][CORE][UI] Add a task status filter for taskList in REST API URL: https://github.com/apache/spark/pull/24984#issuecomment-507262506 @vanzin I follow your comment https://github.com/apache/spark/pull/24982#issuecomment-506782293.

[GitHub] [spark] dongjoon-hyun commented on issue #25006: [SPARK-28208][BUILD] Upgrade to ORC 1.5.6 including closing the ORC readers

dongjoon-hyun commented on issue #25006: [SPARK-28208][BUILD] Upgrade to ORC 1.5.6 including closing the ORC readers URL: https://github.com/apache/spark/pull/25006#issuecomment-507510483 Hi, @omalley . I made a PR to your branch. Could you review and merge that to pass the UT

[GitHub] [spark] SparkQA commented on issue #25025: [WIP][SPARK-28226][PYTHON] Rename Pandas UDF SCALAR_ITER to MAP_ITER and fix documentation

SparkQA commented on issue #25025: [WIP][SPARK-28226][PYTHON] Rename Pandas UDF SCALAR_ITER to MAP_ITER and fix documentation URL: https://github.com/apache/spark/pull/25025#issuecomment-507510151 **[Test build #107096 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #24963: [SPARK-28159][ML] Make the transform natively in ml framework to avoid extra conversion

AmplabJenkins removed a comment on issue #24963: [SPARK-28159][ML] Make the transform natively in ml framework to avoid extra conversion URL: https://github.com/apache/spark/pull/24963#issuecomment-507509860 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #24963: [SPARK-28159][ML] Make the transform natively in ml framework to avoid extra conversion

AmplabJenkins removed a comment on issue #24963: [SPARK-28159][ML] Make the transform natively in ml framework to avoid extra conversion URL: https://github.com/apache/spark/pull/24963#issuecomment-507509863 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins commented on issue #24963: [SPARK-28159][ML] Make the transform natively in ml framework to avoid extra conversion

AmplabJenkins commented on issue #24963: [SPARK-28159][ML] Make the transform natively in ml framework to avoid extra conversion URL: https://github.com/apache/spark/pull/24963#issuecomment-507509860 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #24963: [SPARK-28159][ML] Make the transform natively in ml framework to avoid extra conversion

AmplabJenkins commented on issue #24963: [SPARK-28159][ML] Make the transform natively in ml framework to avoid extra conversion URL: https://github.com/apache/spark/pull/24963#issuecomment-507509863 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #22347: [SPARK-25353][SQL] executeTake in SparkPlan is modified to avoid unnecessary decoding.

SparkQA commented on issue #22347: [SPARK-25353][SQL] executeTake in SparkPlan is modified to avoid unnecessary decoding. URL: https://github.com/apache/spark/pull/22347#issuecomment-507508931 **[Test build #107095 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #22347: [SPARK-25353][SQL] executeTake in SparkPlan is modified to avoid unnecessary decoding.

AmplabJenkins removed a comment on issue #22347: [SPARK-25353][SQL] executeTake in SparkPlan is modified to avoid unnecessary decoding. URL: https://github.com/apache/spark/pull/22347#issuecomment-507508668 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins removed a comment on issue #22347: [SPARK-25353][SQL] executeTake in SparkPlan is modified to avoid unnecessary decoding.

AmplabJenkins removed a comment on issue #22347: [SPARK-25353][SQL] executeTake in SparkPlan is modified to avoid unnecessary decoding. URL: https://github.com/apache/spark/pull/22347#issuecomment-507508666 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA commented on issue #24963: [SPARK-28159][ML] Make the transform natively in ml framework to avoid extra conversion

SparkQA commented on issue #24963: [SPARK-28159][ML] Make the transform natively in ml framework to avoid extra conversion URL: https://github.com/apache/spark/pull/24963#issuecomment-507508924 **[Test build #107094 has

[GitHub] [spark] AmplabJenkins commented on issue #22347: [SPARK-25353][SQL] executeTake in SparkPlan is modified to avoid unnecessary decoding.

AmplabJenkins commented on issue #22347: [SPARK-25353][SQL] executeTake in SparkPlan is modified to avoid unnecessary decoding. URL: https://github.com/apache/spark/pull/22347#issuecomment-507508666 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #24963: [SPARK-28159][ML] Make the transform natively in ml framework to avoid extra conversion

AmplabJenkins commented on issue #24963: [SPARK-28159][ML] Make the transform natively in ml framework to avoid extra conversion URL: https://github.com/apache/spark/pull/24963#issuecomment-507508637 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #24963: [SPARK-28159][ML] Make the transform natively in ml framework to avoid extra conversion

AmplabJenkins removed a comment on issue #24963: [SPARK-28159][ML] Make the transform natively in ml framework to avoid extra conversion URL: https://github.com/apache/spark/pull/24963#issuecomment-507508637 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins commented on issue #24963: [SPARK-28159][ML] Make the transform natively in ml framework to avoid extra conversion

AmplabJenkins commented on issue #24963: [SPARK-28159][ML] Make the transform natively in ml framework to avoid extra conversion URL: https://github.com/apache/spark/pull/24963#issuecomment-507508633 Merged build finished. Test PASSed.

[GitHub] [spark] HyukjinKwon edited a comment on issue #24997: [SPARK-28198][PYTHON] Add mapPartitionsInPandas to allow an iterator of DataFrames

HyukjinKwon edited a comment on issue #24997: [SPARK-28198][PYTHON] Add mapPartitionsInPandas to allow an iterator of DataFrames URL: https://github.com/apache/spark/pull/24997#issuecomment-507500748 But when `StructType` is given alone, it still can iterate with DataFrames:

[GitHub] [spark] AmplabJenkins removed a comment on issue #24963: [SPARK-28159][ML] Make the transform natively in ml framework to avoid extra conversion

AmplabJenkins removed a comment on issue #24963: [SPARK-28159][ML] Make the transform natively in ml framework to avoid extra conversion URL: https://github.com/apache/spark/pull/24963#issuecomment-507508633 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #22347: [SPARK-25353][SQL] executeTake in SparkPlan is modified to avoid unnecessary decoding.

AmplabJenkins commented on issue #22347: [SPARK-25353][SQL] executeTake in SparkPlan is modified to avoid unnecessary decoding. URL: https://github.com/apache/spark/pull/22347#issuecomment-507508668 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #24963: [SPARK-28159][ML] Make the transform natively in ml framework to avoid extra conversion

AmplabJenkins removed a comment on issue #24963: [SPARK-28159][ML] Make the transform natively in ml framework to avoid extra conversion URL: https://github.com/apache/spark/pull/24963#issuecomment-507508077 Test FAILed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins commented on issue #24963: [SPARK-28159][ML] Make the transform natively in ml framework to avoid extra conversion

AmplabJenkins commented on issue #24963: [SPARK-28159][ML] Make the transform natively in ml framework to avoid extra conversion URL: https://github.com/apache/spark/pull/24963#issuecomment-507508077 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #24963: [SPARK-28159][ML] Make the transform natively in ml framework to avoid extra conversion

AmplabJenkins removed a comment on issue #24963: [SPARK-28159][ML] Make the transform natively in ml framework to avoid extra conversion URL: https://github.com/apache/spark/pull/24963#issuecomment-507508070 Merged build finished. Test FAILed.

[GitHub] [spark] SparkQA removed a comment on issue #24963: [SPARK-28159][ML] Make the transform natively in ml framework to avoid extra conversion

SparkQA removed a comment on issue #24963: [SPARK-28159][ML] Make the transform natively in ml framework to avoid extra conversion URL: https://github.com/apache/spark/pull/24963#issuecomment-507502374 **[Test build #107092 has

[GitHub] [spark] AmplabJenkins commented on issue #24963: [SPARK-28159][ML] Make the transform natively in ml framework to avoid extra conversion

AmplabJenkins commented on issue #24963: [SPARK-28159][ML] Make the transform natively in ml framework to avoid extra conversion URL: https://github.com/apache/spark/pull/24963#issuecomment-507508070 Merged build finished. Test FAILed.

[GitHub] [spark] SparkQA commented on issue #24963: [SPARK-28159][ML] Make the transform natively in ml framework to avoid extra conversion

SparkQA commented on issue #24963: [SPARK-28159][ML] Make the transform natively in ml framework to avoid extra conversion URL: https://github.com/apache/spark/pull/24963#issuecomment-507508024 **[Test build #107092 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #25025: [WIP][SPARK-28226][PYTHON] Rename Pandas UDF SCALAR_ITER to MAP_ITER and fix documentation

AmplabJenkins removed a comment on issue #25025: [WIP][SPARK-28226][PYTHON] Rename Pandas UDF SCALAR_ITER to MAP_ITER and fix documentation URL: https://github.com/apache/spark/pull/25025#issuecomment-507507414 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] AmplabJenkins removed a comment on issue #25025: [WIP][SPARK-28226][PYTHON] Rename Pandas UDF SCALAR_ITER to MAP_ITER and fix documentation

AmplabJenkins removed a comment on issue #25025: [WIP][SPARK-28226][PYTHON] Rename Pandas UDF SCALAR_ITER to MAP_ITER and fix documentation URL: https://github.com/apache/spark/pull/25025#issuecomment-507507412 Merged build finished. Test PASSed.

[GitHub] [spark] gczsjdy commented on a change in pull request #24978: [SPARK-28177][SQL] Adjust post shuffle partition number in adaptive execution

gczsjdy commented on a change in pull request #24978: [SPARK-28177][SQL] Adjust post shuffle partition number in adaptive execution URL: https://github.com/apache/spark/pull/24978#discussion_r299291217 ## File path:

[GitHub] [spark] maropu commented on issue #22347: [SPARK-25353][SQL] executeTake in SparkPlan is modified to avoid unnecessary decoding.

maropu commented on issue #22347: [SPARK-25353][SQL] executeTake in SparkPlan is modified to avoid unnecessary decoding. URL: https://github.com/apache/spark/pull/22347#issuecomment-507507775 retest this please This is an

[GitHub] [spark] gczsjdy commented on a change in pull request #24978: [SPARK-28177][SQL] Adjust post shuffle partition number in adaptive execution

gczsjdy commented on a change in pull request #24978: [SPARK-28177][SQL] Adjust post shuffle partition number in adaptive execution URL: https://github.com/apache/spark/pull/24978#discussion_r299293242 ## File path:

[GitHub] [spark] gczsjdy commented on a change in pull request #24978: [SPARK-28177][SQL] Adjust post shuffle partition number in adaptive execution

gczsjdy commented on a change in pull request #24978: [SPARK-28177][SQL] Adjust post shuffle partition number in adaptive execution URL: https://github.com/apache/spark/pull/24978#discussion_r299293606 ## File path:

[GitHub] [spark] SparkQA commented on issue #25025: [WIP][SPARK-28226][PYTHON] Rename Pandas UDF SCALAR_ITER to MAP_ITER and fix documentation

SparkQA commented on issue #25025: [WIP][SPARK-28226][PYTHON] Rename Pandas UDF SCALAR_ITER to MAP_ITER and fix documentation URL: https://github.com/apache/spark/pull/25025#issuecomment-507507764 **[Test build #107093 has

  1   2   3   4   5   6   >