[GitHub] [spark] jerryshao commented on issue #24998: [SPARK-28202] [Core] [Test] Avoid noises of system props in SparkConfSuite

2019-06-30 Thread GitBox
jerryshao commented on issue #24998: [SPARK-28202] [Core] [Test] Avoid noises of system props in SparkConfSuite URL: https://github.com/apache/spark/pull/24998#issuecomment-507126499 I would guess that other tests will also be failed possibly if you have local modified properties. Have

[GitHub] [spark] turboFei commented on a change in pull request #24992: [SPARK-28194][SQL] Refactor code to prevent None.get in EnsureRequirements

2019-06-30 Thread GitBox
turboFei commented on a change in pull request #24992: [SPARK-28194][SQL] Refactor code to prevent None.get in EnsureRequirements URL: https://github.com/apache/spark/pull/24992#discussion_r298889300 ## File path:

[GitHub] [spark] maropu commented on a change in pull request #24992: [SPARK-28194][SQL] Refactor code to prevent None.get in EnsureRequirements

2019-06-30 Thread GitBox
maropu commented on a change in pull request #24992: [SPARK-28194][SQL] Refactor code to prevent None.get in EnsureRequirements URL: https://github.com/apache/spark/pull/24992#discussion_r29620 ## File path:

[GitHub] [spark] cloud-fan commented on a change in pull request #24738: [SPARK-23098][SQL] Migrate Kafka Batch source to v2.

2019-06-30 Thread GitBox
cloud-fan commented on a change in pull request #24738: [SPARK-23098][SQL] Migrate Kafka Batch source to v2. URL: https://github.com/apache/spark/pull/24738#discussion_r298887969 ## File path:

[GitHub] [spark] SparkQA commented on issue #24983: [SPARK-27714][SQL][CBO] Support Genetic Algorithm based join reorder

2019-06-30 Thread GitBox
SparkQA commented on issue #24983: [SPARK-27714][SQL][CBO] Support Genetic Algorithm based join reorder URL: https://github.com/apache/spark/pull/24983#issuecomment-507124499 **[Test build #107060 has

[GitHub] [spark] AngersZhuuuu commented on issue #25015: [SPARK-28217][SQL] Allow a pluggable statistics plan visitor for a logical plan.

2019-06-30 Thread GitBox
AngersZh commented on issue #25015: [SPARK-28217][SQL] Allow a pluggable statistics plan visitor for a logical plan. URL: https://github.com/apache/spark/pull/25015#issuecomment-507124404 [SPARK-27602] (https://issues.apache.org/jira/browse/SPARK-27602) I've thought about doing

[GitHub] [spark] turboFei commented on a change in pull request #24992: [SPARK-28194][SQL] Refactor code to prevent None.get in EnsureRequirements

2019-06-30 Thread GitBox
turboFei commented on a change in pull request #24992: [SPARK-28194][SQL] Refactor code to prevent None.get in EnsureRequirements URL: https://github.com/apache/spark/pull/24992#discussion_r298887634 ## File path:

[GitHub] [spark] turboFei removed a comment on issue #24992: [SPARK-28194][SQL] Refactor code to prevent None.get in EnsureRequirements

2019-06-30 Thread GitBox
turboFei removed a comment on issue #24992: [SPARK-28194][SQL] Refactor code to prevent None.get in EnsureRequirements URL: https://github.com/apache/spark/pull/24992#issuecomment-507123648 Yes, it is a bug.

[GitHub] [spark] AmplabJenkins removed a comment on issue #24983: [SPARK-27714][SQL][CBO] Support Genetic Algorithm based join reorder

2019-06-30 Thread GitBox
AmplabJenkins removed a comment on issue #24983: [SPARK-27714][SQL][CBO] Support Genetic Algorithm based join reorder URL: https://github.com/apache/spark/pull/24983#issuecomment-507124116 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #24983: [SPARK-27714][SQL][CBO] Support Genetic Algorithm based join reorder

2019-06-30 Thread GitBox
AmplabJenkins removed a comment on issue #24983: [SPARK-27714][SQL][CBO] Support Genetic Algorithm based join reorder URL: https://github.com/apache/spark/pull/24983#issuecomment-507124120 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #24983: [SPARK-27714][SQL][CBO] Support Genetic Algorithm based join reorder

2019-06-30 Thread GitBox
AmplabJenkins commented on issue #24983: [SPARK-27714][SQL][CBO] Support Genetic Algorithm based join reorder URL: https://github.com/apache/spark/pull/24983#issuecomment-507124116 Merged build finished. Test PASSed. This is

[GitHub] [spark] AmplabJenkins commented on issue #24983: [SPARK-27714][SQL][CBO] Support Genetic Algorithm based join reorder

2019-06-30 Thread GitBox
AmplabJenkins commented on issue #24983: [SPARK-27714][SQL][CBO] Support Genetic Algorithm based join reorder URL: https://github.com/apache/spark/pull/24983#issuecomment-507124120 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] turboFei commented on issue #24992: [SPARK-28194][SQL] Refactor code to prevent None.get in EnsureRequirements

2019-06-30 Thread GitBox
turboFei commented on issue #24992: [SPARK-28194][SQL] Refactor code to prevent None.get in EnsureRequirements URL: https://github.com/apache/spark/pull/24992#issuecomment-507123648 Yes, it is a bug.

[GitHub] [spark] cloud-fan commented on issue #24978: [SPARK-28177][SQL] Adjust post shuffle partition number in adaptive execution

2019-06-30 Thread GitBox
cloud-fan commented on issue #24978: [SPARK-28177][SQL] Adjust post shuffle partition number in adaptive execution URL: https://github.com/apache/spark/pull/24978#issuecomment-507123632 LGTM This is an automated message from

[GitHub] [spark] xianyinxin commented on issue #24983: [SPARK-27714][SQL][CBO] Support Genetic Algorithm based join reorder

2019-06-30 Thread GitBox
xianyinxin commented on issue #24983: [SPARK-27714][SQL][CBO] Support Genetic Algorithm based join reorder URL: https://github.com/apache/spark/pull/24983#issuecomment-507123598 retest this please This is an automated

[GitHub] [spark] cloud-fan commented on a change in pull request #24978: [SPARK-28177][SQL] Adjust post shuffle partition number in adaptive execution

2019-06-30 Thread GitBox
cloud-fan commented on a change in pull request #24978: [SPARK-28177][SQL] Adjust post shuffle partition number in adaptive execution URL: https://github.com/apache/spark/pull/24978#discussion_r298886464 ## File path:

[GitHub] [spark] AngersZhuuuu edited a comment on issue #24909: [SPARK-28106][SQL] When Spark SQL use "add jar" , before add to SparkContext, check jar path exist first.

2019-06-30 Thread GitBox
AngersZh edited a comment on issue #24909: [SPARK-28106][SQL] When Spark SQL use "add jar" , before add to SparkContext, check jar path exist first. URL: https://github.com/apache/spark/pull/24909#issuecomment-507122951 @gatorsmile @GregOwen Could you review this again? Thanks

[GitHub] [spark] AngersZhuuuu commented on issue #24909: [SPARK-28106][SQL] When Spark SQL use "add jar" , before add to SparkContext, check jar path exist first.

2019-06-30 Thread GitBox
AngersZh commented on issue #24909: [SPARK-28106][SQL] When Spark SQL use "add jar" , before add to SparkContext, check jar path exist first. URL: https://github.com/apache/spark/pull/24909#issuecomment-507122951 @gatorsmile @GregOwen Could you review this again?

[GitHub] [spark] AmplabJenkins removed a comment on issue #24963: [SPARK-28159][ML] Make the transform natively in ml framework to avoid extra conversion

2019-06-30 Thread GitBox
AmplabJenkins removed a comment on issue #24963: [SPARK-28159][ML] Make the transform natively in ml framework to avoid extra conversion URL: https://github.com/apache/spark/pull/24963#issuecomment-507117221 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #24963: [SPARK-28159][ML] Make the transform natively in ml framework to avoid extra conversion

2019-06-30 Thread GitBox
AmplabJenkins removed a comment on issue #24963: [SPARK-28159][ML] Make the transform natively in ml framework to avoid extra conversion URL: https://github.com/apache/spark/pull/24963#issuecomment-507117224 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins commented on issue #24963: [SPARK-28159][ML] Make the transform natively in ml framework to avoid extra conversion

2019-06-30 Thread GitBox
AmplabJenkins commented on issue #24963: [SPARK-28159][ML] Make the transform natively in ml framework to avoid extra conversion URL: https://github.com/apache/spark/pull/24963#issuecomment-507117224 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #24963: [SPARK-28159][ML] Make the transform natively in ml framework to avoid extra conversion

2019-06-30 Thread GitBox
AmplabJenkins commented on issue #24963: [SPARK-28159][ML] Make the transform natively in ml framework to avoid extra conversion URL: https://github.com/apache/spark/pull/24963#issuecomment-507117221 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA removed a comment on issue #24963: [SPARK-28159][ML] Make the transform natively in ml framework to avoid extra conversion

2019-06-30 Thread GitBox
SparkQA removed a comment on issue #24963: [SPARK-28159][ML] Make the transform natively in ml framework to avoid extra conversion URL: https://github.com/apache/spark/pull/24963#issuecomment-507107652 **[Test build #107058 has

[GitHub] [spark] SparkQA commented on issue #24963: [SPARK-28159][ML] Make the transform natively in ml framework to avoid extra conversion

2019-06-30 Thread GitBox
SparkQA commented on issue #24963: [SPARK-28159][ML] Make the transform natively in ml framework to avoid extra conversion URL: https://github.com/apache/spark/pull/24963#issuecomment-507117059 **[Test build #107058 has

[GitHub] [spark] SparkQA commented on issue #25019: [SPARK-28195][SQL] Fix CheckAnalysis not working for command and report misleading error message

2019-06-30 Thread GitBox
SparkQA commented on issue #25019: [SPARK-28195][SQL] Fix CheckAnalysis not working for command and report misleading error message URL: https://github.com/apache/spark/pull/25019#issuecomment-507111962 **[Test build #107059 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #25019: [SPARK-28195][SQL] Fix CheckAnalysis not working for command and report misleading error message

2019-06-30 Thread GitBox
AmplabJenkins removed a comment on issue #25019: [SPARK-28195][SQL] Fix CheckAnalysis not working for command and report misleading error message URL: https://github.com/apache/spark/pull/25019#issuecomment-507111666 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] AmplabJenkins removed a comment on issue #25019: [SPARK-28195][SQL] Fix CheckAnalysis not working for command and report misleading error message

2019-06-30 Thread GitBox
AmplabJenkins removed a comment on issue #25019: [SPARK-28195][SQL] Fix CheckAnalysis not working for command and report misleading error message URL: https://github.com/apache/spark/pull/25019#issuecomment-507111665 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #25019: [SPARK-28195][SQL] Fix CheckAnalysis not working for command and report misleading error message

2019-06-30 Thread GitBox
AmplabJenkins commented on issue #25019: [SPARK-28195][SQL] Fix CheckAnalysis not working for command and report misleading error message URL: https://github.com/apache/spark/pull/25019#issuecomment-507111666 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins commented on issue #25019: [SPARK-28195][SQL] Fix CheckAnalysis not working for command and report misleading error message

2019-06-30 Thread GitBox
AmplabJenkins commented on issue #25019: [SPARK-28195][SQL] Fix CheckAnalysis not working for command and report misleading error message URL: https://github.com/apache/spark/pull/25019#issuecomment-507111665 Merged build finished. Test PASSed.

[GitHub] [spark] maropu commented on issue #25019: [SPARK-28195][SQL] Fix CheckAnalysis not working for command and report misleading error message

2019-06-30 Thread GitBox
maropu commented on issue #25019: [SPARK-28195][SQL] Fix CheckAnalysis not working for command and report misleading error message URL: https://github.com/apache/spark/pull/25019#issuecomment-507111650 This issue only exists in INSERT command? Probably, you'd be better to make the title

[GitHub] [spark] maropu commented on issue #25019: [SPARK-28195][SQL] Fix CheckAnalysis not working for command and report misleading error message

2019-06-30 Thread GitBox
maropu commented on issue #25019: [SPARK-28195][SQL] Fix CheckAnalysis not working for command and report misleading error message URL: https://github.com/apache/spark/pull/25019#issuecomment-507111332 ok to test This is an

[GitHub] [spark] AmplabJenkins removed a comment on issue #25019: [SPARK-28195][SQL] Fix CheckAnalysis not working for command and report misleading error message

2019-06-30 Thread GitBox
AmplabJenkins removed a comment on issue #25019: [SPARK-28195][SQL] Fix CheckAnalysis not working for command and report misleading error message URL: https://github.com/apache/spark/pull/25019#issuecomment-507110740 Can one of the admins verify this patch?

[GitHub] [spark] HyukjinKwon closed pull request #25012: [SPARK-28215][SQL][R] as_tibble was removed from Arrow R API

2019-06-30 Thread GitBox
HyukjinKwon closed pull request #25012: [SPARK-28215][SQL][R] as_tibble was removed from Arrow R API URL: https://github.com/apache/spark/pull/25012 This is an automated message from the Apache Git Service. To respond to

[GitHub] [spark] cloud-fan commented on a change in pull request #25016: [SPARK-28200][SQL] Decimal overflow handling in ExpressionEncoder

2019-06-30 Thread GitBox
cloud-fan commented on a change in pull request #25016: [SPARK-28200][SQL] Decimal overflow handling in ExpressionEncoder URL: https://github.com/apache/spark/pull/25016#discussion_r298877783 ## File path:

[GitHub] [spark] AmplabJenkins removed a comment on issue #25019: [SPARK-28195]Fix CheckAnalysis not working for command and report misleading error message

2019-06-30 Thread GitBox
AmplabJenkins removed a comment on issue #25019: [SPARK-28195]Fix CheckAnalysis not working for command and report misleading error message URL: https://github.com/apache/spark/pull/25019#issuecomment-507110404 Can one of the admins verify this patch?

[GitHub] [spark] AmplabJenkins commented on issue #25019: [SPARK-28195]Fix CheckAnalysis not working for command and report misleading error message

2019-06-30 Thread GitBox
AmplabJenkins commented on issue #25019: [SPARK-28195]Fix CheckAnalysis not working for command and report misleading error message URL: https://github.com/apache/spark/pull/25019#issuecomment-507110740 Can one of the admins verify this patch?

[GitHub] [spark] AmplabJenkins commented on issue #25019: [SPARK-28195]Fix CheckAnalysis not working for command and report misleading error message

2019-06-30 Thread GitBox
AmplabJenkins commented on issue #25019: [SPARK-28195]Fix CheckAnalysis not working for command and report misleading error message URL: https://github.com/apache/spark/pull/25019#issuecomment-507110326 Can one of the admins verify this patch?

[GitHub] [spark] AmplabJenkins commented on issue #25019: [SPARK-28195]Fix CheckAnalysis not working for command and report misleading error message

2019-06-30 Thread GitBox
AmplabJenkins commented on issue #25019: [SPARK-28195]Fix CheckAnalysis not working for command and report misleading error message URL: https://github.com/apache/spark/pull/25019#issuecomment-507110404 Can one of the admins verify this patch?

[GitHub] [spark] AmplabJenkins removed a comment on issue #25019: [SPARK-28195]Fix CheckAnalysis not working for command and report misleading error message

2019-06-30 Thread GitBox
AmplabJenkins removed a comment on issue #25019: [SPARK-28195]Fix CheckAnalysis not working for command and report misleading error message URL: https://github.com/apache/spark/pull/25019#issuecomment-507110326 Can one of the admins verify this patch?

[GitHub] [spark] liupc opened a new pull request #25019: [SPARK-28195]Fix CheckAnalysis not working for command and report misleading error message

2019-06-30 Thread GitBox
liupc opened a new pull request #25019: [SPARK-28195]Fix CheckAnalysis not working for command and report misleading error message URL: https://github.com/apache/spark/pull/25019 ## What changes were proposed in this pull request? This PR will try to fix the issue that the sub

[GitHub] [spark] HyukjinKwon commented on issue #25012: [SPARK-28215][SQL][R] as_tibble was removed from Arrow R API

2019-06-30 Thread GitBox
HyukjinKwon commented on issue #25012: [SPARK-28215][SQL][R] as_tibble was removed from Arrow R API URL: https://github.com/apache/spark/pull/25012#issuecomment-507110218 Merged to master. This is an automated message from

[GitHub] [spark] itsvikramagr commented on a change in pull request #24922: [SPARK-28120][SS] Rocksdb state storage implementation

2019-06-30 Thread GitBox
itsvikramagr commented on a change in pull request #24922: [SPARK-28120][SS] Rocksdb state storage implementation URL: https://github.com/apache/spark/pull/24922#discussion_r298875972 ## File path:

[GitHub] [spark] AmplabJenkins removed a comment on issue #24963: [SPARK-28159][ML] Make the transform natively in ml framework to avoid extra conversion

2019-06-30 Thread GitBox
AmplabJenkins removed a comment on issue #24963: [SPARK-28159][ML] Make the transform natively in ml framework to avoid extra conversion URL: https://github.com/apache/spark/pull/24963#issuecomment-507108411 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #24963: [SPARK-28159][ML] Make the transform natively in ml framework to avoid extra conversion

2019-06-30 Thread GitBox
AmplabJenkins removed a comment on issue #24963: [SPARK-28159][ML] Make the transform natively in ml framework to avoid extra conversion URL: https://github.com/apache/spark/pull/24963#issuecomment-507108414 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins commented on issue #24963: [SPARK-28159][ML] Make the transform natively in ml framework to avoid extra conversion

2019-06-30 Thread GitBox
AmplabJenkins commented on issue #24963: [SPARK-28159][ML] Make the transform natively in ml framework to avoid extra conversion URL: https://github.com/apache/spark/pull/24963#issuecomment-507108414 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #24963: [SPARK-28159][ML] Make the transform natively in ml framework to avoid extra conversion

2019-06-30 Thread GitBox
AmplabJenkins commented on issue #24963: [SPARK-28159][ML] Make the transform natively in ml framework to avoid extra conversion URL: https://github.com/apache/spark/pull/24963#issuecomment-507108411 Merged build finished. Test PASSed.

[GitHub] [spark] itsvikramagr commented on issue #24922: [SPARK-28120][SS] Rocksdb state storage implementation

2019-06-30 Thread GitBox
itsvikramagr commented on issue #24922: [SPARK-28120][SS] Rocksdb state storage implementation URL: https://github.com/apache/spark/pull/24922#issuecomment-507108250 Thanks, @HeartSaVioR for the review. Let me work on your comments. Also, I am looking into generating performance numbers

[GitHub] [spark] SparkQA commented on issue #24963: [SPARK-28159][ML] Make the transform natively in ml framework to avoid extra conversion

2019-06-30 Thread GitBox
SparkQA commented on issue #24963: [SPARK-28159][ML] Make the transform natively in ml framework to avoid extra conversion URL: https://github.com/apache/spark/pull/24963#issuecomment-507107652 **[Test build #107058 has

[GitHub] [spark] cloud-fan closed pull request #25010: [SPARK-28201][SQL] Revisit MakeDecimal behavior on overflow

2019-06-30 Thread GitBox
cloud-fan closed pull request #25010: [SPARK-28201][SQL] Revisit MakeDecimal behavior on overflow URL: https://github.com/apache/spark/pull/25010 This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] cloud-fan commented on issue #25010: [SPARK-28201][SQL] Revisit MakeDecimal behavior on overflow

2019-06-30 Thread GitBox
cloud-fan commented on issue #25010: [SPARK-28201][SQL] Revisit MakeDecimal behavior on overflow URL: https://github.com/apache/spark/pull/25010#issuecomment-507106833 thanks, merging to master! This is an automated message

[GitHub] [spark] AmplabJenkins removed a comment on issue #25012: [SPARK-28215][SQL][R] as_tibble was removed from Arrow R API

2019-06-30 Thread GitBox
AmplabJenkins removed a comment on issue #25012: [SPARK-28215][SQL][R] as_tibble was removed from Arrow R API URL: https://github.com/apache/spark/pull/25012#issuecomment-507106139 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on issue #25012: [SPARK-28215][SQL][R] as_tibble was removed from Arrow R API

2019-06-30 Thread GitBox
SparkQA removed a comment on issue #25012: [SPARK-28215][SQL][R] as_tibble was removed from Arrow R API URL: https://github.com/apache/spark/pull/25012#issuecomment-507099969 **[Test build #107056 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #25012: [SPARK-28215][SQL][R] as_tibble was removed from Arrow R API

2019-06-30 Thread GitBox
AmplabJenkins removed a comment on issue #25012: [SPARK-28215][SQL][R] as_tibble was removed from Arrow R API URL: https://github.com/apache/spark/pull/25012#issuecomment-507106133 Merged build finished. Test PASSed. This is

[GitHub] [spark] AmplabJenkins commented on issue #25012: [SPARK-28215][SQL][R] as_tibble was removed from Arrow R API

2019-06-30 Thread GitBox
AmplabJenkins commented on issue #25012: [SPARK-28215][SQL][R] as_tibble was removed from Arrow R API URL: https://github.com/apache/spark/pull/25012#issuecomment-507106133 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins commented on issue #25012: [SPARK-28215][SQL][R] as_tibble was removed from Arrow R API

2019-06-30 Thread GitBox
AmplabJenkins commented on issue #25012: [SPARK-28215][SQL][R] as_tibble was removed from Arrow R API URL: https://github.com/apache/spark/pull/25012#issuecomment-507106139 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #25012: [SPARK-28215][SQL][R] as_tibble was removed from Arrow R API

2019-06-30 Thread GitBox
SparkQA commented on issue #25012: [SPARK-28215][SQL][R] as_tibble was removed from Arrow R API URL: https://github.com/apache/spark/pull/25012#issuecomment-507106090 **[Test build #107056 has

[GitHub] [spark] cloud-fan commented on a change in pull request #24795: [SPARK-27945][SQL] Minimal changes to support columnar processing

2019-06-30 Thread GitBox
cloud-fan commented on a change in pull request #24795: [SPARK-27945][SQL] Minimal changes to support columnar processing URL: https://github.com/apache/spark/pull/24795#discussion_r298873668 ## File path:

[GitHub] [spark] cloud-fan commented on a change in pull request #24795: [SPARK-27945][SQL] Minimal changes to support columnar processing

2019-06-30 Thread GitBox
cloud-fan commented on a change in pull request #24795: [SPARK-27945][SQL] Minimal changes to support columnar processing URL: https://github.com/apache/spark/pull/24795#discussion_r298873668 ## File path:

[GitHub] [spark] AmplabJenkins removed a comment on issue #24983: [SPARK-27714][SQL][CBO] Support Genetic Algorithm based join reorder

2019-06-30 Thread GitBox
AmplabJenkins removed a comment on issue #24983: [SPARK-27714][SQL][CBO] Support Genetic Algorithm based join reorder URL: https://github.com/apache/spark/pull/24983#issuecomment-507101280 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] HyukjinKwon commented on issue #24946: [SPARK-27234][SS][PYTHON] Use InheritableThreadLocal for current epoch in EpochTracker (to support Python UDFs)

2019-06-30 Thread GitBox
HyukjinKwon commented on issue #24946: [SPARK-27234][SS][PYTHON] Use InheritableThreadLocal for current epoch in EpochTracker (to support Python UDFs) URL: https://github.com/apache/spark/pull/24946#issuecomment-507101455 gentle ping .. :-) ..

[GitHub] [spark] HyukjinKwon commented on issue #24958: [SPARK-28153][PYTHON] Use AtomicReference at InputFileBlockHolder (to support input_file_name with Python UDF)

2019-06-30 Thread GitBox
HyukjinKwon commented on issue #24958: [SPARK-28153][PYTHON] Use AtomicReference at InputFileBlockHolder (to support input_file_name with Python UDF) URL: https://github.com/apache/spark/pull/24958#issuecomment-507101426 gentle ping .. :-) ..

[GitHub] [spark] AmplabJenkins removed a comment on issue #24983: [SPARK-27714][SQL][CBO] Support Genetic Algorithm based join reorder

2019-06-30 Thread GitBox
AmplabJenkins removed a comment on issue #24983: [SPARK-27714][SQL][CBO] Support Genetic Algorithm based join reorder URL: https://github.com/apache/spark/pull/24983#issuecomment-507101274 Merged build finished. Test FAILed.

[GitHub] [spark] SparkQA removed a comment on issue #24983: [SPARK-27714][SQL][CBO] Support Genetic Algorithm based join reorder

2019-06-30 Thread GitBox
SparkQA removed a comment on issue #24983: [SPARK-27714][SQL][CBO] Support Genetic Algorithm based join reorder URL: https://github.com/apache/spark/pull/24983#issuecomment-507101082 **[Test build #107057 has

[GitHub] [spark] AmplabJenkins commented on issue #24983: [SPARK-27714][SQL][CBO] Support Genetic Algorithm based join reorder

2019-06-30 Thread GitBox
AmplabJenkins commented on issue #24983: [SPARK-27714][SQL][CBO] Support Genetic Algorithm based join reorder URL: https://github.com/apache/spark/pull/24983#issuecomment-507101274 Merged build finished. Test FAILed. This is

[GitHub] [spark] AmplabJenkins commented on issue #24983: [SPARK-27714][SQL][CBO] Support Genetic Algorithm based join reorder

2019-06-30 Thread GitBox
AmplabJenkins commented on issue #24983: [SPARK-27714][SQL][CBO] Support Genetic Algorithm based join reorder URL: https://github.com/apache/spark/pull/24983#issuecomment-507101280 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #24983: [SPARK-27714][SQL][CBO] Support Genetic Algorithm based join reorder

2019-06-30 Thread GitBox
SparkQA commented on issue #24983: [SPARK-27714][SQL][CBO] Support Genetic Algorithm based join reorder URL: https://github.com/apache/spark/pull/24983#issuecomment-507101270 **[Test build #107057 has

[GitHub] [spark] SparkQA commented on issue #24983: [SPARK-27714][SQL][CBO] Support Genetic Algorithm based join reorder

2019-06-30 Thread GitBox
SparkQA commented on issue #24983: [SPARK-27714][SQL][CBO] Support Genetic Algorithm based join reorder URL: https://github.com/apache/spark/pull/24983#issuecomment-507101082 **[Test build #107057 has

[GitHub] [spark] AmplabJenkins commented on issue #24983: [SPARK-27714][SQL][CBO] Support Genetic Algorithm based join reorder

2019-06-30 Thread GitBox
AmplabJenkins commented on issue #24983: [SPARK-27714][SQL][CBO] Support Genetic Algorithm based join reorder URL: https://github.com/apache/spark/pull/24983#issuecomment-507100802 Merged build finished. Test PASSed. This is

[GitHub] [spark] AmplabJenkins removed a comment on issue #24983: [SPARK-27714][SQL][CBO] Support Genetic Algorithm based join reorder

2019-06-30 Thread GitBox
AmplabJenkins removed a comment on issue #24983: [SPARK-27714][SQL][CBO] Support Genetic Algorithm based join reorder URL: https://github.com/apache/spark/pull/24983#issuecomment-507100803 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #24983: [SPARK-27714][SQL][CBO] Support Genetic Algorithm based join reorder

2019-06-30 Thread GitBox
AmplabJenkins removed a comment on issue #24983: [SPARK-27714][SQL][CBO] Support Genetic Algorithm based join reorder URL: https://github.com/apache/spark/pull/24983#issuecomment-507100802 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #24983: [SPARK-27714][SQL][CBO] Support Genetic Algorithm based join reorder

2019-06-30 Thread GitBox
AmplabJenkins commented on issue #24983: [SPARK-27714][SQL][CBO] Support Genetic Algorithm based join reorder URL: https://github.com/apache/spark/pull/24983#issuecomment-507100803 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #24983: [SPARK-27714][SQL][CBO] Support Genetic Algorithm based join reorder

2019-06-30 Thread GitBox
AmplabJenkins removed a comment on issue #24983: [SPARK-27714][SQL][CBO] Support Genetic Algorithm based join reorder URL: https://github.com/apache/spark/pull/24983#issuecomment-506319433 Can one of the admins verify this patch?

[GitHub] [spark] gatorsmile commented on issue #24983: [SPARK-27714][SQL][CBO] Support Genetic Algorithm based join reorder

2019-06-30 Thread GitBox
gatorsmile commented on issue #24983: [SPARK-27714][SQL][CBO] Support Genetic Algorithm based join reorder URL: https://github.com/apache/spark/pull/24983#issuecomment-507100505 ok to test This is an automated message from

[GitHub] [spark] SparkQA commented on issue #25012: [SPARK-28215][SQL][R] as_tibble was removed from Arrow R API

2019-06-30 Thread GitBox
SparkQA commented on issue #25012: [SPARK-28215][SQL][R] as_tibble was removed from Arrow R API URL: https://github.com/apache/spark/pull/25012#issuecomment-507099969 **[Test build #107056 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/107056/testReport)**

[GitHub] [spark] AmplabJenkins removed a comment on issue #25012: [SPARK-28215][SQL][R] as_tibble was removed from Arrow R API

2019-06-30 Thread GitBox
AmplabJenkins removed a comment on issue #25012: [SPARK-28215][SQL][R] as_tibble was removed from Arrow R API URL: https://github.com/apache/spark/pull/25012#issuecomment-507099710 Merged build finished. Test PASSed. This is

[GitHub] [spark] AmplabJenkins removed a comment on issue #25012: [SPARK-28215][SQL][R] as_tibble was removed from Arrow R API

2019-06-30 Thread GitBox
AmplabJenkins removed a comment on issue #25012: [SPARK-28215][SQL][R] as_tibble was removed from Arrow R API URL: https://github.com/apache/spark/pull/25012#issuecomment-507099715 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25012: [SPARK-28215][SQL][R] as_tibble was removed from Arrow R API

2019-06-30 Thread GitBox
AmplabJenkins commented on issue #25012: [SPARK-28215][SQL][R] as_tibble was removed from Arrow R API URL: https://github.com/apache/spark/pull/25012#issuecomment-507099710 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins commented on issue #25012: [SPARK-28215][SQL][R] as_tibble was removed from Arrow R API

2019-06-30 Thread GitBox
AmplabJenkins commented on issue #25012: [SPARK-28215][SQL][R] as_tibble was removed from Arrow R API URL: https://github.com/apache/spark/pull/25012#issuecomment-507099715 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] cloud-fan commented on a change in pull request #24795: [SPARK-27945][SQL] Minimal changes to support columnar processing

2019-06-30 Thread GitBox
cloud-fan commented on a change in pull request #24795: [SPARK-27945][SQL] Minimal changes to support columnar processing URL: https://github.com/apache/spark/pull/24795#discussion_r298868156 ## File path:

[GitHub] [spark] viirya commented on a change in pull request #25012: [SPARK-28215][SQL][R] as_tibble was removed from Arrow R API

2019-06-30 Thread GitBox
viirya commented on a change in pull request #25012: [SPARK-28215][SQL][R] as_tibble was removed from Arrow R API URL: https://github.com/apache/spark/pull/25012#discussion_r298868078 ## File path: R/pkg/R/deserialize.R ## @@ -237,7 +237,10 @@ readDeserializeInArrow <-

[GitHub] [spark] HyukjinKwon commented on a change in pull request #25012: [SPARK-28215][SQL][R] as_tibble was removed from Arrow R API

2019-06-30 Thread GitBox
HyukjinKwon commented on a change in pull request #25012: [SPARK-28215][SQL][R] as_tibble was removed from Arrow R API URL: https://github.com/apache/spark/pull/25012#discussion_r298867898 ## File path: R/pkg/R/deserialize.R ## @@ -237,7 +237,10 @@ readDeserializeInArrow

[GitHub] [spark] HyukjinKwon commented on a change in pull request #25012: [SPARK-28215][SQL][R] as_tibble was removed from Arrow R API

2019-06-30 Thread GitBox
HyukjinKwon commented on a change in pull request #25012: [SPARK-28215][SQL][R] as_tibble was removed from Arrow R API URL: https://github.com/apache/spark/pull/25012#discussion_r298867898 ## File path: R/pkg/R/deserialize.R ## @@ -237,7 +237,10 @@ readDeserializeInArrow

[GitHub] [spark] HyukjinKwon closed pull request #25011: [SPARK-28170][ML][PYTHON] Uniform Vectors and Matrix documentation

2019-06-30 Thread GitBox
HyukjinKwon closed pull request #25011: [SPARK-28170][ML][PYTHON] Uniform Vectors and Matrix documentation URL: https://github.com/apache/spark/pull/25011 This is an automated message from the Apache Git Service. To respond

[GitHub] [spark] AmplabJenkins removed a comment on issue #25012: [SPARK-28215][SQL][R] as_tibble was removed from Arrow R API

2019-06-30 Thread GitBox
AmplabJenkins removed a comment on issue #25012: [SPARK-28215][SQL][R] as_tibble was removed from Arrow R API URL: https://github.com/apache/spark/pull/25012#issuecomment-507096128 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on issue #25012: [SPARK-28215][SQL][R] as_tibble was removed from Arrow R API

2019-06-30 Thread GitBox
SparkQA removed a comment on issue #25012: [SPARK-28215][SQL][R] as_tibble was removed from Arrow R API URL: https://github.com/apache/spark/pull/25012#issuecomment-507089936 **[Test build #107055 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #25012: [SPARK-28215][SQL][R] as_tibble was removed from Arrow R API

2019-06-30 Thread GitBox
AmplabJenkins removed a comment on issue #25012: [SPARK-28215][SQL][R] as_tibble was removed from Arrow R API URL: https://github.com/apache/spark/pull/25012#issuecomment-507096124 Merged build finished. Test FAILed. This is

[GitHub] [spark] AmplabJenkins commented on issue #25012: [SPARK-28215][SQL][R] as_tibble was removed from Arrow R API

2019-06-30 Thread GitBox
AmplabJenkins commented on issue #25012: [SPARK-28215][SQL][R] as_tibble was removed from Arrow R API URL: https://github.com/apache/spark/pull/25012#issuecomment-507096124 Merged build finished. Test FAILed. This is an

[GitHub] [spark] HyukjinKwon commented on issue #25011: [SPARK-28170][ML][PYTHON] Uniform Vectors and Matrix documentation

2019-06-30 Thread GitBox
HyukjinKwon commented on issue #25011: [SPARK-28170][ML][PYTHON] Uniform Vectors and Matrix documentation URL: https://github.com/apache/spark/pull/25011#issuecomment-507096175 Merged to master and branch-2.4. This is an

[GitHub] [spark] AmplabJenkins commented on issue #25012: [SPARK-28215][SQL][R] as_tibble was removed from Arrow R API

2019-06-30 Thread GitBox
AmplabJenkins commented on issue #25012: [SPARK-28215][SQL][R] as_tibble was removed from Arrow R API URL: https://github.com/apache/spark/pull/25012#issuecomment-507096128 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #25012: [SPARK-28215][SQL][R] as_tibble was removed from Arrow R API

2019-06-30 Thread GitBox
SparkQA commented on issue #25012: [SPARK-28215][SQL][R] as_tibble was removed from Arrow R API URL: https://github.com/apache/spark/pull/25012#issuecomment-507096113 **[Test build #107055 has

[GitHub] [spark] maropu commented on a change in pull request #24831: [SPARK-19799][SQL] Better support for WITH clause

2019-06-30 Thread GitBox
maropu commented on a change in pull request #24831: [SPARK-19799][SQL] Better support for WITH clause URL: https://github.com/apache/spark/pull/24831#discussion_r298864911 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala ##

[GitHub] [spark] maropu commented on a change in pull request #24831: [SPARK-19799][SQL] Better support for WITH clause

2019-06-30 Thread GitBox
maropu commented on a change in pull request #24831: [SPARK-19799][SQL] Better support for WITH clause URL: https://github.com/apache/spark/pull/24831#discussion_r298865835 ## File path: sql/core/src/test/resources/sql-tests/inputs/cte.sql ## @@ -28,6 +28,177 @@ FROM

[GitHub] [spark] maropu commented on a change in pull request #24831: [SPARK-19799][SQL] Better support for WITH clause

2019-06-30 Thread GitBox
maropu commented on a change in pull request #24831: [SPARK-19799][SQL] Better support for WITH clause URL: https://github.com/apache/spark/pull/24831#discussion_r298865328 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala ##

[GitHub] [spark] maropu commented on a change in pull request #24831: [SPARK-19799][SQL] Better support for WITH clause

2019-06-30 Thread GitBox
maropu commented on a change in pull request #24831: [SPARK-19799][SQL] Better support for WITH clause URL: https://github.com/apache/spark/pull/24831#discussion_r298864801 ## File path: sql/catalyst/src/main/antlr4/org/apache/spark/sql/catalyst/parser/SqlBase.g4 ## @@

[GitHub] [spark] SparkQA commented on issue #25012: [SPARK-28215][SQL][R] as_tibble was removed from Arrow R API

2019-06-30 Thread GitBox
SparkQA commented on issue #25012: [SPARK-28215][SQL][R] as_tibble was removed from Arrow R API URL: https://github.com/apache/spark/pull/25012#issuecomment-507089936 **[Test build #107055 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/107055/testReport)**

[GitHub] [spark] AmplabJenkins removed a comment on issue #25012: [SPARK-28215][SQL][R] as_tibble was removed from Arrow R API

2019-06-30 Thread GitBox
AmplabJenkins removed a comment on issue #25012: [SPARK-28215][SQL][R] as_tibble was removed from Arrow R API URL: https://github.com/apache/spark/pull/25012#issuecomment-507089686 Merged build finished. Test PASSed. This is

[GitHub] [spark] AmplabJenkins removed a comment on issue #25012: [SPARK-28215][SQL][R] as_tibble was removed from Arrow R API

2019-06-30 Thread GitBox
AmplabJenkins removed a comment on issue #25012: [SPARK-28215][SQL][R] as_tibble was removed from Arrow R API URL: https://github.com/apache/spark/pull/25012#issuecomment-507089689 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25012: [SPARK-28215][SQL][R] as_tibble was removed from Arrow R API

2019-06-30 Thread GitBox
AmplabJenkins commented on issue #25012: [SPARK-28215][SQL][R] as_tibble was removed from Arrow R API URL: https://github.com/apache/spark/pull/25012#issuecomment-507089689 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25012: [SPARK-28215][SQL][R] as_tibble was removed from Arrow R API

2019-06-30 Thread GitBox
AmplabJenkins commented on issue #25012: [SPARK-28215][SQL][R] as_tibble was removed from Arrow R API URL: https://github.com/apache/spark/pull/25012#issuecomment-507089686 Merged build finished. Test PASSed. This is an

[GitHub] [spark] HyukjinKwon commented on issue #25012: [SPARK-28215][SQL][R] as_tibble was removed from Arrow R API

2019-06-30 Thread GitBox
HyukjinKwon commented on issue #25012: [SPARK-28215][SQL][R] as_tibble was removed from Arrow R API URL: https://github.com/apache/spark/pull/25012#issuecomment-507088385 I think we can just add `# nolint` for now ... This

  1   2   3   >