[GitHub] [spark] MaxGekk edited a comment on issue #26973: [SPARK-30323][SQL] Support filters pushdown in CSV datasource

2020-01-11 Thread GitBox
MaxGekk edited a comment on issue #26973: [SPARK-30323][SQL] Support filters pushdown in CSV datasource URL: https://github.com/apache/spark/pull/26973#issuecomment-573391098 And in `pushedFilters`, I store only filters that refer to the schema, and the filters that I can handle.

[GitHub] [spark] MaxGekk edited a comment on issue #26973: [SPARK-30323][SQL] Support filters pushdown in CSV datasource

2020-01-11 Thread GitBox
MaxGekk edited a comment on issue #26973: [SPARK-30323][SQL] Support filters pushdown in CSV datasource URL: https://github.com/apache/spark/pull/26973#issuecomment-573390974 @cloud-fan The problem was in the line

[GitHub] [spark] MaxGekk commented on issue #26973: [SPARK-30323][SQL] Support filters pushdown in CSV datasource

2020-01-11 Thread GitBox
MaxGekk commented on issue #26973: [SPARK-30323][SQL] Support filters pushdown in CSV datasource URL: https://github.com/apache/spark/pull/26973#issuecomment-573391098 And in `pushedFilters`, I store only filters that refers to the schema, and the filters that I can handle.

[GitHub] [spark] MaxGekk commented on issue #26973: [SPARK-30323][SQL] Support filters pushdown in CSV datasource

2020-01-11 Thread GitBox
MaxGekk commented on issue #26973: [SPARK-30323][SQL] Support filters pushdown in CSV datasource URL: https://github.com/apache/spark/pull/26973#issuecomment-573390974 @cloud-fan The problem was in the line

[GitHub] [spark] ulysses-you commented on issue #27008: [SPARK-30353][SQL] Add IsNotNull check in SimplifyBinaryComparison optimization

2020-01-11 Thread GitBox
ulysses-you commented on issue #27008: [SPARK-30353][SQL] Add IsNotNull check in SimplifyBinaryComparison optimization URL: https://github.com/apache/spark/pull/27008#issuecomment-573390408 @cloud-fan thanks for merging. Thanks all !

[GitHub] [spark] cloud-fan commented on a change in pull request #26231: [SPARK-29572][SQL] add v1 read fallback API in DS v2

2020-01-11 Thread GitBox
cloud-fan commented on a change in pull request #26231: [SPARK-29572][SQL] add v1 read fallback API in DS v2 URL: https://github.com/apache/spark/pull/26231#discussion_r365563231 ## File path: sql/core/src/main/java/org/apache/spark/sql/connector/read/V1Scan.java ## @@

[GitHub] [spark] cloud-fan commented on a change in pull request #26231: [SPARK-29572][SQL] add v1 read fallback API in DS v2

2020-01-11 Thread GitBox
cloud-fan commented on a change in pull request #26231: [SPARK-29572][SQL] add v1 read fallback API in DS v2 URL: https://github.com/apache/spark/pull/26231#discussion_r365563206 ## File path: sql/core/src/main/java/org/apache/spark/sql/connector/read/V1Scan.java ## @@

[GitHub] [spark] MaxGekk edited a comment on issue #27166: [SPARK-30482][SQL][CORE][TESTS] Add sub-class of `AppenderSkeleton` reusable in tests

2020-01-11 Thread GitBox
MaxGekk edited a comment on issue #27166: [SPARK-30482][SQL][CORE][TESTS] Add sub-class of `AppenderSkeleton` reusable in tests URL: https://github.com/apache/spark/pull/27166#issuecomment-573389742 The difference between the master and this PR is some tests could put more log event in

[GitHub] [spark] MaxGekk commented on issue #27166: [SPARK-30482][SQL][CORE][TESTS] Add sub-class of `AppenderSkeleton` reusable in tests

2020-01-11 Thread GitBox
MaxGekk commented on issue #27166: [SPARK-30482][SQL][CORE][TESTS] Add sub-class of `AppenderSkeleton` reusable in tests URL: https://github.com/apache/spark/pull/27166#issuecomment-573389742 The difference between the master and this PR is some tests could put more log event in log

[GitHub] [spark] cloud-fan commented on issue #26921: [SPARK-30282][SQL] Integrate V2 commands with UnresolvedV2Relation into new resolution framework

2020-01-11 Thread GitBox
cloud-fan commented on issue #26921: [SPARK-30282][SQL] Integrate V2 commands with UnresolvedV2Relation into new resolution framework URL: https://github.com/apache/spark/pull/26921#issuecomment-573389585 SGTM This is an

[GitHub] [spark] cloud-fan commented on issue #25024: [SPARK-27296][SQL] Allows Aggregator to be registered as a UDF

2020-01-11 Thread GitBox
cloud-fan commented on issue #25024: [SPARK-27296][SQL] Allows Aggregator to be registered as a UDF URL: https://github.com/apache/spark/pull/25024#issuecomment-573389525 thanks, merging to master! This is an automated

[GitHub] [spark] cloud-fan closed pull request #25024: [SPARK-27296][SQL] Allows Aggregator to be registered as a UDF

2020-01-11 Thread GitBox
cloud-fan closed pull request #25024: [SPARK-27296][SQL] Allows Aggregator to be registered as a UDF URL: https://github.com/apache/spark/pull/25024 This is an automated message from the Apache Git Service. To respond to

[GitHub] [spark] cloud-fan commented on issue #27151: [SPARK-26218][SQL][Follow up] Fix the corner case when casting float to Integer.

2020-01-11 Thread GitBox
cloud-fan commented on issue #27151: [SPARK-26218][SQL][Follow up] Fix the corner case when casting float to Integer. URL: https://github.com/apache/spark/pull/27151#issuecomment-573389447 We are talking about SQL semantic not IEEE floating number definition. For pgsql ```

[GitHub] [spark] MaxGekk commented on a change in pull request #27166: [SPARK-30482][SQL][CORE][TESTS] Add sub-class of `AppenderSkeleton` reusable in tests

2020-01-11 Thread GitBox
MaxGekk commented on a change in pull request #27166: [SPARK-30482][SQL][CORE][TESTS] Add sub-class of `AppenderSkeleton` reusable in tests URL: https://github.com/apache/spark/pull/27166#discussion_r365562130 ## File path:

[GitHub] [spark] cloud-fan closed pull request #27008: [SPARK-30353][SQL] Add IsNotNull check in SimplifyBinaryComparison optimization

2020-01-11 Thread GitBox
cloud-fan closed pull request #27008: [SPARK-30353][SQL] Add IsNotNull check in SimplifyBinaryComparison optimization URL: https://github.com/apache/spark/pull/27008 This is an automated message from the Apache Git Service.

[GitHub] [spark] cloud-fan commented on issue #27008: [SPARK-30353][SQL] Add IsNotNull check in SimplifyBinaryComparison optimization

2020-01-11 Thread GitBox
cloud-fan commented on issue #27008: [SPARK-30353][SQL] Add IsNotNull check in SimplifyBinaryComparison optimization URL: https://github.com/apache/spark/pull/27008#issuecomment-573388716 thanks, merging to master! This is

[GitHub] [spark] AmplabJenkins commented on issue #27130: [SPARK-25993][SQL][TESTS] Add test cases for CREATE EXTERNAL TABLE with subdirectories

2020-01-11 Thread GitBox
AmplabJenkins commented on issue #27130: [SPARK-25993][SQL][TESTS] Add test cases for CREATE EXTERNAL TABLE with subdirectories URL: https://github.com/apache/spark/pull/27130#issuecomment-573388646 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #27169: [SPARK-30485][SQL] Remove SQL configs deprecated in Spark 2.1 and 2.3

2020-01-11 Thread GitBox
AmplabJenkins removed a comment on issue #27169: [SPARK-30485][SQL] Remove SQL configs deprecated in Spark 2.1 and 2.3 URL: https://github.com/apache/spark/pull/27169#issuecomment-573388635 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27130: [SPARK-25993][SQL][TESTS] Add test cases for CREATE EXTERNAL TABLE with subdirectories

2020-01-11 Thread GitBox
AmplabJenkins commented on issue #27130: [SPARK-25993][SQL][TESTS] Add test cases for CREATE EXTERNAL TABLE with subdirectories URL: https://github.com/apache/spark/pull/27130#issuecomment-573388643 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27130: [SPARK-25993][SQL][TESTS] Add test cases for CREATE EXTERNAL TABLE with subdirectories

2020-01-11 Thread GitBox
AmplabJenkins removed a comment on issue #27130: [SPARK-25993][SQL][TESTS] Add test cases for CREATE EXTERNAL TABLE with subdirectories URL: https://github.com/apache/spark/pull/27130#issuecomment-573388643 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27169: [SPARK-30485][SQL] Remove SQL configs deprecated in Spark 2.1 and 2.3

2020-01-11 Thread GitBox
AmplabJenkins removed a comment on issue #27169: [SPARK-30485][SQL] Remove SQL configs deprecated in Spark 2.1 and 2.3 URL: https://github.com/apache/spark/pull/27169#issuecomment-573388633 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27130: [SPARK-25993][SQL][TESTS] Add test cases for CREATE EXTERNAL TABLE with subdirectories

2020-01-11 Thread GitBox
AmplabJenkins removed a comment on issue #27130: [SPARK-25993][SQL][TESTS] Add test cases for CREATE EXTERNAL TABLE with subdirectories URL: https://github.com/apache/spark/pull/27130#issuecomment-573388646 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins commented on issue #27169: [SPARK-30485][SQL] Remove SQL configs deprecated in Spark 2.1 and 2.3

2020-01-11 Thread GitBox
AmplabJenkins commented on issue #27169: [SPARK-30485][SQL] Remove SQL configs deprecated in Spark 2.1 and 2.3 URL: https://github.com/apache/spark/pull/27169#issuecomment-573388635 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27169: [SPARK-30485][SQL] Remove SQL configs deprecated in Spark 2.1 and 2.3

2020-01-11 Thread GitBox
AmplabJenkins commented on issue #27169: [SPARK-30485][SQL] Remove SQL configs deprecated in Spark 2.1 and 2.3 URL: https://github.com/apache/spark/pull/27169#issuecomment-573388633 Merged build finished. Test PASSed. This

[GitHub] [spark] MaxGekk commented on issue #27166: [SPARK-30482][SQL][CORE][TESTS] Add sub-class of `AppenderSkeleton` reusable in tests

2020-01-11 Thread GitBox
MaxGekk commented on issue #27166: [SPARK-30482][SQL][CORE][TESTS] Add sub-class of `AppenderSkeleton` reusable in tests URL: https://github.com/apache/spark/pull/27166#issuecomment-573388568 Not sure how it is related to my changes: ```

[GitHub] [spark] SparkQA commented on issue #27130: [SPARK-25993][SQL][TESTS] Add test cases for CREATE EXTERNAL TABLE with subdirectories

2020-01-11 Thread GitBox
SparkQA commented on issue #27130: [SPARK-25993][SQL][TESTS] Add test cases for CREATE EXTERNAL TABLE with subdirectories URL: https://github.com/apache/spark/pull/27130#issuecomment-573388533 **[Test build #116548 has

[GitHub] [spark] SparkQA commented on issue #27169: [SPARK-30485][SQL] Remove SQL configs deprecated in Spark 2.1 and 2.3

2020-01-11 Thread GitBox
SparkQA commented on issue #27169: [SPARK-30485][SQL] Remove SQL configs deprecated in Spark 2.1 and 2.3 URL: https://github.com/apache/spark/pull/27169#issuecomment-573388529 **[Test build #116547 has

[GitHub] [spark] kevinyu98 commented on a change in pull request #27130: [SPARK-25993][SQL][TESTS] Add test cases for CREATE EXTERNAL TABLE with subdirectories

2020-01-11 Thread GitBox
kevinyu98 commented on a change in pull request #27130: [SPARK-25993][SQL][TESTS] Add test cases for CREATE EXTERNAL TABLE with subdirectories URL: https://github.com/apache/spark/pull/27130#discussion_r365561742 ## File path:

[GitHub] [spark] cloud-fan commented on issue #22173: [SPARK-24355] Spark external shuffle server improvement to better handle block fetch requests.

2020-01-11 Thread GitBox
cloud-fan commented on issue #22173: [SPARK-24355] Spark external shuffle server improvement to better handle block fetch requests. URL: https://github.com/apache/spark/pull/22173#issuecomment-573387824 Sounds good to me. We can explore different solutions after 3.0.

[GitHub] [spark] emaynardigs edited a comment on issue #27155: [SPARK-17636][SPARK-25557][SQL] Parquet and ORC predicate pushdown in nested fields

2020-01-11 Thread GitBox
emaynardigs edited a comment on issue #27155: [SPARK-17636][SPARK-25557][SQL] Parquet and ORC predicate pushdown in nested fields URL: https://github.com/apache/spark/pull/27155#issuecomment-573387721 Yes, surely we should close one PR. The other one is inactive, fails tests, and doesn’t

[GitHub] [spark] cloud-fan commented on issue #26973: [SPARK-30323][SQL] Support filters pushdown in CSV datasource

2020-01-11 Thread GitBox
cloud-fan commented on issue #26973: [SPARK-30323][SQL] Support filters pushdown in CSV datasource URL: https://github.com/apache/spark/pull/26973#issuecomment-573387725 How did you fix https://github.com/apache/spark/pull/27112/files#r365539740 ? I took a quick look and not sure what was

[GitHub] [spark] emaynardigs commented on issue #27155: [SPARK-17636][SPARK-25557][SQL] Parquet and ORC predicate pushdown in nested fields

2020-01-11 Thread GitBox
emaynardigs commented on issue #27155: [SPARK-17636][SPARK-25557][SQL] Parquet and ORC predicate pushdown in nested fields URL: https://github.com/apache/spark/pull/27155#issuecomment-573387721 Yes, surely we should close one PR. The other one is inactive, fails, tests, and doesn’t merge

[GitHub] [spark] MaxGekk commented on issue #26973: [SPARK-30323][SQL] Support filters pushdown in CSV datasource

2020-01-11 Thread GitBox
MaxGekk commented on issue #26973: [SPARK-30323][SQL] Support filters pushdown in CSV datasource URL: https://github.com/apache/spark/pull/26973#issuecomment-573387323 @HyukjinKwon @dongjoon-hyun @cloud-fan Could you review this PR, please.

[GitHub] [spark] AmplabJenkins commented on issue #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size

2020-01-11 Thread GitBox
AmplabJenkins commented on issue #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size URL: https://github.com/apache/spark/pull/26434#issuecomment-573386516 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size

2020-01-11 Thread GitBox
AmplabJenkins commented on issue #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size URL: https://github.com/apache/spark/pull/26434#issuecomment-573386514 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins removed a comment on issue #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size

2020-01-11 Thread GitBox
AmplabJenkins removed a comment on issue #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size URL: https://github.com/apache/spark/pull/26434#issuecomment-573386516 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size

2020-01-11 Thread GitBox
AmplabJenkins removed a comment on issue #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size URL: https://github.com/apache/spark/pull/26434#issuecomment-573386514 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA commented on issue #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size

2020-01-11 Thread GitBox
SparkQA commented on issue #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size URL: https://github.com/apache/spark/pull/26434#issuecomment-573386433 **[Test build #116546 has

[GitHub] [spark] cloud-fan commented on issue #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size

2020-01-11 Thread GitBox
cloud-fan commented on issue #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size URL: https://github.com/apache/spark/pull/26434#issuecomment-573386247 retest this please This is an automated message

[GitHub] [spark] JkSelf opened a new pull request #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size

2020-01-11 Thread GitBox
JkSelf opened a new pull request #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size URL: https://github.com/apache/spark/pull/26434 ### What changes were proposed in this pull request? This PR implement a rule `OptimizeSkewedPartitions` to optimize the

[GitHub] [spark] cloud-fan closed pull request #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size

2020-01-11 Thread GitBox
cloud-fan closed pull request #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size URL: https://github.com/apache/spark/pull/26434 This is an automated message from the Apache Git Service. To respond to

[GitHub] [spark] AmplabJenkins removed a comment on issue #27041: [SPARK-25061][SQL] Precedence for ThriftServer hiveconf commandline parameter

2020-01-11 Thread GitBox
AmplabJenkins removed a comment on issue #27041: [SPARK-25061][SQL] Precedence for ThriftServer hiveconf commandline parameter URL: https://github.com/apache/spark/pull/27041#issuecomment-573385211 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #27041: [SPARK-25061][SQL] Precedence for ThriftServer hiveconf commandline parameter

2020-01-11 Thread GitBox
AmplabJenkins removed a comment on issue #27041: [SPARK-25061][SQL] Precedence for ThriftServer hiveconf commandline parameter URL: https://github.com/apache/spark/pull/27041#issuecomment-573385210 Merged build finished. Test FAILed.

[GitHub] [spark] SparkQA removed a comment on issue #27041: [SPARK-25061][SQL] Precedence for ThriftServer hiveconf commandline parameter

2020-01-11 Thread GitBox
SparkQA removed a comment on issue #27041: [SPARK-25061][SQL] Precedence for ThriftServer hiveconf commandline parameter URL: https://github.com/apache/spark/pull/27041#issuecomment-573377825 **[Test build #116541 has

[GitHub] [spark] AmplabJenkins commented on issue #27041: [SPARK-25061][SQL] Precedence for ThriftServer hiveconf commandline parameter

2020-01-11 Thread GitBox
AmplabJenkins commented on issue #27041: [SPARK-25061][SQL] Precedence for ThriftServer hiveconf commandline parameter URL: https://github.com/apache/spark/pull/27041#issuecomment-573385211 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27041: [SPARK-25061][SQL] Precedence for ThriftServer hiveconf commandline parameter

2020-01-11 Thread GitBox
AmplabJenkins commented on issue #27041: [SPARK-25061][SQL] Precedence for ThriftServer hiveconf commandline parameter URL: https://github.com/apache/spark/pull/27041#issuecomment-573385210 Merged build finished. Test FAILed.

[GitHub] [spark] SparkQA commented on issue #27041: [SPARK-25061][SQL] Precedence for ThriftServer hiveconf commandline parameter

2020-01-11 Thread GitBox
SparkQA commented on issue #27041: [SPARK-25061][SQL] Precedence for ThriftServer hiveconf commandline parameter URL: https://github.com/apache/spark/pull/27041#issuecomment-573385177 **[Test build #116541 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #27164: [SPARK-30479][SQL] Apply compaction of event log to SQL events

2020-01-11 Thread GitBox
AmplabJenkins removed a comment on issue #27164: [SPARK-30479][SQL] Apply compaction of event log to SQL events URL: https://github.com/apache/spark/pull/27164#issuecomment-573384519 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #27164: [SPARK-30479][SQL] Apply compaction of event log to SQL events

2020-01-11 Thread GitBox
AmplabJenkins removed a comment on issue #27164: [SPARK-30479][SQL] Apply compaction of event log to SQL events URL: https://github.com/apache/spark/pull/27164#issuecomment-573384517 Merged build finished. Test FAILed. This

[GitHub] [spark] AmplabJenkins commented on issue #27164: [SPARK-30479][SQL] Apply compaction of event log to SQL events

2020-01-11 Thread GitBox
AmplabJenkins commented on issue #27164: [SPARK-30479][SQL] Apply compaction of event log to SQL events URL: https://github.com/apache/spark/pull/27164#issuecomment-573384517 Merged build finished. Test FAILed. This is an

[GitHub] [spark] SparkQA removed a comment on issue #27164: [SPARK-30479][SQL] Apply compaction of event log to SQL events

2020-01-11 Thread GitBox
SparkQA removed a comment on issue #27164: [SPARK-30479][SQL] Apply compaction of event log to SQL events URL: https://github.com/apache/spark/pull/27164#issuecomment-573379391 **[Test build #116543 has

[GitHub] [spark] AmplabJenkins commented on issue #27164: [SPARK-30479][SQL] Apply compaction of event log to SQL events

2020-01-11 Thread GitBox
AmplabJenkins commented on issue #27164: [SPARK-30479][SQL] Apply compaction of event log to SQL events URL: https://github.com/apache/spark/pull/27164#issuecomment-573384519 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #27164: [SPARK-30479][SQL] Apply compaction of event log to SQL events

2020-01-11 Thread GitBox
AmplabJenkins removed a comment on issue #27164: [SPARK-30479][SQL] Apply compaction of event log to SQL events URL: https://github.com/apache/spark/pull/27164#issuecomment-573379469 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #27164: [SPARK-30479][SQL] Apply compaction of event log to SQL events

2020-01-11 Thread GitBox
SparkQA commented on issue #27164: [SPARK-30479][SQL] Apply compaction of event log to SQL events URL: https://github.com/apache/spark/pull/27164#issuecomment-573384476 **[Test build #116543 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #27160: [SPARK-30478][CORE][DOCS] Fix Memory Package documentation

2020-01-11 Thread GitBox
AmplabJenkins removed a comment on issue #27160: [SPARK-30478][CORE][DOCS] Fix Memory Package documentation URL: https://github.com/apache/spark/pull/27160#issuecomment-573384282 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27160: [SPARK-30478][CORE][DOCS] Fix Memory Package documentation

2020-01-11 Thread GitBox
AmplabJenkins commented on issue #27160: [SPARK-30478][CORE][DOCS] Fix Memory Package documentation URL: https://github.com/apache/spark/pull/27160#issuecomment-573384282 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #27166: [SPARK-30482][SQL][CORE][TESTS] Add sub-class of `AppenderSkeleton` reusable in tests

2020-01-11 Thread GitBox
AmplabJenkins removed a comment on issue #27166: [SPARK-30482][SQL][CORE][TESTS] Add sub-class of `AppenderSkeleton` reusable in tests URL: https://github.com/apache/spark/pull/27166#issuecomment-573384217 Test FAILed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins removed a comment on issue #27160: [SPARK-30478][CORE][DOCS] Fix Memory Package documentation

2020-01-11 Thread GitBox
AmplabJenkins removed a comment on issue #27160: [SPARK-30478][CORE][DOCS] Fix Memory Package documentation URL: https://github.com/apache/spark/pull/27160#issuecomment-573384279 Merged build finished. Test FAILed. This is

[GitHub] [spark] AmplabJenkins commented on issue #27160: [SPARK-30478][CORE][DOCS] Fix Memory Package documentation

2020-01-11 Thread GitBox
AmplabJenkins commented on issue #27160: [SPARK-30478][CORE][DOCS] Fix Memory Package documentation URL: https://github.com/apache/spark/pull/27160#issuecomment-573384279 Merged build finished. Test FAILed. This is an

[GitHub] [spark] AmplabJenkins removed a comment on issue #27166: [SPARK-30482][SQL][CORE][TESTS] Add sub-class of `AppenderSkeleton` reusable in tests

2020-01-11 Thread GitBox
AmplabJenkins removed a comment on issue #27166: [SPARK-30482][SQL][CORE][TESTS] Add sub-class of `AppenderSkeleton` reusable in tests URL: https://github.com/apache/spark/pull/27166#issuecomment-573384213 Merged build finished. Test FAILed.

[GitHub] [spark] SparkQA removed a comment on issue #27160: [SPARK-30478][CORE][DOCS] Fix Memory Package documentation

2020-01-11 Thread GitBox
SparkQA removed a comment on issue #27160: [SPARK-30478][CORE][DOCS] Fix Memory Package documentation URL: https://github.com/apache/spark/pull/27160#issuecomment-573379392 **[Test build #116544 has

[GitHub] [spark] SparkQA commented on issue #27160: [SPARK-30478][CORE][DOCS] Fix Memory Package documentation

2020-01-11 Thread GitBox
SparkQA commented on issue #27160: [SPARK-30478][CORE][DOCS] Fix Memory Package documentation URL: https://github.com/apache/spark/pull/27160#issuecomment-573384221 **[Test build #116544 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/116544/testReport)**

[GitHub] [spark] SparkQA removed a comment on issue #27166: [SPARK-30482][SQL][CORE][TESTS] Add sub-class of `AppenderSkeleton` reusable in tests

2020-01-11 Thread GitBox
SparkQA removed a comment on issue #27166: [SPARK-30482][SQL][CORE][TESTS] Add sub-class of `AppenderSkeleton` reusable in tests URL: https://github.com/apache/spark/pull/27166#issuecomment-573379393 **[Test build #116542 has

[GitHub] [spark] AmplabJenkins commented on issue #27166: [SPARK-30482][SQL][CORE][TESTS] Add sub-class of `AppenderSkeleton` reusable in tests

2020-01-11 Thread GitBox
AmplabJenkins commented on issue #27166: [SPARK-30482][SQL][CORE][TESTS] Add sub-class of `AppenderSkeleton` reusable in tests URL: https://github.com/apache/spark/pull/27166#issuecomment-573384217 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27166: [SPARK-30482][SQL][CORE][TESTS] Add sub-class of `AppenderSkeleton` reusable in tests

2020-01-11 Thread GitBox
AmplabJenkins commented on issue #27166: [SPARK-30482][SQL][CORE][TESTS] Add sub-class of `AppenderSkeleton` reusable in tests URL: https://github.com/apache/spark/pull/27166#issuecomment-573384213 Merged build finished. Test FAILed.

[GitHub] [spark] SparkQA commented on issue #27166: [SPARK-30482][SQL][CORE][TESTS] Add sub-class of `AppenderSkeleton` reusable in tests

2020-01-11 Thread GitBox
SparkQA commented on issue #27166: [SPARK-30482][SQL][CORE][TESTS] Add sub-class of `AppenderSkeleton` reusable in tests URL: https://github.com/apache/spark/pull/27166#issuecomment-573384153 **[Test build #116542 has

[GitHub] [spark] AmplabJenkins commented on issue #27077: [SPARK-30408][SQL] Should not remove orderBy in sortBy clause in Optimizer

2020-01-11 Thread GitBox
AmplabJenkins commented on issue #27077: [SPARK-30408][SQL] Should not remove orderBy in sortBy clause in Optimizer URL: https://github.com/apache/spark/pull/27077#issuecomment-573381207 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27077: [SPARK-30408][SQL] Should not remove orderBy in sortBy clause in Optimizer

2020-01-11 Thread GitBox
AmplabJenkins removed a comment on issue #27077: [SPARK-30408][SQL] Should not remove orderBy in sortBy clause in Optimizer URL: https://github.com/apache/spark/pull/27077#issuecomment-573381208 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #27077: [SPARK-30408][SQL] Should not remove orderBy in sortBy clause in Optimizer

2020-01-11 Thread GitBox
AmplabJenkins removed a comment on issue #27077: [SPARK-30408][SQL] Should not remove orderBy in sortBy clause in Optimizer URL: https://github.com/apache/spark/pull/27077#issuecomment-573381207 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #27077: [SPARK-30408][SQL] Should not remove orderBy in sortBy clause in Optimizer

2020-01-11 Thread GitBox
AmplabJenkins commented on issue #27077: [SPARK-30408][SQL] Should not remove orderBy in sortBy clause in Optimizer URL: https://github.com/apache/spark/pull/27077#issuecomment-573381208 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #27077: [SPARK-30408][SQL] Should not remove orderBy in sortBy clause in Optimizer

2020-01-11 Thread GitBox
SparkQA commented on issue #27077: [SPARK-30408][SQL] Should not remove orderBy in sortBy clause in Optimizer URL: https://github.com/apache/spark/pull/27077#issuecomment-573381164 **[Test build #116545 has

[GitHub] [spark] dongjoon-hyun commented on issue #27077: [SPARK-30408][SQL] Should not remove orderBy in sortBy clause in Optimizer

2020-01-11 Thread GitBox
dongjoon-hyun commented on issue #27077: [SPARK-30408][SQL] Should not remove orderBy in sortBy clause in Optimizer URL: https://github.com/apache/spark/pull/27077#issuecomment-573381092 cc @gatorsmile and @cloud-fan This

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #27077: [SPARK-30408][SQL] Should not remove orderBy in sortBy clause in Optimizer

2020-01-11 Thread GitBox
dongjoon-hyun commented on a change in pull request #27077: [SPARK-30408][SQL] Should not remove orderBy in sortBy clause in Optimizer URL: https://github.com/apache/spark/pull/27077#discussion_r365556941 ## File path:

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #27077: [SPARK-30408][SQL] Should not remove orderBy in sortBy clause in Optimizer

2020-01-11 Thread GitBox
dongjoon-hyun commented on a change in pull request #27077: [SPARK-30408][SQL] Should not remove orderBy in sortBy clause in Optimizer URL: https://github.com/apache/spark/pull/27077#discussion_r365556941 ## File path:

[GitHub] [spark] dongjoon-hyun commented on issue #27077: [SPARK-30408][SQL] Should not remove orderBy in sortBy clause in Optimizer

2020-01-11 Thread GitBox
dongjoon-hyun commented on issue #27077: [SPARK-30408][SQL] Should not remove orderBy in sortBy clause in Optimizer URL: https://github.com/apache/spark/pull/27077#issuecomment-573380891 Retest this please. This is an

[GitHub] [spark] sddyljsx commented on issue #27135: [SPARK-30458][WEBUI] Fix Wrong Executor Computing Time in Time Line of Stage Page

2020-01-11 Thread GitBox
sddyljsx commented on issue #27135: [SPARK-30458][WEBUI] Fix Wrong Executor Computing Time in Time Line of Stage Page URL: https://github.com/apache/spark/pull/27135#issuecomment-573380355 Thanks for review! @srowen @dongjoon-hyun @lw-lin @HyukjinKwon @gengliangwang

[GitHub] [spark] sddyljsx commented on issue #27160: [SPARK-30478][CORE][DOCS] Fix Memory Package documentation

2020-01-11 Thread GitBox
sddyljsx commented on issue #27160: [SPARK-30478][CORE][DOCS] Fix Memory Package documentation URL: https://github.com/apache/spark/pull/27160#issuecomment-573380206 Thanks! @srowen @dongjoon-hyun This is an automated

[GitHub] [spark] dongjoon-hyun closed pull request #27135: [SPARK-30458][WEBUI] Fix Wrong Executor Computing Time in Time Line of Stage Page

2020-01-11 Thread GitBox
dongjoon-hyun closed pull request #27135: [SPARK-30458][WEBUI] Fix Wrong Executor Computing Time in Time Line of Stage Page URL: https://github.com/apache/spark/pull/27135 This is an automated message from the Apache Git

[GitHub] [spark] AmplabJenkins removed a comment on issue #27160: [SPARK-30478][CORE][DOCS] Fix Memory Package documentation

2020-01-11 Thread GitBox
AmplabJenkins removed a comment on issue #27160: [SPARK-30478][CORE][DOCS] Fix Memory Package documentation URL: https://github.com/apache/spark/pull/27160#issuecomment-573379465 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #27164: [SPARK-30479][SQL] Apply compaction of event log to SQL events

2020-01-11 Thread GitBox
AmplabJenkins removed a comment on issue #27164: [SPARK-30479][SQL] Apply compaction of event log to SQL events URL: https://github.com/apache/spark/pull/27164#issuecomment-573379467 Merged build finished. Test FAILed. This

[GitHub] [spark] AmplabJenkins commented on issue #27164: [SPARK-30479][SQL] Apply compaction of event log to SQL events

2020-01-11 Thread GitBox
AmplabJenkins commented on issue #27164: [SPARK-30479][SQL] Apply compaction of event log to SQL events URL: https://github.com/apache/spark/pull/27164#issuecomment-573379469 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #27160: [SPARK-30478][CORE][DOCS] Fix Memory Package documentation

2020-01-11 Thread GitBox
AmplabJenkins removed a comment on issue #27160: [SPARK-30478][CORE][DOCS] Fix Memory Package documentation URL: https://github.com/apache/spark/pull/27160#issuecomment-573379464 Merged build finished. Test PASSed. This is

[GitHub] [spark] dongjoon-hyun closed pull request #27160: [SPARK-30478][CORE][DOCS] Fix Memory Package documentation

2020-01-11 Thread GitBox
dongjoon-hyun closed pull request #27160: [SPARK-30478][CORE][DOCS] Fix Memory Package documentation URL: https://github.com/apache/spark/pull/27160 This is an automated message from the Apache Git Service. To respond to

[GitHub] [spark] AmplabJenkins commented on issue #27164: [SPARK-30479][SQL] Apply compaction of event log to SQL events

2020-01-11 Thread GitBox
AmplabJenkins commented on issue #27164: [SPARK-30479][SQL] Apply compaction of event log to SQL events URL: https://github.com/apache/spark/pull/27164#issuecomment-573379467 Merged build finished. Test FAILed. This is an

[GitHub] [spark] AmplabJenkins commented on issue #27160: [SPARK-30478][CORE][DOCS] Fix Memory Package documentation

2020-01-11 Thread GitBox
AmplabJenkins commented on issue #27160: [SPARK-30478][CORE][DOCS] Fix Memory Package documentation URL: https://github.com/apache/spark/pull/27160#issuecomment-573379464 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins commented on issue #27160: [SPARK-30478][CORE][DOCS] Fix Memory Package documentation

2020-01-11 Thread GitBox
AmplabJenkins commented on issue #27160: [SPARK-30478][CORE][DOCS] Fix Memory Package documentation URL: https://github.com/apache/spark/pull/27160#issuecomment-573379465 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #27166: [SPARK-30482][SQL][CORE][TESTS] Add sub-class of `AppenderSkeleton` reusable in tests

2020-01-11 Thread GitBox
SparkQA commented on issue #27166: [SPARK-30482][SQL][CORE][TESTS] Add sub-class of `AppenderSkeleton` reusable in tests URL: https://github.com/apache/spark/pull/27166#issuecomment-573379393 **[Test build #116542 has

[GitHub] [spark] SparkQA commented on issue #27164: [SPARK-30479][SQL] Apply compaction of event log to SQL events

2020-01-11 Thread GitBox
SparkQA commented on issue #27164: [SPARK-30479][SQL] Apply compaction of event log to SQL events URL: https://github.com/apache/spark/pull/27164#issuecomment-573379391 **[Test build #116543 has

[GitHub] [spark] SparkQA commented on issue #27160: [SPARK-30478][CORE][DOCS] Fix Memory Package documentation

2020-01-11 Thread GitBox
SparkQA commented on issue #27160: [SPARK-30478][CORE][DOCS] Fix Memory Package documentation URL: https://github.com/apache/spark/pull/27160#issuecomment-573379392 **[Test build #116544 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/116544/testReport)**

[GitHub] [spark] dongjoon-hyun commented on issue #27160: [SPARK-30478][Core]Update the Doc of Memory Package

2020-01-11 Thread GitBox
dongjoon-hyun commented on issue #27160: [SPARK-30478][Core]Update the Doc of Memory Package URL: https://github.com/apache/spark/pull/27160#issuecomment-573379133 Retest this please. This is an automated message from the

[GitHub] [spark] AmplabJenkins removed a comment on issue #27166: [SPARK-30482][SQL][CORE][TESTS] Add sub-class of `AppenderSkeleton` reusable in tests

2020-01-11 Thread GitBox
AmplabJenkins removed a comment on issue #27166: [SPARK-30482][SQL][CORE][TESTS] Add sub-class of `AppenderSkeleton` reusable in tests URL: https://github.com/apache/spark/pull/27166#issuecomment-573379079 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins commented on issue #27166: [SPARK-30482][SQL][CORE][TESTS] Add sub-class of `AppenderSkeleton` reusable in tests

2020-01-11 Thread GitBox
AmplabJenkins commented on issue #27166: [SPARK-30482][SQL][CORE][TESTS] Add sub-class of `AppenderSkeleton` reusable in tests URL: https://github.com/apache/spark/pull/27166#issuecomment-573379079 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] dongjoon-hyun commented on issue #27164: [SPARK-30479][SQL] Apply compaction of event log to SQL events

2020-01-11 Thread GitBox
dongjoon-hyun commented on issue #27164: [SPARK-30479][SQL] Apply compaction of event log to SQL events URL: https://github.com/apache/spark/pull/27164#issuecomment-573379086 Retest this please. This is an automated message

[GitHub] [spark] AmplabJenkins commented on issue #27166: [SPARK-30482][SQL][CORE][TESTS] Add sub-class of `AppenderSkeleton` reusable in tests

2020-01-11 Thread GitBox
AmplabJenkins commented on issue #27166: [SPARK-30482][SQL][CORE][TESTS] Add sub-class of `AppenderSkeleton` reusable in tests URL: https://github.com/apache/spark/pull/27166#issuecomment-573379077 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27166: [SPARK-30482][SQL][CORE][TESTS] Add sub-class of `AppenderSkeleton` reusable in tests

2020-01-11 Thread GitBox
AmplabJenkins removed a comment on issue #27166: [SPARK-30482][SQL][CORE][TESTS] Add sub-class of `AppenderSkeleton` reusable in tests URL: https://github.com/apache/spark/pull/27166#issuecomment-573379077 Merged build finished. Test PASSed.

[GitHub] [spark] dongjoon-hyun commented on issue #27166: [SPARK-30482][SQL][CORE][TESTS] Add sub-class of `AppenderSkeleton` reusable in tests

2020-01-11 Thread GitBox
dongjoon-hyun commented on issue #27166: [SPARK-30482][SQL][CORE][TESTS] Add sub-class of `AppenderSkeleton` reusable in tests URL: https://github.com/apache/spark/pull/27166#issuecomment-573379013 Retest this please. This

[GitHub] [spark] dongjoon-hyun commented on issue #27155: [SPARK-17636][SPARK-25557][SQL] Parquet and ORC predicate pushdown in nested fields

2020-01-11 Thread GitBox
dongjoon-hyun commented on issue #27155: [SPARK-17636][SPARK-25557][SQL] Parquet and ORC predicate pushdown in nested fields URL: https://github.com/apache/spark/pull/27155#issuecomment-573378599 I'll leave this PR to @dbtsai .

[GitHub] [spark] dongjoon-hyun commented on issue #27155: [SPARK-17636][SPARK-25557][SQL] Parquet and ORC predicate pushdown in nested fields

2020-01-11 Thread GitBox
dongjoon-hyun commented on issue #27155: [SPARK-17636][SPARK-25557][SQL] Parquet and ORC predicate pushdown in nested fields URL: https://github.com/apache/spark/pull/27155#issuecomment-573378544 @emaynardigs . In this case, usually, we close the second PR (yours) because the original is

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #27041: [SPARK-25061][SQL] Precedence for ThriftServer hiveconf commandline parameter

2020-01-11 Thread GitBox
dongjoon-hyun commented on a change in pull request #27041: [SPARK-25061][SQL] Precedence for ThriftServer hiveconf commandline parameter URL: https://github.com/apache/spark/pull/27041#discussion_r36097 ## File path:

[GitHub] [spark] AmplabJenkins removed a comment on issue #27041: [SPARK-25061][SQL] Precedence for ThriftServer hiveconf commandline parameter

2020-01-11 Thread GitBox
AmplabJenkins removed a comment on issue #27041: [SPARK-25061][SQL] Precedence for ThriftServer hiveconf commandline parameter URL: https://github.com/apache/spark/pull/27041#issuecomment-573377898 Merged build finished. Test PASSed.

  1   2   3   4   >