[GitHub] [spark] AmplabJenkins removed a comment on issue #22721: [SPARK-19784][SPARK-25403][SQL] Refresh the table even table stats is empty

2020-01-05 Thread GitBox
AmplabJenkins removed a comment on issue #22721: [SPARK-19784][SPARK-25403][SQL] Refresh the table even table stats is empty URL: https://github.com/apache/spark/pull/22721#issuecomment-571039852 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #22721: [SPARK-19784][SPARK-25403][SQL] Refresh the table even table stats is empty

2020-01-05 Thread GitBox
AmplabJenkins removed a comment on issue #22721: [SPARK-19784][SPARK-25403][SQL] Refresh the table even table stats is empty URL: https://github.com/apache/spark/pull/22721#issuecomment-571039842 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #22721: [SPARK-19784][SPARK-25403][SQL] Refresh the table even table stats is empty

2020-01-05 Thread GitBox
AmplabJenkins commented on issue #22721: [SPARK-19784][SPARK-25403][SQL] Refresh the table even table stats is empty URL: https://github.com/apache/spark/pull/22721#issuecomment-571039852 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #22721: [SPARK-19784][SPARK-25403][SQL] Refresh the table even table stats is empty

2020-01-05 Thread GitBox
AmplabJenkins commented on issue #22721: [SPARK-19784][SPARK-25403][SQL] Refresh the table even table stats is empty URL: https://github.com/apache/spark/pull/22721#issuecomment-571039842 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA commented on issue #22721: [SPARK-19784][SPARK-25403][SQL] Refresh the table even table stats is empty

2020-01-05 Thread GitBox
SparkQA commented on issue #22721: [SPARK-19784][SPARK-25403][SQL] Refresh the table even table stats is empty URL: https://github.com/apache/spark/pull/22721#issuecomment-571039378 **[Test build #116140 has

[GitHub] [spark] MaxGekk commented on issue #22501: [SPARK-25492][TEST] Refactor WideSchemaBenchmark to use main method

2020-01-05 Thread GitBox
MaxGekk commented on issue #22501: [SPARK-25492][TEST] Refactor WideSchemaBenchmark to use main method URL: https://github.com/apache/spark/pull/22501#issuecomment-571038776 I have rechecked the benchmark on the recent master - it is still failing with OOM. I opened the JIRA ticket:

[GitHub] [spark] AmplabJenkins removed a comment on issue #27078: [SPARK-30409][SQL][TESTS] Use `NoOp` datasource in SQL benchmarks

2020-01-05 Thread GitBox
AmplabJenkins removed a comment on issue #27078: [SPARK-30409][SQL][TESTS] Use `NoOp` datasource in SQL benchmarks URL: https://github.com/apache/spark/pull/27078#issuecomment-571037655 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #27078: [SPARK-30409][SQL][TESTS] Use `NoOp` datasource in SQL benchmarks

2020-01-05 Thread GitBox
AmplabJenkins removed a comment on issue #27078: [SPARK-30409][SQL][TESTS] Use `NoOp` datasource in SQL benchmarks URL: https://github.com/apache/spark/pull/27078#issuecomment-571037647 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #27078: [SPARK-30409][SQL][TESTS] Use `NoOp` datasource in SQL benchmarks

2020-01-05 Thread GitBox
AmplabJenkins commented on issue #27078: [SPARK-30409][SQL][TESTS] Use `NoOp` datasource in SQL benchmarks URL: https://github.com/apache/spark/pull/27078#issuecomment-571037647 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins commented on issue #27078: [SPARK-30409][SQL][TESTS] Use `NoOp` datasource in SQL benchmarks

2020-01-05 Thread GitBox
AmplabJenkins commented on issue #27078: [SPARK-30409][SQL][TESTS] Use `NoOp` datasource in SQL benchmarks URL: https://github.com/apache/spark/pull/27078#issuecomment-571037655 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #26850: [SPARK-30215][SQL] Remove PrunedInMemoryFileIndex and merge its functionality into InMemoryFileIndex

2020-01-05 Thread GitBox
SparkQA commented on issue #26850: [SPARK-30215][SQL] Remove PrunedInMemoryFileIndex and merge its functionality into InMemoryFileIndex URL: https://github.com/apache/spark/pull/26850#issuecomment-571037313 **[Test build #116139 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #22721: [SPARK-19784][SPARK-25403][SQL] Refresh the table even table stats is empty

2020-01-05 Thread GitBox
AmplabJenkins removed a comment on issue #22721: [SPARK-19784][SPARK-25403][SQL] Refresh the table even table stats is empty URL: https://github.com/apache/spark/pull/22721#issuecomment-571036755 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #27078: [SPARK-30409][SQL][TESTS] Use `NoOp` datasource in SQL benchmarks

2020-01-05 Thread GitBox
SparkQA commented on issue #27078: [SPARK-30409][SQL][TESTS] Use `NoOp` datasource in SQL benchmarks URL: https://github.com/apache/spark/pull/27078#issuecomment-571037270 **[Test build #116138 has

[GitHub] [spark] AmplabJenkins commented on issue #22721: [SPARK-19784][SPARK-25403][SQL] Refresh the table even table stats is empty

2020-01-05 Thread GitBox
AmplabJenkins commented on issue #22721: [SPARK-19784][SPARK-25403][SQL] Refresh the table even table stats is empty URL: https://github.com/apache/spark/pull/22721#issuecomment-571036751 Build finished. Test FAILed. This is

[GitHub] [spark] SparkQA removed a comment on issue #22721: [SPARK-19784][SPARK-25403][SQL] Refresh the table even table stats is empty

2020-01-05 Thread GitBox
SparkQA removed a comment on issue #22721: [SPARK-19784][SPARK-25403][SQL] Refresh the table even table stats is empty URL: https://github.com/apache/spark/pull/22721#issuecomment-571033375 **[Test build #116137 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #22721: [SPARK-19784][SPARK-25403][SQL] Refresh the table even table stats is empty

2020-01-05 Thread GitBox
AmplabJenkins removed a comment on issue #22721: [SPARK-19784][SPARK-25403][SQL] Refresh the table even table stats is empty URL: https://github.com/apache/spark/pull/22721#issuecomment-571036751 Build finished. Test FAILed.

[GitHub] [spark] AmplabJenkins commented on issue #22721: [SPARK-19784][SPARK-25403][SQL] Refresh the table even table stats is empty

2020-01-05 Thread GitBox
AmplabJenkins commented on issue #22721: [SPARK-19784][SPARK-25403][SQL] Refresh the table even table stats is empty URL: https://github.com/apache/spark/pull/22721#issuecomment-571036755 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #22721: [SPARK-19784][SPARK-25403][SQL] Refresh the table even table stats is empty

2020-01-05 Thread GitBox
SparkQA commented on issue #22721: [SPARK-19784][SPARK-25403][SQL] Refresh the table even table stats is empty URL: https://github.com/apache/spark/pull/22721#issuecomment-571036742 **[Test build #116137 has

[GitHub] [spark] turboFei edited a comment on issue #27100: [SPARK-29037][CORE][SQL] Fix the issue that spark gives duplicate result and support concurrent file source write operations write to differ

2020-01-05 Thread GitBox
turboFei edited a comment on issue #27100: [SPARK-29037][CORE][SQL] Fix the issue that spark gives duplicate result and support concurrent file source write operations write to different partitions in the same table. URL: https://github.com/apache/spark/pull/27100#issuecomment-571034510

[GitHub] [spark] AmplabJenkins removed a comment on issue #26850: [SPARK-30215][SQL] Remove PrunedInMemoryFileIndex and merge its functionality into InMemoryFileIndex

2020-01-05 Thread GitBox
AmplabJenkins removed a comment on issue #26850: [SPARK-30215][SQL] Remove PrunedInMemoryFileIndex and merge its functionality into InMemoryFileIndex URL: https://github.com/apache/spark/pull/26850#issuecomment-571035654 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #26850: [SPARK-30215][SQL] Remove PrunedInMemoryFileIndex and merge its functionality into InMemoryFileIndex

2020-01-05 Thread GitBox
AmplabJenkins removed a comment on issue #26850: [SPARK-30215][SQL] Remove PrunedInMemoryFileIndex and merge its functionality into InMemoryFileIndex URL: https://github.com/apache/spark/pull/26850#issuecomment-571035656 Test PASSed. Refer to this link for build results (access rights

[GitHub] [spark] fuwhu commented on a change in pull request #26850: [SPARK-30215][SQL] Remove PrunedInMemoryFileIndex and merge its functionality into InMemoryFileIndex

2020-01-05 Thread GitBox
fuwhu commented on a change in pull request #26850: [SPARK-30215][SQL] Remove PrunedInMemoryFileIndex and merge its functionality into InMemoryFileIndex URL: https://github.com/apache/spark/pull/26850#discussion_r363184004 ## File path:

[GitHub] [spark] AmplabJenkins commented on issue #26850: [SPARK-30215][SQL] Remove PrunedInMemoryFileIndex and merge its functionality into InMemoryFileIndex

2020-01-05 Thread GitBox
AmplabJenkins commented on issue #26850: [SPARK-30215][SQL] Remove PrunedInMemoryFileIndex and merge its functionality into InMemoryFileIndex URL: https://github.com/apache/spark/pull/26850#issuecomment-571035656 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] AmplabJenkins commented on issue #26850: [SPARK-30215][SQL] Remove PrunedInMemoryFileIndex and merge its functionality into InMemoryFileIndex

2020-01-05 Thread GitBox
AmplabJenkins commented on issue #26850: [SPARK-30215][SQL] Remove PrunedInMemoryFileIndex and merge its functionality into InMemoryFileIndex URL: https://github.com/apache/spark/pull/26850#issuecomment-571035654 Merged build finished. Test PASSed.

[GitHub] [spark] turboFei commented on issue #27100: [SPARK-29037][CORE][SQL] Fix the issue that spark gives duplicate result and support concurrent file source write operations write to different par

2020-01-05 Thread GitBox
turboFei commented on issue #27100: [SPARK-29037][CORE][SQL] Fix the issue that spark gives duplicate result and support concurrent file source write operations write to different partitions in the same table. URL: https://github.com/apache/spark/pull/27100#issuecomment-571034510 We

[GitHub] [spark] stczwd commented on issue #26946: [SPARK-30036][SQL] Fix: REPARTITION hint does not work with order by

2020-01-05 Thread GitBox
stczwd commented on issue #26946: [SPARK-30036][SQL] Fix: REPARTITION hint does not work with order by URL: https://github.com/apache/spark/pull/26946#issuecomment-571034381 > Yes it is. But it is similar with outer join. `df.join(df.repartition(10), Seq("id"), "left")` result the 200

[GitHub] [spark] AmplabJenkins removed a comment on issue #26956: [SPARK-30312][SQL] Preserve path permission and acl when truncate table

2020-01-05 Thread GitBox
AmplabJenkins removed a comment on issue #26956: [SPARK-30312][SQL] Preserve path permission and acl when truncate table URL: https://github.com/apache/spark/pull/26956#issuecomment-571033734 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] cloud-fan commented on a change in pull request #27090: [SPARK-27545][SQL] Temporary view is not removed while uncaching the table

2020-01-05 Thread GitBox
cloud-fan commented on a change in pull request #27090: [SPARK-27545][SQL] Temporary view is not removed while uncaching the table URL: https://github.com/apache/spark/pull/27090#discussion_r363182626 ## File path: docs/sql-ref-syntax-aux-cache-uncache-table.md ## @@

[GitHub] [spark] AmplabJenkins removed a comment on issue #26956: [SPARK-30312][SQL] Preserve path permission and acl when truncate table

2020-01-05 Thread GitBox
AmplabJenkins removed a comment on issue #26956: [SPARK-30312][SQL] Preserve path permission and acl when truncate table URL: https://github.com/apache/spark/pull/26956#issuecomment-571033729 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #26956: [SPARK-30312][SQL] Preserve path permission and acl when truncate table

2020-01-05 Thread GitBox
AmplabJenkins commented on issue #26956: [SPARK-30312][SQL] Preserve path permission and acl when truncate table URL: https://github.com/apache/spark/pull/26956#issuecomment-571033734 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] turboFei closed pull request #25863: [SPARK-28945][SPARK-29037][CORE][SQL] Fix the issue that spark gives duplicate result and support concurrent file source write operations write to

2020-01-05 Thread GitBox
turboFei closed pull request #25863: [SPARK-28945][SPARK-29037][CORE][SQL] Fix the issue that spark gives duplicate result and support concurrent file source write operations write to different partitions in the same table. URL: https://github.com/apache/spark/pull/25863

[GitHub] [spark] AmplabJenkins commented on issue #26956: [SPARK-30312][SQL] Preserve path permission and acl when truncate table

2020-01-05 Thread GitBox
AmplabJenkins commented on issue #26956: [SPARK-30312][SQL] Preserve path permission and acl when truncate table URL: https://github.com/apache/spark/pull/26956#issuecomment-571033729 Merged build finished. Test PASSed. This

[GitHub] [spark] cloud-fan commented on a change in pull request #27090: [SPARK-27545][SQL] Temporary view is not removed while uncaching the table

2020-01-05 Thread GitBox
cloud-fan commented on a change in pull request #27090: [SPARK-27545][SQL] Temporary view is not removed while uncaching the table URL: https://github.com/apache/spark/pull/27090#discussion_r363182502 ## File path: docs/sql-ref-syntax-aux-cache-uncache-table.md ## @@

[GitHub] [spark] AmplabJenkins commented on issue #27100: [SPARK-29037][CORE][SQL] Fix the issue that spark gives duplicate result and support concurrent file source write operations write to differen

2020-01-05 Thread GitBox
AmplabJenkins commented on issue #27100: [SPARK-29037][CORE][SQL] Fix the issue that spark gives duplicate result and support concurrent file source write operations write to different partitions in the same table. URL: https://github.com/apache/spark/pull/27100#issuecomment-571033573 Can

[GitHub] [spark] AmplabJenkins removed a comment on issue #27100: [SPARK-29037][CORE][SQL] Fix the issue that spark gives duplicate result and support concurrent file source write operations write to

2020-01-05 Thread GitBox
AmplabJenkins removed a comment on issue #27100: [SPARK-29037][CORE][SQL] Fix the issue that spark gives duplicate result and support concurrent file source write operations write to different partitions in the same table. URL: https://github.com/apache/spark/pull/27100#issuecomment-571033279

[GitHub] [spark] cloud-fan commented on a change in pull request #27090: [SPARK-27545][SQL] Temporary view is not removed while uncaching the table

2020-01-05 Thread GitBox
cloud-fan commented on a change in pull request #27090: [SPARK-27545][SQL] Temporary view is not removed while uncaching the table URL: https://github.com/apache/spark/pull/27090#discussion_r363182294 ## File path: docs/sql-ref-syntax-aux-cache-cache-table.md ## @@ -20,7

[GitHub] [spark] SparkQA commented on issue #22721: [SPARK-19784][SPARK-25403][SQL] Refresh the table even table stats is empty

2020-01-05 Thread GitBox
SparkQA commented on issue #22721: [SPARK-19784][SPARK-25403][SQL] Refresh the table even table stats is empty URL: https://github.com/apache/spark/pull/22721#issuecomment-571033375 **[Test build #116137 has

[GitHub] [spark] SparkQA commented on issue #26956: [SPARK-30312][SQL] Preserve path permission and acl when truncate table

2020-01-05 Thread GitBox
SparkQA commented on issue #26956: [SPARK-30312][SQL] Preserve path permission and acl when truncate table URL: https://github.com/apache/spark/pull/26956#issuecomment-571033385 **[Test build #116136 has

[GitHub] [spark] AmplabJenkins commented on issue #27100: [SPARK-29037][CORE][SQL] Fix the issue that spark gives duplicate result and support concurrent file source write operations write to differen

2020-01-05 Thread GitBox
AmplabJenkins commented on issue #27100: [SPARK-29037][CORE][SQL] Fix the issue that spark gives duplicate result and support concurrent file source write operations write to different partitions in the same table. URL: https://github.com/apache/spark/pull/27100#issuecomment-571033279 Can

[GitHub] [spark] turboFei edited a comment on issue #27100: [SPARK-29037][CORE][SQL] Fix the issue that spark gives duplicate result and support concurrent file source write operations write to differ

2020-01-05 Thread GitBox
turboFei edited a comment on issue #27100: [SPARK-29037][CORE][SQL] Fix the issue that spark gives duplicate result and support concurrent file source write operations write to different partitions in the same table. URL: https://github.com/apache/spark/pull/27100#issuecomment-571032367

[GitHub] [spark] turboFei commented on issue #27100: [SPARK-29037][CORE][SQL] Fix the issue that spark gives duplicate result and support concurrent file source write operations write to different par

2020-01-05 Thread GitBox
turboFei commented on issue #27100: [SPARK-29037][CORE][SQL] Fix the issue that spark gives duplicate result and support concurrent file source write operations write to different partitions in the same table. URL: https://github.com/apache/spark/pull/27100#issuecomment-571032367 just cc

[GitHub] [spark] turboFei opened a new pull request #27100: [SPARK-29037][CORE][SQL] Fix the issue that spark gives duplicate result and support concurrent file source write operations write to differ

2020-01-05 Thread GitBox
turboFei opened a new pull request #27100: [SPARK-29037][CORE][SQL] Fix the issue that spark gives duplicate result and support concurrent file source write operations write to different partitions in the same table. URL: https://github.com/apache/spark/pull/27100 ## What changes were

[GitHub] [spark] AmplabJenkins removed a comment on issue #26678: [SPARK-30226][SQL] Remove withXXX functions in WriteBuilder

2020-01-05 Thread GitBox
AmplabJenkins removed a comment on issue #26678: [SPARK-30226][SQL] Remove withXXX functions in WriteBuilder URL: https://github.com/apache/spark/pull/26678#issuecomment-571031889 Merged build finished. Test PASSed. This is

[GitHub] [spark] AmplabJenkins removed a comment on issue #26678: [SPARK-30226][SQL] Remove withXXX functions in WriteBuilder

2020-01-05 Thread GitBox
AmplabJenkins removed a comment on issue #26678: [SPARK-30226][SQL] Remove withXXX functions in WriteBuilder URL: https://github.com/apache/spark/pull/26678#issuecomment-571031897 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] cloud-fan commented on a change in pull request #27095: [SPARK-30214][SQL] V2 commands resolves namespaces with new resolution framework

2020-01-05 Thread GitBox
cloud-fan commented on a change in pull request #27095: [SPARK-30214][SQL] V2 commands resolves namespaces with new resolution framework URL: https://github.com/apache/spark/pull/27095#discussion_r363181136 ## File path:

[GitHub] [spark] AmplabJenkins removed a comment on issue #22721: [SPARK-19784][SPARK-25403][SQL] Refresh the table even table stats is empty

2020-01-05 Thread GitBox
AmplabJenkins removed a comment on issue #22721: [SPARK-19784][SPARK-25403][SQL] Refresh the table even table stats is empty URL: https://github.com/apache/spark/pull/22721#issuecomment-571031868 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #26678: [SPARK-30226][SQL] Remove withXXX functions in WriteBuilder

2020-01-05 Thread GitBox
AmplabJenkins commented on issue #26678: [SPARK-30226][SQL] Remove withXXX functions in WriteBuilder URL: https://github.com/apache/spark/pull/26678#issuecomment-571031889 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins removed a comment on issue #22721: [SPARK-19784][SPARK-25403][SQL] Refresh the table even table stats is empty

2020-01-05 Thread GitBox
AmplabJenkins removed a comment on issue #22721: [SPARK-19784][SPARK-25403][SQL] Refresh the table even table stats is empty URL: https://github.com/apache/spark/pull/22721#issuecomment-571031862 Build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #26678: [SPARK-30226][SQL] Remove withXXX functions in WriteBuilder

2020-01-05 Thread GitBox
AmplabJenkins commented on issue #26678: [SPARK-30226][SQL] Remove withXXX functions in WriteBuilder URL: https://github.com/apache/spark/pull/26678#issuecomment-571031897 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #22721: [SPARK-19784][SPARK-25403][SQL] Refresh the table even table stats is empty

2020-01-05 Thread GitBox
AmplabJenkins commented on issue #22721: [SPARK-19784][SPARK-25403][SQL] Refresh the table even table stats is empty URL: https://github.com/apache/spark/pull/22721#issuecomment-571031862 Build finished. Test PASSed. This is

[GitHub] [spark] AmplabJenkins commented on issue #22721: [SPARK-19784][SPARK-25403][SQL] Refresh the table even table stats is empty

2020-01-05 Thread GitBox
AmplabJenkins commented on issue #22721: [SPARK-19784][SPARK-25403][SQL] Refresh the table even table stats is empty URL: https://github.com/apache/spark/pull/22721#issuecomment-571031868 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] wangyum opened a new pull request #22721: [SPARK-19784][SPARK-25403][SQL] Refresh the table even table stats is empty

2020-01-05 Thread GitBox
wangyum opened a new pull request #22721: [SPARK-19784][SPARK-25403][SQL] Refresh the table even table stats is empty URL: https://github.com/apache/spark/pull/22721 ## What changes were proposed in this pull request? We invalidate table relation once table data is changed by

[GitHub] [spark] SparkQA commented on issue #26678: [SPARK-30226][SQL] Remove withXXX functions in WriteBuilder

2020-01-05 Thread GitBox
SparkQA commented on issue #26678: [SPARK-30226][SQL] Remove withXXX functions in WriteBuilder URL: https://github.com/apache/spark/pull/26678#issuecomment-571031509 **[Test build #116135 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/116135/testReport)**

[GitHub] [spark] wangyum commented on issue #22721: [SPARK-19784][SPARK-25403][SQL] Refresh the table even table stats is empty

2020-01-05 Thread GitBox
wangyum commented on issue #22721: [SPARK-19784][SPARK-25403][SQL] Refresh the table even table stats is empty URL: https://github.com/apache/spark/pull/22721#issuecomment-571031416 Yes. It still exist: ```scala scala> spark.version res0: String = 3.0.0-preview2 scala> val

[GitHub] [spark] imback82 commented on a change in pull request #27095: [SPARK-30214][SQL] V2 commands resolves namespaces with new resolution framework

2020-01-05 Thread GitBox
imback82 commented on a change in pull request #27095: [SPARK-30214][SQL] V2 commands resolves namespaces with new resolution framework URL: https://github.com/apache/spark/pull/27095#discussion_r363180521 ## File path:

[GitHub] [spark] cloud-fan commented on issue #26678: [SPARK-30226][SQL] Remove withXXX functions in WriteBuilder

2020-01-05 Thread GitBox
cloud-fan commented on issue #26678: [SPARK-30226][SQL] Remove withXXX functions in WriteBuilder URL: https://github.com/apache/spark/pull/26678#issuecomment-571030227 retest this please This is an automated message from the

[GitHub] [spark] viirya commented on a change in pull request #26956: [SPARK-30312][SQL] Preserve path permission and acl when truncate table

2020-01-05 Thread GitBox
viirya commented on a change in pull request #26956: [SPARK-30312][SQL] Preserve path permission and acl when truncate table URL: https://github.com/apache/spark/pull/26956#discussion_r363179571 ## File path:

[GitHub] [spark] cloud-fan commented on issue #22721: [SPARK-19784][SPARK-25403][SQL] Refresh the table even table stats is empty

2020-01-05 Thread GitBox
cloud-fan commented on issue #22721: [SPARK-19784][SPARK-25403][SQL] Refresh the table even table stats is empty URL: https://github.com/apache/spark/pull/22721#issuecomment-571029700 does the problem still exist? I think we need to merge this PR.

[GitHub] [spark] cloud-fan commented on a change in pull request #26850: [SPARK-30215][SQL] Remove PrunedInMemoryFileIndex and merge its functionality into InMemoryFileIndex

2020-01-05 Thread GitBox
cloud-fan commented on a change in pull request #26850: [SPARK-30215][SQL] Remove PrunedInMemoryFileIndex and merge its functionality into InMemoryFileIndex URL: https://github.com/apache/spark/pull/26850#discussion_r363178201 ## File path:

[GitHub] [spark] AmplabJenkins removed a comment on issue #26437: [SPARK-29800][SQL] Rewrite non-correlated EXISTS subquery use ScalaSubquery to optimize perf

2020-01-05 Thread GitBox
AmplabJenkins removed a comment on issue #26437: [SPARK-29800][SQL] Rewrite non-correlated EXISTS subquery use ScalaSubquery to optimize perf URL: https://github.com/apache/spark/pull/26437#issuecomment-571028311 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] AmplabJenkins removed a comment on issue #26437: [SPARK-29800][SQL] Rewrite non-correlated EXISTS subquery use ScalaSubquery to optimize perf

2020-01-05 Thread GitBox
AmplabJenkins removed a comment on issue #26437: [SPARK-29800][SQL] Rewrite non-correlated EXISTS subquery use ScalaSubquery to optimize perf URL: https://github.com/apache/spark/pull/26437#issuecomment-571028304 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #26437: [SPARK-29800][SQL] Rewrite non-correlated EXISTS subquery use ScalaSubquery to optimize perf

2020-01-05 Thread GitBox
AmplabJenkins commented on issue #26437: [SPARK-29800][SQL] Rewrite non-correlated EXISTS subquery use ScalaSubquery to optimize perf URL: https://github.com/apache/spark/pull/26437#issuecomment-571028311 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins commented on issue #26437: [SPARK-29800][SQL] Rewrite non-correlated EXISTS subquery use ScalaSubquery to optimize perf

2020-01-05 Thread GitBox
AmplabJenkins commented on issue #26437: [SPARK-29800][SQL] Rewrite non-correlated EXISTS subquery use ScalaSubquery to optimize perf URL: https://github.com/apache/spark/pull/26437#issuecomment-571028304 Merged build finished. Test PASSed.

[GitHub] [spark] cloud-fan commented on a change in pull request #26956: [SPARK-30312][SQL] Preserve path permission and acl when truncate table

2020-01-05 Thread GitBox
cloud-fan commented on a change in pull request #26956: [SPARK-30312][SQL] Preserve path permission and acl when truncate table URL: https://github.com/apache/spark/pull/26956#discussion_r363177907 ## File path:

[GitHub] [spark] cloud-fan commented on a change in pull request #26933: [SPARK-30292][SQL]Throw Exception when invalid string is cast to numeric type in ANSI mode

2020-01-05 Thread GitBox
cloud-fan commented on a change in pull request #26933: [SPARK-30292][SQL]Throw Exception when invalid string is cast to numeric type in ANSI mode URL: https://github.com/apache/spark/pull/26933#discussion_r363177700 ## File path:

[GitHub] [spark] SparkQA commented on issue #26437: [SPARK-29800][SQL] Rewrite non-correlated subquery use ScalaSubquery to optimize perf

2020-01-05 Thread GitBox
SparkQA commented on issue #26437: [SPARK-29800][SQL] Rewrite non-correlated subquery use ScalaSubquery to optimize perf URL: https://github.com/apache/spark/pull/26437#issuecomment-571027899 **[Test build #116134 has

[GitHub] [spark] cloud-fan commented on issue #26437: [SPARK-29800][SQL] Rewrite non-correlated subquery use ScalaSubquery to optimize perf

2020-01-05 Thread GitBox
cloud-fan commented on issue #26437: [SPARK-29800][SQL] Rewrite non-correlated subquery use ScalaSubquery to optimize perf URL: https://github.com/apache/spark/pull/26437#issuecomment-571027174 retest this please This is an

[GitHub] [spark] cloud-fan commented on a change in pull request #27095: [SPARK-30214][SQL] V2 commands resolves namespaces with new resolution framework

2020-01-05 Thread GitBox
cloud-fan commented on a change in pull request #27095: [SPARK-30214][SQL] V2 commands resolves namespaces with new resolution framework URL: https://github.com/apache/spark/pull/27095#discussion_r363176908 ## File path:

[GitHub] [spark] cloud-fan commented on issue #26696: [WIP][SPARK-18886][CORE] Make locality wait time be the time since a TSM's available slots were fully utilized

2020-01-05 Thread GitBox
cloud-fan commented on issue #26696: [WIP][SPARK-18886][CORE] Make locality wait time be the time since a TSM's available slots were fully utilized URL: https://github.com/apache/spark/pull/26696#issuecomment-571026533 > offer 1 resource that was rejected - no timer reset > offer all

[GitHub] [spark] iRakson commented on a change in pull request #26933: [SPARK-30292][SQL]Throw Exception when invalid string is cast to numeric type in ANSI mode

2020-01-05 Thread GitBox
iRakson commented on a change in pull request #26933: [SPARK-30292][SQL]Throw Exception when invalid string is cast to numeric type in ANSI mode URL: https://github.com/apache/spark/pull/26933#discussion_r363174317 ## File path:

[GitHub] [spark] AngersZhuuuu commented on a change in pull request #26141: [SPARK-29492][SQL]Reset HiveSession's SessionState conf's ClassLoader when sync mode

2020-01-05 Thread GitBox
AngersZh commented on a change in pull request #26141: [SPARK-29492][SQL]Reset HiveSession's SessionState conf's ClassLoader when sync mode URL: https://github.com/apache/spark/pull/26141#discussion_r363169817 ## File path:

[GitHub] [spark] zhengruifeng commented on a change in pull request #27097: [SPARK-9478][ML][PYSPARK] Add sample weights to Random Forest

2020-01-05 Thread GitBox
zhengruifeng commented on a change in pull request #27097: [SPARK-9478][ML][PYSPARK] Add sample weights to Random Forest URL: https://github.com/apache/spark/pull/27097#discussion_r363174121 ## File path:

[GitHub] [spark] iRakson commented on a change in pull request #26863: [SPARK-30234]ADD FILE cannot add directories from sql CLI

2020-01-05 Thread GitBox
iRakson commented on a change in pull request #26863: [SPARK-30234]ADD FILE cannot add directories from sql CLI URL: https://github.com/apache/spark/pull/26863#discussion_r363173378 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ##

[GitHub] [spark] iRakson removed a comment on issue #26863: [SPARK-30234]ADD FILE cannot add directories from sql CLI

2020-01-05 Thread GitBox
iRakson removed a comment on issue #26863: [SPARK-30234]ADD FILE cannot add directories from sql CLI URL: https://github.com/apache/spark/pull/26863#issuecomment-570762805 @cloud-fan Anything else needs to be done for this one??

[GitHub] [spark] amanomer edited a comment on issue #27056: [SPARK-27217][SQL] Nested schema pruning with Aggregation

2020-01-05 Thread GitBox
amanomer edited a comment on issue #27056: [SPARK-27217][SQL] Nested schema pruning with Aggregation URL: https://github.com/apache/spark/pull/27056#issuecomment-571022568 > Actually I'm thinking to add nested column pruning rule for these logical operators. I think it should be feasible

[GitHub] [spark] amanomer commented on issue #27056: [SPARK-27217][SQL] Nested schema pruning with Aggregation

2020-01-05 Thread GitBox
amanomer commented on issue #27056: [SPARK-27217][SQL] Nested schema pruning with Aggregation URL: https://github.com/apache/spark/pull/27056#issuecomment-571022568 > Actually I'm thinking to add nested column pruning rule for these logical operators. I think it should be feasible to have

[GitHub] [spark] AmplabJenkins removed a comment on issue #26806: [SPARK-30183][SQL] Disallow to specify reserved properties in CREATE NAMESPACE syntax

2020-01-05 Thread GitBox
AmplabJenkins removed a comment on issue #26806: [SPARK-30183][SQL] Disallow to specify reserved properties in CREATE NAMESPACE syntax URL: https://github.com/apache/spark/pull/26806#issuecomment-571021945 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #26806: [SPARK-30183][SQL] Disallow to specify reserved properties in CREATE NAMESPACE syntax

2020-01-05 Thread GitBox
AmplabJenkins commented on issue #26806: [SPARK-30183][SQL] Disallow to specify reserved properties in CREATE NAMESPACE syntax URL: https://github.com/apache/spark/pull/26806#issuecomment-571021945 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #26806: [SPARK-30183][SQL] Disallow to specify reserved properties in CREATE NAMESPACE syntax

2020-01-05 Thread GitBox
AmplabJenkins removed a comment on issue #26806: [SPARK-30183][SQL] Disallow to specify reserved properties in CREATE NAMESPACE syntax URL: https://github.com/apache/spark/pull/26806#issuecomment-571021949 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins commented on issue #26806: [SPARK-30183][SQL] Disallow to specify reserved properties in CREATE NAMESPACE syntax

2020-01-05 Thread GitBox
AmplabJenkins commented on issue #26806: [SPARK-30183][SQL] Disallow to specify reserved properties in CREATE NAMESPACE syntax URL: https://github.com/apache/spark/pull/26806#issuecomment-571021949 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27099: [SPARK-30335][SQL][DOCS] Note first and last can be non-deterministic in SQL function docs as well

2020-01-05 Thread GitBox
AmplabJenkins commented on issue #27099: [SPARK-30335][SQL][DOCS] Note first and last can be non-deterministic in SQL function docs as well URL: https://github.com/apache/spark/pull/27099#issuecomment-571021632 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA removed a comment on issue #26806: [SPARK-30183][SQL] Disallow to specify reserved properties in CREATE NAMESPACE syntax

2020-01-05 Thread GitBox
SparkQA removed a comment on issue #26806: [SPARK-30183][SQL] Disallow to specify reserved properties in CREATE NAMESPACE syntax URL: https://github.com/apache/spark/pull/26806#issuecomment-570980968 **[Test build #116123 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #27099: [SPARK-30335][SQL][DOCS] Note first and last can be non-deterministic in SQL function docs as well

2020-01-05 Thread GitBox
AmplabJenkins removed a comment on issue #27099: [SPARK-30335][SQL][DOCS] Note first and last can be non-deterministic in SQL function docs as well URL: https://github.com/apache/spark/pull/27099#issuecomment-571021635 Test PASSed. Refer to this link for build results (access rights to

[GitHub] [spark] SparkQA commented on issue #26806: [SPARK-30183][SQL] Disallow to specify reserved properties in CREATE NAMESPACE syntax

2020-01-05 Thread GitBox
SparkQA commented on issue #26806: [SPARK-30183][SQL] Disallow to specify reserved properties in CREATE NAMESPACE syntax URL: https://github.com/apache/spark/pull/26806#issuecomment-571021520 **[Test build #116123 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #27099: [SPARK-30335][SQL][DOCS] Note first and last can be non-deterministic in SQL function docs as well

2020-01-05 Thread GitBox
AmplabJenkins removed a comment on issue #27099: [SPARK-30335][SQL][DOCS] Note first and last can be non-deterministic in SQL function docs as well URL: https://github.com/apache/spark/pull/27099#issuecomment-571021632 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #27099: [SPARK-30335][SQL][DOCS] Note first and last can be non-deterministic in SQL function docs as well

2020-01-05 Thread GitBox
AmplabJenkins commented on issue #27099: [SPARK-30335][SQL][DOCS] Note first and last can be non-deterministic in SQL function docs as well URL: https://github.com/apache/spark/pull/27099#issuecomment-571021635 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] SparkQA commented on issue #27099: [SPARK-30335][SQL][DOCS] Note first and last can be non-deterministic in SQL function docs as well

2020-01-05 Thread GitBox
SparkQA commented on issue #27099: [SPARK-30335][SQL][DOCS] Note first and last can be non-deterministic in SQL function docs as well URL: https://github.com/apache/spark/pull/27099#issuecomment-571021295 **[Test build #116133 has

[GitHub] [spark] HyukjinKwon opened a new pull request #27099: [SPARK-30335][SQL][DOCS] Note first and last can be non-deterministic in SQL function docs as well

2020-01-05 Thread GitBox
HyukjinKwon opened a new pull request #27099: [SPARK-30335][SQL][DOCS] Note first and last can be non-deterministic in SQL function docs as well URL: https://github.com/apache/spark/pull/27099 ### What changes were proposed in this pull request? This PR adds a note first and last can be

[GitHub] [spark] imback82 commented on a change in pull request #27095: [SPARK-30214][SQL] V2 commands resolves namespaces with new resolution framework

2020-01-05 Thread GitBox
imback82 commented on a change in pull request #27095: [SPARK-30214][SQL] V2 commands resolves namespaces with new resolution framework URL: https://github.com/apache/spark/pull/27095#discussion_r363170839 ## File path:

[GitHub] [spark] imback82 commented on a change in pull request #27095: [SPARK-30214][SQL] V2 commands resolves namespaces with new resolution framework

2020-01-05 Thread GitBox
imback82 commented on a change in pull request #27095: [SPARK-30214][SQL] V2 commands resolves namespaces with new resolution framework URL: https://github.com/apache/spark/pull/27095#discussion_r363170628 ## File path:

[GitHub] [spark] AmplabJenkins removed a comment on issue #27035: [SPARK-30351][ML][PySpark] BisectingKMeans support instance weighting

2020-01-05 Thread GitBox
AmplabJenkins removed a comment on issue #27035: [SPARK-30351][ML][PySpark] BisectingKMeans support instance weighting URL: https://github.com/apache/spark/pull/27035#issuecomment-571019094 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27035: [SPARK-30351][ML][PySpark] BisectingKMeans support instance weighting

2020-01-05 Thread GitBox
AmplabJenkins removed a comment on issue #27035: [SPARK-30351][ML][PySpark] BisectingKMeans support instance weighting URL: https://github.com/apache/spark/pull/27035#issuecomment-571019098 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27035: [SPARK-30351][ML][PySpark] BisectingKMeans support instance weighting

2020-01-05 Thread GitBox
AmplabJenkins commented on issue #27035: [SPARK-30351][ML][PySpark] BisectingKMeans support instance weighting URL: https://github.com/apache/spark/pull/27035#issuecomment-571019098 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27035: [SPARK-30351][ML][PySpark] BisectingKMeans support instance weighting

2020-01-05 Thread GitBox
AmplabJenkins commented on issue #27035: [SPARK-30351][ML][PySpark] BisectingKMeans support instance weighting URL: https://github.com/apache/spark/pull/27035#issuecomment-571019094 Merged build finished. Test PASSed. This

[GitHub] [spark] SparkQA removed a comment on issue #27035: [SPARK-30351][ML][PySpark] BisectingKMeans support instance weighting

2020-01-05 Thread GitBox
SparkQA removed a comment on issue #27035: [SPARK-30351][ML][PySpark] BisectingKMeans support instance weighting URL: https://github.com/apache/spark/pull/27035#issuecomment-571005548 **[Test build #116128 has

[GitHub] [spark] SparkQA commented on issue #27035: [SPARK-30351][ML][PySpark] BisectingKMeans support instance weighting

2020-01-05 Thread GitBox
SparkQA commented on issue #27035: [SPARK-30351][ML][PySpark] BisectingKMeans support instance weighting URL: https://github.com/apache/spark/pull/27035#issuecomment-571018831 **[Test build #116128 has

[GitHub] [spark] AngersZhuuuu commented on a change in pull request #26141: [SPARK-29492][SQL]Reset HiveSession's SessionState conf's ClassLoader when sync mode

2020-01-05 Thread GitBox
AngersZh commented on a change in pull request #26141: [SPARK-29492][SQL]Reset HiveSession's SessionState conf's ClassLoader when sync mode URL: https://github.com/apache/spark/pull/26141#discussion_r363169817 ## File path:

[GitHub] [spark] AngersZhuuuu commented on a change in pull request #26437: [SPARK-29800][SQL] Rewrite non-correlated subquery use ScalaSubquery to optimize perf

2020-01-05 Thread GitBox
AngersZh commented on a change in pull request #26437: [SPARK-29800][SQL] Rewrite non-correlated subquery use ScalaSubquery to optimize perf URL: https://github.com/apache/spark/pull/26437#discussion_r363169514 ## File path:

[GitHub] [spark] SparkQA commented on issue #27085: [SPARK-29779][CORE] Compact old event log files and cleanup

2020-01-05 Thread GitBox
SparkQA commented on issue #27085: [SPARK-29779][CORE] Compact old event log files and cleanup URL: https://github.com/apache/spark/pull/27085#issuecomment-571017808 **[Test build #116132 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/116132/testReport)**

[GitHub] [spark] AmplabJenkins removed a comment on issue #27085: [SPARK-29779][CORE] Compact old event log files and cleanup

2020-01-05 Thread GitBox
AmplabJenkins removed a comment on issue #27085: [SPARK-29779][CORE] Compact old event log files and cleanup URL: https://github.com/apache/spark/pull/27085#issuecomment-571016364 Test PASSed. Refer to this link for build results (access rights to CI server needed):

  1   2   3   4   >