[GitHub] [spark] AmplabJenkins removed a comment on pull request #27006: [SPARK-30352][SQL] DataSourceV2: Add CURRENT_CATALOG function

AmplabJenkins removed a comment on pull request #27006: URL: https://github.com/apache/spark/pull/27006#issuecomment-632889226 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] yaooqinn commented on pull request #27006: [SPARK-30352][SQL] DataSourceV2: Add CURRENT_CATALOG function

yaooqinn commented on pull request #27006: URL: https://github.com/apache/spark/pull/27006#issuecomment-632988407 retest this please This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] viirya commented on a change in pull request #26422: [SPARK-29786][SQL] Fix MetaException when dropping a partition not exists on HDFS

viirya commented on a change in pull request #26422: URL: https://github.com/apache/spark/pull/26422#discussion_r429517900 ## File path: sql/hive/src/main/scala/org/apache/spark/sql/hive/client/HiveClientImpl.scala ## @@ -638,6 +644,17 @@ private[hive] class HiveClientImpl(

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28603: [SPARK-31788][CORE][PYTHON] Fix UnionRDD of PairRDDs

AmplabJenkins removed a comment on pull request #28603: URL: https://github.com/apache/spark/pull/28603#issuecomment-632972088 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28603: [SPARK-31788][CORE][PYTHON] Fix UnionRDD of PairRDDs

AmplabJenkins commented on pull request #28603: URL: https://github.com/apache/spark/pull/28603#issuecomment-632972088 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28603: [SPARK-31788][CORE][PYTHON] Fix UnionRDD of PairRDDs

AmplabJenkins removed a comment on pull request #28603: URL: https://github.com/apache/spark/pull/28603#issuecomment-632975557 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28603: [SPARK-31788][CORE][PYTHON] Fix UnionRDD of PairRDDs

AmplabJenkins commented on pull request #28603: URL: https://github.com/apache/spark/pull/28603#issuecomment-632975557 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] MaxGekk opened a new pull request #28620: [SPARK-31802][SQL] Format Java date-time types in `Row.jsonValue` directly

MaxGekk opened a new pull request #28620: URL: https://github.com/apache/spark/pull/28620 ### What changes were proposed in this pull request? Use `format()` methods for Java date-time types in `Row.jsonValue`. The PR https://github.com/apache/spark/pull/28582 added the methods to avoid

[GitHub] [spark] prakharjain09 opened a new pull request #28619: [WIP][SPARK-21040][CORE] Speculate tasks which are running on decommission executors

prakharjain09 opened a new pull request #28619: URL: https://github.com/apache/spark/pull/28619 ### What changes were proposed in this pull request? This PR adds functionality to consider the running tasks on decommission executors based on some config. In spark-on-cloud , we

[GitHub] [spark] AmplabJenkins commented on pull request #28619: [WIP][SPARK-21040][CORE] Speculate tasks which are running on decommission executors

AmplabJenkins commented on pull request #28619: URL: https://github.com/apache/spark/pull/28619#issuecomment-632985525 Can one of the admins verify this patch? This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28619: [WIP][SPARK-21040][CORE] Speculate tasks which are running on decommission executors

AmplabJenkins removed a comment on pull request #28619: URL: https://github.com/apache/spark/pull/28619#issuecomment-632985431 Can one of the admins verify this patch? This is an automated message from the Apache Git

[GitHub] [spark] AmplabJenkins commented on pull request #28619: [WIP][SPARK-21040][CORE] Speculate tasks which are running on decommission executors

AmplabJenkins commented on pull request #28619: URL: https://github.com/apache/spark/pull/28619#issuecomment-632985431 Can one of the admins verify this patch? This is an automated message from the Apache Git Service. To

[GitHub] [spark] SparkQA commented on pull request #27006: [SPARK-30352][SQL] DataSourceV2: Add CURRENT_CATALOG function

SparkQA commented on pull request #27006: URL: https://github.com/apache/spark/pull/27006#issuecomment-632988959 **[Test build #123024 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123024/testReport)** for PR 27006 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #27006: [SPARK-30352][SQL] DataSourceV2: Add CURRENT_CATALOG function

AmplabJenkins commented on pull request #27006: URL: https://github.com/apache/spark/pull/27006#issuecomment-632989057 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #27006: [SPARK-30352][SQL] DataSourceV2: Add CURRENT_CATALOG function

AmplabJenkins removed a comment on pull request #27006: URL: https://github.com/apache/spark/pull/27006#issuecomment-632989057 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #28603: [SPARK-31788][CORE][PYTHON] Fix UnionRDD of PairRDDs

SparkQA commented on pull request #28603: URL: https://github.com/apache/spark/pull/28603#issuecomment-632975404 **[Test build #123023 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123023/testReport)** for PR 28603 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #28603: [SPARK-31788][CORE][PYTHON] Fix UnionRDD of PairRDDs

SparkQA removed a comment on pull request #28603: URL: https://github.com/apache/spark/pull/28603#issuecomment-632971926 **[Test build #123023 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123023/testReport)** for PR 28603 at commit

[GitHub] [spark] MaxGekk commented on pull request #28620: [SPARK-31802][SQL] Format Java date-time types in `Row.jsonValue` directly

MaxGekk commented on pull request #28620: URL: https://github.com/apache/spark/pull/28620#issuecomment-632989799 @cloud-fan @HyukjinKwon @hvanhovell Please, review this PR. This is an automated message from the Apache Git

[GitHub] [spark] AmplabJenkins commented on pull request #28620: [SPARK-31802][SQL] Format Java date-time types in `Row.jsonValue` directly

AmplabJenkins commented on pull request #28620: URL: https://github.com/apache/spark/pull/28620#issuecomment-632990441 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #28620: [SPARK-31802][SQL] Format Java date-time types in `Row.jsonValue` directly

SparkQA commented on pull request #28620: URL: https://github.com/apache/spark/pull/28620#issuecomment-632990317 **[Test build #123025 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123025/testReport)** for PR 28620 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28620: [SPARK-31802][SQL] Format Java date-time types in `Row.jsonValue` directly

AmplabJenkins removed a comment on pull request #28620: URL: https://github.com/apache/spark/pull/28620#issuecomment-632990441 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] HeartSaVioR opened a new pull request #28607: [SPARK-24634][SS] Add a new metric regarding number of inputs later than watermark plus allowed delay

HeartSaVioR opened a new pull request #28607: URL: https://github.com/apache/spark/pull/28607 ### What changes were proposed in this pull request? Please refer https://issues.apache.org/jira/browse/SPARK-24634 to see rationalization of the issue. This patch adds a new metric

[GitHub] [spark] TJX2014 commented on a change in pull request #28534: [SPARK-31710][SQL] Adds TIMESTAMP_SECONDS, TIMESTAMP_MILLIS and TIMESTAMP_MICROS functions

TJX2014 commented on a change in pull request #28534: URL: https://github.com/apache/spark/pull/28534#discussion_r429072668 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/DateExpressionsSuite.scala ## @@ -1146,4 +1146,25 @@ class

[GitHub] [spark] AmplabJenkins commented on pull request #28534: [SPARK-31710][SQL] Adds TIMESTAMP_SECONDS, TIMESTAMP_MILLIS and TIMESTAMP_MICROS functions

AmplabJenkins commented on pull request #28534: URL: https://github.com/apache/spark/pull/28534#issuecomment-632528981 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #28600: [SPARK-31761][SQL] cast integer to Long to avoid IntegerOverflow for IntegralDivide operator

SparkQA commented on pull request #28600: URL: https://github.com/apache/spark/pull/28600#issuecomment-632528840 **[Test build #122969 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122969/testReport)** for PR 28600 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #28600: [SPARK-31761][SQL] cast integer to Long to avoid IntegerOverflow for IntegralDivide operator

AmplabJenkins commented on pull request #28600: URL: https://github.com/apache/spark/pull/28600#issuecomment-632528945 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #28534: [SPARK-31710][SQL] Adds TIMESTAMP_SECONDS, TIMESTAMP_MILLIS and TIMESTAMP_MICROS functions

SparkQA removed a comment on pull request #28534: URL: https://github.com/apache/spark/pull/28534#issuecomment-632503725 **[Test build #122968 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122968/testReport)** for PR 28534 at commit

[GitHub] [spark] SparkQA commented on pull request #28607: [SPARK-24634][SS] Add a new metric regarding number of inputs later than watermark plus allowed delay

SparkQA commented on pull request #28607: URL: https://github.com/apache/spark/pull/28607#issuecomment-632528838 **[Test build #122971 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122971/testReport)** for PR 28607 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28534: [SPARK-31710][SQL] Adds TIMESTAMP_SECONDS, TIMESTAMP_MILLIS and TIMESTAMP_MICROS functions

AmplabJenkins removed a comment on pull request #28534: URL: https://github.com/apache/spark/pull/28534#issuecomment-632527894 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on pull request #28604: [SPARK-29854][SQL][TESTS] Add tests to check lpad/rpad throw an exception for invalid length input

AmplabJenkins commented on pull request #28604: URL: https://github.com/apache/spark/pull/28604#issuecomment-632529174 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #28608: [SPARK-31612][SQL][DOCS][FOLLOW-UP] Fix a few issues in SQL ref

AmplabJenkins commented on pull request #28608: URL: https://github.com/apache/spark/pull/28608#issuecomment-632528998 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #28556: [SPARK-31736][SQL] Nested column aliasing for RepartitionByExpression/Join

SparkQA commented on pull request #28556: URL: https://github.com/apache/spark/pull/28556#issuecomment-632528836 **[Test build #122966 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122966/testReport)** for PR 28556 at commit

[GitHub] [spark] SparkQA commented on pull request #28592: [SPARK-31771][SQL] Disable Narrow TextStyle for datetime pattern 'G/M/L/E/u/Q/q'

SparkQA commented on pull request #28592: URL: https://github.com/apache/spark/pull/28592#issuecomment-632528823 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [spark] SparkQA commented on pull request #28363: [SPARK-27188][SS] FileStreamSink: provide a new option to have retention on output files

SparkQA commented on pull request #28363: URL: https://github.com/apache/spark/pull/28363#issuecomment-632528846 **[Test build #122961 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122961/testReport)** for PR 28363 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #28607: [SPARK-24634][SS] Add a new metric regarding number of inputs later than watermark plus allowed delay

AmplabJenkins commented on pull request #28607: URL: https://github.com/apache/spark/pull/28607#issuecomment-632528976 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #28592: [SPARK-31771][SQL] Disable Narrow TextStyle for datetime pattern 'G/M/L/E/u/Q/q'

AmplabJenkins commented on pull request #28592: URL: https://github.com/apache/spark/pull/28592#issuecomment-632529190 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #28608: [SPARK-31612][SQL][DOCS][FOLLOW-UP] Fix a few issues in SQL ref

SparkQA commented on pull request #28608: URL: https://github.com/apache/spark/pull/28608#issuecomment-632528841 **[Test build #122970 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122970/testReport)** for PR 28608 at commit

[GitHub] [spark] SparkQA commented on pull request #28604: [SPARK-29854][SQL][TESTS] Add tests to check lpad/rpad throw an exception for invalid length input

SparkQA commented on pull request #28604: URL: https://github.com/apache/spark/pull/28604#issuecomment-632528844 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [spark] SparkQA commented on pull request #28534: [SPARK-31710][SQL] Adds TIMESTAMP_SECONDS, TIMESTAMP_MILLIS and TIMESTAMP_MICROS functions

SparkQA commented on pull request #28534: URL: https://github.com/apache/spark/pull/28534#issuecomment-632528824 **[Test build #122968 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122968/testReport)** for PR 28534 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #28556: [SPARK-31736][SQL] Nested column aliasing for RepartitionByExpression/Join

AmplabJenkins commented on pull request #28556: URL: https://github.com/apache/spark/pull/28556#issuecomment-632529069 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] cloud-fan commented on a change in pull request #28600: [SPARK-31761][SQL] cast integer to Long to avoid IntegerOverflow for IntegralDivide operator

cloud-fan commented on a change in pull request #28600: URL: https://github.com/apache/spark/pull/28600#discussion_r429082030 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/TypeCoercion.scala ## @@ -684,6 +685,24 @@ object TypeCoercion {

[GitHub] [spark] cloud-fan commented on a change in pull request #28600: [SPARK-31761][SQL] cast integer to Long to avoid IntegerOverflow for IntegralDivide operator

cloud-fan commented on a change in pull request #28600: URL: https://github.com/apache/spark/pull/28600#discussion_r429081944 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/TypeCoercion.scala ## @@ -684,6 +685,24 @@ object TypeCoercion {

[GitHub] [spark] sandeep-katta commented on a change in pull request #28600: [SPARK-31761][SQL] cast integer to Long to avoid IntegerOverflow for IntegralDivide operator

sandeep-katta commented on a change in pull request #28600: URL: https://github.com/apache/spark/pull/28600#discussion_r429088285 ## File path: sql/core/src/test/scala/org/apache/spark/sql/SQLQuerySuite.scala ## @@ -3495,6 +3495,13 @@ class SQLQuerySuite extends QueryTest with

[GitHub] [spark] cloud-fan commented on a change in pull request #28600: [SPARK-31761][SQL] cast integer to Long to avoid IntegerOverflow for IntegralDivide operator

cloud-fan commented on a change in pull request #28600: URL: https://github.com/apache/spark/pull/28600#discussion_r429089026 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/TypeCoercion.scala ## @@ -684,6 +685,24 @@ object TypeCoercion {

[GitHub] [spark] AmplabJenkins commented on pull request #28610: [SPARK-31793][SQL] Reduce the memory usage in file scan location metadata

AmplabJenkins commented on pull request #28610: URL: https://github.com/apache/spark/pull/28610#issuecomment-632547558 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #28610: [SPARK-31793][SQL] Reduce the memory usage in file scan location metadata

SparkQA commented on pull request #28610: URL: https://github.com/apache/spark/pull/28610#issuecomment-632547522 **[Test build #122976 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122976/testReport)** for PR 28610 at commit

[GitHub] [spark] yaooqinn commented on a change in pull request #28592: [SPARK-31771][SQL] Disable Narrow TextStyle for datetime pattern 'G/M/L/E/u/Q/q'

yaooqinn commented on a change in pull request #28592: URL: https://github.com/apache/spark/pull/28592#discussion_r429093201 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/DateFormatter.scala ## @@ -33,6 +34,8 @@ sealed trait DateFormatter

[GitHub] [spark] SparkQA removed a comment on pull request #28610: [SPARK-31793][SQL] Reduce the memory usage in file scan location metadata

SparkQA removed a comment on pull request #28610: URL: https://github.com/apache/spark/pull/28610#issuecomment-632539325 **[Test build #122976 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122976/testReport)** for PR 28610 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28610: [SPARK-31793][SQL] Reduce the memory usage in file scan location metadata

AmplabJenkins removed a comment on pull request #28610: URL: https://github.com/apache/spark/pull/28610#issuecomment-632547558 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28612: [SPARK-31755][SQL][3.0] allow missing year/hour when parsing date/timestamp string

AmplabJenkins removed a comment on pull request #28612: URL: https://github.com/apache/spark/pull/28612#issuecomment-632558881 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28610: [SPARK-31793][SQL] Reduce the memory usage in file scan location metadata

AmplabJenkins removed a comment on pull request #28610: URL: https://github.com/apache/spark/pull/28610#issuecomment-632558963 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28610: [SPARK-31793][SQL] Reduce the memory usage in file scan location metadata

AmplabJenkins commented on pull request #28610: URL: https://github.com/apache/spark/pull/28610#issuecomment-632558963 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #28612: [SPARK-31755][SQL][3.0] allow missing year/hour when parsing date/timestamp string

AmplabJenkins commented on pull request #28612: URL: https://github.com/apache/spark/pull/28612#issuecomment-632558881 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] cloud-fan commented on a change in pull request #28592: [SPARK-31771][SQL] Disable Narrow TextStyle for datetime pattern 'G/M/L/E/u/Q/q'

cloud-fan commented on a change in pull request #28592: URL: https://github.com/apache/spark/pull/28592#discussion_r429116529 ## File path: docs/sql-ref-datetime-pattern.md ## @@ -26,44 +26,128 @@ There are several common scenarios for datetime usage in Spark: - Datetime

[GitHub] [spark] cloud-fan commented on a change in pull request #28534: [SPARK-31710][SQL] Adds TIMESTAMP_SECONDS, TIMESTAMP_MILLIS and TIMESTAMP_MICROS functions

cloud-fan commented on a change in pull request #28534: URL: https://github.com/apache/spark/pull/28534#discussion_r429067349 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/DateExpressionsSuite.scala ## @@ -1146,4 +1146,25 @@ class

[GitHub] [spark] jiangxb1987 commented on pull request #28596: [SPARK-31784][CORE][TEST] Fix test BarrierTaskContextSuite."share messages with allGather() call"

jiangxb1987 commented on pull request #28596: URL: https://github.com/apache/spark/pull/28596#issuecomment-632515872 Thanks, merged to master/3.0 ! This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] cloud-fan commented on a change in pull request #28534: [SPARK-31710][SQL] Adds TIMESTAMP_SECONDS, TIMESTAMP_MILLIS and TIMESTAMP_MICROS functions

cloud-fan commented on a change in pull request #28534: URL: https://github.com/apache/spark/pull/28534#discussion_r429066959 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/DateExpressionsSuite.scala ## @@ -1146,4 +1146,25 @@ class

[GitHub] [spark] jiangxb1987 closed pull request #28596: [SPARK-31784][CORE][TEST] Fix test BarrierTaskContextSuite."share messages with allGather() call"

jiangxb1987 closed pull request #28596: URL: https://github.com/apache/spark/pull/28596 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [spark] huaxingao opened a new pull request #28608: [SPARK-31612][SQL][DOCS][FOLLOW-UP] Fix a few issues in SQL ref

huaxingao opened a new pull request #28608: URL: https://github.com/apache/spark/pull/28608 ### What changes were proposed in this pull request? Fix a few issues in SQL Reference ### Why are the changes needed? To make SQL Reference look better ### Does this PR

[GitHub] [spark] cloud-fan commented on a change in pull request #28592: [SPARK-31771][SQL] Disable Narrow TextStyle for datetime pattern 'G/M/L/E/u/Q/q'

cloud-fan commented on a change in pull request #28592: URL: https://github.com/apache/spark/pull/28592#discussion_r429071489 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/DateTimeFormatterHelper.scala ## @@ -86,6 +86,33 @@ trait

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28534: [SPARK-31710][SQL] Adds TIMESTAMP_SECONDS, TIMESTAMP_MILLIS and TIMESTAMP_MICROS functions

AmplabJenkins removed a comment on pull request #28534: URL: https://github.com/apache/spark/pull/28534#issuecomment-632527874 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #28534: [SPARK-31710][SQL] Adds TIMESTAMP_SECONDS, TIMESTAMP_MILLIS and TIMESTAMP_MICROS functions

AmplabJenkins commented on pull request #28534: URL: https://github.com/apache/spark/pull/28534#issuecomment-632527874 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #28363: [SPARK-27188][SS] FileStreamSink: provide a new option to have retention on output files

AmplabJenkins commented on pull request #28363: URL: https://github.com/apache/spark/pull/28363#issuecomment-632532177 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #28534: [SPARK-31710][SQL] Adds TIMESTAMP_SECONDS, TIMESTAMP_MILLIS and TIMESTAMP_MICROS functions

AmplabJenkins commented on pull request #28534: URL: https://github.com/apache/spark/pull/28534#issuecomment-632532197 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #28607: [SPARK-24634][SS] Add a new metric regarding number of inputs later than watermark plus allowed delay

AmplabJenkins commented on pull request #28607: URL: https://github.com/apache/spark/pull/28607#issuecomment-632532129 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] HyukjinKwon edited a comment on pull request #28576: [SPARK-31755][SQL] allow missing year/hour when parsing date/timestamp string

HyukjinKwon edited a comment on pull request #28576: URL: https://github.com/apache/spark/pull/28576#issuecomment-632532022 @cloud-fan, there's conflict on SQL file output against branch-3.0. It's trivial but can you just open a PR to backport since we're running RCs?

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28534: [SPARK-31710][SQL] Adds TIMESTAMP_SECONDS, TIMESTAMP_MILLIS and TIMESTAMP_MICROS functions

AmplabJenkins removed a comment on pull request #28534: URL: https://github.com/apache/spark/pull/28534#issuecomment-632532197 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28363: [SPARK-27188][SS] FileStreamSink: provide a new option to have retention on output files

AmplabJenkins removed a comment on pull request #28363: URL: https://github.com/apache/spark/pull/28363#issuecomment-632532177 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28607: [SPARK-24634][SS] Add a new metric regarding number of inputs later than watermark plus allowed delay

AmplabJenkins removed a comment on pull request #28607: URL: https://github.com/apache/spark/pull/28607#issuecomment-632532129 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] HyukjinKwon commented on pull request #28576: [SPARK-31755][SQL] allow missing year/hour when parsing date/timestamp string

HyukjinKwon commented on pull request #28576: URL: https://github.com/apache/spark/pull/28576#issuecomment-632532022 @cloud-fan, there's conflict on SQL file output. It's trivial but can you just open a PR to backport since we're running RCs?

[GitHub] [spark] sandeep-katta commented on a change in pull request #28600: [SPARK-31761][SQL] cast integer to Long to avoid IntegerOverflow for IntegralDivide operator

sandeep-katta commented on a change in pull request #28600: URL: https://github.com/apache/spark/pull/28600#discussion_r429083860 ## File path: sql/core/src/test/scala/org/apache/spark/sql/SQLQuerySuite.scala ## @@ -3495,6 +3495,13 @@ class SQLQuerySuite extends QueryTest with

[GitHub] [spark] cloud-fan commented on a change in pull request #28610: [SPARK-31793][SQL] Reduce the memory usage in file scan location metadata

cloud-fan commented on a change in pull request #28610: URL: https://github.com/apache/spark/pull/28610#discussion_r429091272 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/DataSourceScanExecRedactionSuite.scala ## @@ -116,6 +116,39 @@ class

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28600: [SPARK-31761][SQL] cast integer to Long to avoid IntegerOverflow for IntegralDivide operator

AmplabJenkins removed a comment on pull request #28600: URL: https://github.com/apache/spark/pull/28600#issuecomment-632555271 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] cloud-fan commented on a change in pull request #28600: [SPARK-31761][SQL] cast integer to Long to avoid IntegerOverflow for IntegralDivide operator

cloud-fan commented on a change in pull request #28600: URL: https://github.com/apache/spark/pull/28600#discussion_r429105908 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/TypeCoercion.scala ## @@ -684,6 +685,24 @@ object TypeCoercion {

[GitHub] [spark] yaooqinn commented on a change in pull request #28592: [SPARK-31771][SQL] Disable Narrow TextStyle for datetime pattern 'G/M/L/E/u/Q/q'

yaooqinn commented on a change in pull request #28592: URL: https://github.com/apache/spark/pull/28592#discussion_r429110475 ## File path: sql/core/src/test/resources/sql-tests/results/datetime.sql.out ## @@ -750,3 +750,164 @@ select to_timestamp("2019 10:10:10", "

[GitHub] [spark] yaooqinn commented on a change in pull request #28592: [SPARK-31771][SQL] Disable Narrow TextStyle for datetime pattern 'G/M/L/E/u/Q/q'

yaooqinn commented on a change in pull request #28592: URL: https://github.com/apache/spark/pull/28592#discussion_r429110475 ## File path: sql/core/src/test/resources/sql-tests/results/datetime.sql.out ## @@ -750,3 +750,164 @@ select to_timestamp("2019 10:10:10", "

[GitHub] [spark] SparkQA commented on pull request #28592: [SPARK-31771][SQL] Disable Narrow TextStyle for datetime pattern 'G/M/L/E/u/Q/q'

SparkQA commented on pull request #28592: URL: https://github.com/apache/spark/pull/28592#issuecomment-632565558 **[Test build #122986 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122986/testReport)** for PR 28592 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #28592: [SPARK-31771][SQL] Disable Narrow TextStyle for datetime pattern 'G/M/L/E/u/Q/q'

AmplabJenkins commented on pull request #28592: URL: https://github.com/apache/spark/pull/28592#issuecomment-632566188 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28610: [SPARK-31793][SQL] Reduce the memory usage in file scan location metadata

AmplabJenkins removed a comment on pull request #28610: URL: https://github.com/apache/spark/pull/28610#issuecomment-632570419 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] SparkQA commented on pull request #28610: [SPARK-31793][SQL] Reduce the memory usage in file scan location metadata

SparkQA commented on pull request #28610: URL: https://github.com/apache/spark/pull/28610#issuecomment-632570376 **[Test build #122985 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122985/testReport)** for PR 28610 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #28610: [SPARK-31793][SQL] Reduce the memory usage in file scan location metadata

AmplabJenkins commented on pull request #28610: URL: https://github.com/apache/spark/pull/28610#issuecomment-632570419 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #28610: [SPARK-31793][SQL] Reduce the memory usage in file scan location metadata

SparkQA removed a comment on pull request #28610: URL: https://github.com/apache/spark/pull/28610#issuecomment-632561931 **[Test build #122985 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122985/testReport)** for PR 28610 at commit

[GitHub] [spark] ScrapCodes commented on pull request #28601: [SPARK-31786][K8S][BUILD] Upgrade kubernetes-client to 4.9.2

ScrapCodes commented on pull request #28601: URL: https://github.com/apache/spark/pull/28601#issuecomment-632576240 @dongjoon-hyun, I have the same question as above, why not upgrade to 4.10.1 ? Looks good otherwise.

[GitHub] [spark] AmplabJenkins commented on pull request #28610: [SPARK-31793][SQL] Reduce the memory usage in file scan location metadata

AmplabJenkins commented on pull request #28610: URL: https://github.com/apache/spark/pull/28610#issuecomment-632587364 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28610: [SPARK-31793][SQL] Reduce the memory usage in file scan location metadata

AmplabJenkins removed a comment on pull request #28610: URL: https://github.com/apache/spark/pull/28610#issuecomment-632587364 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA removed a comment on pull request #28560: [SPARK-27217][SQL] Nested column aliasing for more operators which can prune nested column

SparkQA removed a comment on pull request #28560: URL: https://github.com/apache/spark/pull/28560#issuecomment-632417352 **[Test build #122954 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122954/testReport)** for PR 28560 at commit

[GitHub] [spark] SparkQA commented on pull request #28560: [SPARK-27217][SQL] Nested column aliasing for more operators which can prune nested column

SparkQA commented on pull request #28560: URL: https://github.com/apache/spark/pull/28560#issuecomment-632506187 **[Test build #122954 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122954/testReport)** for PR 28560 at commit

[GitHub] [spark] cloud-fan commented on pull request #28596: [SPARK-31784][CORE][TEST] Fix test BarrierTaskContextSuite."share messages with allGather() call"

cloud-fan commented on pull request #28596: URL: https://github.com/apache/spark/pull/28596#issuecomment-632505971 LGTM This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #28600: [SPARK-31761][SQL] cast integer to Long to avoid IntegerOverflow for IntegralDivide operator

SparkQA commented on pull request #28600: URL: https://github.com/apache/spark/pull/28600#issuecomment-632510289 **[Test build #122969 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122969/testReport)** for PR 28600 at commit

[GitHub] [spark] viirya commented on pull request #28560: [SPARK-27217][SQL] Nested column aliasing for more operators which can prune nested column

viirya commented on pull request #28560: URL: https://github.com/apache/spark/pull/28560#issuecomment-632510298 cc @cloud-fan This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [spark] AmplabJenkins commented on pull request #28600: [SPARK-31761][SQL] cast integer to Long to avoid IntegerOverflow for IntegralDivide operator

AmplabJenkins commented on pull request #28600: URL: https://github.com/apache/spark/pull/28600#issuecomment-632510690 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] cloud-fan commented on a change in pull request #28592: [SPARK-31771][SQL] Disable Narrow TextStyle for datetime pattern 'G/M/L/E/u/Q/q'

cloud-fan commented on a change in pull request #28592: URL: https://github.com/apache/spark/pull/28592#discussion_r429070818 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/DateFormatter.scala ## @@ -33,6 +34,8 @@ sealed trait DateFormatter

[GitHub] [spark] AmplabJenkins commented on pull request #28596: [SPARK-31784][CORE][TEST] Fix test BarrierTaskContextSuite."share messages with allGather() call"

AmplabJenkins commented on pull request #28596: URL: https://github.com/apache/spark/pull/28596#issuecomment-632524539 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #28596: [SPARK-31784][CORE][TEST] Fix test BarrierTaskContextSuite."share messages with allGather() call"

SparkQA removed a comment on pull request #28596: URL: https://github.com/apache/spark/pull/28596#issuecomment-632462754 **[Test build #122962 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122962/testReport)** for PR 28596 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #28607: [SPARK-24634][SS] Add a new metric regarding number of inputs later than watermark plus allowed delay

AmplabJenkins commented on pull request #28607: URL: https://github.com/apache/spark/pull/28607#issuecomment-632523837 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] xccui opened a new pull request #28609: [SPARK-31792][DOCS] Introduce the structured streaming UI in the Web UI doc

xccui opened a new pull request #28609: URL: https://github.com/apache/spark/pull/28609 ### What changes were proposed in this pull request? This PR adds the structured streaming UI introduction to the Web UI doc. ### Why are the changes needed? The structured streaming web UI

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28592: [SPARK-31771][SQL] Disable Narrow TextStyle for datetime pattern 'G/M/L/E/u/Q/q'

AmplabJenkins removed a comment on pull request #28592: URL: https://github.com/apache/spark/pull/28592#issuecomment-632530062 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #28592: [SPARK-31771][SQL] Disable Narrow TextStyle for datetime pattern 'G/M/L/E/u/Q/q'

AmplabJenkins commented on pull request #28592: URL: https://github.com/apache/spark/pull/28592#issuecomment-632530062 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28556: [SPARK-31736][SQL] Nested column aliasing for RepartitionByExpression/Join

AmplabJenkins removed a comment on pull request #28556: URL: https://github.com/apache/spark/pull/28556#issuecomment-632529080 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28534: [SPARK-31710][SQL] Adds TIMESTAMP_SECONDS, TIMESTAMP_MILLIS and TIMESTAMP_MICROS functions

AmplabJenkins removed a comment on pull request #28534: URL: https://github.com/apache/spark/pull/28534#issuecomment-632528991 Test FAILed. Refer to this link for build results (access rights to CI server needed):

  1   2   3   4   5   6   7   >