[jira] [Updated] (SPARK-24352) Flaky test: StandaloneDynamicAllocationSuite

[ https://issues.apache.org/jira/browse/SPARK-24352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-24352: Issue Type: Test (was: Bug) > Flaky test: StandaloneDynamicAllocationSuite >

[jira] [Updated] (SPARK-28535) Flaky test: JobCancellationSuite."interruptible iterator of shuffle reader"

[ https://issues.apache.org/jira/browse/SPARK-28535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-28535: Issue Type: Test (was: Bug) > Flaky test: JobCancellationSuite."interruptible iterator of shuffle reader"

[jira] [Updated] (SPARK-28418) Flaky Test: pyspark.sql.tests.test_dataframe: test_query_execution_listener_on_collect

[ https://issues.apache.org/jira/browse/SPARK-28418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-28418: Issue Type: Test (was: Bug) > Flaky Test: pyspark.sql.tests.test_dataframe: > test_query_execution_liste

[jira] [Updated] (SPARK-28335) Flaky test: org.apache.spark.streaming.kafka010.DirectKafkaStreamSuite.offset recovery from kafka

[ https://issues.apache.org/jira/browse/SPARK-28335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-28335: Issue Type: Test (was: Bug) > Flaky test: org.apache.spark.streaming.kafka010.DirectKafkaStreamSuite.offs

[jira] [Updated] (SPARK-28357) Fix Flaky Test - FileAppenderSuite.rolling file appender - size-based rolling compressed

[ https://issues.apache.org/jira/browse/SPARK-28357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-28357: Issue Type: Test (was: Bug) > Fix Flaky Test - FileAppenderSuite.rolling file appender - size-based rolli

[jira] [Updated] (SPARK-24898) Adding spark.checkpoint.compress to the docs

[ https://issues.apache.org/jira/browse/SPARK-24898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-24898: Issue Type: Improvement (was: Task) > Adding spark.checkpoint.compress to the docs >

[jira] [Updated] (SPARK-28261) Flaky test: org.apache.spark.network.TransportClientFactorySuite.reuseClientsUpToConfigVariable

[ https://issues.apache.org/jira/browse/SPARK-28261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-28261: Issue Type: Test (was: Bug) > Flaky test: > org.apache.spark.network.TransportClientFactorySuite.reuseCl

[jira] [Updated] (SPARK-28247) Flaky test: "query without test harness" in ContinuousSuite

[ https://issues.apache.org/jira/browse/SPARK-28247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-28247: Issue Type: Test (was: Bug) > Flaky test: "query without test harness" in ContinuousSuite > -

[jira] [Updated] (SPARK-28713) Bump checkstyle from 8.14 to 8.23

[ https://issues.apache.org/jira/browse/SPARK-28713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-28713: Issue Type: Improvement (was: Task) > Bump checkstyle from 8.14 to 8.23 > ---

[jira] [Updated] (SPARK-27596) The JDBC 'query' option doesn't work for Oracle database

[ https://issues.apache.org/jira/browse/SPARK-27596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-27596: Issue Type: Bug (was: Improvement) > The JDBC 'query' option doesn't work for Oracle database > -

[jira] [Updated] (SPARK-28642) Hide credentials in show create table

[ https://issues.apache.org/jira/browse/SPARK-28642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-28642: Issue Type: Bug (was: Improvement) > Hide credentials in show create table >

[jira] [Updated] (SPARK-23519) Create View Commands Fails with The view output (col1,col1) contains duplicate column name

[ https://issues.apache.org/jira/browse/SPARK-23519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang-Chi Hsieh updated SPARK-23519: Component/s: (was: Spark Core) > Create View Commands Fails with The view output (col

[jira] [Commented] (SPARK-23519) Create View Commands Fails with The view output (col1,col1) contains duplicate column name

[ https://issues.apache.org/jira/browse/SPARK-23519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16920302#comment-16920302 ] Liang-Chi Hsieh commented on SPARK-23519: - This was closed and then reopened and

[jira] [Updated] (SPARK-23519) Create View Commands Fails with The view output (col1,col1) contains duplicate column name

[ https://issues.apache.org/jira/browse/SPARK-23519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang-Chi Hsieh updated SPARK-23519: Labels: (was: bulk-closed) > Create View Commands Fails with The view output (col1,col1

[jira] [Resolved] (SPARK-28612) DataSourceV2: Add new DataFrameWriter API for v2

[ https://issues.apache.org/jira/browse/SPARK-28612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Burak Yavuz resolved SPARK-28612. - Fix Version/s: 3.0.0 Resolution: Fixed Resolved by [https://github.com/apache/spark/pull/

[jira] [Assigned] (SPARK-28612) DataSourceV2: Add new DataFrameWriter API for v2

[ https://issues.apache.org/jira/browse/SPARK-28612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Burak Yavuz reassigned SPARK-28612: --- Assignee: Ryan Blue > DataSourceV2: Add new DataFrameWriter API for v2 > --

[jira] [Commented] (SPARK-28770) Flaky Tests: Test ReplayListenerSuite.End-to-end replay with compression failed

[ https://issues.apache.org/jira/browse/SPARK-28770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16920234#comment-16920234 ] Wing Yew Poon commented on SPARK-28770: --- I looked into the issue further. In Event

[jira] [Commented] (SPARK-28921) Spark jobs failing on latest versions of Kubernetes (1.15.3, 1.14.6, 1,13.10)

[ https://issues.apache.org/jira/browse/SPARK-28921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16920227#comment-16920227 ] Dongjoon Hyun commented on SPARK-28921: --- BTW, [~andygrove]. I tried to add your PR

[jira] [Commented] (SPARK-28921) Spark jobs failing on latest versions of Kubernetes (1.15.3, 1.14.6, 1,13.10)

[ https://issues.apache.org/jira/browse/SPARK-28921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16920226#comment-16920226 ] Dongjoon Hyun commented on SPARK-28921: --- [~psschwei] and [~andygrove]. BTW, do yo

[jira] [Updated] (SPARK-28921) Spark jobs failing on latest versions of Kubernetes (1.15.3, 1.14.6, 1,13.10)

[ https://issues.apache.org/jira/browse/SPARK-28921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28921: -- Priority: Major (was: Critical) > Spark jobs failing on latest versions of Kubernetes (1.15.3

[jira] [Created] (SPARK-28938) Kubernetes using unsupported docker image

Rodney Aaron Stainback created SPARK-28938: -- Summary: Kubernetes using unsupported docker image Key: SPARK-28938 URL: https://issues.apache.org/jira/browse/SPARK-28938 Project: Spark

[jira] [Resolved] (SPARK-28803) Document DESCRIBE TABLE in SQL Reference.

[ https://issues.apache.org/jira/browse/SPARK-28803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-28803. - Fix Version/s: 3.0.0 Assignee: Dilip Biswal Resolution: Fixed > Document DESCRIBE TABLE

[jira] [Commented] (SPARK-25994) SPIP: Property Graphs, Cypher Queries, and Algorithms

[ https://issues.apache.org/jira/browse/SPARK-25994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16920213#comment-16920213 ] Ruben Berenguel commented on SPARK-25994: - Hi [~mju], I’ve had a series of unfor

[jira] [Commented] (SPARK-28770) Flaky Tests: Test ReplayListenerSuite.End-to-end replay with compression failed

[ https://issues.apache.org/jira/browse/SPARK-28770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16920212#comment-16920212 ] Wing Yew Poon commented on SPARK-28770: --- On my branch from which [https://github.c

[jira] [Updated] (SPARK-27907) HiveUDAF should return NULL in case of 0 rows

[ https://issues.apache.org/jira/browse/SPARK-27907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-27907: -- Labels: correctness (was: ) > HiveUDAF should return NULL in case of 0 rows > ---

[jira] [Updated] (SPARK-28871) Some codes in 'Policy for handling multiple watermarks' does not show friendly

[ https://issues.apache.org/jira/browse/SPARK-28871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28871: -- Labels: (was: documentation) > Some codes in 'Policy for handling multiple watermarks' does

[jira] [Updated] (SPARK-28542) Document Stages page

[ https://issues.apache.org/jira/browse/SPARK-28542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-28542: -- Fix Version/s: 3.0.0 > Document Stages page > > > Key: SPARK-2854

[jira] [Assigned] (SPARK-28542) Document Stages page

[ https://issues.apache.org/jira/browse/SPARK-28542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-28542: - Fix Version/s: (was: 3.0.0) Assignee: (was: Pablo Langa Blanco) Priori

[jira] [Resolved] (SPARK-28542) Document Stages page

[ https://issues.apache.org/jira/browse/SPARK-28542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-28542. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 25598 [https://github.c

[jira] [Assigned] (SPARK-28542) Document Stages page

[ https://issues.apache.org/jira/browse/SPARK-28542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-28542: - Assignee: Pablo Langa Blanco > Document Stages page > > >

[jira] [Resolved] (SPARK-28932) Maven install fails on JDK11

[ https://issues.apache.org/jira/browse/SPARK-28932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-28932. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 25638 [https://

[jira] [Commented] (SPARK-28916) Generated SpecificSafeProjection.apply method grows beyond 64 KB when use SparkSQL

[ https://issues.apache.org/jira/browse/SPARK-28916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16920153#comment-16920153 ] Marco Gaido commented on SPARK-28916: - I think the problem is related to subexpressi

[jira] [Updated] (SPARK-28864) Add spark source connector for Aliyun Log Service

[ https://issues.apache.org/jira/browse/SPARK-28864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ke Li updated SPARK-28864: -- Description: Alibaba Log Service is a big data service which has been widely used in Alibaba Group and thousa

[jira] [Resolved] (SPARK-28903) Fix AWS JDK version conflict that breaks Pyspark Kinesis tests

[ https://issues.apache.org/jira/browse/SPARK-28903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-28903. --- Fix Version/s: 3.0.0 2.4.5 Resolution: Fixed Issue resolved by pull reques

[jira] [Commented] (SPARK-28921) Spark jobs failing on latest versions of Kubernetes (1.15.3, 1.14.6, 1,13.10)

[ https://issues.apache.org/jira/browse/SPARK-28921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16920133#comment-16920133 ] Andy Grove commented on SPARK-28921: Here's a PR to fix against master branch since

[jira] [Commented] (SPARK-28916) Generated SpecificSafeProjection.apply method grows beyond 64 KB when use SparkSQL

[ https://issues.apache.org/jira/browse/SPARK-28916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16920074#comment-16920074 ] Marco Gaido commented on SPARK-28916: - Thanks for reporting this. I am checking it.

[jira] [Commented] (SPARK-28934) Add `spark.sql.compatiblity.mode`

[ https://issues.apache.org/jira/browse/SPARK-28934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16920072#comment-16920072 ] Marco Gaido commented on SPARK-28934: - Hi [~smilegator]! Thanks for opening this. I

[jira] [Updated] (SPARK-28908) Structured Streaming Kafka sink support Exactly-Once semantics

[ https://issues.apache.org/jira/browse/SPARK-28908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wenxuanguan updated SPARK-28908: Attachment: (was: Kafka Sink Exactly-Once Semantics Design Sketch.pdf) > Structured Streaming

[jira] [Updated] (SPARK-28908) Structured Streaming Kafka sink support Exactly-Once semantics

[ https://issues.apache.org/jira/browse/SPARK-28908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wenxuanguan updated SPARK-28908: Attachment: Kafka Sink Exactly-Once Semantics Design Sketch V1.pdf > Structured Streaming Kafka si