[jira] [Comment Edited] (SPARK-29302) dynamic partition overwrite with speculation enabled

[ https://issues.apache.org/jira/browse/SPARK-29302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16949190#comment-16949190 ] Shimin Yang edited comment on SPARK-29302 at 10/11/19 7:16 AM: ---

[jira] [Updated] (SPARK-29382) Support writing `INTERVAL` type to datasource table

[ https://issues.apache.org/jira/browse/SPARK-29382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-29382: --- Summary: Support writing `INTERVAL` type to datasource table (was: Support the `INTERVAL` type by P

[jira] [Updated] (SPARK-29382) Support writing `INTERVAL` type to datasource table

[ https://issues.apache.org/jira/browse/SPARK-29382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-29382: --- Description: Creating a table with `INTERVAL` column for writing failed with the error: {code:java}

[jira] [Comment Edited] (SPARK-29302) dynamic partition overwrite with speculation enabled

[ https://issues.apache.org/jira/browse/SPARK-29302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16949229#comment-16949229 ] feiwang edited comment on SPARK-29302 at 10/11/19 7:46 AM: --- [~

[jira] [Commented] (SPARK-29302) dynamic partition overwrite with speculation enabled

[ https://issues.apache.org/jira/browse/SPARK-29302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16949229#comment-16949229 ] feiwang commented on SPARK-29302: - [~dangdangdang] Hi, I have thought a simple solution

[jira] [Commented] (SPARK-28547) Make it work for wide (> 10K columns data)

[ https://issues.apache.org/jira/browse/SPARK-28547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16949230#comment-16949230 ] antonkulaga commented on SPARK-28547: - >I bet there is room for improvement, but, te

[jira] [Closed] (SPARK-6363) Switch to Scala 2.11 for default build

[ https://issues.apache.org/jira/browse/SPARK-6363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] antonkulaga closed SPARK-6363. -- Resolved > Switch to Scala 2.11 for default build > -- > >

[jira] [Updated] (SPARK-29427) Create KeyValueGroupedDataset from RelationalGroupedDataset

[ https://issues.apache.org/jira/browse/SPARK-29427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh updated SPARK-29427: Component/s: (was: Spark Core) > Create KeyValueGroupedDataset from RelationalGroupedDataset >

[jira] [Created] (SPARK-29436) Support executor for selecting scheduler through scheduler name

merrily01 created SPARK-29436: - Summary: Support executor for selecting scheduler through scheduler name Key: SPARK-29436 URL: https://issues.apache.org/jira/browse/SPARK-29436 Project: Spark Is

[jira] [Updated] (SPARK-29436) Support executor for selecting scheduler through scheduler name

[ https://issues.apache.org/jira/browse/SPARK-29436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] merrily01 updated SPARK-29436: -- Description: In the case of k8s multi-scheduler, support executor for selecting scheduler through sche

[jira] [Updated] (SPARK-29436) Support executor for selecting scheduler through scheduler name in the case of k8s multi-scheduler scenario.

[ https://issues.apache.org/jira/browse/SPARK-29436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] merrily01 updated SPARK-29436: -- Summary: Support executor for selecting scheduler through scheduler name in the case of k8s multi-sche

[jira] [Commented] (SPARK-29427) Create KeyValueGroupedDataset from RelationalGroupedDataset

[ https://issues.apache.org/jira/browse/SPARK-29427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16949282#comment-16949282 ] L. C. Hsieh commented on SPARK-29427: - This seems to be an interesting idea. I think

[jira] [Created] (SPARK-29437) CSV Writer should escape 'escapechar' when it exists in the data

Tomasz Bartczak created SPARK-29437: --- Summary: CSV Writer should escape 'escapechar' when it exists in the data Key: SPARK-29437 URL: https://issues.apache.org/jira/browse/SPARK-29437 Project: Spark

[jira] [Updated] (SPARK-29436) Support executor for selecting scheduler through scheduler name in the case of k8s multi-scheduler scenario.

[ https://issues.apache.org/jira/browse/SPARK-29436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] merrily01 updated SPARK-29436: -- Issue Type: New Feature (was: Improvement) > Support executor for selecting scheduler through schedul

[jira] [Commented] (SPARK-29423) leak on org.apache.spark.sql.execution.streaming.StreamingQueryListenerBus

[ https://issues.apache.org/jira/browse/SPARK-29423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16949340#comment-16949340 ] Yuming Wang commented on SPARK-29423: - Maybe we should lazily initialize {{Streaming

[jira] [Created] (SPARK-29438) Failed to get state store in stream-stream join

Genmao Yu created SPARK-29438: - Summary: Failed to get state store in stream-stream join Key: SPARK-29438 URL: https://issues.apache.org/jira/browse/SPARK-29438 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-29438) Failed to get state store in stream-stream join

[ https://issues.apache.org/jira/browse/SPARK-29438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Genmao Yu updated SPARK-29438: -- Description: Now, Spark use the `TaskPartitionId` to determine the StateStore path. {code:java} TaskPa

[jira] [Commented] (SPARK-29302) dynamic partition overwrite with speculation enabled

[ https://issues.apache.org/jira/browse/SPARK-29302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16949359#comment-16949359 ] Shimin Yang commented on SPARK-29302: - Hi [~hzfeiwang], thanks for your contribution

[jira] [Comment Edited] (SPARK-29302) dynamic partition overwrite with speculation enabled

[ https://issues.apache.org/jira/browse/SPARK-29302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16949190#comment-16949190 ] Shimin Yang edited comment on SPARK-29302 at 10/11/19 10:41 AM: --

[jira] [Commented] (SPARK-29438) Failed to get state store in stream-stream join

[ https://issues.apache.org/jira/browse/SPARK-29438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16949365#comment-16949365 ] Genmao Yu commented on SPARK-29438: --- There are several optional alternatives to resolv

[jira] [Comment Edited] (SPARK-29438) Failed to get state store in stream-stream join

[ https://issues.apache.org/jira/browse/SPARK-29438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16949365#comment-16949365 ] Genmao Yu edited comment on SPARK-29438 at 10/11/19 11:15 AM:

[jira] [Comment Edited] (SPARK-29438) Failed to get state store in stream-stream join

[ https://issues.apache.org/jira/browse/SPARK-29438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16949365#comment-16949365 ] Genmao Yu edited comment on SPARK-29438 at 10/11/19 11:15 AM:

[jira] [Updated] (SPARK-29427) Create KeyValueGroupedDataset in a relational way

[ https://issues.apache.org/jira/browse/SPARK-29427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexander Hagerf updated SPARK-29427: - Summary: Create KeyValueGroupedDataset in a relational way (was: Create KeyValueGrouped

[jira] [Commented] (SPARK-29438) Failed to get state store in stream-stream join

[ https://issues.apache.org/jira/browse/SPARK-29438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16949430#comment-16949430 ] Jungtaek Lim commented on SPARK-29438: -- Could you point out the codebase where you

[jira] [Comment Edited] (SPARK-29438) Failed to get state store in stream-stream join

[ https://issues.apache.org/jira/browse/SPARK-29438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16949430#comment-16949430 ] Jungtaek Lim edited comment on SPARK-29438 at 10/11/19 1:12 PM: --

[jira] [Created] (SPARK-29439) DDL commands should not use DataSourceV2Relation

Wenchen Fan created SPARK-29439: --- Summary: DDL commands should not use DataSourceV2Relation Key: SPARK-29439 URL: https://issues.apache.org/jira/browse/SPARK-29439 Project: Spark Issue Type: Im

[jira] [Assigned] (SPARK-29396) Extend Spark plugin interface to driver

[ https://issues.apache.org/jira/browse/SPARK-29396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves reassigned SPARK-29396: - Assignee: Thomas Graves > Extend Spark plugin interface to driver > ---

[jira] [Assigned] (SPARK-29396) Extend Spark plugin interface to driver

[ https://issues.apache.org/jira/browse/SPARK-29396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves reassigned SPARK-29396: - Assignee: (was: Thomas Graves) > Extend Spark plugin interface to driver >

[jira] [Commented] (SPARK-29396) Extend Spark plugin interface to driver

[ https://issues.apache.org/jira/browse/SPARK-29396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16949460#comment-16949460 ] Thomas Graves commented on SPARK-29396: ---  While I do like the idea, do we have som

[jira] [Commented] (SPARK-29438) Failed to get state store in stream-stream join

[ https://issues.apache.org/jira/browse/SPARK-29438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16949461#comment-16949461 ] Genmao Yu commented on SPARK-29438: --- [~kabhwan] Yes, the whole statestore path is `Ch

[jira] [Updated] (SPARK-29438) Failed to get state store in stream-stream join

[ https://issues.apache.org/jira/browse/SPARK-29438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Genmao Yu updated SPARK-29438: -- Description: Now, Spark use the `TaskPartitionId` to determine the StateStore path. {code:java} TaskPa

[jira] [Commented] (SPARK-29438) Failed to get state store in stream-stream join

[ https://issues.apache.org/jira/browse/SPARK-29438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16949465#comment-16949465 ] Jungtaek Lim commented on SPARK-29438: -- Could you please link the actual code block

[jira] [Created] (SPARK-29440) Support java.time.Duration as an external type of CalendarIntervalType

Maxim Gekk created SPARK-29440: -- Summary: Support java.time.Duration as an external type of CalendarIntervalType Key: SPARK-29440 URL: https://issues.apache.org/jira/browse/SPARK-29440 Project: Spark

[jira] [Commented] (SPARK-29437) CSV Writer should escape 'escapechar' when it exists in the data

[ https://issues.apache.org/jira/browse/SPARK-29437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16949483#comment-16949483 ] Ankit Raj Boudh commented on SPARK-29437: - hi @Tomasz Bartczak, I will check th

[jira] [Commented] (SPARK-29435) Spark 3 doesnt work with older shuffle service

[ https://issues.apache.org/jira/browse/SPARK-29435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16949508#comment-16949508 ] Sandeep Katta commented on SPARK-29435: --- [~koert] I will investigate this further,

[jira] [Issue Comment Deleted] (SPARK-29435) Spark 3 doesnt work with older shuffle service

[ https://issues.apache.org/jira/browse/SPARK-29435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandeep Katta updated SPARK-29435: -- Comment: was deleted (was: [~koert] I will investigate this further, If I found root cause wil

[jira] [Commented] (SPARK-16534) Kafka 0.10 Python support

[ https://issues.apache.org/jira/browse/SPARK-16534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16949521#comment-16949521 ] Rakesh commented on SPARK-16534: Was this actually resolved? Any when the support will b

[jira] [Commented] (SPARK-29435) Spark 3 doesnt work with older shuffle service

[ https://issues.apache.org/jira/browse/SPARK-29435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16949522#comment-16949522 ] Sandeep Katta commented on SPARK-29435: --- Ya I am even able to reproduce it, I am l

[jira] [Comment Edited] (SPARK-16534) Kafka 0.10 Python support

[ https://issues.apache.org/jira/browse/SPARK-16534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16949521#comment-16949521 ] Rakesh edited comment on SPARK-16534 at 10/11/19 2:59 PM: -- Was

[jira] [Created] (SPARK-29441) Unable to Alter table column type in spark.

prudhviraj created SPARK-29441: -- Summary: Unable to Alter table column type in spark. Key: SPARK-29441 URL: https://issues.apache.org/jira/browse/SPARK-29441 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-16534) Kafka 0.10 Python support

[ https://issues.apache.org/jira/browse/SPARK-16534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16949554#comment-16949554 ] Hyukjin Kwon commented on SPARK-16534: -- No, it was resolved as discussed about affe

[jira] [Commented] (SPARK-16534) Kafka 0.10 Python support

[ https://issues.apache.org/jira/browse/SPARK-16534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16949556#comment-16949556 ] Hyukjin Kwon commented on SPARK-16534: -- Actually, this JIRA seems not going to be f

[jira] [Updated] (SPARK-29423) leak on org.apache.spark.sql.execution.streaming.StreamingQueryListenerBus

[ https://issues.apache.org/jira/browse/SPARK-29423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-29423: - Affects Version/s: 2.4.3 > leak on org.apache.spark.sql.execution.streaming.StreamingQueryListe

[jira] [Commented] (SPARK-28547) Make it work for wide (> 10K columns data)

[ https://issues.apache.org/jira/browse/SPARK-28547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16949561#comment-16949561 ] Hyukjin Kwon commented on SPARK-28547: -- [~antonkulaga], if you're unable to elabora

[jira] [Commented] (SPARK-29428) Can't persist/set None-valued param

[ https://issues.apache.org/jira/browse/SPARK-29428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16949586#comment-16949586 ] Huaxin Gao commented on SPARK-29428: I will take a look of this. > Can't persist/s

[jira] [Commented] (SPARK-27981) Remove `Illegal reflective access` warning for `java.nio.Bits.unaligned()`

[ https://issues.apache.org/jira/browse/SPARK-27981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16949598#comment-16949598 ] Kuhu Shukla commented on SPARK-27981: - Hello [~dongjoon], I am seeing the following

[jira] [Created] (SPARK-29442) Last `mode("default")` should work like `mode("error")`

Dongjoon Hyun created SPARK-29442: - Summary: Last `mode("default")` should work like `mode("error")` Key: SPARK-29442 URL: https://issues.apache.org/jira/browse/SPARK-29442 Project: Spark Iss

[jira] [Updated] (SPARK-29442) Set `default` mode should override the existing mode

[ https://issues.apache.org/jira/browse/SPARK-29442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29442: -- Summary: Set `default` mode should override the existing mode (was: Last `mode("default")` sh

[jira] [Created] (SPARK-29443) Spark-on-Kubernetes: driver pod keeps spinning/terminating executor pods

James Nguyen created SPARK-29443: Summary: Spark-on-Kubernetes: driver pod keeps spinning/terminating executor pods Key: SPARK-29443 URL: https://issues.apache.org/jira/browse/SPARK-29443 Project: Spa

[jira] [Commented] (SPARK-29396) Extend Spark plugin interface to driver

[ https://issues.apache.org/jira/browse/SPARK-29396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16949669#comment-16949669 ] Imran Rashid commented on SPARK-29396: -- The memory monitor plugin I wrote (why I pu

[jira] [Updated] (SPARK-29443) Spark-on-Kubernetes: driver pod keeps spinning/terminating executor pods

[ https://issues.apache.org/jira/browse/SPARK-29443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Nguyen updated SPARK-29443: - Environment: EKS version: v1.14.6-eks-5047ed with 18 x r5a.12xlarge EC2 instances as Worker nod

[jira] [Updated] (SPARK-29432) nullable flag of new column changes when persisting a pyspark dataframe

[ https://issues.apache.org/jira/browse/SPARK-29432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanna Saraswathi Krishnan updated SPARK-29432: - Description: When I add a new column to a dataframe with {{withC

[jira] [Updated] (SPARK-29432) nullable flag of new column changes when persisting a pyspark dataframe

[ https://issues.apache.org/jira/browse/SPARK-29432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanna Saraswathi Krishnan updated SPARK-29432: - Issue Type: Bug (was: Question) > nullable flag of new column c

[jira] [Reopened] (SPARK-29432) nullable flag of new column changes when persisting a pyspark dataframe

[ https://issues.apache.org/jira/browse/SPARK-29432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanna Saraswathi Krishnan reopened SPARK-29432: -- Edited the commands to reproduce the issue. The issue is not resol

[jira] [Commented] (SPARK-29432) nullable flag of new column changes when persisting a pyspark dataframe

[ https://issues.apache.org/jira/browse/SPARK-29432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16949678#comment-16949678 ] Prasanna Saraswathi Krishnan commented on SPARK-29432: -- Hello I co

[jira] [Comment Edited] (SPARK-29432) nullable flag of new column changes when persisting a pyspark dataframe

[ https://issues.apache.org/jira/browse/SPARK-29432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16949068#comment-16949068 ] Prasanna Saraswathi Krishnan edited comment on SPARK-29432 at 10/11/19 5:51 PM: --

[jira] [Updated] (SPARK-27812) kubernetes client import non-daemon thread which block jvm exit.

[ https://issues.apache.org/jira/browse/SPARK-27812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ilan Filonenko updated SPARK-27812: --- Affects Version/s: 2.4.4 > kubernetes client import non-daemon thread which block jvm exit.

[jira] [Commented] (SPARK-29396) Extend Spark plugin interface to driver

[ https://issues.apache.org/jira/browse/SPARK-29396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16949765#comment-16949765 ] Luca Canali commented on SPARK-29396: - This looks quite a good improvement proposal

[jira] [Commented] (SPARK-28867) InMemoryStore checkpoint to speed up replay log file in HistoryServer

[ https://issues.apache.org/jira/browse/SPARK-28867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16949767#comment-16949767 ] Imran Rashid commented on SPARK-28867: -- This is closely related to SPARK-20656. It

[jira] [Assigned] (SPARK-29306) Executors need to track what ResourceProfile they are created with

[ https://issues.apache.org/jira/browse/SPARK-29306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves reassigned SPARK-29306: - Assignee: Thomas Graves > Executors need to track what ResourceProfile they are created

[jira] [Assigned] (SPARK-29148) Modify dynamic allocation manager for stage level scheduling

[ https://issues.apache.org/jira/browse/SPARK-29148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves reassigned SPARK-29148: - Assignee: Thomas Graves > Modify dynamic allocation manager for stage level scheduling

[jira] [Assigned] (SPARK-29415) Stage Level Sched: Add base ResourceProfile and Request classes

[ https://issues.apache.org/jira/browse/SPARK-29415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves reassigned SPARK-29415: - Assignee: Thomas Graves > Stage Level Sched: Add base ResourceProfile and Request class

[jira] [Assigned] (SPARK-25341) Support rolling back a shuffle map stage and re-generate the shuffle files

[ https://issues.apache.org/jira/browse/SPARK-25341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh reassigned SPARK-25341: --- Assignee: Yuanjian Li > Support rolling back a shuffle map stage and re-generate the shuffl

[jira] [Assigned] (SPARK-29402) Add tests for grouped map pandas_udf using window

[ https://issues.apache.org/jira/browse/SPARK-29402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler reassigned SPARK-29402: Assignee: Bryan Cutler > Add tests for grouped map pandas_udf using window >

[jira] [Resolved] (SPARK-29402) Add tests for grouped map pandas_udf using window

[ https://issues.apache.org/jira/browse/SPARK-29402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler resolved SPARK-29402. -- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26063 [https://gi

[jira] [Commented] (SPARK-29428) Can't persist/set None-valued param

[ https://issues.apache.org/jira/browse/SPARK-29428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16949863#comment-16949863 ] Huaxin Gao commented on SPARK-29428: This seems to be a usage error. The error was i

[jira] [Created] (SPARK-29444) Add configuration to support JacksonGenrator to keep fields with null values

Jackey Lee created SPARK-29444: -- Summary: Add configuration to support JacksonGenrator to keep fields with null values Key: SPARK-29444 URL: https://issues.apache.org/jira/browse/SPARK-29444 Project: Spa

[jira] [Commented] (SPARK-29222) Flaky test: pyspark.mllib.tests.test_streaming_algorithms.StreamingLinearRegressionWithTests.test_parameter_convergence

[ https://issues.apache.org/jira/browse/SPARK-29222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16949869#comment-16949869 ] huangtianhua commented on SPARK-29222: -- [~hyukjin.kwon], we took test to increase d

[jira] [Commented] (SPARK-12014) Spark SQL query containing semicolon is broken in Beeline (related to HIVE-11100)

[ https://issues.apache.org/jira/browse/SPARK-12014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16949874#comment-16949874 ] Yuming Wang commented on SPARK-12014: - [~chutium] This issue has been fixed since we

[jira] [Commented] (SPARK-29435) Spark 3 doesnt work with older shuffle service

[ https://issues.apache.org/jira/browse/SPARK-29435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16949881#comment-16949881 ] Sandeep Katta commented on SPARK-29435: --- [~koert] can you please apply this [patc

[jira] [Commented] (SPARK-29295) Duplicate result when dropping partition of an external table and then overwriting

[ https://issues.apache.org/jira/browse/SPARK-29295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16949886#comment-16949886 ] angerszhu commented on SPARK-29295: ---  This probelm seems start from hive 1.2 I test i

[jira] [Commented] (SPARK-29426) Watermark does not take effect

[ https://issues.apache.org/jira/browse/SPARK-29426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16949892#comment-16949892 ] Jungtaek Lim commented on SPARK-29426: -- Could you attach query listener and see the

[jira] [Commented] (SPARK-29421) Add an opportunity to change the file format of command CREATE TABLE LIKE

[ https://issues.apache.org/jira/browse/SPARK-29421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16949899#comment-16949899 ] Lantao Jin commented on SPARK-29421: PR filed. [~cloud_fan], could you help to revie

[jira] [Commented] (SPARK-29428) Can't persist/set None-valued param

[ https://issues.apache.org/jira/browse/SPARK-29428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16949908#comment-16949908 ] L. C. Hsieh commented on SPARK-29428: - Yeah, I think it is not valid to set None to

[jira] [Commented] (SPARK-29432) nullable flag of new column changes when persisting a pyspark dataframe

[ https://issues.apache.org/jira/browse/SPARK-29432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16949910#comment-16949910 ] L. C. Hsieh commented on SPARK-29432: - You can find related discussion like: http:/

[jira] [Created] (SPARK-29445) Bump netty-all from 4.1.39.Final to 4.1.42.Final

Fokko Driesprong created SPARK-29445: Summary: Bump netty-all from 4.1.39.Final to 4.1.42.Final Key: SPARK-29445 URL: https://issues.apache.org/jira/browse/SPARK-29445 Project: Spark Issu

[jira] [Created] (SPARK-29446) Upgrade netty-all to 4.1.42 and fix vulnerabilities.

jiaan.geng created SPARK-29446: -- Summary: Upgrade netty-all to 4.1.42 and fix vulnerabilities. Key: SPARK-29446 URL: https://issues.apache.org/jira/browse/SPARK-29446 Project: Spark Issue Type: