[jira] [Updated] (SPARK-37604) The option emptyValueInRead(in CSVOptions) is suggested to be designed as that any fields matching this string will be set as empty values "" when reading

[ https://issues.apache.org/jira/browse/SPARK-37604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Guo updated SPARK-37604: Description: The csv data format is imported from databricks [spark-csv|https://github.com/databricks/spa

[jira] [Updated] (SPARK-37604) The option emptyValueInRead(in CSVOptions) is suggested to be designed as that any fields matching this string will be set as empty values "" when reading

[ https://issues.apache.org/jira/browse/SPARK-37604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Guo updated SPARK-37604: Description: The csv data format is imported from databricks [spark-csv|https://github.com/databricks/spa

[jira] [Updated] (SPARK-37604) The option emptyValueInRead(in CSVOptions) is suggested to be designed as that any fields matching this string will be set as empty values "" when reading

[ https://issues.apache.org/jira/browse/SPARK-37604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Guo updated SPARK-37604: Description: The csv data format is imported from databricks [spark-csv|https://github.com/databricks/spa

[jira] [Updated] (SPARK-37604) The option emptyValueInRead(in CSVOptions) is suggested to be designed as that any fields matching this string will be set as empty values "" when reading

[ https://issues.apache.org/jira/browse/SPARK-37604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Guo updated SPARK-37604: Description: The csv data format is imported from databricks [spark-csv|https://github.com/databricks/spa

[jira] [Updated] (SPARK-37604) The option emptyValueInRead(in CSVOptions) is suggested to be designed as that any fields matching this string will be set as empty values "" when reading

[ https://issues.apache.org/jira/browse/SPARK-37604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Guo updated SPARK-37604: Description: The csv data format is imported from databricks [spark-csv|https://github.com/databricks/spa

[jira] [Updated] (SPARK-37604) The parameter emptyValueInRead(in CSVOptions) is suggested to be designed as that any fields matching this string will be set as empty values "" when reading

[ https://issues.apache.org/jira/browse/SPARK-37604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Guo updated SPARK-37604: Description: The csv data format is imported from databricks [spark-csv|https://github.com/databricks/spa

[jira] [Updated] (SPARK-37604) The option emptyValueInRead(in CSVOptions) is suggested to be designed as that any fields matching this string will be set as empty values "" when reading

[ https://issues.apache.org/jira/browse/SPARK-37604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Guo updated SPARK-37604: Summary: The option emptyValueInRead(in CSVOptions) is suggested to be designed as that any fields matchin

[jira] [Updated] (SPARK-37593) Optimize HeapMemoryAllocator to avoid memory waste when using G1GC

[ https://issues.apache.org/jira/browse/SPARK-37593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] EdisonWang updated SPARK-37593: --- Description: Spark's tungsten memory model usually tries to allocate memory by one `page` each time

[jira] [Updated] (SPARK-37593) Optimize HeapMemoryAllocator to avoid memory waste when using G1GC

[ https://issues.apache.org/jira/browse/SPARK-37593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] EdisonWang updated SPARK-37593: --- Summary: Optimize HeapMemoryAllocator to avoid memory waste when using G1GC (was: Optimize HeapMemo

[jira] [Updated] (SPARK-37604) The parameter emptyValueInRead(in CSVOptions) is suggested to be designed as that any fields matching this string will be set as empty values "" when reading

[ https://issues.apache.org/jira/browse/SPARK-37604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Guo updated SPARK-37604: Description: Csv data format is For null values, the parameter nullValue can be set when reading or writi

[jira] [Updated] (SPARK-37604) The parameter emptyValueInRead(in CSVOptions) is suggested to be designed as that any fields matching this string will be set as empty values "" when reading

[ https://issues.apache.org/jira/browse/SPARK-37604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Guo updated SPARK-37604: Summary: The parameter emptyValueInRead(in CSVOptions) is suggested to be designed as that any fields matc

[jira] [Updated] (SPARK-37604) The parameter emptyValueInRead is suggested to be designed as that any fields matching this string will be set as empty values "" when reading

[ https://issues.apache.org/jira/browse/SPARK-37604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Guo updated SPARK-37604: Summary: The parameter emptyValueInRead is suggested to be designed as that any fields matching this strin

[jira] [Updated] (SPARK-37604) The parameter emptyValueInRead is suggested to be designed that any fields matching this string will be set as empty values "" when reading

[ https://issues.apache.org/jira/browse/SPARK-37604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Guo updated SPARK-37604: Summary: The parameter emptyValueInRead is suggested to be designed that any fields matching this string w

[jira] [Updated] (SPARK-37604) The parameter emptyValueInRead is suggested to be designed that any fields matching this string will be set as empty values "" when reading to be

[ https://issues.apache.org/jira/browse/SPARK-37604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Guo updated SPARK-37604: Summary: The parameter emptyValueInRead is suggested to be designed that any fields matching this string w

[jira] [Resolved] (SPARK-37558) Improve spark-sql cli command doc

[ https://issues.apache.org/jira/browse/SPARK-37558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-37558. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34821 [https://gith

[jira] [Assigned] (SPARK-37558) Improve spark-sql cli command doc

[ https://issues.apache.org/jira/browse/SPARK-37558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-37558: --- Assignee: angerszhu > Improve spark-sql cli command doc > -

[jira] [Updated] (SPARK-37604) The parameter emptyValueInRead in CSVOptions is not designed as it supposed to be

[ https://issues.apache.org/jira/browse/SPARK-37604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Guo updated SPARK-37604: Summary: The parameter emptyValueInRead in CSVOptions is not designed as it supposed to be (was: The para

[jira] (SPARK-37604) The parameter emptyValueInRead in CSVOptions is not designed as supposed to be

[ https://issues.apache.org/jira/browse/SPARK-37604 ] Wei Guo deleted comment on SPARK-37604: - was (Author: wayne guo): [~hyukjin.kwon] [~mmolimar]  Can we discuss it? > The parameter emptyValueInRead in CSVOptions is not designed as supposed to be

[jira] [Commented] (SPARK-37060) Report driver status does not handle response from backup masters

[ https://issues.apache.org/jira/browse/SPARK-37060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17459952#comment-17459952 ] Apache Spark commented on SPARK-37060: -- User 'mohamadrezarostami' has created a pul

[jira] [Commented] (SPARK-37060) Report driver status does not handle response from backup masters

[ https://issues.apache.org/jira/browse/SPARK-37060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17459950#comment-17459950 ] Apache Spark commented on SPARK-37060: -- User 'mohamadrezarostami' has created a pul

[jira] [Commented] (SPARK-37060) Report driver status does not handle response from backup masters

[ https://issues.apache.org/jira/browse/SPARK-37060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17459947#comment-17459947 ] Apache Spark commented on SPARK-37060: -- User 'mohamadrezarostami' has created a pul

[jira] [Assigned] (SPARK-37060) Report driver status does not handle response from backup masters

[ https://issues.apache.org/jira/browse/SPARK-37060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wuyi reassigned SPARK-37060: Assignee: Mohamadreza Rostami > Report driver status does not handle response from backup masters > -

[jira] [Resolved] (SPARK-37060) Report driver status does not handle response from backup masters

[ https://issues.apache.org/jira/browse/SPARK-37060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wuyi resolved SPARK-37060. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by https://github.com/apache/spark/pull/34331 >

[jira] [Assigned] (SPARK-37653) Upgrade RoaringBitmap to 0.9.23

[ https://issues.apache.org/jira/browse/SPARK-37653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37653: Assignee: Apache Spark > Upgrade RoaringBitmap to 0.9.23 > --

[jira] [Commented] (SPARK-37653) Upgrade RoaringBitmap to 0.9.23

[ https://issues.apache.org/jira/browse/SPARK-37653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17459914#comment-17459914 ] Apache Spark commented on SPARK-37653: -- User 'LuciferYang' has created a pull reque

[jira] [Assigned] (SPARK-37653) Upgrade RoaringBitmap to 0.9.23

[ https://issues.apache.org/jira/browse/SPARK-37653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37653: Assignee: (was: Apache Spark) > Upgrade RoaringBitmap to 0.9.23 > ---

[jira] [Commented] (SPARK-37652) Support optimize skewed join through union

[ https://issues.apache.org/jira/browse/SPARK-37652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17459911#comment-17459911 ] Apache Spark commented on SPARK-37652: -- User 'mcdull-zhang' has created a pull requ

[jira] [Commented] (SPARK-37652) Support optimize skewed join through union

[ https://issues.apache.org/jira/browse/SPARK-37652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17459910#comment-17459910 ] Apache Spark commented on SPARK-37652: -- User 'mcdull-zhang' has created a pull requ

[jira] [Assigned] (SPARK-37652) Support optimize skewed join through union

[ https://issues.apache.org/jira/browse/SPARK-37652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37652: Assignee: (was: Apache Spark) > Support optimize skewed join through union >

[jira] [Assigned] (SPARK-37652) Support optimize skewed join through union

[ https://issues.apache.org/jira/browse/SPARK-37652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37652: Assignee: Apache Spark > Support optimize skewed join through union > ---

[jira] [Updated] (SPARK-37652) Support optimize skewed join through union

[ https://issues.apache.org/jira/browse/SPARK-37652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] mcdull_zhang updated SPARK-37652: - Description: `OptimizeSkewedJoin` rule will take effect only when the plan has two ShuffleQuery

[jira] [Created] (SPARK-37653) Upgrade RoaringBitmap to 0.9.23

Yang Jie created SPARK-37653: Summary: Upgrade RoaringBitmap to 0.9.23 Key: SPARK-37653 URL: https://issues.apache.org/jira/browse/SPARK-37653 Project: Spark Issue Type: Improvement Com

[jira] [Updated] (SPARK-37652) Support optimize skewed join through union

[ https://issues.apache.org/jira/browse/SPARK-37652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] mcdull_zhang updated SPARK-37652: - Description: `OptimizeSkewedJoin` rule will take effect only when the plan has two ShuffleQuery

[jira] [Created] (SPARK-37652) Support optimize skewed join through union

mcdull_zhang created SPARK-37652: Summary: Support optimize skewed join through union Key: SPARK-37652 URL: https://issues.apache.org/jira/browse/SPARK-37652 Project: Spark Issue Type: Sub-ta

[jira] [Updated] (SPARK-37652) Support optimize skewed join through union

[ https://issues.apache.org/jira/browse/SPARK-37652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] mcdull_zhang updated SPARK-37652: - Description: `OptimizeSkewedJoin` rule will take effect only when the plan has two ShuffleQuery

[jira] [Resolved] (SPARK-37373) Collect LocalSparkContext worker logs in case of test failure

[ https://issues.apache.org/jira/browse/SPARK-37373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-37373. Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34651 [https:

[jira] [Commented] (SPARK-34735) Add modified configs for SQL execution in UI

[ https://issues.apache.org/jira/browse/SPARK-34735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17459750#comment-17459750 ] Apache Spark commented on SPARK-34735: -- User 'ulysses-you' has created a pull reque

[jira] [Commented] (SPARK-34735) Add modified configs for SQL execution in UI

[ https://issues.apache.org/jira/browse/SPARK-34735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17459749#comment-17459749 ] Apache Spark commented on SPARK-34735: -- User 'ulysses-you' has created a pull reque

<    1   2