[jira] [Resolved] (SPARK-46900) Upgrade slf4j to 2.0.11

[ https://issues.apache.org/jira/browse/SPARK-46900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46900. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44928

[jira] [Assigned] (SPARK-46900) Upgrade slf4j to 2.0.11

[ https://issues.apache.org/jira/browse/SPARK-46900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-46900: - Assignee: Yang Jie > Upgrade slf4j to 2.0.11 > --- > >

[jira] [Updated] (SPARK-46901) Upgrade pyarrow to 15.0.0

[ https://issues.apache.org/jira/browse/SPARK-46901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46901: --- Labels: pull-request-available (was: ) > Upgrade pyarrow to 15.0.0 >

[jira] [Resolved] (SPARK-46901) Upgrade pyarrow to 15.0.0

[ https://issues.apache.org/jira/browse/SPARK-46901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46901. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44924

[jira] [Resolved] (SPARK-46721) Some tests failed when cherry-picking https://github.com/apache/spark/pull/43494 back to branch 3.5

[ https://issues.apache.org/jira/browse/SPARK-46721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wu Yi resolved SPARK-46721. --- Resolution: Fixed Issue resolved by pull request 44735 [https://github.com/apache/spark/pull/44735] > Some

[jira] [Assigned] (SPARK-46721) Some tests failed when cherry-picking https://github.com/apache/spark/pull/43494 back to branch 3.5

[ https://issues.apache.org/jira/browse/SPARK-46721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wu Yi reassigned SPARK-46721: - Assignee: Bobby Wang > Some tests failed when cherry-picking >

[jira] [Resolved] (SPARK-46899) Remove POST APIs from `MasterWebUI` when spark.ui.killEnabled is false

[ https://issues.apache.org/jira/browse/SPARK-46899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46899. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44926

[jira] [Assigned] (SPARK-46899) Remove POST APIs from `MasterWebUI` when spark.ui.killEnabled is false

[ https://issues.apache.org/jira/browse/SPARK-46899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-46899: - Assignee: Dongjoon Hyun > Remove POST APIs from `MasterWebUI` when

[jira] [Updated] (SPARK-46900) Upgrade slf4j to 2.0.11

[ https://issues.apache.org/jira/browse/SPARK-46900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46900: --- Labels: pull-request-available (was: ) > Upgrade slf4j to 2.0.11 > ---

[jira] [Created] (SPARK-46900) Upgrade slf4j to 2.0.11

Yang Jie created SPARK-46900: Summary: Upgrade slf4j to 2.0.11 Key: SPARK-46900 URL: https://issues.apache.org/jira/browse/SPARK-46900 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-39717) Spark on YARN + preemption: "Not removing executor 304 because the ResourceProfile was UNKNOWN"

[ https://issues.apache.org/jira/browse/SPARK-39717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17811747#comment-17811747 ] GANHONGNAN commented on SPARK-39717: Is there any update about this issue? > Spark on YARN +

[jira] [Resolved] (SPARK-46898) Simplify the protobuf function transformation in Planner

[ https://issues.apache.org/jira/browse/SPARK-46898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-46898. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44925

[jira] [Assigned] (SPARK-46898) Simplify the protobuf function transformation in Planner

[ https://issues.apache.org/jira/browse/SPARK-46898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-46898: Assignee: Ruifeng Zheng > Simplify the protobuf function transformation in Planner >

[jira] [Assigned] (SPARK-46897) Refine docstring of `bit_and/bit_or/bit_xor`

[ https://issues.apache.org/jira/browse/SPARK-46897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-46897: - Assignee: Yang Jie > Refine docstring of `bit_and/bit_or/bit_xor` >

[jira] [Resolved] (SPARK-46897) Refine docstring of `bit_and/bit_or/bit_xor`

[ https://issues.apache.org/jira/browse/SPARK-46897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46897. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44923

[jira] [Updated] (SPARK-46899) Remove POST APIs from `MasterWebUI` when spark.ui.killEnabled is false

[ https://issues.apache.org/jira/browse/SPARK-46899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46899: --- Labels: pull-request-available (was: ) > Remove POST APIs from `MasterWebUI` when

[jira] [Created] (SPARK-46899) Remove POST APIs from `MasterWebUI` when spark.ui.killEnabled is false

Dongjoon Hyun created SPARK-46899: - Summary: Remove POST APIs from `MasterWebUI` when spark.ui.killEnabled is false Key: SPARK-46899 URL: https://issues.apache.org/jira/browse/SPARK-46899 Project:

[jira] [Updated] (SPARK-46898) Simplify the protobuf function transformation in Planner

[ https://issues.apache.org/jira/browse/SPARK-46898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46898: --- Labels: pull-request-available (was: ) > Simplify the protobuf function transformation in

[jira] [Created] (SPARK-46898) Simplify the protobuf function transformation in Planner

Ruifeng Zheng created SPARK-46898: - Summary: Simplify the protobuf function transformation in Planner Key: SPARK-46898 URL: https://issues.apache.org/jira/browse/SPARK-46898 Project: Spark

[jira] [Resolved] (SPARK-46896) Clean up the imports in `pyspark.pandas.tests.{frame, series, groupby}.*`

[ https://issues.apache.org/jira/browse/SPARK-46896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-46896. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44922

[jira] [Assigned] (SPARK-46896) Clean up the imports in `pyspark.pandas.tests.{frame, series, groupby}.*`

[ https://issues.apache.org/jira/browse/SPARK-46896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-46896: - Assignee: Ruifeng Zheng > Clean up the imports in `pyspark.pandas.tests.{frame,

[jira] [Updated] (SPARK-46897) Refine docstring of `bit_and/bit_or/bit_xor`

[ https://issues.apache.org/jira/browse/SPARK-46897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46897: --- Labels: pull-request-available (was: ) > Refine docstring of `bit_and/bit_or/bit_xor` >

[jira] [Created] (SPARK-46897) Refine docstring of `bit_and/bit_or/bit_xor`

Yang Jie created SPARK-46897: Summary: Refine docstring of `bit_and/bit_or/bit_xor` Key: SPARK-46897 URL: https://issues.apache.org/jira/browse/SPARK-46897 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-46896) Clean up the imports in `pyspark.pandas.tests.{frame, series, groupby}.*`

[ https://issues.apache.org/jira/browse/SPARK-46896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-46896: -- Parent: SPARK-46457 Issue Type: Sub-task (was: Improvement) > Clean up the imports

[jira] [Updated] (SPARK-46896) Clean up the imports in `pyspark.pandas.tests.{frame, series, groupby}.*`

[ https://issues.apache.org/jira/browse/SPARK-46896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46896: --- Labels: pull-request-available (was: ) > Clean up the imports in

[jira] [Created] (SPARK-46896) Clean up the imports in `pyspark.pandas.tests.{frame, series, groupby}.*`

Ruifeng Zheng created SPARK-46896: - Summary: Clean up the imports in `pyspark.pandas.tests.{frame, series, groupby}.*` Key: SPARK-46896 URL: https://issues.apache.org/jira/browse/SPARK-46896 Project:

[jira] [Resolved] (SPARK-46874) Remove pyspark.pandas dependency from assertDataFrameEqual

[ https://issues.apache.org/jira/browse/SPARK-46874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46874. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44899

[jira] [Assigned] (SPARK-46874) Remove pyspark.pandas dependency from assertDataFrameEqual

[ https://issues.apache.org/jira/browse/SPARK-46874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-46874: - Assignee: Haejoon Lee > Remove pyspark.pandas dependency from assertDataFrameEqual >

[jira] [Updated] (SPARK-46895) Replace Timer with single thread scheduled executor

[ https://issues.apache.org/jira/browse/SPARK-46895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46895: --- Labels: pull-request-available (was: ) > Replace Timer with single thread scheduled

[jira] [Created] (SPARK-46895) Replace Timer with single thread scheduled executor

Jiaan Geng created SPARK-46895: -- Summary: Replace Timer with single thread scheduled executor Key: SPARK-46895 URL: https://issues.apache.org/jira/browse/SPARK-46895 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-46889) Validate `spark.master.ui.decommission.allow.mode` setting

[ https://issues.apache.org/jira/browse/SPARK-46889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46889. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44916

[jira] [Assigned] (SPARK-46873) PySpark spark.streams should not recreate new StreamingQueryManager

[ https://issues.apache.org/jira/browse/SPARK-46873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46873: Assignee: Wei Liu > PySpark spark.streams should not recreate new StreamingQueryManager

[jira] [Resolved] (SPARK-46873) PySpark spark.streams should not recreate new StreamingQueryManager

[ https://issues.apache.org/jira/browse/SPARK-46873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46873. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44898

[jira] [Updated] (SPARK-46894) Move PySpark error conditions into standalone JSON file

[ https://issues.apache.org/jira/browse/SPARK-46894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46894: --- Labels: pull-request-available (was: ) > Move PySpark error conditions into standalone

[jira] [Created] (SPARK-46894) Move PySpark error conditions into standalone JSON file

Nicholas Chammas created SPARK-46894: Summary: Move PySpark error conditions into standalone JSON file Key: SPARK-46894 URL: https://issues.apache.org/jira/browse/SPARK-46894 Project: Spark

[jira] [Resolved] (SPARK-46892) Upgrade dropwizard metrics 4.2.25

[ https://issues.apache.org/jira/browse/SPARK-46892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46892. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44918

[jira] [Created] (SPARK-46893) Sanitize UI descriptions from inline scripts

Willi Raschkowski created SPARK-46893: - Summary: Sanitize UI descriptions from inline scripts Key: SPARK-46893 URL: https://issues.apache.org/jira/browse/SPARK-46893 Project: Spark Issue

[jira] [Updated] (SPARK-46893) Sanitize UI descriptions from inline scripts

[ https://issues.apache.org/jira/browse/SPARK-46893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Willi Raschkowski updated SPARK-46893: -- Attachment: Screen Recording 2024-01-28 at 17.51.47.mov > Sanitize UI descriptions

[jira] [Updated] (SPARK-3734) DriverRunner should not read SPARK_HOME from submitter's environment

[ https://issues.apache.org/jira/browse/SPARK-3734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-3734: -- Labels: pull-request-available (was: ) > DriverRunner should not read SPARK_HOME from

[jira] [Updated] (SPARK-46892) Upgrade dropwizard metrics 4.2.25

[ https://issues.apache.org/jira/browse/SPARK-46892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46892: --- Labels: pull-request-available (was: ) > Upgrade dropwizard metrics 4.2.25 >

[jira] [Created] (SPARK-46892) Upgrade dropwizard metrics 4.2.25

BingKun Pan created SPARK-46892: --- Summary: Upgrade dropwizard metrics 4.2.25 Key: SPARK-46892 URL: https://issues.apache.org/jira/browse/SPARK-46892 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-46891) allow configure of statistics logical plan visitor

Izek Greenfield created SPARK-46891: --- Summary: allow configure of statistics logical plan visitor Key: SPARK-46891 URL: https://issues.apache.org/jira/browse/SPARK-46891 Project: Spark

[jira] [Assigned] (SPARK-46753) Fix `pypy3` python test

[ https://issues.apache.org/jira/browse/SPARK-46753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-46753: -- Assignee: (was: Apache Spark) > Fix `pypy3` python test >

[jira] [Assigned] (SPARK-46753) Fix `pypy3` python test

[ https://issues.apache.org/jira/browse/SPARK-46753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-46753: -- Assignee: Apache Spark > Fix `pypy3` python test > --- > >

[jira] [Assigned] (SPARK-46753) Fix `pypy3` python test

[ https://issues.apache.org/jira/browse/SPARK-46753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-46753: -- Assignee: Apache Spark > Fix `pypy3` python test > --- > >

[jira] [Assigned] (SPARK-46873) PySpark spark.streams should not recreate new StreamingQueryManager

[ https://issues.apache.org/jira/browse/SPARK-46873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-46873: -- Assignee: (was: Apache Spark) > PySpark spark.streams should not recreate new

[jira] [Assigned] (SPARK-46873) PySpark spark.streams should not recreate new StreamingQueryManager

[ https://issues.apache.org/jira/browse/SPARK-46873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-46873: -- Assignee: Apache Spark > PySpark spark.streams should not recreate new

[jira] [Assigned] (SPARK-46753) Fix `pypy3` python test

[ https://issues.apache.org/jira/browse/SPARK-46753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-46753: -- Assignee: (was: Apache Spark) > Fix `pypy3` python test >

[jira] [Assigned] (SPARK-46873) PySpark spark.streams should not recreate new StreamingQueryManager

[ https://issues.apache.org/jira/browse/SPARK-46873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-46873: -- Assignee: (was: Apache Spark) > PySpark spark.streams should not recreate new

[jira] [Assigned] (SPARK-46873) PySpark spark.streams should not recreate new StreamingQueryManager

[ https://issues.apache.org/jira/browse/SPARK-46873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-46873: -- Assignee: Apache Spark > PySpark spark.streams should not recreate new

[jira] [Updated] (SPARK-46890) CSV fails on a column with default and without enforcing schema

[ https://issues.apache.org/jira/browse/SPARK-46890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-46890: - Description: When we create a table using CSV on an existing file with a header and: - a column has an

[jira] (SPARK-46890) CSV fails on a column with default and without enforcing schema

[ https://issues.apache.org/jira/browse/SPARK-46890 ] Max Gekk deleted comment on SPARK-46890: -- was (Author: maxgekk): @dtenedor FYI > CSV fails on a column with default and without enforcing schema >

[jira] [Commented] (SPARK-46890) CSV fails on a column with default and without enforcing schema

[ https://issues.apache.org/jira/browse/SPARK-46890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17811638#comment-17811638 ] Max Gekk commented on SPARK-46890: -- [~dtenedor] FYI > CSV fails on a column with default and without

[jira] [Commented] (SPARK-46890) CSV fails on a column with default and without enforcing schema

[ https://issues.apache.org/jira/browse/SPARK-46890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17811637#comment-17811637 ] Max Gekk commented on SPARK-46890: -- @dtenedor FYI > CSV fails on a column with default and without

[jira] [Created] (SPARK-46890) CSV fails on a column with default and without enforcing schema

Max Gekk created SPARK-46890: Summary: CSV fails on a column with default and without enforcing schema Key: SPARK-46890 URL: https://issues.apache.org/jira/browse/SPARK-46890 Project: Spark

[jira] [Assigned] (SPARK-46890) CSV fails on a column with default and without enforcing schema

[ https://issues.apache.org/jira/browse/SPARK-46890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-46890: Assignee: (was: Max Gekk) > CSV fails on a column with default and without enforcing schema