[jira] [Updated] (SPARK-48071) Use Python 3.10 in `Python Linter` step

2024-05-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48071: --- Labels: pull-request-available (was: ) > Use Python 3.10 in `Python Linter` step >

[jira] [Updated] (SPARK-48070) Support AdaptiveQueryExecSuite to skip check results

2024-05-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48070: --- Labels: pull-request-available (was: ) > Support AdaptiveQueryExecSuite to skip check

[jira] [Updated] (SPARK-48069) Handle PEP-632 by checking `ModuleNotFoundError` on `setuptools`

2024-05-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48069: --- Labels: pull-request-available (was: ) > Handle PEP-632 by checking `ModuleNotFoundError`

[jira] [Updated] (SPARK-48068) Fix `mypy` failure in Python 3.10

2024-05-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48068: --- Labels: pull-request-available (was: ) > Fix `mypy` failure in Python 3.10 >

[jira] [Updated] (SPARK-48067) Fix Variant default columns for more complex default variants

2024-04-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48067: --- Labels: pull-request-available (was: ) > Fix Variant default columns for more complex

[jira] [Updated] (SPARK-48064) Improve error messages for routine related errors

2024-04-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48064: --- Labels: pull-request-available (was: ) > Improve error messages for routine related errors

[jira] [Updated] (SPARK-47578) Spark core: Migrate logWarn with variables to structured logging framework

2024-04-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47578: --- Labels: pull-request-available (was: ) > Spark core: Migrate logWarn with variables to

[jira] [Updated] (SPARK-48063) Enable `spark.stage.ignoreDecommissionFetchFailure` by default

2024-04-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48063: --- Labels: pull-request-available (was: ) > Enable

[jira] [Updated] (SPARK-48035) try_add/try_multiply should not be semantic equal to add/multiply

2024-04-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48035: --- Labels: pull-request-available (was: ) > try_add/try_multiply should not be semantic equal

[jira] [Updated] (SPARK-48062) Add pyspark test for SimpleDataSourceStreamingReader

2024-04-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48062: --- Labels: pull-request-available (was: ) > Add pyspark test for

[jira] [Updated] (SPARK-48061) Parameterize max limits of `spark.sql.test.randomDataGenerator`

2024-04-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48061: --- Labels: pull-request-available (was: ) > Parameterize max limits of

[jira] [Updated] (SPARK-48060) Fix StreamingQueryHashPartitionVerifySuite to update golden files correctly

2024-04-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48060: --- Labels: pull-request-available (was: ) > Fix StreamingQueryHashPartitionVerifySuite to

[jira] [Updated] (SPARK-48050) Log logical plan at query start

2024-04-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48050: --- Labels: pull-request-available (was: ) > Log logical plan at query start >

[jira] [Updated] (SPARK-48059) Implement the structured log framework on the java side

2024-04-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48059: --- Labels: pull-request-available (was: ) > Implement the structured log framework on the

[jira] [Updated] (SPARK-48058) `UserDefinedFunction.returnType` parse the DDL string

2024-04-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48058: --- Labels: pull-request-available (was: ) > `UserDefinedFunction.returnType` parse the DDL

[jira] [Assigned] (SPARK-47566) SubstringIndex

2024-04-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47566: -- Assignee: Apache Spark > SubstringIndex > -- > > Key:

[jira] [Assigned] (SPARK-47566) SubstringIndex

2024-04-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47566: -- Assignee: (was: Apache Spark) > SubstringIndex > -- > >

[jira] [Updated] (SPARK-48054) Backward compatibility test for Spark Connect

2024-04-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48054: --- Labels: pull-request-available (was: ) > Backward compatibility test for Spark Connect >

[jira] [Updated] (SPARK-48055) Enable PandasUDFScalarParityTests.{test_vectorized_udf_empty_partition, test_vectorized_udf_struct_with_empty_partition}

2024-04-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48055: --- Labels: pull-request-available (was: ) > Enable

[jira] [Updated] (SPARK-48053) SparkSession.createDataFrame should warn for unsupported options

2024-04-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48053: --- Labels: pull-request-available (was: ) > SparkSession.createDataFrame should warn for

[jira] [Updated] (SPARK-48051) Add Golden Table Tests for Variant from different engines

2024-04-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48051: --- Labels: pull-request-available (was: ) > Add Golden Table Tests for Variant from different

[jira] [Updated] (SPARK-48046) Remove `clock` parameter from `DriverServiceFeatureStep`

2024-04-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48046: --- Labels: pull-request-available (was: ) > Remove `clock` parameter from

[jira] [Updated] (SPARK-48042) Don't use a copy of timestamp formatter with a new override zone for each value

2024-04-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48042: --- Labels: pull-request-available (was: ) > Don't use a copy of timestamp formatter with a

[jira] [Updated] (SPARK-48040) Spark connect supports set scheduler pool name

2024-04-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48040: --- Labels: pull-request-available (was: ) > Spark connect supports set scheduler pool name >

[jira] [Updated] (SPARK-48041) Avoid repeated calls to conf.resolver in Analyzer

2024-04-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48041: --- Labels: pull-request-available (was: ) > Avoid repeated calls to conf.resolver in Analyzer

[jira] [Assigned] (SPARK-47567) StringLocate

2024-04-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47567: -- Assignee: (was: Apache Spark) > StringLocate > > >

[jira] [Assigned] (SPARK-47567) StringLocate

2024-04-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47567: -- Assignee: Apache Spark > StringLocate > > > Key:

[jira] [Assigned] (SPARK-47567) StringLocate

2024-04-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47567: -- Assignee: (was: Apache Spark) > StringLocate > > >

[jira] [Assigned] (SPARK-47567) StringLocate

2024-04-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47567: -- Assignee: Apache Spark > StringLocate > > > Key:

[jira] [Updated] (SPARK-48038) Promote driverServiceName to DriverServiceFeatureStep

2024-04-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48038: --- Labels: pull-request-available (was: ) > Promote driverServiceName to

[jira] [Updated] (SPARK-48037) SortShuffleWriter lacks shuffle write related metrics resulting in potentially inaccurate data

2024-04-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48037: --- Labels: pull-request-available (was: ) > SortShuffleWriter lacks shuffle write related

[jira] [Updated] (SPARK-48036) Update `sql-ref-ansi-compliance.md` and `sql-ref-identifier.md`

2024-04-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48036: --- Labels: pull-request-available (was: ) > Update `sql-ref-ansi-compliance.md` and

[jira] [Updated] (SPARK-48034) NullPointerException in MapStatusesSerDeserBenchmark

2024-04-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48034: --- Labels: pull-request-available (was: ) > NullPointerException in

[jira] [Updated] (SPARK-48033) Support Generated Column expressions that are `RuntimeReplaceable`

2024-04-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48033: --- Labels: pull-request-available (was: ) > Support Generated Column expressions that are

[jira] [Updated] (SPARK-48029) Update the packages name removed in building the spark docker image

2024-04-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48029: --- Labels: pull-request-available (was: ) > Update the packages name removed in building the

[jira] [Updated] (SPARK-48031) Add schema evolution options to views

2024-04-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48031: --- Labels: pull-request-available (was: ) > Add schema evolution options to views >

[jira] [Updated] (SPARK-48028) Regenerate benchmark results after turning ANSI on

2024-04-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48028: --- Labels: pull-request-available (was: ) > Regenerate benchmark results after turning ANSI

[jira] [Updated] (SPARK-48030) InternalRowComparableWrapper should cache rowOrdering to improve performace

2024-04-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48030: --- Labels: pull-request-available (was: ) > InternalRowComparableWrapper should cache

[jira] [Updated] (SPARK-47585) SQL core: Migrate logInfo with variables to structured logging framework

2024-04-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47585: --- Labels: pull-request-available (was: ) > SQL core: Migrate logInfo with variables to

[jira] [Updated] (SPARK-48027) InjectRuntimeFilter for multi-level join should check child join type

2024-04-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48027: --- Labels: pull-request-available (was: ) > InjectRuntimeFilter for multi-level join should

[jira] [Assigned] (SPARK-48025) Fix org.apache.spark.sql.execution.benchmark.DateTimeBenchmark

2024-04-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-48025: -- Assignee: (was: Apache Spark) > Fix

[jira] [Assigned] (SPARK-48025) Fix org.apache.spark.sql.execution.benchmark.DateTimeBenchmark

2024-04-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-48025: -- Assignee: Apache Spark > Fix

[jira] [Updated] (SPARK-48025) Fix org.apache.spark.sql.execution.benchmark.DateTimeBenchmark

2024-04-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48025: --- Labels: pull-request-available (was: ) > Fix

[jira] [Updated] (SPARK-48019) ColumnVectors with dictionaries and nulls are not read/copied correctly

2024-04-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48019: --- Labels: pull-request-available (was: ) > ColumnVectors with dictionaries and nulls are not

[jira] [Updated] (SPARK-48021) Add `--add-modules=jdk.incubator.vector` to `JavaModuleOptions`

2024-04-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48021: --- Labels: pull-request-available (was: ) > Add `--add-modules=jdk.incubator.vector` to

[jira] [Assigned] (SPARK-48012) SPJ: Support Transfrom Expressions for One Side Shuffle

2024-04-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-48012: -- Assignee: Apache Spark > SPJ: Support Transfrom Expressions for One Side Shuffle >

[jira] [Assigned] (SPARK-47730) Support APP_ID and EXECUTOR_ID placeholder in labels

2024-04-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47730: -- Assignee: (was: Apache Spark) > Support APP_ID and EXECUTOR_ID placeholder in

[jira] [Assigned] (SPARK-48012) SPJ: Support Transfrom Expressions for One Side Shuffle

2024-04-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-48012: -- Assignee: (was: Apache Spark) > SPJ: Support Transfrom Expressions for One Side

[jira] [Assigned] (SPARK-47730) Support APP_ID and EXECUTOR_ID placeholder in labels

2024-04-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47730: -- Assignee: Apache Spark > Support APP_ID and EXECUTOR_ID placeholder in labels >

[jira] [Assigned] (SPARK-47730) Support APP_ID and EXECUTOR_ID placeholder in labels

2024-04-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47730: -- Assignee: Apache Spark > Support APP_ID and EXECUTOR_ID placeholder in labels >

[jira] [Assigned] (SPARK-47730) Support APP_ID and EXECUTOR_ID placeholder in labels

2024-04-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47730: -- Assignee: (was: Apache Spark) > Support APP_ID and EXECUTOR_ID placeholder in

[jira] [Assigned] (SPARK-47730) Support APP_ID and EXECUTOR_ID placeholder in labels

2024-04-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47730: -- Assignee: Apache Spark > Support APP_ID and EXECUTOR_ID placeholder in labels >

[jira] [Assigned] (SPARK-48006) add SortOrder for window function which has no orderSpec

2024-04-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-48006: -- Assignee: Apache Spark > add SortOrder for window function which has no orderSpec >

[jira] [Assigned] (SPARK-47730) Support APP_ID and EXECUTOR_ID placeholder in labels

2024-04-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47730: -- Assignee: (was: Apache Spark) > Support APP_ID and EXECUTOR_ID placeholder in

[jira] [Assigned] (SPARK-48006) add SortOrder for window function which has no orderSpec

2024-04-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-48006: -- Assignee: (was: Apache Spark) > add SortOrder for window function which has no

[jira] [Updated] (SPARK-48020) Pin 'pandas==2.2.2'

2024-04-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48020: --- Labels: pull-request-available (was: ) > Pin 'pandas==2.2.2' > --- > >

[jira] [Updated] (SPARK-48012) SPJ: Support Transfrom Expressions for One Side Shuffle

2024-04-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48012: --- Labels: pull-request-available (was: ) > SPJ: Support Transfrom Expressions for One Side

[jira] [Updated] (SPARK-48017) Add Spark application submission worker for operator

2024-04-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48017: --- Labels: pull-request-available (was: ) > Add Spark application submission worker for

[jira] [Updated] (SPARK-48018) Null groupId causing missing param error when throwing KafkaException.couldNotReadOffsetRange

2024-04-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48018: --- Labels: pull-request-available (was: ) > Null groupId causing missing param error when

[jira] [Updated] (SPARK-48016) Binary Arithmetic operators should include the evalMode when makeCopy

2024-04-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48016: --- Labels: pull-request-available (was: ) > Binary Arithmetic operators should include the

[jira] [Updated] (SPARK-48015) Update `build.gradle` to fix deprecation warnings

2024-04-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48015: --- Labels: pull-request-available (was: ) > Update `build.gradle` to fix deprecation warnings

[jira] [Updated] (SPARK-48014) Change the makeFromJava error in EvaluatePython to a user-facing error

2024-04-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48014: --- Labels: pull-request-available (was: ) > Change the makeFromJava error in EvaluatePython

[jira] [Updated] (SPARK-48010) Avoid repeated calls to conf.resolver in resolveExpression

2024-04-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48010: --- Labels: pull-request-available (was: ) > Avoid repeated calls to conf.resolver in

[jira] [Updated] (SPARK-47408) Fix mathExpressions that use StringType

2024-04-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47408: --- Labels: pull-request-available (was: ) > Fix mathExpressions that use StringType >

[jira] [Updated] (SPARK-48007) MsSQLServer: upgrade mssql.jdbc.version to 12.6.1.jre11

2024-04-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48007: --- Labels: pull-request-available (was: ) > MsSQLServer: upgrade mssql.jdbc.version to

[jira] [Updated] (SPARK-48006) add SortOrder for window function which has no orderSpec

2024-04-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48006: --- Labels: pull-request-available (was: ) > add SortOrder for window function which has no

[jira] [Assigned] (SPARK-46122) Set `spark.sql.legacy.createHiveTableByDefault` to `false` by default

2024-04-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-46122: -- Assignee: (was: Apache Spark) > Set `spark.sql.legacy.createHiveTableByDefault`

[jira] [Assigned] (SPARK-46122) Set `spark.sql.legacy.createHiveTableByDefault` to `false` by default

2024-04-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-46122: -- Assignee: Apache Spark > Set `spark.sql.legacy.createHiveTableByDefault` to `false`

[jira] [Assigned] (SPARK-48003) Hll sketch aggregate support for strings with collation

2024-04-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-48003: -- Assignee: Apache Spark > Hll sketch aggregate support for strings with collation >

[jira] [Updated] (SPARK-48005) Enable `DefaultIndexParityTests. test_index_distributed_sequence_cleanup`

2024-04-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48005: --- Labels: pull-request-available (was: ) > Enable `DefaultIndexParityTests.

[jira] [Updated] (SPARK-48003) Hll sketch aggregate support for strings with collation

2024-04-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48003: --- Labels: pull-request-available (was: ) > Hll sketch aggregate support for strings with

[jira] [Updated] (SPARK-48004) Add WriteFilesExecBase trait for v1 write

2024-04-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48004: --- Labels: pull-request-available (was: ) > Add WriteFilesExecBase trait for v1 write >

[jira] [Updated] (SPARK-47968) MsSQLServer: Map datatimeoffset to TimestampType

2024-04-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47968: --- Labels: pull-request-available (was: ) > MsSQLServer: Map datatimeoffset to TimestampType

[jira] [Updated] (SPARK-48001) Remove unused `private implicit def arrayToArrayWritable` from `SparkContext`

2024-04-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48001: --- Labels: pull-request-available (was: ) > Remove unused `private implicit def

[jira] [Updated] (SPARK-48002) Add Observed metrics test in PySpark StreamingQueryListeners

2024-04-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48002: --- Labels: pull-request-available (was: ) > Add Observed metrics test in PySpark

[jira] [Updated] (SPARK-45225) XML: XSD file URL support

2024-04-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45225: --- Labels: pull-request-available (was: ) > XML: XSD file URL support >

[jira] [Updated] (SPARK-47355) Use wildcard imports in CollationTypeCasts

2024-04-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47355: --- Labels: pull-request-available (was: ) > Use wildcard imports in CollationTypeCasts >

[jira] [Updated] (SPARK-47991) Arrange the test cases for window frames and window functions.

2024-04-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47991: --- Labels: pull-request-available (was: ) > Arrange the test cases for window frames and

[jira] [Commented] (SPARK-38958) Override S3 Client in Spark Write/Read calls

2024-04-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17840748#comment-17840748 ] ASF GitHub Bot commented on SPARK-38958: hadoop-yetus commented on PR #6550: URL:

[jira] [Assigned] (SPARK-47566) SubstringIndex

2024-04-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47566: -- Assignee: Apache Spark > SubstringIndex > -- > > Key:

[jira] [Assigned] (SPARK-47566) SubstringIndex

2024-04-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47566: -- Assignee: (was: Apache Spark) > SubstringIndex > -- > >

[jira] [Updated] (SPARK-47986) [CONNECT][PYTHON] Unable to create a new session when the default session is closed by the server

2024-04-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47986: --- Labels: pull-request-available (was: ) > [CONNECT][PYTHON] Unable to create a new session

[jira] [Updated] (SPARK-47985) Simplify functions with `lit`

2024-04-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47985: --- Labels: pull-request-available (was: ) > Simplify functions with `lit` >

[jira] [Updated] (SPARK-47984) Change `MetricsAggregate/V2Aggregator`'s `serialize/deserialize` to call `SparkSerDeUtils`'s `serialize/deserialize` methods.

2024-04-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47984: --- Labels: pull-request-available (was: ) > Change `MetricsAggregate/V2Aggregator`'s

[jira] [Updated] (SPARK-47983) Demote spark.sql.pyspark.legacy.inferArrayTypeFromFirstElement.enabled to internal

2024-04-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47983: --- Labels: pull-request-available (was: ) > Demote

[jira] [Updated] (SPARK-47979) Use Hive tables explicitly for Hive table capability tests

2024-04-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47979: --- Labels: pull-request-available (was: ) > Use Hive tables explicitly for Hive table

[jira] [Updated] (SPARK-47977) DateTimeUtils.timestampDiff and DateTimeUtils.timestampAdd should not throw INTERNAL_ERROR exception

2024-04-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47977: --- Labels: pull-request-available (was: ) > DateTimeUtils.timestampDiff and

[jira] [Updated] (SPARK-47842) Spark job relying over Hudi are blocked after one or zero commit

2024-04-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47842: --- Labels: pull-request-available (was: ) > Spark job relying over Hudi are blocked after one

[jira] [Updated] (SPARK-47939) Parameterized queries fail for DESCRIBE & EXPLAIN w/ UNBOUND_SQL_PARAMETER error

2024-04-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47939: --- Labels: pull-request-available (was: ) > Parameterized queries fail for DESCRIBE & EXPLAIN

[jira] [Updated] (SPARK-47974) Remove install_scala from build/mvn

2024-04-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47974: --- Labels: pull-request-available (was: ) > Remove install_scala from build/mvn >

[jira] [Updated] (SPARK-47962) Improve doc test in pyspark dataframe

2024-04-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47962: --- Labels: pull-request-available (was: ) > Improve doc test in pyspark dataframe >

[jira] [Updated] (SPARK-47965) Avoid orNull in TypedConfigBuilder

2024-04-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47965: --- Labels: pull-request-available (was: ) > Avoid orNull in TypedConfigBuilder >

[jira] [Updated] (SPARK-47583) SQL core: Migrate logError with variables to structured logging framework

2024-04-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47583: --- Labels: pull-request-available (was: ) > SQL core: Migrate logError with variables to

[jira] [Updated] (SPARK-47960) Support Chaining Stateful Operators in TransformWithState

2024-04-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47960: --- Labels: pull-request-available (was: ) > Support Chaining Stateful Operators in

[jira] [Updated] (SPARK-47958) Task Scheduler may not know about executor when using LocalSchedulerBackend

2024-04-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47958: --- Labels: pull-request-available (was: ) > Task Scheduler may not know about executor when

[jira] [Updated] (SPARK-47956) sanity check for unresolved LCA reference

2024-04-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47956: --- Labels: pull-request-available (was: ) > sanity check for unresolved LCA reference >

[jira] [Updated] (SPARK-47954) Support creating ingress entry for external UI access

2024-04-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47954: --- Labels: pull-request-available (was: ) > Support creating ingress entry for external UI

[jira] [Updated] (SPARK-47952) Support retrieving the real SparkConnectService GRPC address and port programmatically when running on Yarn

2024-04-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47952: --- Labels: pull-request-available (was: ) > Support retrieving the real SparkConnectService

[jira] [Updated] (SPARK-46841) Language support for collations

2024-04-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46841: --- Labels: pull-request-available (was: ) > Language support for collations >

[jira] [Updated] (SPARK-47953) MsSQLServer: Document Mapping Spark SQL Data Types to Microsoft SQL Server

2024-04-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47953: --- Labels: pull-request-available (was: ) > MsSQLServer: Document Mapping Spark SQL Data

<    2   3   4   5   6   7   8   9   10   11   >