[jira] [Updated] (SPARK-48408) Simplify `date_format` & `from_unixtime`

2024-05-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48408: --- Labels: pull-request-available (was: ) > Simplify `date_format` & `from_unixtime` >

[jira] [Created] (SPARK-48408) Simplify `date_format` & `from_unixtime`

2024-05-23 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-48408: --- Summary: Simplify `date_format` & `from_unixtime` Key: SPARK-48408 URL: https://issues.apache.org/jira/browse/SPARK-48408 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-48405) Upgrade `commons-compress` to 1.26.2

2024-05-23 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-48405. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46725

[jira] [Assigned] (SPARK-48405) Upgrade `commons-compress` to 1.26.2

2024-05-23 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-48405: Assignee: BingKun Pan > Upgrade `commons-compress` to 1.26.2 >

[jira] [Updated] (SPARK-48407) Teradata: Document Type Conversion rules between Spark SQL and teradata

2024-05-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48407: --- Labels: pull-request-available (was: ) > Teradata: Document Type Conversion rules between

[jira] [Created] (SPARK-48407) Teradata: Document Type Conversion rules between Spark SQL and teradata

2024-05-23 Thread Kent Yao (Jira)
Kent Yao created SPARK-48407: Summary: Teradata: Document Type Conversion rules between Spark SQL and teradata Key: SPARK-48407 URL: https://issues.apache.org/jira/browse/SPARK-48407 Project: Spark

[jira] [Updated] (SPARK-48406) Upgrade commons-cli to 1.8.0

2024-05-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48406: --- Labels: pull-request-available (was: ) > Upgrade commons-cli to 1.8.0 >

[jira] [Updated] (SPARK-48283) Implement modified Lowercase operation for UTF8_BINARY_LCASE

2024-05-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48283: --- Labels: pull-request-available (was: ) > Implement modified Lowercase operation for

[jira] [Created] (SPARK-48406) Upgrade commons-cli to 1.8.0

2024-05-23 Thread Yang Jie (Jira)
Yang Jie created SPARK-48406: Summary: Upgrade commons-cli to 1.8.0 Key: SPARK-48406 URL: https://issues.apache.org/jira/browse/SPARK-48406 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-48399) Teradata: ByteType wrongly mapping to teradata byte(binary) type

2024-05-23 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-48399. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46715

[jira] [Updated] (SPARK-48405) Upgrade `commons-compress` to 1.26.2

2024-05-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48405: --- Labels: pull-request-available (was: ) > Upgrade `commons-compress` to 1.26.2 >

[jira] [Created] (SPARK-48405) Upgrade `commons-compress` to 1.26.2

2024-05-23 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-48405: --- Summary: Upgrade `commons-compress` to 1.26.2 Key: SPARK-48405 URL: https://issues.apache.org/jira/browse/SPARK-48405 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-48404) Driver and Executor support merge and run in a single jvm

2024-05-23 Thread melin (Jira)
melin created SPARK-48404: - Summary: Driver and Executor support merge and run in a single jvm Key: SPARK-48404 URL: https://issues.apache.org/jira/browse/SPARK-48404 Project: Spark Issue Type:

[jira] [Commented] (SPARK-33164) SPIP: add SQL support to "SELECT * (EXCEPT someColumn) FROM .." equivalent to DataSet.dropColumn(someColumn)

2024-05-23 Thread Jonathan Boarman (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17849126#comment-17849126 ] Jonathan Boarman commented on SPARK-33164: -- There are significant benefits provided by the

[jira] [Commented] (SPARK-48361) Correctness: CSV corrupt record filter with aggregate ignored

2024-05-23 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17849095#comment-17849095 ] Bruce Robbins commented on SPARK-48361: --- I can take a look at the root cause, unless you are

[jira] [Updated] (SPARK-48318) Hash join support for strings with collation (complex types)

2024-05-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48318: --- Labels: pull-request-available (was: ) > Hash join support for strings with collation

[jira] [Updated] (SPARK-41049) Nondeterministic expressions have unstable values if they are children of CodegenFallback expressions

2024-05-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-41049: --- Labels: correctness pull-request-available (was: correctness) > Nondeterministic

[jira] [Created] (SPARK-48403) Fix Upper, Lower, InitCap for UTF8_BINARY_LCASE

2024-05-23 Thread Jira
Uroš Bojanić created SPARK-48403: Summary: Fix Upper, Lower, InitCap for UTF8_BINARY_LCASE Key: SPARK-48403 URL: https://issues.apache.org/jira/browse/SPARK-48403 Project: Spark Issue Type:

[jira] [Updated] (SPARK-48400) Promote `PrometheusServlet` to `DeveloperApi`

2024-05-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48400: --- Labels: pull-request-available (was: ) > Promote `PrometheusServlet` to `DeveloperApi` >

[jira] [Commented] (SPARK-48361) Correctness: CSV corrupt record filter with aggregate ignored

2024-05-23 Thread Ted Chester Jenks (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17848936#comment-17848936 ] Ted Chester Jenks commented on SPARK-48361: --- Ah yes! Sorry [~bersprockets] I messed up my

[jira] [Updated] (SPARK-48361) Correctness: CSV corrupt record filter with aggregate ignored

2024-05-23 Thread Ted Chester Jenks (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Chester Jenks updated SPARK-48361: -- Description: Using corrupt record in CSV parsing for some data cleaning logic, I came

[jira] [Commented] (SPARK-45265) Support Hive 4.0 metastore

2024-05-23 Thread Ankit Prakash Gupta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17848924#comment-17848924 ] Ankit Prakash Gupta commented on SPARK-45265: - Since Hive 4.0.0 is already GA  ! Maybe I can

[jira] [Updated] (SPARK-45265) Support Hive 4.0 metastore

2024-05-23 Thread Ankit Prakash Gupta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankit Prakash Gupta updated SPARK-45265: Attachment: image-2024-05-23-17-35-48-426.png > Support Hive 4.0 metastore >

[jira] [Resolved] (SPARK-48395) Fix StructType.treeString for parameterized types

2024-05-23 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-48395. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46711

[jira] [Created] (SPARK-48401) Spark Connect Go Session Type cannot be used in complex code

2024-05-23 Thread David Sisson (Jira)
David Sisson created SPARK-48401: Summary: Spark Connect Go Session Type cannot be used in complex code Key: SPARK-48401 URL: https://issues.apache.org/jira/browse/SPARK-48401 Project: Spark

[jira] [Updated] (SPARK-48399) Teradata: ByteType wrongly mapping to teradata byte(binary) type

2024-05-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48399: --- Labels: pull-request-available (was: ) > Teradata: ByteType wrongly mapping to teradata

[jira] [Created] (SPARK-48400) Promote `PrometheusServlet` to `DeveloperApi`

2024-05-23 Thread Zhou JIANG (Jira)
Zhou JIANG created SPARK-48400: -- Summary: Promote `PrometheusServlet` to `DeveloperApi` Key: SPARK-48400 URL: https://issues.apache.org/jira/browse/SPARK-48400 Project: Spark Issue Type:

[jira] [Created] (SPARK-48399) Teradata: ByteType wrongly mapping to teradata byte(binary) type

2024-05-23 Thread Kent Yao (Jira)
Kent Yao created SPARK-48399: Summary: Teradata: ByteType wrongly mapping to teradata byte(binary) type Key: SPARK-48399 URL: https://issues.apache.org/jira/browse/SPARK-48399 Project: Spark

[jira] [Updated] (SPARK-48382) Add controller / reconciler module to operator

2024-05-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48382: --- Labels: pull-request-available (was: ) > Add controller / reconciler module to operator >

[jira] [Comment Edited] (SPARK-48397) Add data write time metric to FileFormatDataWriter/BasicWriteJobStatsTracker

2024-05-23 Thread Eric Yang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17848824#comment-17848824 ] Eric Yang edited comment on SPARK-48397 at 5/23/24 6:38 AM: The PR:

[jira] [Updated] (SPARK-48397) Add data write time metric to FileFormatDataWriter/BasicWriteJobStatsTracker

2024-05-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48397: --- Labels: pull-request-available (was: ) > Add data write time metric to

[jira] [Updated] (SPARK-48396) Support configuring limit control for SQL to use maximum cores

2024-05-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48396: --- Labels: pull-request-available (was: ) > Support configuring limit control for SQL to use

[jira] [Commented] (SPARK-48397) Add data write time metric to FileFormatDataWriter/BasicWriteJobStatsTracker

2024-05-23 Thread Eric Yang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17848824#comment-17848824 ] Eric Yang commented on SPARK-48397: --- I'm working on a PR for it. > Add data write time metric to

[jira] [Created] (SPARK-48398) Add Helm chart for Operator Deployment

2024-05-23 Thread Zhou JIANG (Jira)
Zhou JIANG created SPARK-48398: -- Summary: Add Helm chart for Operator Deployment Key: SPARK-48398 URL: https://issues.apache.org/jira/browse/SPARK-48398 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-48397) Add data write time metric to FileFormatDataWriter/BasicWriteJobStatsTracker

2024-05-23 Thread Eric Yang (Jira)
Eric Yang created SPARK-48397: - Summary: Add data write time metric to FileFormatDataWriter/BasicWriteJobStatsTracker Key: SPARK-48397 URL: https://issues.apache.org/jira/browse/SPARK-48397 Project: