[jira] [Commented] (SPARK-18105) LZ4 failed to decompress a stream of shuffled data

2024-02-13 Thread Jakub Wozniak (Jira)
[ https://issues.apache.org/jira/browse/SPARK-18105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17817233#comment-17817233 ] Jakub Wozniak commented on SPARK-18105: --- With Spark 3.5.0 running on Yarn Hadoop we had this:

[jira] [Commented] (SPARK-38958) Override S3 Client in Spark Write/Read calls

2024-02-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17817222#comment-17817222 ] ASF GitHub Bot commented on SPARK-38958: hadoop-yetus commented on PR #6550: URL:

[jira] [Comment Edited] (SPARK-44114) Upgrade built-in Hive to 3+

2024-02-13 Thread HiuFung Kwok (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17817215#comment-17817215 ] HiuFung Kwok edited comment on SPARK-44114 at 2/14/24 5:58 AM: --- hi

[jira] [Commented] (SPARK-44114) Upgrade built-in Hive to 3+

2024-02-13 Thread HiuFung Kwok (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17817215#comment-17817215 ] HiuFung Kwok commented on SPARK-44114: -- hi [~dongjoon]  It turns out that is blocked by

[jira] [Commented] (SPARK-38958) Override S3 Client in Spark Write/Read calls

2024-02-13 Thread Prerak Pradhan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17817208#comment-17817208 ] Prerak Pradhan commented on SPARK-38958: Hey [~ste...@apache.org] , I created a draft

[jira] [Updated] (SPARK-38958) Override S3 Client in Spark Write/Read calls

2024-02-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-38958: --- Labels: pull-request-available (was: ) > Override S3 Client in Spark Write/Read calls >

[jira] [Commented] (SPARK-38958) Override S3 Client in Spark Write/Read calls

2024-02-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17817203#comment-17817203 ] ASF GitHub Bot commented on SPARK-38958: PradhanPrerak opened a new pull request, #6550: URL:

[jira] [Commented] (SPARK-25789) Support for Dataset of Avro

2024-02-13 Thread Dheeren Beborrtha (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17817184#comment-17817184 ] Dheeren Beborrtha commented on SPARK-25789: --- Any chance that the PR can be merged ? > Support

[jira] [Updated] (SPARK-47037) JoinWith on non-inner joins adds an unnecessary shuffle

2024-02-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47037: --- Labels: pull-request-available (was: ) > JoinWith on non-inner joins adds an unnecessary

[jira] [Created] (SPARK-47037) JoinWith on non-inner joins adds an unnecessary shuffle

2024-02-13 Thread Lior Regev (Jira)
Lior Regev created SPARK-47037: -- Summary: JoinWith on non-inner joins adds an unnecessary shuffle Key: SPARK-47037 URL: https://issues.apache.org/jira/browse/SPARK-47037 Project: Spark Issue

[jira] [Assigned] (SPARK-46979) Add support for defining state encoder for key/value and col family independently

2024-02-13 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-46979: Assignee: Anish Shrigondekar > Add support for defining state encoder for key/value and

[jira] [Resolved] (SPARK-46979) Add support for defining state encoder for key/value and col family independently

2024-02-13 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-46979. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45038

[jira] [Updated] (SPARK-47036) RocksDB versionID Mismatch in SST files with Compaction

2024-02-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47036: --- Labels: pull-request-available (was: ) > RocksDB versionID Mismatch in SST files with

[jira] [Created] (SPARK-47036) RocksDB versionID Mismatch in SST files with Compaction

2024-02-13 Thread Bhuwan Sahni (Jira)
Bhuwan Sahni created SPARK-47036: Summary: RocksDB versionID Mismatch in SST files with Compaction Key: SPARK-47036 URL: https://issues.apache.org/jira/browse/SPARK-47036 Project: Spark

[jira] [Commented] (SPARK-47034) join between cached temp tables result in missing entries

2024-02-13 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17817123#comment-17817123 ] Bruce Robbins commented on SPARK-47034: --- I wonder if this is SPARK-45592 (and, relatedly,

[jira] [Updated] (SPARK-47034) join between cached temp tables result in missing entries

2024-02-13 Thread shurik mermelshtein (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shurik mermelshtein updated SPARK-47034: Description: we create several temp tables (views) by loading several delta

[jira] [Created] (SPARK-47034) join between cached temp tables result in missing entries

2024-02-13 Thread shurik mermelshtein (Jira)
shurik mermelshtein created SPARK-47034: --- Summary: join between cached temp tables result in missing entries Key: SPARK-47034 URL: https://issues.apache.org/jira/browse/SPARK-47034 Project:

[jira] [Created] (SPARK-47033) EXECUTE IMMEDIATE USING does not recognize session variable names

2024-02-13 Thread Serge Rielau (Jira)
Serge Rielau created SPARK-47033: Summary: EXECUTE IMMEDIATE USING does not recognize session variable names Key: SPARK-47033 URL: https://issues.apache.org/jira/browse/SPARK-47033 Project: Spark

[jira] [Updated] (SPARK-47023) Upgrade `aircompressor` to 1.26

2024-02-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47023: -- Description: `aircompressor` is a transitive dependency from Apache ORC and Parquet.

[jira] [Updated] (SPARK-47023) Upgrade `aircompressor` to 1.26

2024-02-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47023: -- Fix Version/s: 3.5.1 > Upgrade `aircompressor` to 1.26 > --- > >

[jira] [Updated] (SPARK-47023) Upgrade `aircompressor` to 1.26

2024-02-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47023: -- Affects Version/s: 3.5.0 > Upgrade `aircompressor` to 1.26 > ---

[jira] [Closed] (SPARK-46638) Create API to acquire execution memory for 'eval' and 'terminate' methods

2024-02-13 Thread Daniel (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel closed SPARK-46638. -- > Create API to acquire execution memory for 'eval' and 'terminate' methods >

[jira] [Created] (SPARK-47032) Create API for 'analyze' method to send input column(s) to output table unchanged

2024-02-13 Thread Daniel (Jira)
Daniel created SPARK-47032: -- Summary: Create API for 'analyze' method to send input column(s) to output table unchanged Key: SPARK-47032 URL: https://issues.apache.org/jira/browse/SPARK-47032 Project: Spark

[jira] [Resolved] (SPARK-47028) Check SparkUnsupportedOperationException instead of UnsupportedOperationException

2024-02-13 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-47028. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45082

[jira] [Assigned] (SPARK-46928) Support ListState in Arbitrary State API v2

2024-02-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-46928: -- Assignee: Apache Spark > Support ListState in Arbitrary State API v2 >

[jira] [Assigned] (SPARK-46928) Support ListState in Arbitrary State API v2

2024-02-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-46928: -- Assignee: (was: Apache Spark) > Support ListState in Arbitrary State API v2 >

[jira] [Updated] (SPARK-47028) Check SparkUnsupportedOperationException instead of UnsupportedOperationException

2024-02-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47028: --- Labels: pull-request-available (was: ) > Check SparkUnsupportedOperationException instead