[jira] [Created] (SPARK-48526) Allow passing custom sink to StreamTest::testStream

2024-06-04 Thread Johan Lasperas (Jira)
Johan Lasperas created SPARK-48526: -- Summary: Allow passing custom sink to StreamTest::testStream Key: SPARK-48526 URL: https://issues.apache.org/jira/browse/SPARK-48526 Project: Spark

[jira] [Updated] (SPARK-48308) Unify getting data schema without partition columns in FileSourceStrategy

2024-05-16 Thread Johan Lasperas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Johan Lasperas updated SPARK-48308: --- Description: In

[jira] [Updated] (SPARK-48308) Unify getting data schema without partition columns in FileSourceStrategy

2024-05-16 Thread Johan Lasperas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Johan Lasperas updated SPARK-48308: --- Description: In

[jira] [Created] (SPARK-48308) Unify getting data schema without partition columns in FileSourceStrategy

2024-05-16 Thread Johan Lasperas (Jira)
Johan Lasperas created SPARK-48308: -- Summary: Unify getting data schema without partition columns in FileSourceStrategy Key: SPARK-48308 URL: https://issues.apache.org/jira/browse/SPARK-48308

[jira] [Updated] (SPARK-46092) Overflow in Parquet row group filter creation causes incorrect results

2023-11-24 Thread Johan Lasperas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Johan Lasperas updated SPARK-46092: --- Description: While the parquet readers don't support reading parquet values into larger

[jira] [Created] (SPARK-46092) Overflow in Parquet row group filter creation causes incorrect results

2023-11-24 Thread Johan Lasperas (Jira)
Johan Lasperas created SPARK-46092: -- Summary: Overflow in Parquet row group filter creation causes incorrect results Key: SPARK-46092 URL: https://issues.apache.org/jira/browse/SPARK-46092 Project:

[jira] [Created] (SPARK-44026) Update helper methods to create SQLMetric with initial value

2023-06-12 Thread Johan Lasperas (Jira)
Johan Lasperas created SPARK-44026: -- Summary: Update helper methods to create SQLMetric with initial value Key: SPARK-44026 URL: https://issues.apache.org/jira/browse/SPARK-44026 Project: Spark

[jira] [Created] (SPARK-43487) Wrong error message used for `ambiguousRelationAliasNameInNestedCTEError`

2023-05-12 Thread Johan Lasperas (Jira)
Johan Lasperas created SPARK-43487: -- Summary: Wrong error message used for `ambiguousRelationAliasNameInNestedCTEError` Key: SPARK-43487 URL: https://issues.apache.org/jira/browse/SPARK-43487

[jira] [Updated] (SPARK-43487) Wrong error message used for `ambiguousRelationAliasNameInNestedCTEError`

2023-05-12 Thread Johan Lasperas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Johan Lasperas updated SPARK-43487: --- Description: The batch of errors migrated to error classes as part of spark-40540 contains

[jira] [Updated] (SPARK-43217) Correctly recurse into maps of maps and arrays of arrays in StructType.findNestedField

2023-04-20 Thread Johan Lasperas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Johan Lasperas updated SPARK-43217: --- Description:

[jira] [Updated] (SPARK-43217) Correctly recurse into maps of maps and arrays of arrays in StructType.findNestedField

2023-04-20 Thread Johan Lasperas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Johan Lasperas updated SPARK-43217: --- Description:

[jira] [Updated] (SPARK-43217) Correctly recurse into maps of maps and arrays of arrays in StructType.findNestedField

2023-04-20 Thread Johan Lasperas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Johan Lasperas updated SPARK-43217: --- Description:

[jira] [Created] (SPARK-43217) Correctly recurse into maps of maps and arrays of arrays in StructType.findNestedField

2023-04-20 Thread Johan Lasperas (Jira)
Johan Lasperas created SPARK-43217: -- Summary: Correctly recurse into maps of maps and arrays of arrays in StructType.findNestedField Key: SPARK-43217 URL: https://issues.apache.org/jira/browse/SPARK-43217

[jira] [Updated] (SPARK-42918) Generalize handling of metadata attributes in FileSourceStrategy

2023-03-24 Thread Johan Lasperas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Johan Lasperas updated SPARK-42918: --- Description: A first step towards allowing file format implementations to inject custom

[jira] [Updated] (SPARK-42918) Generalize handling of metadata attributes in FileSourceStrategy

2023-03-24 Thread Johan Lasperas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Johan Lasperas updated SPARK-42918: --- Description: A first step towards allowing file format implementations to inject custom

[jira] [Updated] (SPARK-42918) Generalize handling of metadata attributes in FileSourceStrategy

2023-03-24 Thread Johan Lasperas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Johan Lasperas updated SPARK-42918: --- Description: A first step towards allowing file format implementations to inject custom

[jira] [Updated] (SPARK-42918) Generalize handling of metadata attributes in FileSourceStrategy

2023-03-24 Thread Johan Lasperas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Johan Lasperas updated SPARK-42918: --- Description: A first step towards allowing file format implementations to inject custom

[jira] [Updated] (SPARK-42918) Generalize handling of metadata attributes in FileSourceStrategy

2023-03-24 Thread Johan Lasperas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Johan Lasperas updated SPARK-42918: --- Description: A first step towards allowing file format implementations to inject custom

[jira] [Updated] (SPARK-42918) Generalize handling of metadata attributes in FileSourceStrategy

2023-03-24 Thread Johan Lasperas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Johan Lasperas updated SPARK-42918: --- Summary: Generalize handling of metadata attributes in FileSourceStrategy (was: Introduce

[jira] [Updated] (SPARK-42918) Introduce abstractions to create constant and generated metadata fields

2023-03-24 Thread Johan Lasperas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Johan Lasperas updated SPARK-42918: --- Description: As a follow-up on https://issues.apache.org/jira/browse/SPARK-41791 that

[jira] [Created] (SPARK-42918) Introduce abstractions to create constant and generated metadata fields

2023-03-24 Thread Johan Lasperas (Jira)
Johan Lasperas created SPARK-42918: -- Summary: Introduce abstractions to create constant and generated metadata fields Key: SPARK-42918 URL: https://issues.apache.org/jira/browse/SPARK-42918 Project:

[jira] [Updated] (SPARK-40921) Add WHEN NOT MATCHED BY SOURCE clause to MERGE INTO command

2022-10-26 Thread Johan Lasperas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Johan Lasperas updated SPARK-40921: --- Target Version/s: (was: 3.4.0) > Add WHEN NOT MATCHED BY SOURCE clause to MERGE INTO

[jira] [Created] (SPARK-40921) Add WHEN NOT MATCHED BY SOURCE clause to MERGE INTO command

2022-10-26 Thread Johan Lasperas (Jira)
Johan Lasperas created SPARK-40921: -- Summary: Add WHEN NOT MATCHED BY SOURCE clause to MERGE INTO command Key: SPARK-40921 URL: https://issues.apache.org/jira/browse/SPARK-40921 Project: Spark