[jira] [Updated] (SPARK-45604) Converting timestamp_ntz to array can cause NPE or SEGFAULT on parquet vectorized reader

2023-10-19 Thread Zamil Majdy (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zamil Majdy updated SPARK-45604: Description: Repro: ``` val path = "/tmp/sample_parquet_file" spark.sql("SELECT

[jira] [Updated] (SPARK-45604) Converting timestamp_ntz to array can cause NPE or SEGFAULT on parquet vectorized reader

2023-10-19 Thread Zamil Majdy (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zamil Majdy updated SPARK-45604: Description: Repro: val path = "/tmp/sample_parquet_file" spark.sql("SELECT CAST('2019-01-01'

[jira] [Updated] (SPARK-45604) Converting timestamp_ntz to array can cause NPE or SEGFAULT on parquet vectorized reader

2023-10-19 Thread Zamil Majdy (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zamil Majdy updated SPARK-45604: Description: Repro: {{{}{}}}``` val path = "/tmp/zamil/timestamp" spark.sql("SELECT

[jira] [Updated] (SPARK-45604) Converting timestamp_ntz to array can cause NPE or SEGFAULT on parquet vectorized reader

2023-10-19 Thread Zamil Majdy (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zamil Majdy updated SPARK-45604: Description: Repro: {{val path = "/tmp/someparquetfile"}} {{spark.sql("SELECT CAST('2019-01-01

[jira] [Updated] (SPARK-45604) Converting timestamp_ntz to array can cause NPE or SEGFAULT on parquet vectorized reader

2023-10-19 Thread Zamil Majdy (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zamil Majdy updated SPARK-45604: Description: Repro: {{val path = "/tmp/someparquetfile" spark.sql("SELECT CAST('2019-01-01

[jira] [Created] (SPARK-45608) Migrate SchemaColumnConvertNotSupportedException onto DATATYPE_MISMATCH error classes

2023-10-19 Thread Zamil Majdy (Jira)
Zamil Majdy created SPARK-45608: --- Summary: Migrate SchemaColumnConvertNotSupportedException onto DATATYPE_MISMATCH error classes Key: SPARK-45608 URL: https://issues.apache.org/jira/browse/SPARK-45608

[jira] [Updated] (SPARK-45604) Converting timestamp_ntz to array can cause NPE or SEGFAULT on parquet vectorized reader

2023-10-19 Thread Zamil Majdy (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zamil Majdy updated SPARK-45604: Description: Repro: ``` val path = "/tmp/someparquetfile" val df = sql("SELECT MAP('key',

[jira] [Updated] (SPARK-45604) Converting timestamp_ntz to array can cause NPE or SEGFAULT on parquet vectorized reader

2023-10-19 Thread Zamil Majdy (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zamil Majdy updated SPARK-45604: Description: Repro: ``` spark.conf.set("spark.databricks.photon.enabled", "false") val path =

[jira] [Updated] (SPARK-45604) Converting timestamp_ntz to array can cause NPE or SEGFAULT on parquet vectorized reader

2023-10-19 Thread Zamil Majdy (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zamil Majdy updated SPARK-45604: Description: Repro: ``` val path = "/tmp/zamil/timestamp" val df = sql("SELECT MAP('key',

[jira] [Updated] (SPARK-45604) Converting timestamp_ntz to array can cause NPE or SEGFAULT on parquet vectorized reader

2023-10-19 Thread Zamil Majdy (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zamil Majdy updated SPARK-45604: Description: Repro:   ``` spark.conf.set("spark.databricks.photon.enabled", "false") val path

[jira] [Created] (SPARK-45604) Converting timestamp_ntz to array can cause NPE or SEGFAULT on parquet vectorized reader

2023-10-19 Thread Zamil Majdy (Jira)
Zamil Majdy created SPARK-45604: --- Summary: Converting timestamp_ntz to array can cause NPE or SEGFAULT on parquet vectorized reader Key: SPARK-45604 URL: https://issues.apache.org/jira/browse/SPARK-45604

[jira] [Updated] (SPARK-45604) Converting timestamp_ntz to array can cause NPE or SEGFAULT on parquet vectorized reader

2023-10-19 Thread Zamil Majdy (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zamil Majdy updated SPARK-45604: Description: Repro:   {{```}} spark.conf.set("spark.databricks.photon.enabled", "false") val

[jira] [Created] (SPARK-44718) High On-heap memory usage is detected while doing parquet-file reading with Off-Heap memory mode enabled on spark

2023-08-08 Thread Zamil Majdy (Jira)
Zamil Majdy created SPARK-44718: --- Summary: High On-heap memory usage is detected while doing parquet-file reading with Off-Heap memory mode enabled on spark Key: SPARK-44718 URL:

[jira] [Created] (SPARK-43264) Avoid allocation of unwritten ColumnVector in VectorizedReader

2023-04-24 Thread Zamil Majdy (Jira)
Zamil Majdy created SPARK-43264: --- Summary: Avoid allocation of unwritten ColumnVector in VectorizedReader Key: SPARK-43264 URL: https://issues.apache.org/jira/browse/SPARK-43264 Project: Spark