[
https://issues.apache.org/jira/browse/SPARK-37722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ivan Sadikov updated SPARK-37722:
-
Description:
Some file systems (for example, ABFS) do not support file names/paths ending
with
[
https://issues.apache.org/jira/browse/SPARK-37722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ivan Sadikov updated SPARK-37722:
-
Description:
Some file systems (for example, ABFS) do not support file names/paths ending
with
[
https://issues.apache.org/jira/browse/SPARK-37722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ivan Sadikov updated SPARK-37722:
-
Description:
Some file systems (for example, ABFS) do not support file names/paths ending
with
Ivan Sadikov created SPARK-37722:
Summary: Escape dots in partition names
Key: SPARK-37722
URL: https://issues.apache.org/jira/browse/SPARK-37722
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-37722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ivan Sadikov updated SPARK-37722:
-
Summary: Escape dot character in partition names (was: Escape dots in
partition names)
>
[
https://issues.apache.org/jira/browse/SPARK-37771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ivan Sadikov updated SPARK-37771:
-
Issue Type: Bug (was: Improvement)
> Race condition in withHiveState and limited logic in
Ivan Sadikov created SPARK-37771:
Summary: Race condition in withHiveState and limited logic in
IsolatedClientLoader result in ClassNotFoundException
Key: SPARK-37771
URL:
[
https://issues.apache.org/jira/browse/SPARK-37771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ivan Sadikov updated SPARK-37771:
-
Description:
There is a race condition between creating a Hive client and loading classes
that
[
https://issues.apache.org/jira/browse/SPARK-37771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ivan Sadikov updated SPARK-37771:
-
Description:
There is a race condition between creating a Hive client and loading classes
that
Ivan Sadikov created SPARK-37385:
Summary: Add tests for TimestampNTZ and TimestampLTZ for Parquet
data source
Key: SPARK-37385
URL: https://issues.apache.org/jira/browse/SPARK-37385
Project: Spark
Ivan Sadikov created SPARK-37360:
Summary: Support TimestampNTZ in JSON data source
Key: SPARK-37360
URL: https://issues.apache.org/jira/browse/SPARK-37360
Project: Spark
Issue Type:
Ivan Sadikov created SPARK-37326:
Summary: Support TimestampNTZ in CSV data source
Key: SPARK-37326
URL: https://issues.apache.org/jira/browse/SPARK-37326
Project: Spark
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/SPARK-37771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17486107#comment-17486107
]
Ivan Sadikov commented on SPARK-37771:
--
I could not manage to work around the issue with Hadoop
[
https://issues.apache.org/jira/browse/SPARK-38829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17520296#comment-17520296
]
Ivan Sadikov commented on SPARK-38829:
--
I opened [https://github.com/apache/spark/pull/36137] to
[
https://issues.apache.org/jira/browse/SPARK-38829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17520870#comment-17520870
]
Ivan Sadikov commented on SPARK-38829:
--
[~Gengliang.Wang] Do you still want to merge the PR for 3.3
Ivan Sadikov created SPARK-45139:
Summary: Add DatabricksDialect to handle SQL type conversion
Key: SPARK-45139
URL: https://issues.apache.org/jira/browse/SPARK-45139
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-45139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ivan Sadikov updated SPARK-45139:
-
Description: Databricks SQL dialect is needed to refine type conversion
when connecting to a
Ivan Sadikov created SPARK-45194:
Summary: Parquet reads fail with "RuntimeException: Unable to
create Parquet converter for data type "timestamp_ntz" due to incorrect schema
inference
Key: SPARK-45194
URL:
[
https://issues.apache.org/jira/browse/SPARK-45194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17766198#comment-17766198
]
Ivan Sadikov commented on SPARK-45194:
--
cc [~gengliang] [~cloud_fan]
> Parquet reads fail with
[
https://issues.apache.org/jira/browse/SPARK-45194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ivan Sadikov updated SPARK-45194:
-
Description:
I found that Parquet reads could fail due to incorrect schema inference with
two
[
https://issues.apache.org/jira/browse/SPARK-45194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ivan Sadikov updated SPARK-45194:
-
Description:
I found that Parquet reads could fail due to incorrect schema inference with
two
Ivan Sadikov created SPARK-44940:
Summary: Improve performance of JSON parsing when partial results
are enabled
Key: SPARK-44940
URL: https://issues.apache.org/jira/browse/SPARK-44940
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-44940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ivan Sadikov updated SPARK-44940:
-
Description:
Follow-up on https://issues.apache.org/jira/browse/SPARK-40646.
I found that JSON
[
https://issues.apache.org/jira/browse/SPARK-44940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17758394#comment-17758394
]
Ivan Sadikov commented on SPARK-44940:
--
I have prototyped the fix and will open a PR shortly.
>
[
https://issues.apache.org/jira/browse/SPARK-44940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ivan Sadikov updated SPARK-44940:
-
Summary: Improve performance of JSON parsing when
"spark.sql.json.enablePartialResults" is
[
https://issues.apache.org/jira/browse/SPARK-44940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17758792#comment-17758792
]
Ivan Sadikov commented on SPARK-44940:
--
Opened https://github.com/apache/spark/pull/42667.
>
Ivan Sadikov created SPARK-39339:
Summary: Support TimestampNTZ in JDBC data source
Key: SPARK-39339
URL: https://issues.apache.org/jira/browse/SPARK-39339
Project: Spark
Issue Type:
Ivan Sadikov created SPARK-39731:
Summary: Correctness issue when parsing dates with MMdd format
in CSV
Key: SPARK-39731
URL: https://issues.apache.org/jira/browse/SPARK-39731
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-39731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ivan Sadikov updated SPARK-39731:
-
Description:
In Spark 3.x, when reading CSV data like this:
{code:java}
name,mydate
1,2020011
[
https://issues.apache.org/jira/browse/SPARK-39731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ivan Sadikov updated SPARK-39731:
-
Description:
In Spark 3.x, when reading CSV data like this:
{code:java}
name,mydate
1,2020011
[
https://issues.apache.org/jira/browse/SPARK-39731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ivan Sadikov updated SPARK-39731:
-
Description:
In Spark 3.x, when reading CSV data like this:
{code:java}
name,mydate
1,2020011
[
https://issues.apache.org/jira/browse/SPARK-39833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17571768#comment-17571768
]
Ivan Sadikov commented on SPARK-39833:
--
Interesting, I will take a look.
> Filtered parquet data
[
https://issues.apache.org/jira/browse/SPARK-39904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ivan Sadikov updated SPARK-39904:
-
Description: Follow-up for
https://issues.apache.org/jira/browse/SPARK-39469.
> Rename
Ivan Sadikov created SPARK-39904:
Summary: Rename inferDate to preferDate and fix an issue when
inferring schema
Key: SPARK-39904
URL: https://issues.apache.org/jira/browse/SPARK-39904
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-39731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ivan Sadikov updated SPARK-39731:
-
Description:
In Spark 3.x, when reading CSV data like this:
{code:java}
name,mydate
1,2020011
[
https://issues.apache.org/jira/browse/SPARK-39731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ivan Sadikov updated SPARK-39731:
-
Summary: Correctness issue when parsing dates with MMdd format in CSV
and JSON (was:
Ivan Sadikov created SPARK-39802:
Summary: Support Avro recursive schemas in Spark
Key: SPARK-39802
URL: https://issues.apache.org/jira/browse/SPARK-39802
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-39802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17567759#comment-17567759
]
Ivan Sadikov commented on SPARK-39802:
--
[~Gengliang.Wang] Would you be able to comment on this
[
https://issues.apache.org/jira/browse/SPARK-39802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ivan Sadikov updated SPARK-39802:
-
Summary: Support recursive Avro schemas in Spark (was: Support Avro
recursive schemas in
[
https://issues.apache.org/jira/browse/SPARK-39802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ivan Sadikov updated SPARK-39802:
-
Description:
This is a follow-up for https://issues.apache.org/jira/browse/SPARK-25718.
It
[
https://issues.apache.org/jira/browse/SPARK-39802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ivan Sadikov updated SPARK-39802:
-
Description:
This is a follow-up for https://issues.apache.org/jira/browse/SPARK-25718.
It
[
https://issues.apache.org/jira/browse/SPARK-39802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ivan Sadikov updated SPARK-39802:
-
Description:
This is a follow-up for https://issues.apache.org/jira/browse/SPARK-25718.
It
[
https://issues.apache.org/jira/browse/SPARK-39802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ivan Sadikov updated SPARK-39802:
-
Description:
This is a follow-up for https://issues.apache.org/jira/browse/SPARK-25718.
It
[
https://issues.apache.org/jira/browse/SPARK-39802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ivan Sadikov updated SPARK-39802:
-
Description:
This is a follow-up for https://issues.apache.org/jira/browse/SPARK-25718.
It
[
https://issues.apache.org/jira/browse/SPARK-39802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ivan Sadikov updated SPARK-39802:
-
Summary: Support recursive references in Avro schemas in Spark (was:
Support recursive Avro
[
https://issues.apache.org/jira/browse/SPARK-39084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17530600#comment-17530600
]
Ivan Sadikov commented on SPARK-39084:
--
I am going to open a PR to fix this shortly.
>
[
https://issues.apache.org/jira/browse/SPARK-39084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ivan Sadikov updated SPARK-39084:
-
Description:
It was discovered that a particular data distribution in a DataFrame with
groupBy
Ivan Sadikov created SPARK-39084:
Summary: df.rdd.isEmpty() results in unexpected executor failure
and JVM crash
Key: SPARK-39084
URL: https://issues.apache.org/jira/browse/SPARK-39084
Project: Spark
Ivan Sadikov created SPARK-39086:
Summary: Support UDT in Parquet OSS vectorised reader
Key: SPARK-39086
URL: https://issues.apache.org/jira/browse/SPARK-39086
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-39086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ivan Sadikov updated SPARK-39086:
-
Summary: Support UDT in Spark Parquet vectorized reader (was: Support UDT
in Parquet OSS
Ivan Sadikov created SPARK-40215:
Summary: Add SQL configs to control CSV/JSON date and timestamp
parsing behaviour
Key: SPARK-40215
URL: https://issues.apache.org/jira/browse/SPARK-40215
Project:
[
https://issues.apache.org/jira/browse/SPARK-40215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17584612#comment-17584612
]
Ivan Sadikov commented on SPARK-40215:
--
Follow-up.
> Add SQL configs to control CSV/JSON date and
[
https://issues.apache.org/jira/browse/SPARK-40169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17582664#comment-17582664
]
Ivan Sadikov commented on SPARK-40169:
--
I would like to work on it as it was my responsibility to
[
https://issues.apache.org/jira/browse/SPARK-40169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ivan Sadikov updated SPARK-40169:
-
Description:
This is a follow for SPARK-39833. In
Ivan Sadikov created SPARK-40169:
Summary: Fix the issue with Parquet column index and predicate
pushdown in Data source V1
Key: SPARK-40169
URL: https://issues.apache.org/jira/browse/SPARK-40169
[
https://issues.apache.org/jira/browse/SPARK-40292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17600198#comment-17600198
]
Ivan Sadikov commented on SPARK-40292:
--
I will take a look.
> arrays_zip output unexpected alias
Ivan Sadikov created SPARK-40815:
Summary: SymlinkTextInputFormat returns incorrect result due to
enabled spark.hadoopRDD.ignoreEmptySplits
Key: SPARK-40815
URL: https://issues.apache.org/jira/browse/SPARK-40815
Ivan Sadikov created SPARK-40496:
Summary: Configs to control "enableDateTimeParsingFallback" are
incorrectly swapped
Key: SPARK-40496
URL: https://issues.apache.org/jira/browse/SPARK-40496
Project:
[
https://issues.apache.org/jira/browse/SPARK-40527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ivan Sadikov updated SPARK-40527:
-
Summary: Keep struct field names or map keys in CreateNamedStruct (was:
Keep struct field
[
https://issues.apache.org/jira/browse/SPARK-40527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ivan Sadikov updated SPARK-40527:
-
Summary: Keep struct field names or map keys for UnresolvedExtractValue in
CreateNamedStruct
[
https://issues.apache.org/jira/browse/SPARK-40527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ivan Sadikov updated SPARK-40527:
-
Summary: Keep struct/map field names for UnresolvedExtractValue in
CreateNamedStruct (was:
[
https://issues.apache.org/jira/browse/SPARK-40527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ivan Sadikov updated SPARK-40527:
-
Description:
Using index-like notation when extracting columns in a struct produces
generated
[
https://issues.apache.org/jira/browse/SPARK-40527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ivan Sadikov updated SPARK-40527:
-
Summary: Generate field names for UnresolvedExtractValue in
CreateNamedStruct (was: Generate
Ivan Sadikov created SPARK-40527:
Summary: Generate names for UnresolvedExtractValue in
CreateNamedStruct
Key: SPARK-40527
URL: https://issues.apache.org/jira/browse/SPARK-40527
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-40527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ivan Sadikov updated SPARK-40527:
-
Summary: Keep struct field names or map keys in CreateStruct (was: Keep
struct field names or
[
https://issues.apache.org/jira/browse/SPARK-40470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ivan Sadikov updated SPARK-40470:
-
Description:
This is a follow-up for https://issues.apache.org/jira/browse/SPARK-40292.
I
[
https://issues.apache.org/jira/browse/SPARK-40470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ivan Sadikov updated SPARK-40470:
-
Description:
This is a follow-up for https://issues.apache.org/jira/browse/SPARK-40292.
I
Ivan Sadikov created SPARK-40470:
Summary: arrays_zip output unexpected alias column names when
using Map
Key: SPARK-40470
URL: https://issues.apache.org/jira/browse/SPARK-40470
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-40470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ivan Sadikov updated SPARK-40470:
-
Description:
This is a follow-up for https://issues.apache.org/jira/browse/SPARK-40292.
I
[
https://issues.apache.org/jira/browse/SPARK-40470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ivan Sadikov updated SPARK-40470:
-
Summary: arrays_zip output unexpected alias column names when using
GetMapValue and
[
https://issues.apache.org/jira/browse/SPARK-40468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ivan Sadikov updated SPARK-40468:
-
Description:
I have found that depending on the name of the corrupt record in CSV, the field
Ivan Sadikov created SPARK-40468:
Summary: Column pruning is not handled correctly in CSV when
_corrupt_record is used
Key: SPARK-40468
URL: https://issues.apache.org/jira/browse/SPARK-40468
Project:
[
https://issues.apache.org/jira/browse/SPARK-40468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ivan Sadikov updated SPARK-40468:
-
Description:
I have found that depending on the name of the corrupt record in CSV, the field
[
https://issues.apache.org/jira/browse/SPARK-40468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ivan Sadikov updated SPARK-40468:
-
Description:
I have found that depending on the name of the corrupt record in CSV, the field
[
https://issues.apache.org/jira/browse/SPARK-40468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ivan Sadikov updated SPARK-40468:
-
Description:
I have found that depending on the name of the corrupt record in CSV, the field
[
https://issues.apache.org/jira/browse/SPARK-40646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ivan Sadikov updated SPARK-40646:
-
Description:
I recently found an issue when parsing the following JSON file:
{code:java}
{"a":
[
https://issues.apache.org/jira/browse/SPARK-40646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ivan Sadikov updated SPARK-40646:
-
Description:
I recently found an issue when parsing the following JSON file:
{code:java}
{"a":
Ivan Sadikov created SPARK-40646:
Summary: Fix returning partial results in JSON data source and
JSON functions
Key: SPARK-40646
URL: https://issues.apache.org/jira/browse/SPARK-40646
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-40584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17613304#comment-17613304
]
Ivan Sadikov commented on SPARK-40584:
--
Disabling "multiLine" also fixes the issue.
Seems to be an
[
https://issues.apache.org/jira/browse/SPARK-40541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17617914#comment-17617914
]
Ivan Sadikov commented on SPARK-40541:
--
I was asking about the actual problem. It is not clear what
[
https://issues.apache.org/jira/browse/SPARK-40541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17617914#comment-17617914
]
Ivan Sadikov edited comment on SPARK-40541 at 10/14/22 6:42 PM:
I was
[
https://issues.apache.org/jira/browse/SPARK-40541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17617914#comment-17617914
]
Ivan Sadikov edited comment on SPARK-40541 at 10/14/22 6:43 PM:
I was
[
https://issues.apache.org/jira/browse/SPARK-39783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ivan Sadikov updated SPARK-39783:
-
Summary: Column backticks are misplaced in the erroWrong column backticks
in UNRESOLVED_COLUMN
[
https://issues.apache.org/jira/browse/SPARK-39783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ivan Sadikov updated SPARK-39783:
-
Summary: Column backticks are misplaced in the AnalysisException
[UNRESOLVED_COLUMN] error
[
https://issues.apache.org/jira/browse/SPARK-39783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ivan Sadikov updated SPARK-39783:
-
Description:
AnalysisException [UNRESOLVED_COLUMN]
The following code references a nested
[
https://issues.apache.org/jira/browse/SPARK-39783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ivan Sadikov updated SPARK-39783:
-
Description:
AnalysisException [UNRESOLVED_COLUMN] shows the wrong suggestion when a field
[
https://issues.apache.org/jira/browse/SPARK-39783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17617509#comment-17617509
]
Ivan Sadikov commented on SPARK-39783:
--
It is not clear from the ticket, you should update the
[
https://issues.apache.org/jira/browse/SPARK-39783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17617509#comment-17617509
]
Ivan Sadikov edited comment on SPARK-39783 at 10/14/22 7:14 AM:
It is
[
https://issues.apache.org/jira/browse/SPARK-40637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17617435#comment-17617435
]
Ivan Sadikov commented on SPARK-40637:
--
You are not writing to the table in the first example but
[
https://issues.apache.org/jira/browse/SPARK-40541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17617439#comment-17617439
]
Ivan Sadikov commented on SPARK-40541:
--
What is the question here? Does marking column as nullable
[
https://issues.apache.org/jira/browse/SPARK-40430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17617441#comment-17617441
]
Ivan Sadikov commented on SPARK-40430:
--
Can you try FSCK REPAIR TABLE command on your table if you
[
https://issues.apache.org/jira/browse/SPARK-39783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17617460#comment-17617460
]
Ivan Sadikov commented on SPARK-39783:
--
This is by design if I am not mistaken. Such columns need
[
https://issues.apache.org/jira/browse/SPARK-39257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17617463#comment-17617463
]
Ivan Sadikov commented on SPARK-39257:
--
I have had a similar issue before, you would need to do
[ https://issues.apache.org/jira/browse/SPARK-39257 ]
Ivan Sadikov deleted comment on SPARK-39257:
--
was (Author: ivan.sadikov):
I have had a similar issue before, you would need to do packet capture to
figure out what the underlying issue is.
[
https://issues.apache.org/jira/browse/SPARK-39833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17575510#comment-17575510
]
Ivan Sadikov commented on SPARK-39833:
--
It appears to be a bug in Parquet-Mr.
There is a
[
https://issues.apache.org/jira/browse/SPARK-39833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17575032#comment-17575032
]
Ivan Sadikov edited comment on SPARK-39833 at 8/5/22 1:48 AM:
--
This is
[
https://issues.apache.org/jira/browse/SPARK-39833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17575570#comment-17575570
]
Ivan Sadikov commented on SPARK-39833:
--
I opened a PR to quickly fix it:
[
https://issues.apache.org/jira/browse/SPARK-39833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17575032#comment-17575032
]
Ivan Sadikov edited comment on SPARK-39833 at 8/5/22 5:07 AM:
--
Your example
Ivan Sadikov created SPARK-40052:
Summary: Handle direct byte buffers in
VectorizedDeltaBinaryPackedReader
Key: SPARK-40052
URL: https://issues.apache.org/jira/browse/SPARK-40052
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-39833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17575032#comment-17575032
]
Ivan Sadikov edited comment on SPARK-39833 at 8/4/22 5:51 AM:
--
This is
1 - 100 of 139 matches
Mail list logo
