Chao Sun created SPARK-38891:
--------------------------------
Summary: Skipping allocating vector for repetition & definition
levels when possible
Key: SPARK-38891
URL: https://issues.apache.org/jira/browse/SPARK-38891
Project: Spark
Issue Type: Sub-task
Components: SQL
Affects Versions: 3.3.0
Reporter: Chao Sun
Currently the vectorized Parquet reader will allocate vectors for repetition
and definition levels in all cases. However in certain cases (e.g., when
reading primitive types) this is not necessary and should be avoided.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
