[
https://issues.apache.org/jira/browse/SPARK-28376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16884858#comment-16884858
]
Hyukjin Kwon commented on SPARK-28376:
--------------------------------------
Is it a regression? the slides say Spark supports. Please clarify if this is a
regression or not. Which Parquet version it supports.
Also, please show the producer with checking Parquet files via Parquet tools.
Reopen this when the details are provided.
> Support to write sorted parquet files in each row group
> -------------------------------------------------------
>
> Key: SPARK-28376
> URL: https://issues.apache.org/jira/browse/SPARK-28376
> Project: Spark
> Issue Type: New Feature
> Components: Input/Output, Spark Core
> Affects Versions: 2.4.3
> Reporter: t oo
> Priority: Major
>
> this is for the ability to writeee parquet with sorteed values in each
> rowgroup
>
> see
> [https://stackoverflow.com/questions/52159938/cant-write-ordered-data-to-parquet-in-spark]
> [https://www.slideshare.net/RyanBlue3/parquet-performance-tuning-the-missing-guide]
> (slidee 26-27)
>
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
