t oo created SPARK-28376:
----------------------------

             Summary: Write sorted parquet files
                 Key: SPARK-28376
                 URL: https://issues.apache.org/jira/browse/SPARK-28376
             Project: Spark
          Issue Type: New Feature
          Components: Input/Output, Spark Core
    Affects Versions: 2.4.3
            Reporter: t oo


this is for the ability to writeee parquet with sorteed values in each rowgroup

 

see 
[https://stackoverflow.com/questions/52159938/cant-write-ordered-data-to-parquet-in-spark]

[https://www.slideshare.net/RyanBlue3/parquet-performance-tuning-the-missing-guide]
 (slidee 26-27)

 



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to