Xinli Shang created PARQUET-2075:
------------------------------------

             Summary: Unified translation tool  
                 Key: PARQUET-2075
                 URL: https://issues.apache.org/jira/browse/PARQUET-2075
             Project: Parquet
          Issue Type: New Feature
            Reporter: Xinli Shang
            Assignee: Xinli Shang


During the discussion of PARQUET-2071, we came up with the idea of a universal 
tool to translate the existing file to a different state while skipping some 
level steps like encoding/decoding, to gain speed. For example, only decompress 
pages and then compress directly. For PARQUET-2071, we only decrypt and then 
encrypt directly. This will be useful for the existing data to onboard Parquet 
features like column encryption, zstd etc. 

We already have tools like trans-compression, column pruning etc. We will 
consolidate all these tools with this universal tool. 





--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to