yugu created PARQUET-1056:
-----------------------------

             Summary: Partial Reading when process crash
                 Key: PARQUET-1056
                 URL: https://issues.apache.org/jira/browse/PARQUET-1056
             Project: Parquet
          Issue Type: Wish
          Components: parquet-cpp
    Affects Versions: cpp-1.1.0
            Reporter: yugu


questions are actually twofold:

1. is there a way to write data column by column ?
I see a columnwriter but seems that's for arrow..

2. was wondering if there is a way to preserve the footer information once in a 
while, in case the process crashes. for now if the proc crash the parquet file 
become unreadable...

In the code the close function (for parquetfilewriter) basically just flushes 
and close the stream. maybe a separate api for flush footer to target file?
(or maybe there is an existing way for making things robust I missed)

thanks!



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Reply via email to