Hi Andrew, > > IMO decent COPY FROM / TO STDIN support is crucial, because otherwise you > > can't do COPY from/to a client. Which would make the feature unusable for > > anybody not superuser, including just about all users of hosted PG. > > > > +1 > > Note that Parquet puts the metadata at the end of each file, which makes > it nice to write but somewhat unfriendly for streaming readers, which > would have to accumulate the whole file in order to process it.
It's not necessarily that bad since data is divided into pages, each page can be processed separately. However personally I have limited experience with Parquet at this point. Some experimentation is required. I will keep in mind the requirement regarding COPY FROM / TO STDIN. -- Best regards, Aleksander Alekseev
