Re: [DISCUSS] Spark version support strategy

2021-10-07 Thread OpenInx
> We should probably add a section to our Flink docs that explains and links to Flink’s support policy and has a table of Iceberg versions that work with Flink versions. (We should probably have the same table for Spark, too!) Thanks Ryan for the suggestion, I created a separate issue to address t

Re: Snapshot tagging, branching and retention

2021-10-07 Thread Jack Ye
Hi everyone, We have had a few iterations of the design doc with various people, thanks for all the feedback. I am thinking about a meeting to finalize the design and move forward with implementation. Considering the various time zones, I propose we choose any time from Tuesday (10/12) to Friday

RE: Error when writing large number of rows with S3FileIO

2021-10-07 Thread Mayur Srivastava
Jack, thanks for the follow-up. The issue was with the MPUs support in our internal S3 backend. It currently doesn’t support content-type=‘binary/octet-stream’. It worked when we changed it to the following: CreateMultipartUploadRequest.builder().bucket(bucket).key(key).contentType("application