Re: [DISCUSS] Supporting partial file rewrite/compose

2022-11-10 Thread Ayush Saxena
Hi Wei-Chiu, I think this got lost somewhere or the discussion moved somewhere else, if so please loop in me as well. Just guessing why everyone is so quiet :-) 1. Apache Iceberg or other evolvable table format. The first point that you mentioned regarding the iceberg, may be the use case that

[DISCUSS] Supporting partial file rewrite/compose

2022-10-07 Thread Wei-Chiu Chuang
There were a number of discussions that happened during ApacheCon. In the spirit of the Apache Way, I am taking the conversation online, sharing with the larger community and also capturing requirements. Credits to Owen who started this discussion. There are a number of scenarios where users want