bithw1 commented on issue #17570: URL: https://github.com/apache/hudi/issues/17570#issuecomment-3646544221
Thanks @deepakpanda93 I have always thought that parquet files stay unchanged once they are created in one commit. Per your explanation, it looks that parquet files can be appended if they are small enough As of the `hoodie.parquet.small.file.limit`, I think it is the threshold used to control whether to create new `file group`, not `file slice`. I have always thought, when new data inserted, there will be new file slice, if the file/file slice is big enough(>120MB), then new file group will be created. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
