txdong-sz commented on issue #1911: URL: https://github.com/apache/iceberg/issues/1911#issuecomment-744990726
@rdblue the reson why we use iceberg is that iceberg is cloud native. Works with any cloud store and reduces NN congestion when in HDFS, by avoiding listing and renames i think that we need to consider everything about cloud object storeing we have one table with 30TB data stilll small data in our business   and we list table take about 10 seconds . so i think that the defualt implement need to be native cloud base if the code is not effect other functions . and we need to review every code about list files to avoid avoid performance loss ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
