ayush-san commented on issue #2900: URL: https://github.com/apache/iceberg/issues/2900#issuecomment-895713796
> How long have you been running the ingestion job to Iceberg? When did you start to see the problem since the beginning of the job? We are running 5 jobs with 90 somethings tables for about 2 months now and have only started getting GC errors from the last week. We never faced this issue while doing the POC with just 10 tables. > How often do you checkpoint/commit? We have a checkpoint at every 10 min @stevenzwu Since now the consistency issue(https://github.com/apache/iceberg/issues/2308) with rewrite action will be solved in 0.12, I can start running maintenance procedures for the streaming job too -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
