GangYang-HX commented on issue #4521: URL: https://github.com/apache/paimon/issues/4521#issuecomment-2475518588
For example, the Paimon table has 1500 fields, the Parallelism of the Write operator is 500, and the task is restarted. In extreme cases, it will trigger 1500*500 calls to the latest schema information. If each call takes 20ms, the total time is: 1500*500*30ms=6.25h. This will greatly affect the throughput of the task. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
