NEUpanning commented on issue #10104: URL: https://github.com/apache/incubator-gluten/issues/10104#issuecomment-3034351501
> You may set it to a lower value or set to 0 to disable merging them. @marin-ma I see 95% appended payloads contain fewer than 10 rows in this case, so only disabling merging through this configuration can solve it. But I assume disabling merging could result in performance regression for other ETLs. Can we make the merge buffer size configurable or optimize the merge process like [I mentioned above](https://github.com/apache/incubator-gluten/issues/10104#issuecomment-3027528073)? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
