wjddn279 commented on issue #63532: URL: https://github.com/apache/airflow/issues/63532#issuecomment-4063674938
@vatsrahul1001 Thank you for testing! I've increased the `BATCH_SIZE` from 1,000 to 10,000 in the PR (both worked fine in my local PostgreSQL environment). Could you check if the 10,000 value is applied correctly, and also test with 1,000 and 100? Even with 10,000 rows the string size is around 1MB, so I don't think it would be an issue. If errors still occur even with a `BATCH_SIZE` of 100, I'd suspect a different cause. (From my experiments, `BATCH_SIZE` of 1,000 or above was the optimal range.) Also, it seems like the error message is not complete — could you share the full error message? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
