Abacn commented on PR #22304: URL: https://github.com/apache/beam/pull/22304#issuecomment-1185896258
Default number of records causing "pipeline too large" exception, likely the records used for assertion also embedded in pipeline json? Setting number of records to 5000, the pipeline can run, but keeps bumping ``` java.lang.NullPointerException 16:32:18 org.apache.beam.sdk.io.jdbc.JdbcIO$WriteFn.getConnection(JdbcIO.java:2325) 16:32:18 org.apache.beam.sdk.io.jdbc.JdbcIO$WriteFn.executeBatch(JdbcIO.java:2375) 16:32:18 org.apache.beam.sdk.io.jdbc.JdbcIO$WriteFn.processElement(JdbcIO.java:2334) ``` changing getConnection to synchronized, this problem persists. Likely dataSource not configured properly and dataSource.getConnection() returned null -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
