hansva commented on issue #6088: URL: https://github.com/apache/hop/issues/6088#issuecomment-3585654784
Are you expecting a volume that needs a bulk loader? The bulk loader creates a file in the backend and then uses the PostgreSQL COPY command. The command is executed once the input stream finishes and the file is fully created. This is why you are not seeing any records in the DB. In theory, we could add a splitting option to execute the copy command and split to a new file at a certain "commit size". You could also add a pipeline executor to execute for every X rows and inside the pipeline executor use the Bulk loader. This pipeline will run once per batch of records that is received. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
