[GitHub] [nifi] davyam commented on pull request #6053: NIFI-4239 - Adding CaptureChangePostgreSQL processor to capture data changes (INSERT/UPDATE/DELETE) from PostgreSQL tables via Logical Replicati

2023-01-23 Thread via GitHub
davyam commented on PR #6053: URL: https://github.com/apache/nifi/pull/6053#issuecomment-1401239864 > @shilpaprotiviti if the processor is so urgent for you: I build and uploaded the NAR directly

[GitHub] [nifi] davyam commented on pull request #6053: NIFI-4239 - Adding CaptureChangePostgreSQL processor to capture data changes (INSERT/UPDATE/DELETE) from PostgreSQL tables via Logical Replicati

2022-12-30 Thread GitBox
davyam commented on PR #6053: URL: https://github.com/apache/nifi/pull/6053#issuecomment-1368052164 Hey guys, we are a little late, I know, other personal activities get in the way, but I'm still working on the improvements. ASAP we will have the CapctureChangePostgreSQL

[GitHub] [nifi] davyam commented on pull request #6053: NIFI-4239 - Adding CaptureChangePostgreSQL processor to capture data changes (INSERT/UPDATE/DELETE) from PostgreSQL tables via Logical Replicati

2022-05-23 Thread GitBox
davyam commented on PR #6053: URL: https://github.com/apache/nifi/pull/6053#issuecomment-1134998581 > Okay, but how do you take an initial snapshot of database and immediately start the cdc process? There were several problems with the snapshot (delay, size, etc.). So, we decided to

[GitHub] [nifi] davyam commented on pull request #6053: NIFI-4239 - Adding CaptureChangePostgreSQL processor to capture data changes (INSERT/UPDATE/DELETE) from PostgreSQL tables via Logical Replicati

2022-05-22 Thread GitBox
davyam commented on PR #6053: URL: https://github.com/apache/nifi/pull/6053#issuecomment-1133954910 > I have a problem. Hey, @djshura2008 you are using a previous CaptureChangePostgreSQL processor version, maybe from PR 4065. I know that because we don't have anymore the "Take a

[GitHub] [nifi] davyam commented on pull request #6053: NIFI-4239 - Adding CaptureChangePostgreSQL processor to capture data changes (INSERT/UPDATE/DELETE) from PostgreSQL tables via Logical Replicati

2022-05-18 Thread GitBox
davyam commented on PR #6053: URL: https://github.com/apache/nifi/pull/6053#issuecomment-1130246347 > Generating large numbers of small FlowFiles leads to poor flow performance, so that's why it is more important to implement that capability initially, as opposed to introducing it later.

[GitHub] [nifi] davyam commented on pull request #6053: NIFI-4239 - Adding CaptureChangePostgreSQL processor to capture data changes (INSERT/UPDATE/DELETE) from PostgreSQL tables via Logical Replicati

2022-05-18 Thread GitBox
davyam commented on PR #6053: URL: https://github.com/apache/nifi/pull/6053#issuecomment-1130131396 @exceptionfactory thanks for review! I'll check all suggestions and apply the necessary adjustments as soon as possible. About the RecordWriter Service, you're right, there are

[GitHub] [nifi] davyam commented on pull request #6053: NIFI-4239 - Adding CaptureChangePostgreSQL processor to capture data changes (INSERT/UPDATE/DELETE) from PostgreSQL tables via Logical Replicati

2022-05-17 Thread GitBox
davyam commented on PR #6053: URL: https://github.com/apache/nifi/pull/6053#issuecomment-1129440527 @joewitt @mattyb149 @exceptionfactory Hey guys, this is the new PR for NIFI-4239 (CaptureChangePostgreSQL processor). Sorry for the mess in #5710 =/ Please, run the