Re: PutSQL fragmented transaction error

2023-02-10 Thread João Marcos Polo Junior
That's great to hear! Im will give it a try. What about performing different operations (such as insert for a set of records, updates for another set of record and the same for deletes) in a transaction? Is it possible with PutDatabaseRecord? Em sex., 10 de fev. de 2023 às 14:29, Matt Burgess esc

Re: PutSQL fragmented transaction error

2023-02-10 Thread Matt Burgess
I agree with Chris here about using PutDatabaseRecord instead of the Split and PutSQL. PutDatabaseRecord will process all records in a FlowFile as a transaction, so in PutDatabaseRecord you can set an AvroReader (to read the records coming out of ExecuteSQL) and the statement type (such as INSERT)

Re: PutSQL fragmented transaction error

2023-02-10 Thread João Marcos Polo Junior
Thanks for replying it. I'm afraid this approach do not work with transaction. How can I process all records in the same transaction? Em sex., 10 de fev. de 2023 às 13:05, Chris Sampson < chris.samp...@naimuri.com> escreveu: > I don't use the database/SQL processors much, but see questions about

Re: PutSQL fragmented transaction error

2023-02-10 Thread Chris Sampson
I don't use the database/SQL processors much, but see questions about these on the Apache NiFi Slack channels quite regularly - you might have better look using ExecuteSQLRecord (can output in Avro or JSON, etc. using your wanted RecordSetWriter Controller Service) then feed that through to a PutDa

Fwd: PutSQL fragmented transaction error

2023-02-10 Thread João Marcos Polo Junior
I’m trying to create a flow (nifi 1.18) to query a database (ExecuteSQL), transform it records to json (ConvertAvroToJson), split it into json objects (SplitJson) and then perform the necessary actions into another database (PutSQL). All json objects splitted from the same original flowfile needs t

RE: [EXTERNAL] Re: Disabling flows - nifi registry

2023-02-10 Thread Kevin Doran
No, in 1.20.0, component enabled/disabled state is still treated as a change that affects versioning. Do let us know if you continue to see performance issues for your flow on recent versions of NiFi with all processors enabled. That is something that should be addressed. Regards, Kevin On Feb

Re: How to cherry pick a specific line from a flowfile?

2023-02-10 Thread James McMahon
Ah - of course. I went overboard here. Just because I don't use the OutputStream for this purpose doesn't mean I can assume the method signature for the session.write() doesn't still require it. I'll fix this later tonight. Thank you both very much, Matt and Mark. Jim On Thu, Feb 9, 2023 at 10:44