Hi,
i tried to understand the executeSQL Processor.
I created a database with a table „users“. This table has two entries.
The problem with the processor is that it selected multiple times the entries
from the table and created altogether 26 flow files even that only two entries
where available. In addition each flow file consist of the both entires.
I configured the executeSQL Processor the following way:
Settings: Didn’t changed anything here except of auto terminate on failure:
Scheduling:
Cron based: * * * * * ? (Run every minute)
Concurrent tasks: 1
Properties:
Database Connection Pooling Service: DBmysql
SQL select query: Select * from user
My Wait Time: 0 seconds
Then I used a processor: convertAvroToJson and a PutFile Processor.
If I runt the flow it creates 26 flow files and each of them has all entries of
the tables as json included.
My goal is to extract the table ones. So that the entries are only created ones
as json as row not 26 times.
My understanding was that each row of the table will be one flow file and
therefore for each line of the table would be one json file on disk (using
PutFile).
But it seems that this not right. What happens if I have millions of entries in
such a table? Will this be done with one flow file?
How would I configure that Nifi extract the table ones?
It would be great if somebody could help me with this ?
BR
Ralf
