Re: ConsumeKafka processor erroring when held up by full queue

2017-02-20 Thread Nick Carenza
Hey Koji, thanks for putting in the time. I have not had a chance to start working on this myself and I certainly support any effort to resolve it. I'll take a look at your branch and play around with it. Thanks!, Nick On Mon, Feb 20, 2017 at 2:30 AM, Koji Kawamura

Nifi: Database to Kafka

2017-02-20 Thread Uwe Geercken
Hello,   I would like to query a mariadb database for the latest updates based on a timestamp column and then put the retrieved record into kafka.   What would be the best practice to do that? Use a QueryDatabaseTable, convert the result (which is in Avro format) to Json and put that in Kafka?

Re: Split csv file into multipart.

2017-02-20 Thread Andy LoPresto
Prabhu, I answered this question and provided a template on StackOverflow [1]. [1] http://stackoverflow.com/a/42353526/70465 Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D

Re: No Response from NiFi to Http POST Request

2017-02-20 Thread James McMahon
This sounds like it could be the problem Andy. Thank you very much for the insights. First thing early tomorrow when I am back at site I will try this and see if I can establish a connection from Python and send a response. -Jim On Fri, Feb 17, 2017 at 7:52 PM, Andy LoPresto

Re: Rebel flowfile and python scripts.

2017-02-20 Thread Wes Lawrence
Hey Alessio, I've only used the ExecuteScript processor once before, but the one thing I noticed was the session wasn't being commited after the transfer ( session.commit()). If you add that after the transfers on lines 23 and 26, does that make a difference? Also, what's the timer strategy for

Re: ConsumeKafka processor erroring when held up by full queue

2017-02-20 Thread Koji Kawamura
Hi Nick, Joe, Bryan, I confirmed that this is easily reproducible and I got exactly the same stacktrace. Also I was curious about how Kafka consumer's pause/resume API works, so I've gone further and done a simple experiment to see if it helps in this situation to retain consumer connection.

Rebel flowfile and python scripts.

2017-02-20 Thread Alessio Palma
Hello all, there is a strange behavior on our NIFI installation. I wrote a script in python and for some reason and sometimes the flowfile does not always moves into it, like in this case: [cid:bc2b4b7b-c4dc-4a6a-bffb-e78f432a897b] I see that Queued Duration for the above flowfile is

Re: Unable to Start Nifi | Database nay be already in use : “Locked by another process”

2017-02-20 Thread Pierre Villard
Hi Shashi, Any chance you would still have a NiFi instance running? Could you check using something like: ps -aef | grep -i nifi Thanks, Pierre 2017-02-20 7:59 GMT+01:00 Shashi Vishwakarma : > Hi > > I am trying to start nifi but facing h2.jdbc.jdbcSqlException :