Re: Merging content with n events with MergeContent / bin packing algorithm

2017-01-25 Thread Lee Laim
Sam, I'll throw out a few options that may help. 1. Split the file of events into groups of 100 first, then split again to single events for transformation. Set the merge strategy to defragment. The merge will wait for the initial 100 events before sending them on. This will guarantee

Re: NiFi 1.1.1 can't start as a cluster OverlappingFileLockException

2017-01-25 Thread bmichaud
It appears that, for the time being the authorization issue is solved, but I did nothing to solve it. Thanks for the help. -- View this message in context: http://apache-nifi-developer-list.39713.n7.nabble.com/NiFi-1-1-1-can-t-start-as-a-cluster-OverlappingFileLockException-tp14486p14515.html

Merging content with n events with MergeContent / bin packing algorithm

2017-01-25 Thread sam
Hi! I am reading a file of events, splitting the file into events, doing some transformations, merging the file back and posting events in groups of 100. It think this most common use case for data flow tools. I facing problems in last part of merging the events back. I am using MergeContent

Re: NiFi 1.1.1 proxy authorization error

2017-01-25 Thread bmichaud
The way I was setting up initial security was with the legacy authorized-users.xml file. additionally, my certificate keystore.jks has been and must be generated by a company internal tool. I have done so, and generated a truststore file using the java keytool, adding trusted entries for various

Data provenance

2017-01-25 Thread Serghei Ilin
Hey guys, I have an issue that data provenance after some days is not available. I see new data passing but not logged in data provenance. After restarting NiFi data is there. Can you point what should I check/set etc? NiFi version: 1.0.0 Default settings, except:

Re: Data provenance

2017-01-25 Thread Joe Witt
Serghei, Could you show a screenshot of the query you're submitting to provenance and the results that come back? Can you describe a bit more about it in general? 2 GB is quite a small repository size. Any consideration to making that larger? I'm not saying that is the cause of not seeing the

Reminder to run checkstyle and RAT before merging to master

2017-01-25 Thread Andy LoPresto
Hi everyone, Just a quick reminder to all committers to please run with the -Pcontrib-check Maven profile when reviewing PRs and merging things to master. I know it can be slow, but it’s very important to ensure we maintain our code style and perform the license check. Tonight master was

Re: Spring JdbcTemplate, SimpleJdbcCall and DataSource

2017-01-25 Thread Koji Kawamura
Hi Toivo, Sorry for the delayed response, I reviewed the PR and posted few comments. Please check the PR. https://github.com/apache/nifi/pull/1417 Thanks, Koji On Fri, Jan 20, 2017 at 4:51 PM, Toivo Adams wrote: > Please, can anyone review PR? >

Re: NiFi 1.1.1 proxy authorization error

2017-01-25 Thread Andy LoPresto
Yes, you can manually construct the keystore and truststore files if you know how. The toolkit is provided as a convenience for users who do not have the experience or a dedicated security team to generate those files. Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com PGP