[GitHub] nifi-minifi pull request: MINIFI-12 initial commit of http config ...

2016-04-15 Thread apiri
Github user apiri commented on a diff in the pull request: https://github.com/apache/nifi-minifi/pull/9#discussion_r59962066 --- Diff: minifi-nar-bundles/minifi-framework-bundle/minifi-framework/minifi-runtime/src/main/java/org/apache/nifi/minifi/configuration/RestChangeNotifier.java

Re: [GitHub] nifi-minifi pull request: MINIFI-12 initial commit of http config ...

2016-04-15 Thread Tijo Thomas
I vote for Jetty unless it is used for a web application with many user sessions.  On Saturday, 16 April 2016 12:00 PM, apiri wrote: Github user apiri commented on a diff in the pull request:     https://github.com/apache/nifi-minifi/pull/9#discussion_r59961984  

[GitHub] nifi-minifi pull request: MINIFI-12 initial commit of http config ...

2016-04-15 Thread apiri
Github user apiri commented on a diff in the pull request: https://github.com/apache/nifi-minifi/pull/9#discussion_r59961984 --- Diff: minifi-nar-bundles/minifi-framework-bundle/minifi-framework/minifi-runtime/pom.xml --- @@ -40,6 +40,24 @@ limitations under the License.

[GitHub] nifi-minifi pull request: MINIFI-14 Incorporating Listener/Notifie...

2016-04-15 Thread apiri
Github user apiri commented on a diff in the pull request: https://github.com/apache/nifi-minifi/pull/10#discussion_r59961712 --- Diff: minifi-nar-bundles/minifi-framework-bundle/minifi-framework/minifi-resources/src/main/resources/conf/bootstrap.conf --- @@ -28,6 +28,16 @@

[GitHub] nifi-minifi pull request: MINIFI-14 Incorporating Listener/Notifie...

2016-04-15 Thread apiri
Github user apiri commented on a diff in the pull request: https://github.com/apache/nifi-minifi/pull/10#discussion_r59961376 --- Diff: minifi-bootstrap/src/main/java/org/apache/nifi/minifi/bootstrap/configuration/FileChangeNotifier.java --- @@ -92,6 +93,7 @@ protected boolean

Re: [VOTE] Release Apache NiFi 0.6.1 (RC2)

2016-04-15 Thread Jeff
+1 (non-binding) Overall, the build worked as expected on my Windows 7 desktop. I went through the release guide and things looked good. NiFi starts up from the convenience binary and works as expected. Output from mvn -version infoon my Win7 desktop: Apache Maven 3.3.9

Re: @DynamicProperty annotation of more than one property?

2016-04-15 Thread Joe Percivall
Hello Russell, The annotation you are looking for is @DynamicProperties[1] an example of it in use is in the PutFTP processor[2]. [1] https://github.com/apache/nifi/blob/e4b7e47836edf47042973e604005058c28eed23b/nifi-api/src/main/java/org/apache/nifi/annotation/behavior/DynamicProperties.java

@DynamicProperty annotation of more than one property?

2016-04-15 Thread Russell Bateman
What's the syntax for defining more than one dynamic property for a processor? I need to specify up to three distinctly different ones and attempting to do it all in @DynamicProperty( name = "{blah,blah2,blah3}", value = "{\"blah-value\",\"blah2-value\",\"blah3-value\"}",

[GitHub] nifi-minifi pull request: MINIFI-15 Created a config file format w...

2016-04-15 Thread JPercivall
Github user JPercivall commented on a diff in the pull request: https://github.com/apache/nifi-minifi/pull/8#discussion_r59952289 --- Diff: minifi-nar-bundles/minifi-framework-bundle/minifi-framework/minifi-resources/src/main/resources/conf/config.yml --- @@ -0,0 +1,101 @@ +#

[GitHub] nifi-minifi pull request: MINIFI-15 Created a config file format w...

2016-04-15 Thread JPercivall
Github user JPercivall commented on a diff in the pull request: https://github.com/apache/nifi-minifi/pull/8#discussion_r59950579 --- Diff: minifi-bootstrap/src/main/java/org/apache/nifi/minifi/bootstrap/util/ConfigTransformer.java --- @@ -0,0 +1,566 @@ +/* + * Licensed

[GitHub] nifi-minifi pull request: MINIFI-15 Created a config file format w...

2016-04-15 Thread JPercivall
Github user JPercivall commented on a diff in the pull request: https://github.com/apache/nifi-minifi/pull/8#discussion_r59950322 --- Diff: minifi-bootstrap/src/main/java/org/apache/nifi/minifi/bootstrap/util/ConfigTransformer.java --- @@ -0,0 +1,566 @@ +/* + * Licensed

[GitHub] nifi pull request: NIFI-1551: Prepare for introduction of Authoriz...

2016-04-15 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/nifi/pull/359 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] nifi pull request: [NIFI-1761] UI - Remove reminants of cluster-in...

2016-04-15 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/nifi/pull/356 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] nifi pull request: NIFI-1551: Prepare for introduction of Authoriz...

2016-04-15 Thread markap14
Github user markap14 commented on the pull request: https://github.com/apache/nifi/pull/359#issuecomment-210618998 Looks like the latest commit addresses both issues outlined above. Will merge into master. Thanks for knocking this out! --- If your project is set up for it, you

[GitHub] nifi-minifi pull request: MINIFI-14 Incorporating Listener/Notifie...

2016-04-15 Thread JPercivall
Github user JPercivall commented on a diff in the pull request: https://github.com/apache/nifi-minifi/pull/10#discussion_r59930579 --- Diff: minifi-bootstrap/src/main/java/org/apache/nifi/minifi/bootstrap/RunMiNiFi.java --- @@ -567,6 +586,104 @@ public void dump(final File

[GitHub] nifi pull request: NIFI-1551: Prepare for introduction of Authoriz...

2016-04-15 Thread markap14
Github user markap14 commented on the pull request: https://github.com/apache/nifi/pull/359#issuecomment-210612644 Looks good. I verified that I was able to start NiFi using both secure and non-secure ports. I was then able to verify that I was able to add each component, update it,

[GitHub] nifi pull request: [NIFI-1761] UI - Remove reminants of cluster-in...

2016-04-15 Thread mcgilman
Github user mcgilman commented on the pull request: https://github.com/apache/nifi/pull/356#issuecomment-210607175 Reviewing... --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] nifi-minifi pull request: MINIFI-15 Created a config file format w...

2016-04-15 Thread JPercivall
Github user JPercivall commented on a diff in the pull request: https://github.com/apache/nifi-minifi/pull/8#discussion_r59926348 --- Diff: minifi-bootstrap/pom.xml --- @@ -45,5 +45,16 @@ limitations under the License. org.apache.nifi

[GitHub] nifi-minifi pull request: MINIFI-14 Incorporating Listener/Notifie...

2016-04-15 Thread apiri
Github user apiri commented on a diff in the pull request: https://github.com/apache/nifi-minifi/pull/10#discussion_r59926319 --- Diff: minifi-bootstrap/src/main/java/org/apache/nifi/minifi/bootstrap/RunMiNiFi.java --- @@ -567,6 +586,104 @@ public void dump(final File dumpFile)

[GitHub] nifi-minifi pull request: MINIFI-14 Incorporating Listener/Notifie...

2016-04-15 Thread JPercivall
Github user JPercivall commented on a diff in the pull request: https://github.com/apache/nifi-minifi/pull/10#discussion_r59926141 --- Diff: minifi-bootstrap/src/main/java/org/apache/nifi/minifi/bootstrap/RunMiNiFi.java --- @@ -567,6 +586,104 @@ public void dump(final File

[GitHub] nifi-minifi pull request: MINIFI-15 Created a config file format w...

2016-04-15 Thread apiri
Github user apiri commented on a diff in the pull request: https://github.com/apache/nifi-minifi/pull/8#discussion_r59925817 --- Diff: minifi-nar-bundles/minifi-framework-bundle/minifi-framework/minifi-resources/src/main/resources/conf/config.yml --- @@ -0,0 +1,101 @@ +#

[GitHub] nifi-minifi pull request: MINIFI-15 Created a config file format w...

2016-04-15 Thread apiri
Github user apiri commented on a diff in the pull request: https://github.com/apache/nifi-minifi/pull/8#discussion_r59924347 --- Diff: minifi-bootstrap/pom.xml --- @@ -45,5 +45,16 @@ limitations under the License. org.apache.nifi

[GitHub] nifi-minifi pull request: MINIFI-15 Created a config file format w...

2016-04-15 Thread apiri
Github user apiri commented on a diff in the pull request: https://github.com/apache/nifi-minifi/pull/8#discussion_r59923164 --- Diff: minifi-bootstrap/src/main/java/org/apache/nifi/minifi/bootstrap/util/ConfigTransformer.java --- @@ -0,0 +1,566 @@ +/* + * Licensed to the

[GitHub] nifi pull request: NIFI-1551: Prepare for introduction of Authoriz...

2016-04-15 Thread mcgilman
GitHub user mcgilman opened a pull request: https://github.com/apache/nifi/pull/359 NIFI-1551: Prepare for introduction of Authorizer usage - Removing the AuthorityProvider. - Refactoring REST API in preparation for introduction of the Authorizer. - Updating UI accordingly.

[GitHub] nifi-minifi pull request: MINIFI-15 Created a config file format w...

2016-04-15 Thread apiri
Github user apiri commented on a diff in the pull request: https://github.com/apache/nifi-minifi/pull/8#discussion_r59922487 --- Diff: minifi-bootstrap/src/main/java/org/apache/nifi/minifi/bootstrap/util/ConfigTransformer.java --- @@ -0,0 +1,566 @@ +/* + * Licensed to the

[GitHub] nifi-minifi pull request: MINIFI-15 Created a config file format w...

2016-04-15 Thread JPercivall
Github user JPercivall commented on a diff in the pull request: https://github.com/apache/nifi-minifi/pull/8#discussion_r59921795 --- Diff: minifi-bootstrap/pom.xml --- @@ -45,5 +45,16 @@ limitations under the License. org.apache.nifi

Re: Use of List in StandardProvenanceEventRecord.Builder

2016-04-15 Thread Richard Miskin
Mark,Joe, I’d spotted the ‘correlation attribute’ and I’d set that to a uuid relating to the incoming request, that much is fine. The problem I had was how the set things up so that MergeContent knows when it has got all the files. The options seemed to be batch size or time related, neither

Re: Opening socket connection to server localhost/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error)

2016-04-15 Thread McDermott, Chris Kevin (MSDU - STaTS/StorefrontRemote)
Thanks for the explanation, Mark. I feel much better :-) Chris On 4/15/16, 2:31 PM, "Mark Payne" wrote: >Chris, > >The INFO level message here is ZooKeeper's way of indicating that you are not >configured >to use Kerberized connections when communicating with the

[GitHub] nifi-minifi pull request: MINIFI-15 Created a config file format w...

2016-04-15 Thread apiri
Github user apiri commented on a diff in the pull request: https://github.com/apache/nifi-minifi/pull/8#discussion_r59920842 --- Diff: minifi-bootstrap/pom.xml --- @@ -45,5 +45,16 @@ limitations under the License. org.apache.nifi

Re: Opening socket connection to server localhost/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error)

2016-04-15 Thread Mark Payne
Chris, The INFO level message here is ZooKeeper's way of indicating that you are not configured to use Kerberized connections when communicating with the ZooKeeper Server. If you are aware of that, then it is no issue. While it indicates that it is an unknown error, it is not something that

[GitHub] nifi-minifi pull request: MINIFI-14 Incorporating Listener/Notifie...

2016-04-15 Thread apiri
GitHub user apiri opened a pull request: https://github.com/apache/nifi-minifi/pull/10 MINIFI-14 Incorporating Listener/Notifier Logic Incorporating Listener/Notifier logic to RunMiNiFi and performing some refactoring of how the FileChangeNotifier is handled. You can merge this

Re: Use of List in StandardProvenanceEventRecord.Builder

2016-04-15 Thread Mark Payne
Just to build on what Joe said - the correlation attribute can be used to ensure that FlowFiles are bunched together appropriately. So you could, for instance, create an attribute named "batch.id" and set it as UUID. So if you perform a query against your database, you can generate a new UUID

Re: Use of List in StandardProvenanceEventRecord.Builder

2016-04-15 Thread Joe Witt
Richard, MergeContent supports a concept called 'correlation attribute' which will merge things together based on a matching correlation attribute value. That might be useful for your case. Regarding heap use you are observing i'd be happy to work through that more with you. Thanks Joe On

Re: Use of List in StandardProvenanceEventRecord.Builder

2016-04-15 Thread Richard Miskin
Hi Mark, Thanks for pointer, I’d not spotted I was losing my provenance information. I’d changed my code from transferring the temporary FlowFiles to a relationship that was auto-terminated to using session.remove() and had assumed that the provenance report was the same. I’ve just tested it

[GitHub] nifi pull request: Nifi 1214

2016-04-15 Thread markap14
Github user markap14 commented on a diff in the pull request: https://github.com/apache/nifi/pull/321#discussion_r59908921 --- Diff: nifi-mock/src/main/java/org/apache/nifi/util/TestRunner.java --- @@ -865,4 +866,21 @@ * @return the State Manager that is used to store and

Re: Use of List in StandardProvenanceEventRecord.Builder

2016-04-15 Thread Mark Payne
Richard, So the order of the children may be important for some people. It certainly is reasonable to care about the order in which the children were created. The larger concern, though, would be that if we moved to a Set such as HashSet, the difference in the amount of heap consumed is pretty

Use of List in StandardProvenanceEventRecord.Builder

2016-04-15 Thread Richard Miskin
Hi, I’m trying to track down a performance problem that I’ve spotted with a custom NiFi processor that I’ve written. When triggered by an incoming FlowFile, the processor loads many (up to about 500,000) records from a database and produces an output file in a custom format. I’m trying to

Re: Multiple nar/custom processors: advisable directory structure

2016-04-15 Thread Oleg Zhurakousky
Hmm, I am not sure I follow completely. You’ve described the approach you followed (i assume successfully) to create a NAR. Are you asking if you should follow the same approach for creating another NAR? Cheers Oleg > On Apr 15, 2016, at 3:16 AM, idioma wrote: > >

[GitHub] nifi pull request: [NIFI-1761] Initial AngularJS application boots...

2016-04-15 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/nifi/pull/331 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

Re: Multiple nar/custom processors: advisable directory structure

2016-04-15 Thread idioma
Oleg, thanks for your reply. No, in this case it is not strictly related to my first processor so I felt myself it should go in a separate NAR. I am probably still unsure on how to generate it. For my first one, I have created an empty folder and then run mvn archetype:generate, then after filling