[GitHub] nifi-minifi pull request #21: MINIFI-41 - CLI utility for template.xml -> YA...

2016-07-01 Thread JPercivall
Github user JPercivall commented on a diff in the pull request: https://github.com/apache/nifi-minifi/pull/21#discussion_r69371933 --- Diff: minifi-toolkit/minifi-toolkit-configuration/src/main/java/org/apache/nifi/minifi/toolkit/configuration/ConfigMain.java --- @@ -0,0 +1,342

Re: ListS3 processor question (duplicate files / maintaining state)

2016-07-01 Thread Adam Lamar
ddewaele, > 2. Sometimes, when syncing files to my S3 buckets, I notice that the ListS3 > processor is picking up the same file twice. Is there a way to avoid that ? Joe's response is correct. If you upload an object to S3 that overwrites an existing key, the modified date will change, and

[GitHub] nifi issue #602: NIFI-2165: fix support for inserting timestamps into cassan...

2016-07-01 Thread mattyb149
Github user mattyb149 commented on the issue: https://github.com/apache/nifi/pull/602 Can you put your template in a Gist? I'll give it a try too --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] nifi issue #602: NIFI-2165: fix support for inserting timestamps into cassan...

2016-07-01 Thread mattyb149
Github user mattyb149 commented on the issue: https://github.com/apache/nifi/pull/602 Were there quotes (single or double) in the real flow's value? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] nifi issue #602: NIFI-2165: fix support for inserting timestamps into cassan...

2016-07-01 Thread mattyb149
Github user mattyb149 commented on the issue: https://github.com/apache/nifi/pull/602 I cherry-picked in the commits that added unit tests, to show that they would fail without your fix, however they pass. Any idea how the tests differ from the error that spawned the Jira? --- If

[GitHub] nifi issue #483: NIFI-1899 - Introduce ExtractEmailAttachments and ExtractEm...

2016-07-01 Thread trixpan
Github user trixpan commented on the issue: https://github.com/apache/nifi/pull/483 I also added Apache Commons Email to NOTICE --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] nifi issue #483: NIFI-1899 - Introduce ExtractEmailAttachments and ExtractEm...

2016-07-01 Thread trixpan
Github user trixpan commented on the issue: https://github.com/apache/nifi/pull/483 @joewitt According to to https://mvnrepository.com/artifact/org.subethamail/subethasmtp/3.1.7 The only dependencies should be

Re: Github mails

2016-07-01 Thread Joe Witt
Ok team I put in a request for 'issues@nifi.a.o' and updated https://issues.apache.org/jira/browse/INFRA-12191# to reflect our plans. Will now edit the website to document the purpose of each list. Thanks Joe On Wed, Jun 29, 2016 at 5:06 AM, Joe Skora wrote: > +1 > > On Tue,

[GitHub] nifi pull request #576: NIFI-2068: Add Elasticsearch HTTP processors

2016-07-01 Thread JPercivall
Github user JPercivall commented on a diff in the pull request: https://github.com/apache/nifi/pull/576#discussion_r69357651 --- Diff:

[GitHub] nifi issue #602: NIFI-2165: fix support for inserting timestamps into cassan...

2016-07-01 Thread mattyb149
Github user mattyb149 commented on the issue: https://github.com/apache/nifi/pull/602 An example could be another test just like that one with cql.args.10.value set to "I'm not a timestamp" or a timestamp not in ISO-8601 format like "07.01.2016". Not saying the operation should

[GitHub] nifi issue #602: NIFI-2165: fix support for inserting timestamps into cassan...

2016-07-01 Thread jeffoxenberg
Github user jeffoxenberg commented on the issue: https://github.com/apache/nifi/pull/602 No problem. I think I added a test for a good value here: `https://github.com/jeffoxenberg/nifi/commit/335e4f08a60989909d2d152f426fa5d46dec9a1b`. Could you give me an example of writing

[GitHub] nifi pull request #576: NIFI-2068: Add Elasticsearch HTTP processors

2016-07-01 Thread mattyb149
Github user mattyb149 commented on a diff in the pull request: https://github.com/apache/nifi/pull/576#discussion_r69355562 --- Diff:

[GitHub] nifi pull request #597: NIFI-2021: Fixed infinite replicated recursion

2016-07-01 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/nifi/pull/597 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] nifi issue #603: NIFI-1781: Updating UI to respect access controls outside o...

2016-07-01 Thread markap14
Github user markap14 commented on the issue: https://github.com/apache/nifi/pull/603 @mcgilman excellent - all looks good, as far as I can tell. This PR addresses several issues that existed in the application. I've pushed to master. --- If your project is set up for it, you can

[GitHub] nifi pull request #576: NIFI-2068: Add Elasticsearch HTTP processors

2016-07-01 Thread mattyb149
Github user mattyb149 commented on a diff in the pull request: https://github.com/apache/nifi/pull/576#discussion_r69353249 --- Diff:

[GitHub] nifi pull request #576: NIFI-2068: Add Elasticsearch HTTP processors

2016-07-01 Thread mattyb149
Github user mattyb149 commented on a diff in the pull request: https://github.com/apache/nifi/pull/576#discussion_r6935 --- Diff:

[GitHub] nifi-minifi pull request #21: MINIFI-41 - CLI utility for template.xml -> YA...

2016-07-01 Thread JPercivall
Github user JPercivall commented on a diff in the pull request: https://github.com/apache/nifi-minifi/pull/21#discussion_r69352051 --- Diff: minifi-toolkit/minifi-toolkit-configuration/src/test/resources/Splunk_Processors_with_Listen_TCP.xml --- @@ -0,0 +1,18 @@ + +

[GitHub] nifi pull request #576: NIFI-2068: Add Elasticsearch HTTP processors

2016-07-01 Thread mattyb149
Github user mattyb149 commented on a diff in the pull request: https://github.com/apache/nifi/pull/576#discussion_r69351172 --- Diff:

[GitHub] nifi-minifi pull request #21: MINIFI-41 - CLI utility for template.xml -> YA...

2016-07-01 Thread brosander
Github user brosander commented on a diff in the pull request: https://github.com/apache/nifi-minifi/pull/21#discussion_r69346935 --- Diff: minifi-toolkit/minifi-toolkit-configuration/src/test/resources/Splunk_Processors_with_Listen_TCP.xml --- @@ -0,0 +1,18 @@ + +

[GitHub] nifi pull request #576: NIFI-2068: Add Elasticsearch HTTP processors

2016-07-01 Thread mattyb149
Github user mattyb149 commented on a diff in the pull request: https://github.com/apache/nifi/pull/576#discussion_r69346410 --- Diff:

[GitHub] nifi issue #602: NIFI-2165: fix support for inserting timestamps into cassan...

2016-07-01 Thread mattyb149
Github user mattyb149 commented on the issue: https://github.com/apache/nifi/pull/602 Looks good, mind adding unit test(s) to try various good and bad values? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] nifi pull request #603: NIFI-1781: Updating UI to respect access controls ou...

2016-07-01 Thread mcgilman
GitHub user mcgilman opened a pull request: https://github.com/apache/nifi/pull/603 NIFI-1781: Updating UI to respect access controls outside of canvas - Updating UI according to permissions through out the application. - Shuffling provenance events, template, and cluster search

[GitHub] nifi-minifi pull request #21: MINIFI-41 - CLI utility for template.xml -> YA...

2016-07-01 Thread JPercivall
Github user JPercivall commented on a diff in the pull request: https://github.com/apache/nifi-minifi/pull/21#discussion_r69342080 --- Diff: minifi-toolkit/minifi-toolkit-configuration/src/test/resources/Splunk_Processors_with_Listen_TCP.xml --- @@ -0,0 +1,18 @@ + +

[GitHub] nifi pull request #602: NIFI-2165: fix support for inserting timestamps into...

2016-07-01 Thread jeffoxenberg
GitHub user jeffoxenberg opened a pull request: https://github.com/apache/nifi/pull/602 NIFI-2165: fix support for inserting timestamps into cassandra As per https://issues.apache.org/jira/browse/NIFI-2165, fixing support for inserting timestamps into Cassandra. You can merge this

[GitHub] nifi issue #593: NIFI-2150: Cleanse more values from templates that are not ...

2016-07-01 Thread markap14
Github user markap14 commented on the issue: https://github.com/apache/nifi/pull/593 @mcgilman good call. Looks good to me! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] nifi pull request #593: NIFI-2150: Cleanse more values from templates that a...

2016-07-01 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/nifi/pull/593 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] nifi issue #593: NIFI-2150: Cleanse more values from templates that are not ...

2016-07-01 Thread mcgilman
Github user mcgilman commented on the issue: https://github.com/apache/nifi/pull/593 @markap14 Looks great! I made one additional change to populate snippet results off of the actual components instead of just the snippet contents (since the contents are now pruned).

[GitHub] nifi pull request #601: NIFI-2039: Provide a new ProcessSession.read() metho...

2016-07-01 Thread markap14
GitHub user markap14 opened a pull request: https://github.com/apache/nifi/pull/601 NIFI-2039: Provide a new ProcessSession.read() method that provides an InputStream instead of using a callback You can merge this pull request into a Git repository by running: $ git pull

[GitHub] nifi pull request #576: NIFI-2068: Add Elasticsearch HTTP processors

2016-07-01 Thread mattyb149
Github user mattyb149 commented on a diff in the pull request: https://github.com/apache/nifi/pull/576#discussion_r69325929 --- Diff: nifi-nar-bundles/nifi-elasticsearch-bundle/nifi-elasticsearch-processors/pom.xml --- @@ -56,6 +56,11 @@ language governing permissions and

[GitHub] nifi issue #576: NIFI-2068: Add Elasticsearch HTTP processors

2016-07-01 Thread JPercivall
Github user JPercivall commented on the issue: https://github.com/apache/nifi/pull/576 It would be nice to have integration tests similar to those in the original Fetch/PutElasticSearch processors. --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] nifi pull request #576: NIFI-2068: Add Elasticsearch HTTP processors

2016-07-01 Thread JPercivall
Github user JPercivall commented on a diff in the pull request: https://github.com/apache/nifi/pull/576#discussion_r69324539 --- Diff:

[GitHub] nifi pull request #576: NIFI-2068: Add Elasticsearch HTTP processors

2016-07-01 Thread JPercivall
Github user JPercivall commented on a diff in the pull request: https://github.com/apache/nifi/pull/576#discussion_r69323436 --- Diff:

[GitHub] nifi pull request #576: NIFI-2068: Add Elasticsearch HTTP processors

2016-07-01 Thread JPercivall
Github user JPercivall commented on a diff in the pull request: https://github.com/apache/nifi/pull/576#discussion_r69320973 --- Diff:

[GitHub] nifi pull request #576: NIFI-2068: Add Elasticsearch HTTP processors

2016-07-01 Thread JPercivall
Github user JPercivall commented on a diff in the pull request: https://github.com/apache/nifi/pull/576#discussion_r69320860 --- Diff:

[GitHub] nifi pull request #576: NIFI-2068: Add Elasticsearch HTTP processors

2016-07-01 Thread JPercivall
Github user JPercivall commented on a diff in the pull request: https://github.com/apache/nifi/pull/576#discussion_r69320695 --- Diff: nifi-nar-bundles/nifi-elasticsearch-bundle/nifi-elasticsearch-processors/pom.xml --- @@ -56,6 +56,11 @@ language governing permissions and

[GitHub] nifi pull request #576: NIFI-2068: Add Elasticsearch HTTP processors

2016-07-01 Thread mattyb149
Github user mattyb149 commented on a diff in the pull request: https://github.com/apache/nifi/pull/576#discussion_r69320414 --- Diff:

[GitHub] nifi pull request #576: NIFI-2068: Add Elasticsearch HTTP processors

2016-07-01 Thread JPercivall
Github user JPercivall commented on a diff in the pull request: https://github.com/apache/nifi/pull/576#discussion_r69319929 --- Diff:

[GitHub] nifi pull request #576: NIFI-2068: Add Elasticsearch HTTP processors

2016-07-01 Thread mattyb149
Github user mattyb149 commented on a diff in the pull request: https://github.com/apache/nifi/pull/576#discussion_r69319909 --- Diff:

[GitHub] nifi pull request #576: NIFI-2068: Add Elasticsearch HTTP processors

2016-07-01 Thread JPercivall
Github user JPercivall commented on a diff in the pull request: https://github.com/apache/nifi/pull/576#discussion_r69319708 --- Diff:

[GitHub] nifi pull request #576: NIFI-2068: Add Elasticsearch HTTP processors

2016-07-01 Thread mattyb149
Github user mattyb149 commented on a diff in the pull request: https://github.com/apache/nifi/pull/576#discussion_r69319637 --- Diff:

[GitHub] nifi pull request #576: NIFI-2068: Add Elasticsearch HTTP processors

2016-07-01 Thread mattyb149
Github user mattyb149 commented on a diff in the pull request: https://github.com/apache/nifi/pull/576#discussion_r69319591 --- Diff:

[GitHub] nifi pull request #576: NIFI-2068: Add Elasticsearch HTTP processors

2016-07-01 Thread JPercivall
Github user JPercivall commented on a diff in the pull request: https://github.com/apache/nifi/pull/576#discussion_r69319479 --- Diff:

[GitHub] nifi pull request #576: NIFI-2068: Add Elasticsearch HTTP processors

2016-07-01 Thread JPercivall
Github user JPercivall commented on a diff in the pull request: https://github.com/apache/nifi/pull/576#discussion_r69319085 --- Diff:

[GitHub] nifi pull request #576: NIFI-2068: Add Elasticsearch HTTP processors

2016-07-01 Thread mattyb149
Github user mattyb149 commented on a diff in the pull request: https://github.com/apache/nifi/pull/576#discussion_r69318800 --- Diff:

[GitHub] nifi pull request #576: NIFI-2068: Add Elasticsearch HTTP processors

2016-07-01 Thread mattyb149
Github user mattyb149 commented on a diff in the pull request: https://github.com/apache/nifi/pull/576#discussion_r69318859 --- Diff:

[GitHub] nifi pull request #576: NIFI-2068: Add Elasticsearch HTTP processors

2016-07-01 Thread JPercivall
Github user JPercivall commented on a diff in the pull request: https://github.com/apache/nifi/pull/576#discussion_r69318837 --- Diff:

[GitHub] nifi pull request #576: NIFI-2068: Add Elasticsearch HTTP processors

2016-07-01 Thread mattyb149
Github user mattyb149 commented on a diff in the pull request: https://github.com/apache/nifi/pull/576#discussion_r69318666 --- Diff: nifi-nar-bundles/nifi-elasticsearch-bundle/nifi-elasticsearch-processors/pom.xml --- @@ -56,6 +56,11 @@ language governing permissions and

[GitHub] nifi pull request #576: NIFI-2068: Add Elasticsearch HTTP processors

2016-07-01 Thread JPercivall
Github user JPercivall commented on a diff in the pull request: https://github.com/apache/nifi/pull/576#discussion_r69318008 --- Diff:

[GitHub] nifi pull request #576: NIFI-2068: Add Elasticsearch HTTP processors

2016-07-01 Thread JPercivall
Github user JPercivall commented on a diff in the pull request: https://github.com/apache/nifi/pull/576#discussion_r69317662 --- Diff:

[GitHub] nifi pull request #576: NIFI-2068: Add Elasticsearch HTTP processors

2016-07-01 Thread JPercivall
Github user JPercivall commented on a diff in the pull request: https://github.com/apache/nifi/pull/576#discussion_r69317330 --- Diff:

[GitHub] nifi pull request #576: NIFI-2068: Add Elasticsearch HTTP processors

2016-07-01 Thread JPercivall
Github user JPercivall commented on a diff in the pull request: https://github.com/apache/nifi/pull/576#discussion_r69317281 --- Diff:

[GitHub] nifi pull request #576: NIFI-2068: Add Elasticsearch HTTP processors

2016-07-01 Thread JPercivall
Github user JPercivall commented on a diff in the pull request: https://github.com/apache/nifi/pull/576#discussion_r69317035 --- Diff:

[GitHub] nifi pull request #576: NIFI-2068: Add Elasticsearch HTTP processors

2016-07-01 Thread JPercivall
Github user JPercivall commented on a diff in the pull request: https://github.com/apache/nifi/pull/576#discussion_r69316350 --- Diff:

[GitHub] nifi pull request #576: NIFI-2068: Add Elasticsearch HTTP processors

2016-07-01 Thread JPercivall
Github user JPercivall commented on a diff in the pull request: https://github.com/apache/nifi/pull/576#discussion_r69314307 --- Diff:

[GitHub] nifi pull request #576: NIFI-2068: Add Elasticsearch HTTP processors

2016-07-01 Thread JPercivall
Github user JPercivall commented on a diff in the pull request: https://github.com/apache/nifi/pull/576#discussion_r69313807 --- Diff:

[GitHub] nifi pull request #600: NIFI-906: Make NiFi docs responsible

2016-07-01 Thread ijokarumawak
GitHub user ijokarumawak opened a pull request: https://github.com/apache/nifi/pull/600 NIFI-906: Make NiFi docs responsible - Switched from absolute layout to responsible using flex-box. - Added toggle switch to control component listing pane visibility. - Tested with

[GitHub] nifi pull request #576: NIFI-2068: Add Elasticsearch HTTP processors

2016-07-01 Thread JPercivall
Github user JPercivall commented on a diff in the pull request: https://github.com/apache/nifi/pull/576#discussion_r69313182 --- Diff:

[GitHub] nifi pull request #576: NIFI-2068: Add Elasticsearch HTTP processors

2016-07-01 Thread JPercivall
Github user JPercivall commented on a diff in the pull request: https://github.com/apache/nifi/pull/576#discussion_r69312668 --- Diff:

Re: ExecuteSQL multi

2016-07-01 Thread Mark Payne
Richard, NiFi allows you to configure how many threads are executing at the same time. This is configured by right-clicking on the processor and going to the "Scheduling" tab. You can choose the number of concurrent tasks. If that is set to 1, then only one FlowFile will be processed at a

[GitHub] nifi pull request #576: NIFI-2068: Add Elasticsearch HTTP processors

2016-07-01 Thread JPercivall
Github user JPercivall commented on a diff in the pull request: https://github.com/apache/nifi/pull/576#discussion_r69306232 --- Diff: nifi-nar-bundles/nifi-elasticsearch-bundle/nifi-elasticsearch-processors/pom.xml --- @@ -56,6 +56,11 @@ language governing permissions and

Re: Question about Mock classes in ControllerServiceInitializer

2016-07-01 Thread Mark Payne
So my guess here is that the controller service or processor or whatever it is that was created was the one that logged "Shutting down server" as one of its lifecycle methods, but the Mock Processor Logger has a bug where instead of logging the toString() of the Processor or Controller Service

[GitHub] nifi issue #483: NIFI-1899 - Introduce ExtractEmailAttachments and ExtractEm...

2016-07-01 Thread trixpan
Github user trixpan commented on the issue: https://github.com/apache/nifi/pull/483 @ijokarumawak thanks for the gist. Interesting that junit missed that and I incorrectly assumed the change in structure had not lead to side effects. Feedback was much appreciated and unless

Re: Question about Mock classes in ControllerServiceInitializer

2016-07-01 Thread Oleg Zhurakousky
Joe Personally I probably need to look at it more thoroughly to have an intelligent answer, but one thing I know for sure (or at least I believe. . .) is that if you see any of these Mock* references in the log when you starting NiFi instance it’s definitely a bug. If that is what you see,

Re: Question about Mock classes in ControllerServiceInitializer

2016-07-01 Thread Joe Skora
Mark and Oleg, thanks, it makes sense now. But, I'm still trying to track down how we have logs containing "... INFO [Finalizer] o.a.n.d.mock.MockProcessorLogger Shutting down server". It still doesn't seem like that should occur. On Thu, Jun 30, 2016 at 6:30 PM, Oleg Zhurakousky <

[GitHub] nifi issue #483: NIFI-1899 - Introduce ExtractEmailAttachments and ExtractEm...

2016-07-01 Thread ijokarumawak
Github user ijokarumawak commented on the issue: https://github.com/apache/nifi/pull/483 @trixpan Thanks for addressing comments promptly! I confirmed that all of my comments are addressed. However the modification on ExtractEmailHeader.java didn't work with following error:

[GitHub] nifi pull request #483: NIFI-1899 - Introduce ExtractEmailAttachments and Ex...

2016-07-01 Thread trixpan
Github user trixpan commented on a diff in the pull request: https://github.com/apache/nifi/pull/483#discussion_r69261278 --- Diff: nifi-nar-bundles/nifi-email-bundle/nifi-email-processors/src/main/java/org/apache/nifi/processors/email/ExtractEmailHeaders.java --- @@ -0,0 +1,234

[GitHub] nifi pull request #483: NIFI-1899 - Introduce ExtractEmailAttachments and Ex...

2016-07-01 Thread trixpan
Github user trixpan commented on a diff in the pull request: https://github.com/apache/nifi/pull/483#discussion_r69260944 --- Diff: nifi-nar-bundles/nifi-email-bundle/nifi-email-processors/src/main/java/org/apache/nifi/processors/email/ExtractEmailAttachments.java --- @@ -0,0