[GitHub] nifi pull request: NiFi-1808 Added GetMQTT and PutMQTT processors

2016-04-28 Thread r-b-us
Github user r-b-us closed the pull request at: https://github.com/apache/nifi/pull/381 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] nifi pull request: NiFi-1808 Added GetMQTT and PutMQTT processors

2016-04-28 Thread r-b-us
Github user r-b-us commented on the pull request: https://github.com/apache/nifi/pull/381#issuecomment-215595294 Ok - good luck! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] nifi pull request: NiFi-1808 Added GetMQTT and PutMQTT processors

2016-04-28 Thread JPercivall
Github user JPercivall commented on the pull request: https://github.com/apache/nifi/pull/381#issuecomment-215578997 @r-b-us I created another PR[1] so that I could work on it. I have your original commit as the underlying base and I did work on top of it so you can close this PR

[GitHub] nifi pull request: Nifi 1808

2016-04-28 Thread JPercivall
GitHub user JPercivall opened a pull request: https://github.com/apache/nifi/pull/392 Nifi 1808 Using @r-b-us original PR[1] as a base, I refactored it a bit and added more functionality. [1] https://github.com/apache/nifi/pull/381 You can merge this pull request into a

[GitHub] nifi pull request: NIFI-1816 Added provenance event SEND in Handle...

2016-04-28 Thread markap14
Github user markap14 commented on a diff in the pull request: https://github.com/apache/nifi/pull/389#discussion_r61509041 --- Diff: nifi-nar-bundles/nifi-standard-bundle/nifi-standard-processors/src/main/java/org/apache/nifi/processors/standard/HandleHttpResponse.java --- @@

[GitHub] nifi pull request: NIFI-981: Added ExecuteHiveQL and PutHiveQL pro...

2016-04-28 Thread bbende
Github user bbende commented on a diff in the pull request: https://github.com/apache/nifi/pull/384#discussion_r61502555 --- Diff: nifi-nar-bundles/nifi-hive-bundle/nifi-hive-processors/src/main/java/org/apache/nifi/processors/hive/ExecuteHiveQL.java --- @@ -152,8 +152,23 @@

[GitHub] nifi pull request: NIFI-1805

2016-04-28 Thread aperepel
Github user aperepel commented on the pull request: https://github.com/apache/nifi/pull/377#issuecomment-215543265 @markap14 don't show more, change _how_ things are shown. in case of a connection and backpressure a simple gradient change in color (or a binary ok/throttled color) of

[GitHub] nifi pull request: NIFI-1816 Added provenance event SEND in Handle...

2016-04-28 Thread pvillard31
Github user pvillard31 commented on a diff in the pull request: https://github.com/apache/nifi/pull/389#discussion_r61487043 --- Diff: nifi-nar-bundles/nifi-standard-bundle/nifi-standard-processors/src/main/java/org/apache/nifi/processors/standard/HandleHttpResponse.java --- @@

[GitHub] nifi pull request: NIFI-1805

2016-04-28 Thread markap14
Github user markap14 commented on the pull request: https://github.com/apache/nifi/pull/377#issuecomment-215533199 We have talked before about having some sort of icon on a connection that indicates that back pressure is configured and then some sort of indicator that back pressure

[GitHub] nifi pull request: NIFI-981: Added ExecuteHiveQL and PutHiveQL pro...

2016-04-28 Thread mattyb149
Github user mattyb149 commented on a diff in the pull request: https://github.com/apache/nifi/pull/384#discussion_r61486272 --- Diff: nifi-nar-bundles/nifi-hive-bundle/nifi-hive-processors/src/main/java/org/apache/nifi/processors/hive/ExecuteHiveQL.java --- @@ -0,0 +1,178 @@

[GitHub] nifi pull request: NIFI-1816 Added provenance event SEND in Handle...

2016-04-28 Thread markap14
Github user markap14 commented on a diff in the pull request: https://github.com/apache/nifi/pull/389#discussion_r61485635 --- Diff: nifi-nar-bundles/nifi-standard-bundle/nifi-standard-processors/src/main/java/org/apache/nifi/processors/standard/HandleHttpResponse.java --- @@

[GitHub] nifi pull request: NIFI-1824: If attempting to archive content, an...

2016-04-28 Thread markap14
GitHub user markap14 opened a pull request: https://github.com/apache/nifi/pull/391 NIFI-1824: If attempting to archive content, and there are no claimant counts for it, ensure that the stream is closed. NIFI-1824: If attempting to archive content, and there are no claimant counts

[GitHub] nifi-minifi-cpp pull request: MINIFI-6: Initial Checkin for basic ...

2016-04-28 Thread benqiu2016
Github user benqiu2016 commented on the pull request: https://github.com/apache/nifi-minifi-cpp/pull/1#issuecomment-215509378 Initial Checkin for basic C++ MiNiFi framework https://issues.apache.org/jira/browse/MINIFI-6 --- If your project is set up for it, you can reply to this

[GitHub] nifi-minifi-cpp pull request: MINIFI-6: Initial Checkin for basic ...

2016-04-28 Thread benqiu2016
GitHub user benqiu2016 opened a pull request: https://github.com/apache/nifi-minifi-cpp/pull/1 MINIFI-6: Initial Checkin for basic C++ MiNiFi framework You can merge this pull request into a Git repository by running: $ git pull https://github.com/benqiu2016/nifi-minifi-cpp

Re: GetKafka blowing up with assertion error in Kafka client code

2016-04-28 Thread Oleg Zhurakousky
Chris Thanks for looking into this and describing the problem. Indeed we have seen similar symptoms but would need to further investigate and see if there is an option to stop the internal to Kafka reconnect thread. It appears there are configuration properties in the new API to do that, while

Re: Identifier Attribute for PutElasticSearch

2016-04-28 Thread Bryan Bende
Hello, ElasticSearch requires id for each document that is added. The value of this property will be the id on the document being added. You would likely set the value of this property to expression language that references a FlowFile attribute, you could use ${uuid} to use the FlowFile's uuid

Re: GetKafka blowing up with assertion error in Kafka client code

2016-04-28 Thread McDermott, Chris Kevin (MSDU - STaTS/StorefrontRemote)
Oleg, I have reproduced the problem. Its pretty easy to do. Just delete and recreate the topic while the processor is running. I think I saw a similar problem when I increased the partitions in the topic. That problem resolved itself when I restarted the GetKafka processors. However, to

Re: [GitHub] nifi pull request: Nifi 1214

2016-04-28 Thread Toivo Adams
To move on and clean a mess I created new pull request. https://github.com/apache/nifi/pull/388 nifi-1214b Mock Framework should allow order-independent assumptions on FlowFiles. This replaces previous nifi-1214 thanks toivo -- View this message in context:

[GitHub] nifi pull request: nifi-1214b Mock Framework should allow order-in...

2016-04-28 Thread ToivoAdams
GitHub user ToivoAdams opened a pull request: https://github.com/apache/nifi/pull/388 nifi-1214b Mock Framework should allow order-independent assumptions … nifi-1214b Mock Framework should allow order-independent assumptions on FlowFiles. This replaces previous nifi-1214 You

Re: NiFi 0.5.1 "too many open files"

2016-04-28 Thread Mark Payne
Mike, I am looking into this, and I was able to figure out how we could potentially archive (and eventually age off from the archive) a piece of data for which there is still an open file handle. Specifically, I am able to understand how this could happen only when we have a problem reading a

[GitHub] nifi pull request: NIFI-1822: Allow concurrent execution in Execut...

2016-04-28 Thread mattyb149
GitHub user mattyb149 opened a pull request: https://github.com/apache/nifi/pull/387 NIFI-1822: Allow concurrent execution in ExecuteScript Added a ScriptEngine pool for use by ExecuteScript, to enable it to run with multiple concurrent tasks. You can merge this pull request into

[GitHub] nifi pull request: NIFI-856 Implements experimental ListenLumberja...

2016-04-28 Thread apiri
Github user apiri commented on a diff in the pull request: https://github.com/apache/nifi/pull/290#discussion_r61430470 --- Diff: nifi-nar-bundles/nifi-lumberjack-bundle/nifi-lumberjack-processors/src/main/java/org/apache/nifi/processors/lumberjack/ListenLumberjack.java --- @@

[GitHub] nifi pull request: NIFI-856 Implements experimental ListenLumberja...

2016-04-28 Thread apiri
Github user apiri commented on a diff in the pull request: https://github.com/apache/nifi/pull/290#discussion_r61429387 --- Diff: nifi-nar-bundles/nifi-lumberjack-bundle/nifi-lumberjack-processors/src/main/java/org/apache/nifi/processors/lumberjack/event/LumberjackMetadata.java ---

RE: Reg: Issues in Custom Processor

2016-04-28 Thread Sourav Gulati
Hi Bryan, Following is the code snapshot: try (FileChannel fileChannel = FileChannel.open(file.toPath(), StandardOpenOption.READ)) { fileChannel.position(lastKnownLocation); FlowFile flowFile = session.create(); flowFile = writeToFlowFile(session, flowFile, fileChannel, positionHolder);

[GitHub] nifi pull request: NIFI-1812 nifi-env scripts (linux/windows)

2016-04-28 Thread YolandaMDavis
GitHub user YolandaMDavis opened a pull request: https://github.com/apache/nifi/pull/386 NIFI-1812 nifi-env scripts (linux/windows) Initial commit for nifi-env scripts. Scripts will provide a centralized method of setting environmental variables for use by other scripts (e.g.

[GitHub] nifi pull request: NIFI-856 Implements experimental ListenLumberja...

2016-04-28 Thread trixpan
Github user trixpan commented on a diff in the pull request: https://github.com/apache/nifi/pull/290#discussion_r61381899 --- Diff: nifi-nar-bundles/nifi-lumberjack-bundle/nifi-lumberjack-nar/src/main/resources/META-INF/NOTICE --- @@ -0,0 +1,28 @@ +nifi-lumberjack-nar

[GitHub] nifi pull request: NIFI-856 Implements experimental ListenLumberja...

2016-04-28 Thread trixpan
Github user trixpan commented on a diff in the pull request: https://github.com/apache/nifi/pull/290#discussion_r61381818 --- Diff: nifi-nar-bundles/nifi-lumberjack-bundle/nifi-lumberjack-processors/src/test/java/org/apache/nifi/processors/lumberjack/ListenLumberjackTest.java ---

[GitHub] nifi pull request: NIFI-856 Implements experimental ListenLumberja...

2016-04-28 Thread trixpan
Github user trixpan commented on a diff in the pull request: https://github.com/apache/nifi/pull/290#discussion_r61381697 --- Diff: