Re: Nifi processor last execution time

2015-11-13 Thread Sean Busbey
Sam, For now I would store this information in HDFS. Alternatively, if you have it ZooKeeper would also work. On Thu, Nov 12, 2015 at 10:45 PM, Sam Kamau wrote: > I am working on a processor that loads data to HDFS for an RDBMS using > ExecuteSQL processor. The data has a

Re: Release wrangling: 1 week until our hopeful 0.4.0 release

2015-11-13 Thread Aldrin Piri
Scanned through and removed the 0.4.0 tagging for State Management. Thanks for the suggestion. On Fri, Nov 13, 2015 at 10:10 AM, Sean Busbey wrote: > Has anyone had a chance to do a pass through Feature Proposals to move out > any that aren't going to make 0.4.0? > >

Re: Release wrangling: 1 week until our hopeful 0.4.0 release

2015-11-13 Thread Sean Busbey
Has anyone had a chance to do a pass through Feature Proposals to move out any that aren't going to make 0.4.0? https://cwiki.apache.org/confluence/display/NIFI/NiFi+Feature+Proposals On Thu, Nov 12, 2015 at 8:13 AM, Tony Kurc wrote: >

[GitHub] nifi pull request: NIFI-748 Fixed logic around handling partial qu...

2015-11-13 Thread olegz
GitHub user olegz opened a pull request: https://github.com/apache/nifi/pull/123 NIFI-748 Fixed logic around handling partial query results from prove… …nance repository - Ensured that failures derived form correlating Document to its actual provenance event do fail

Merge Binary

2015-11-13 Thread plj
I have written a processor that will take an image and tile it into 512x512 images. I now want to write a processor to merge them back together again. I see MergeContent and I would like to extend it. 1st off does this seem reasonable? If so: I'm working in my own bundle and my current hold

[GitHub] nifi pull request: NIFI-1146 Allow GetKafka to be configured with ...

2015-11-13 Thread naveenmadhire
GitHub user naveenmadhire opened a pull request: https://github.com/apache/nifi/pull/125 NIFI-1146 Allow GetKafka to be configured with auto.offset.reset to "largest" or "smallest" You can merge this pull request into a Git repository by running: $ git pull

[GitHub] nifi pull request: NIFI-1156: HTML Parsing Processors Bundle

2015-11-13 Thread jdye64
GitHub user jdye64 opened a pull request: https://github.com/apache/nifi/pull/124 NIFI-1156: HTML Parsing Processors Bundle NIFI-1156: HTML Parsing Processors Bundle. GetHTMLElement, ModifyHTMLElement, and PutHTMLElement You can merge this pull request into a Git repository by

Re: Merging csv files based on criterias

2015-11-13 Thread Yaismel Miranda Pons
Hi Joe, thanks for taking the time to answer. This is the scenario I'm trying to accomplish with nifi: I want to create a simple dataflow for automating the process of ingesting CSV data found in some datasets. The dataset could come from either an Http endpoint or just be csv files in a

Nifi processor last execution time

2015-11-13 Thread Sam Kamau
I am working on a processor that loads data to HDFS for an RDBMS using ExecuteSQL processor. The data has a last update time that I would like to use to load records that have changed since the last load. How best can I go about saving the last execution time so I can use it as a filter in the

Re: https connection fails with ERR_CONNECTION_CLOSED

2015-11-13 Thread Joe Witt
Hello So keep in mind the term 'template' in NiFi means a section of capture configuration that if put on the graph becomes a live flow. In Nifi you're interacting with 'the flow' which can be one connecting thing or many disconnected things. The manipulation of the flow on the graph is