enforce run only in promary node $ multiple primary node

2016-09-19 Thread Tijo Thomas
 Hi , 1. While writing a processor is it possible to enforce to run only in primary node. I saw a Jira for this but appears to unresolved.  [NIFI-543] Provide extensions a way to indicate that they can run only on primary node, if clustered - ASF JIRA   | | | | || | | |

Re: enforce run only in promary node $ multiple primary node

2016-09-19 Thread Jeff
Tijo, To give you some information on your second question, you can design your flow to redistribute the flowfiles coming out of your processors to other nodes in the cluster for processing. There are several examples on how this on various blogs/email lists/etc, and I just grabbed one for refere

ETL processors for NiFi

2016-09-19 Thread Karthik Ramakrishnan
Hello All, I am currently developing an ETL pipeline and I am using Apache NiFi for this task. I would like to know if there is any processor that help with the following use case: I am consuming from Kafka and based on some attributes in the message then I am updating the database with the data.

Re: ETL processors for NiFi

2016-09-19 Thread Mark Payne
Hi Karthik, I think what you want to be using here is PutSQL, rather than ExecuteSQL. ExecuteSQL is designed to perform a SELECT statement, whereas PutSQL would update a database. PutSQL expects the incoming FlowFile to contain the SQL to execute. So you could use ReplaceText with the 'Replacem

Re: ETL processors for NiFi

2016-09-19 Thread Karthik Ramakrishnan
Hey Mark, This would help me a lot in building the flow. Thanks a bunch!! Warm Regards, Karthik R. On Mon, Sep 19, 2016 at 3:11 PM, Mark Payne wrote: > Hi Karthik, > > I think what you want to be using here is PutSQL, rather than ExecuteSQL. > ExecuteSQL > is designed to perform a SELECT state

Idea needed to get XL from SharePoint using NiFi

2016-09-19 Thread Nathamuni, Ramanujam
Hello: I need to get the XL files on windows SharePoint 2013 and store as CSV file or load into database? Please give me the things to try out? Thanks, Ram * This e-mail may contain confidential or privileged information. I

UI: flow status and counters feedback

2016-09-19 Thread Andrew Grande
Hi All, I'd like to provide some feedback on the NiFi 1.0 UI now that I had a chance to use it for a while, as well as pass along what I heard directly from other end users. Attached is a screenshot of a status bar right above the main flow canvas. The biggest difference from the 0.x UI is how mu

Re: UI: feedback on the processor 'color' in NiFi 1.0

2016-09-19 Thread Jeff
I was thinking, in addition to changing the color of the icon on the processor, that the color of the drop shadow could be changed as well. That would provide more contrast, but preserve readability, in my opinion. On Mon, Sep 19, 2016 at 6:39 PM Andrew Grande wrote: > Hi All, > > Rolling with U

Download item from queue - what permission is required?

2016-09-19 Thread Andre
Hi there, I am puzzled but one of 1.0.0 features. I had some flowfiles in the queue and as customary I did a list queue. Flowfile was in there, attributes in perfect shape. Yet when I try to download the data of the flowfile (i.e. click the download button) it reports I don't have permissions.

Periodic delta pulls from a data source

2016-09-19 Thread Selvam Raman
> Hi, > > We have a requirement to pull data periodically from a data source. For this to work we would like nifi to keep track of the last id or time stamp that was pulled successfully so that the next pull starts from that point. > > Let me know if nifi supports this? If yes how do we configure?