Download item from queue - what permission is required?

[Andre]

Hi there,


I am puzzled but one of 1.0.0 features. I had some flowfiles in the queue
and as customary I did a list queue.

Flowfile was in there, attributes in perfect shape. Yet when I try to
download the data of the flowfile (i.e. click the download button) it
reports I don't have permissions.

I would assume the permissions required would be "view the data"?


Cheers

Re: UI: feedback on the processor 'color' in NiFi 1.0

[Jeff]

I was thinking, in addition to changing the color of the icon on the
processor, that the color of the drop shadow could be changed as well.
That would provide more contrast, but preserve readability, in my opinion.

On Mon, Sep 19, 2016 at 6:39 PM Andrew Grande  wrote:

> Hi All,
>
> Rolling with UI feedback threads. This time I'd like to discuss how NiFi
> 'lost' its ability to change processor boxes color. I.e. as you can see
> from a screenshot attached, it does change color for the processor in the
> flow overview panel, but the processor itself only changes the icon in the
> top-left of the box. I came across a few users who definitely miss the old
> way. I personally think changing the icon color for the processor doesn't
> go far enough, especially when one is dealing with a flow of several dozen
> processors, zooms in and out often. The overview helps, but it's not the
> same.
>
> Proposal - can we restore how color selection for the processor changed
> the actual background of the processor box on the canvas? Let the user go
> wild with colors and deal with readability, but at least it's easy to spot
> 'important' things this way. And with multi-tenant authorization it becomes
> a poor-man's doc between teams, to an extent.
>
> Thanks for any feedback,
> Andrew
>

UI: flow status and counters feedback

[Andrew Grande]

Hi All,

I'd like to provide some feedback on the NiFi 1.0 UI now that I had a
chance to use it for a while, as well as pass along what I heard directly
from other end users.

Attached is a screenshot of a status bar right above the main flow canvas.
The biggest difference from the 0.x UI is how much whitespace it now has
between elements. To a point where it's not possible to quickly scan the
state with a glance.

Does anyone have other opinions? Can we adjust things slightly so they are
easier on the eye an have less horizontal friction?

Thanks!
Andrew

Idea needed to get XL from SharePoint using NiFi

[Nathamuni, Ramanujam]

Hello:

I need to get the XL files on windows SharePoint 2013  and store as CSV file or 
load into database? Please give me the things to try out?

Thanks,
Ram
*
This e-mail may contain confidential or privileged information.
If you are not the intended recipient, please notify the sender immediately and 
then delete it.

TIAA
*

Re: ETL processors for NiFi

[Karthik Ramakrishnan]

Hey Mark,

This would help me a lot in building the flow. Thanks a bunch!!

Warm Regards,
Karthik R.

On Mon, Sep 19, 2016 at 3:11 PM, Mark Payne  wrote:

> Hi Karthik,
>
> I think what you want to be using here is PutSQL, rather than ExecuteSQL.
> ExecuteSQL
> is designed to perform a SELECT statement, whereas PutSQL would update a
> database.
>
> PutSQL expects the incoming FlowFile to contain the SQL to execute.
> So you could use ReplaceText with the 'Replacement Strategy' set to
> "Always Replace"
> and set the Replacement Value to whatever SQL you want to use. The
> ReplaceText processor
> supports the Expression Language, so you can reference whatever FlowFile
> attributes you would
> like to formulate the message.
>
> How to get information from the Kafka message into your FlowFile
> attributes depends on the type of
> data that you are pulling. If it is JSON, for instance, you could use
> EvaluateJsonPath to extract out
> particular pieces of information into FlowFile attributes.
>
> Does this help?
>
> Thanks
> -Mark
>
> On Sep 19, 2016, at 3:58 PM, Karthik Ramakrishnan <
> karthik.ramakrishna...@gmail.com> wrote:
>
> Hello All,
>
> I am currently developing an ETL pipeline and I am using Apache NiFi for
> this task. I would like to know if there is any processor that help with
> the following use case: I am consuming from Kafka and based on some
> attributes in the message then I am updating the database with the data. I
> have a GetKafka for getting the messages and a ExecuteSQL processor for
> updating the database.  I am stuck in finding a processor that reads the
> Kafka message and checks the attribute and then sends the data values to
> the executeSQL processor. Can someone help on this?
>
> Thanks!!
>
> --
> Thanks,
> *Karthik Ramakrishnan*
> *Data Services Intern*
> *Copart Inc.*
> *Dallas, TX*
> *Contact : +1 (469) 951-8854 <%2B1%20%28469%29%20951-8854>*
>
>
>


-- 
Thanks,
*Karthik Ramakrishnan*
*Contact : +1 (469) 951-8854*

Re: ETL processors for NiFi

[Mark Payne]

Hi Karthik,

I think what you want to be using here is PutSQL, rather than ExecuteSQL. 
ExecuteSQL
is designed to perform a SELECT statement, whereas PutSQL would update a 
database.

PutSQL expects the incoming FlowFile to contain the SQL to execute.
So you could use ReplaceText with the 'Replacement Strategy' set to "Always 
Replace"
and set the Replacement Value to whatever SQL you want to use. The ReplaceText 
processor
supports the Expression Language, so you can reference whatever FlowFile 
attributes you would
like to formulate the message.

How to get information from the Kafka message into your FlowFile attributes 
depends on the type of
data that you are pulling. If it is JSON, for instance, you could use 
EvaluateJsonPath to extract out
particular pieces of information into FlowFile attributes.

Does this help?

Thanks
-Mark

> On Sep 19, 2016, at 3:58 PM, Karthik Ramakrishnan 
>  wrote:
> 
> Hello All,
> 
> I am currently developing an ETL pipeline and I am using Apache NiFi for this 
> task. I would like to know if there is any processor that help with the 
> following use case: I am consuming from Kafka and based on some attributes in 
> the message then I am updating the database with the data. I have a GetKafka 
> for getting the messages and a ExecuteSQL processor for updating the 
> database.  I am stuck in finding a processor that reads the Kafka message and 
> checks the attribute and then sends the data values to the executeSQL 
> processor. Can someone help on this? 
> 
> Thanks!!
> 
> -- 
> Thanks,
> Karthik Ramakrishnan
> Data Services Intern
> Copart Inc.
> Dallas, TX
> Contact : +1 (469) 951-8854
> 

enforce run only in promary node $ multiple primary node

[Tijo Thomas]

 Hi ,
1. While writing a processor is it possible to enforce to run only in primary 
node. I saw a Jira for this but appears to unresolved. 
[NIFI-543] Provide extensions a way to indicate that they can run only on 
primary node, if clustered - ASF JIRA  

  
|  
|   
|   
|   ||

   |

  |
|  
|   |  
[NIFI-543] Provide extensions a way to indicate that they can run only on p...
   |   |

  |

  |

 
2. Currently my Primary node is heavily loaded  as i have many  processor which 
will run only in Primary node.  Is it possible to define multiple primary nodes 
. or is it possible to configure processors not to run in primary node. 
Tijo