RE: GetMongoDB : How to pass parameters as input to GetMongoDB processor

[Brajendra Mishra]

Hi Mike,
Thanks for responding.
Here, I have attached missing image attachment.

Brajendra Mishra
Persistent Systems Ltd.

From: Mike Thomsen 
Sent: Wednesday, May 02, 2018 6:24 PM
To: dev@nifi.apache.org
Subject: Re: GetMongoDB : How to pass parameters as input to GetMongoDB 
processor

That might require 1.6.0. Also, your image didn't come through in your response 
to Sivaprasanna so resend that too.
On Wed, May 2, 2018 at 8:37 AM Brajendra Mishra 
> wrote:
Hi Mike,

Thanks a lot for responding.

On your statement
"That is its new default behavior if you leave the query field blank and have 
an incoming connection from another processor. That would be a good way to 
integrate the flow with another application"

Could you please share a sample template for the same?


Brajendra Mishra
Persistent Systems Ltd.

-Original Message-
From: Mike Thomsen >
Sent: Wednesday, May 02, 2018 5:58 PM
To: dev@nifi.apache.org
Subject: Re: GetMongoDB : How to pass parameters as input to GetMongoDB 
processor

GetMongo can also use the body of a flowfile for the query. That is its new 
default behavior if you leave the query field blank and have an incoming 
connection from another processor. That would be a good way to integrate the 
flow with another application. For example, you could add FetchKafka to the 
flow and have your applications post messages to Kafka with the queries they 
want it to run and FetchKafka would send that JSON to GetMongo as it comes in. 
Or you could build a REST service that writes the JSON to disk and use GetFile 
to load it. Lots of ways to do this.

On Wed, May 2, 2018 at 6:42 AM Sivaprasanna 
>
wrote:

> Since I'm not so sure about your exact use case, I have just created a
> rough template based on the simple example flow that I had posted
> earlier which is GenerateFlowfile -> UpdateAttribute -> GetMongo. I
> have attached the template here.
>
> -
> Sivaprasanna
>
> On Wed, May 2, 2018 at 2:55 PM, Brajendra Mishra <
> brajendra_mis...@persistent.com> 
> wrote:
>
>> Hi Sivaprasanna,
>>
>> Could you please provide me the sample template for the same, where I
>> can pass parameters (and get those parameters' value to process
>> further) to GetMongoDB processor?
>> It would be a great help for us.
>>
>> Brajendra Mishra
>> Persistent Systems Ltd.
>>
>> -Original Message-
>> From: Sivaprasanna 
>> >
>> Sent: Wednesday, May 02, 2018 2:28 PM
>> To: dev@nifi.apache.org
>> Subject: Re: GetMongoDB : How to pass parameters as input to
>> GetMongoDB processor
>>
>> Hi.
>>
>> GetMongo can take input. So technically you can use a processor
>> before and then connect it  to GetMongo.
>>
>> A simple example :
>> GenerateFlowfile -> UpdateAttribute -> GetMongo
>>
>> In the UpdateAttribute, you can add attributes for the database and
>> collection and then use them in GetMong using NiFi Expression Language.
>>
>> Let me know, if that doesn’t help.
>>
>> -
>> Sivaprasanna
>>
>> On Wed, 2 May 2018 at 1:26 PM, Brajendra Mishra <
>> brajendra_mis...@persistent.com> 
>> wrote:
>>
>> > Hi Team,
>> > We have found there is only 'GetMongoDB' processor to connect and
>> > query to MongoDB in Apache NiFi.
>> > Hence, we this processor does not take any type or input.
>> >
>> > Do we have another type to Apache NiFi processor which can take
>> > parameters as input (details of MongoDB, query, instance etc.) from
>> other processor?
>> > If not then please suggest when such type of processor can be
>> > expected in upcoming release?
>> >
>> > Brajendra Mishra
>> > Persistent Systems Ltd.
>> >
>> > DISCLAIMER
>> > ==
>> > This e-mail may contain privileged and confidential information
>> > which is the property of Persistent Systems Ltd. It is intended
>> > only for the use of the individual or entity to which it is
>> > addressed. If you are not the intended recipient, you are not
>> > authorized to read, retain, copy, print, distribute or use this
>> > message. If you have received this communication in error, please
>> > notify the sender and delete all copies
>> of this message.
>> > Persistent Systems Ltd. does not accept any liability for virus
>> > infected mails.
>> >
>> DISCLAIMER
>> ==
>> This e-mail may contain privileged and confidential information which
>> is the property of Persistent Systems Ltd. It is intended only for
>> the use of the individual or entity to which it is addressed. If you
>> are not the intended recipient, you are not authorized to read,
>> retain, copy, print, distribute or use this message. If you have
>> received this communication in error, please 

Re: wifi questions

[Andy LoPresto]

Hi Clay,

A common use case for NiFi and Kafka in conjunction is when you want the 
capabilities of a message broker system like Kafka with very low latency and 
multiple publishers/consumers, but you also have the need for some of the 
features NiFi provides like backpressure, as you mentioned. This is frequently 
found in industrial control systems or hardware/IoT integration (sometimes 
interfacing with MQTT).

In the scenario you call out in 1), yes, NiFi can be a complete solution for 
record transformation and writing to HDFS.

I am not a Storm expert, but you correctly identify NiFi as a good “deliverer” 
of data to stream processing applications.

I also won’t address microbatching, but I’m confident some other community 
members will have good input on the topic.

I’ve included a couple resources you may find helpful, and I would suggest you 
might also get good results sending this email to the us...@nifi.apache.org 
 mailing list, as this list tends to focus more 
on the internals of NiFi, extensibility, and feature development. The users 
list has many contributors who deploy NiFi in real world scenarios and 
integrate with other systems that may not monitor this list.

Good luck.

https://bryanbende.com/development/2016/09/15/apache-nifi-and-apache-kafka 

https://hortonworks.com/webinar/apache-kafka-apache-nifi-better-together/ 

https://hortonworks.com/tutorial/realtime-event-processing-in-hadoop-with-nifi-kafka-and-storm/
 


Andy LoPresto
alopre...@apache.org
alopresto.apa...@gmail.com
PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4  BACE 3C6E F65B 2F7D EF69

> On May 2, 2018, at 7:45 PM, Clay Teahouse  wrote:
> 
> Hello All,
> 
> 1) Why would one need both nifi and Kafka in an environment, considering
> that NiFi can handle back pressure, set up and deal with queues? I have an
> environment where I would be collecting data via NiFi and I would need to
> write the data to hdfs after some post processing. Can't I just process the
> records in NiFi, change the format and write the data to HDFS via a NiFi
> HDFS processor, PutHDFS?
> 
> 2) Similarly, if I need to do some stream processing, can't I just pull the
> data from NiFi processor via NiFiSpout, do the processing via some bolts,
> and write the data to HDFS either via HDFS bolt or A NiFi HDFS processor?
> 
> Do I even need storm in the picture?
> 
> 3) Is NiFi suited for microbatch processing? Would it be better to pull the
> data from NiFi via spark streaming and do microbatching there? Which
> approach is most performant and reliable?
> 
> thanks
> 
> Clay



signature.asc
Description: Message signed with OpenPGP using GPGMail

wifi questions

[Clay Teahouse]

Hello All,

1) Why would one need both nifi and Kafka in an environment, considering
that NiFi can handle back pressure, set up and deal with queues? I have an
environment where I would be collecting data via NiFi and I would need to
write the data to hdfs after some post processing. Can't I just process the
records in NiFi, change the format and write the data to HDFS via a NiFi
HDFS processor, PutHDFS?

2) Similarly, if I need to do some stream processing, can't I just pull the
data from NiFi processor via NiFiSpout, do the processing via some bolts,
and write the data to HDFS either via HDFS bolt or A NiFi HDFS processor?

Do I even need storm in the picture?

3) Is NiFi suited for microbatch processing? Would it be better to pull the
data from NiFi via spark streaming and do microbatching there? Which
approach is most performant and reliable?

thanks

Clay

Re: GetMongoDB : How to pass parameters as input to GetMongoDB processor

[Mike Thomsen]

That might require 1.6.0. Also, your image didn't come through in your
response to Sivaprasanna so resend that too.

On Wed, May 2, 2018 at 8:37 AM Brajendra Mishra <
brajendra_mis...@persistent.com> wrote:

> Hi Mike,
>
> Thanks a lot for responding.
>
> On your statement
> "That is its new default behavior if you leave the query field blank and
> have an incoming connection from another processor. That would be a good
> way to integrate the flow with another application"
>
> Could you please share a sample template for the same?
>
>
> Brajendra Mishra
> Persistent Systems Ltd.
>
> -Original Message-
> From: Mike Thomsen 
> Sent: Wednesday, May 02, 2018 5:58 PM
> To: dev@nifi.apache.org
> Subject: Re: GetMongoDB : How to pass parameters as input to GetMongoDB
> processor
>
> GetMongo can also use the body of a flowfile for the query. That is its
> new default behavior if you leave the query field blank and have an
> incoming connection from another processor. That would be a good way to
> integrate the flow with another application. For example, you could add
> FetchKafka to the flow and have your applications post messages to Kafka
> with the queries they want it to run and FetchKafka would send that JSON to
> GetMongo as it comes in. Or you could build a REST service that writes the
> JSON to disk and use GetFile to load it. Lots of ways to do this.
>
> On Wed, May 2, 2018 at 6:42 AM Sivaprasanna 
> wrote:
>
> > Since I'm not so sure about your exact use case, I have just created a
> > rough template based on the simple example flow that I had posted
> > earlier which is GenerateFlowfile -> UpdateAttribute -> GetMongo. I
> > have attached the template here.
> >
> > -
> > Sivaprasanna
> >
> > On Wed, May 2, 2018 at 2:55 PM, Brajendra Mishra <
> > brajendra_mis...@persistent.com> wrote:
> >
> >> Hi Sivaprasanna,
> >>
> >> Could you please provide me the sample template for the same, where I
> >> can pass parameters (and get those parameters' value to process
> >> further) to GetMongoDB processor?
> >> It would be a great help for us.
> >>
> >> Brajendra Mishra
> >> Persistent Systems Ltd.
> >>
> >> -Original Message-
> >> From: Sivaprasanna 
> >> Sent: Wednesday, May 02, 2018 2:28 PM
> >> To: dev@nifi.apache.org
> >> Subject: Re: GetMongoDB : How to pass parameters as input to
> >> GetMongoDB processor
> >>
> >> Hi.
> >>
> >> GetMongo can take input. So technically you can use a processor
> >> before and then connect it  to GetMongo.
> >>
> >> A simple example :
> >> GenerateFlowfile -> UpdateAttribute -> GetMongo
> >>
> >> In the UpdateAttribute, you can add attributes for the database and
> >> collection and then use them in GetMong using NiFi Expression Language.
> >>
> >> Let me know, if that doesn’t help.
> >>
> >> -
> >> Sivaprasanna
> >>
> >> On Wed, 2 May 2018 at 1:26 PM, Brajendra Mishra <
> >> brajendra_mis...@persistent.com> wrote:
> >>
> >> > Hi Team,
> >> > We have found there is only 'GetMongoDB' processor to connect and
> >> > query to MongoDB in Apache NiFi.
> >> > Hence, we this processor does not take any type or input.
> >> >
> >> > Do we have another type to Apache NiFi processor which can take
> >> > parameters as input (details of MongoDB, query, instance etc.) from
> >> other processor?
> >> > If not then please suggest when such type of processor can be
> >> > expected in upcoming release?
> >> >
> >> > Brajendra Mishra
> >> > Persistent Systems Ltd.
> >> >
> >> > DISCLAIMER
> >> > ==
> >> > This e-mail may contain privileged and confidential information
> >> > which is the property of Persistent Systems Ltd. It is intended
> >> > only for the use of the individual or entity to which it is
> >> > addressed. If you are not the intended recipient, you are not
> >> > authorized to read, retain, copy, print, distribute or use this
> >> > message. If you have received this communication in error, please
> >> > notify the sender and delete all copies
> >> of this message.
> >> > Persistent Systems Ltd. does not accept any liability for virus
> >> > infected mails.
> >> >
> >> DISCLAIMER
> >> ==
> >> This e-mail may contain privileged and confidential information which
> >> is the property of Persistent Systems Ltd. It is intended only for
> >> the use of the individual or entity to which it is addressed. If you
> >> are not the intended recipient, you are not authorized to read,
> >> retain, copy, print, distribute or use this message. If you have
> >> received this communication in error, please notify the sender and
> delete all copies of this message.
> >> Persistent Systems Ltd. does not accept any liability for virus
> >> infected mails.
> >>
> >
> >
> DISCLAIMER
> ==
> This e-mail may contain privileged and confidential information which is
> the property of Persistent Systems Ltd. It is intended only for the use of
> the individual or entity to which it is 

RE: GetMongoDB : How to pass parameters as input to GetMongoDB processor

[Brajendra Mishra]

Hi Sivaprasanna,
I have imported template you shared, its showing below error (Upstream 
connections is invalid) for GetMongo;
Can you please check this if you faced the same this or are you using other 
version of Apache NiFi. We are using Apache NiFi version 1.5.0.



[cid:image001.jpg@01D3E241.066A55A0]

Thanks
Brajendra Mishra
Persistent Systems Ltd.

From: Sivaprasanna 
Sent: Wednesday, May 02, 2018 4:12 PM
To: dev@nifi.apache.org
Subject: Re: GetMongoDB : How to pass parameters as input to GetMongoDB 
processor

Since I'm not so sure about your exact use case, I have just created a rough 
template based on the simple example flow that I had posted earlier which is 
GenerateFlowfile -> UpdateAttribute -> GetMongo. I have attached the template 
here.

-
Sivaprasanna

On Wed, May 2, 2018 at 2:55 PM, Brajendra Mishra 
> wrote:
Hi Sivaprasanna,

Could you please provide me the sample template for the same, where I can pass 
parameters (and get those parameters' value to process further) to GetMongoDB 
processor?
It would be a great help for us.

Brajendra Mishra
Persistent Systems Ltd.
-Original Message-
From: Sivaprasanna >
Sent: Wednesday, May 02, 2018 2:28 PM
To: dev@nifi.apache.org
Subject: Re: GetMongoDB : How to pass parameters as input to GetMongoDB 
processor

Hi.

GetMongo can take input. So technically you can use a processor before and then 
connect it  to GetMongo.

A simple example :
GenerateFlowfile -> UpdateAttribute -> GetMongo

In the UpdateAttribute, you can add attributes for the database and collection 
and then use them in GetMong using NiFi Expression Language.

Let me know, if that doesn’t help.

-
Sivaprasanna

On Wed, 2 May 2018 at 1:26 PM, Brajendra Mishra < 
brajendra_mis...@persistent.com> wrote:

> Hi Team,
> We have found there is only 'GetMongoDB' processor to connect and
> query to MongoDB in Apache NiFi.
> Hence, we this processor does not take any type or input.
>
> Do we have another type to Apache NiFi processor which can take
> parameters as input (details of MongoDB, query, instance etc.) from other 
> processor?
> If not then please suggest when such type of processor can be expected
> in upcoming release?
>
> Brajendra Mishra
> Persistent Systems Ltd.
>
> DISCLAIMER
> ==
> This e-mail may contain privileged and confidential information which
> is the property of Persistent Systems Ltd. It is intended only for the
> use of the individual or entity to which it is addressed. If you are
> not the intended recipient, you are not authorized to read, retain,
> copy, print, distribute or use this message. If you have received this
> communication in error, please notify the sender and delete all copies of 
> this message.
> Persistent Systems Ltd. does not accept any liability for virus
> infected mails.
>
DISCLAIMER
==
This e-mail may contain privileged and confidential information which is the 
property of Persistent Systems Ltd. It is intended only for the use of the 
individual or entity to which it is addressed. If you are not the intended 
recipient, you are not authorized to read, retain, copy, print, distribute or 
use this message. If you have received this communication in error, please 
notify the sender and delete all copies of this message. Persistent Systems 
Ltd. does not accept any liability for virus infected mails.

RE: GetMongoDB : How to pass parameters as input to GetMongoDB processor

[Brajendra Mishra]

Hi Mike,

Thanks a lot for responding.

On your statement 
"That is its new default behavior if you leave the query field blank and have 
an incoming connection from another processor. That would be a good way to 
integrate the flow with another application"

Could you please share a sample template for the same?


Brajendra Mishra
Persistent Systems Ltd.

-Original Message-
From: Mike Thomsen  
Sent: Wednesday, May 02, 2018 5:58 PM
To: dev@nifi.apache.org
Subject: Re: GetMongoDB : How to pass parameters as input to GetMongoDB 
processor

GetMongo can also use the body of a flowfile for the query. That is its new 
default behavior if you leave the query field blank and have an incoming 
connection from another processor. That would be a good way to integrate the 
flow with another application. For example, you could add FetchKafka to the 
flow and have your applications post messages to Kafka with the queries they 
want it to run and FetchKafka would send that JSON to GetMongo as it comes in. 
Or you could build a REST service that writes the JSON to disk and use GetFile 
to load it. Lots of ways to do this.

On Wed, May 2, 2018 at 6:42 AM Sivaprasanna 
wrote:

> Since I'm not so sure about your exact use case, I have just created a 
> rough template based on the simple example flow that I had posted 
> earlier which is GenerateFlowfile -> UpdateAttribute -> GetMongo. I 
> have attached the template here.
>
> -
> Sivaprasanna
>
> On Wed, May 2, 2018 at 2:55 PM, Brajendra Mishra < 
> brajendra_mis...@persistent.com> wrote:
>
>> Hi Sivaprasanna,
>>
>> Could you please provide me the sample template for the same, where I 
>> can pass parameters (and get those parameters' value to process 
>> further) to GetMongoDB processor?
>> It would be a great help for us.
>>
>> Brajendra Mishra
>> Persistent Systems Ltd.
>>
>> -Original Message-
>> From: Sivaprasanna 
>> Sent: Wednesday, May 02, 2018 2:28 PM
>> To: dev@nifi.apache.org
>> Subject: Re: GetMongoDB : How to pass parameters as input to 
>> GetMongoDB processor
>>
>> Hi.
>>
>> GetMongo can take input. So technically you can use a processor 
>> before and then connect it  to GetMongo.
>>
>> A simple example :
>> GenerateFlowfile -> UpdateAttribute -> GetMongo
>>
>> In the UpdateAttribute, you can add attributes for the database and 
>> collection and then use them in GetMong using NiFi Expression Language.
>>
>> Let me know, if that doesn’t help.
>>
>> -
>> Sivaprasanna
>>
>> On Wed, 2 May 2018 at 1:26 PM, Brajendra Mishra < 
>> brajendra_mis...@persistent.com> wrote:
>>
>> > Hi Team,
>> > We have found there is only 'GetMongoDB' processor to connect and 
>> > query to MongoDB in Apache NiFi.
>> > Hence, we this processor does not take any type or input.
>> >
>> > Do we have another type to Apache NiFi processor which can take 
>> > parameters as input (details of MongoDB, query, instance etc.) from
>> other processor?
>> > If not then please suggest when such type of processor can be 
>> > expected in upcoming release?
>> >
>> > Brajendra Mishra
>> > Persistent Systems Ltd.
>> >
>> > DISCLAIMER
>> > ==
>> > This e-mail may contain privileged and confidential information 
>> > which is the property of Persistent Systems Ltd. It is intended 
>> > only for the use of the individual or entity to which it is 
>> > addressed. If you are not the intended recipient, you are not 
>> > authorized to read, retain, copy, print, distribute or use this 
>> > message. If you have received this communication in error, please 
>> > notify the sender and delete all copies
>> of this message.
>> > Persistent Systems Ltd. does not accept any liability for virus 
>> > infected mails.
>> >
>> DISCLAIMER
>> ==
>> This e-mail may contain privileged and confidential information which 
>> is the property of Persistent Systems Ltd. It is intended only for 
>> the use of the individual or entity to which it is addressed. If you 
>> are not the intended recipient, you are not authorized to read, 
>> retain, copy, print, distribute or use this message. If you have 
>> received this communication in error, please notify the sender and delete 
>> all copies of this message.
>> Persistent Systems Ltd. does not accept any liability for virus 
>> infected mails.
>>
>
>
DISCLAIMER
==
This e-mail may contain privileged and confidential information which is the 
property of Persistent Systems Ltd. It is intended only for the use of the 
individual or entity to which it is addressed. If you are not the intended 
recipient, you are not authorized to read, retain, copy, print, distribute or 
use this message. If you have received this communication in error, please 
notify the sender and delete all copies of this message. Persistent Systems 
Ltd. does not accept any liability for virus infected mails.

Re: GetMongoDB : How to pass parameters as input to GetMongoDB processor

[Mike Thomsen]

GetMongo can also use the body of a flowfile for the query. That is its new
default behavior if you leave the query field blank and have an incoming
connection from another processor. That would be a good way to integrate
the flow with another application. For example, you could add FetchKafka to
the flow and have your applications post messages to Kafka with the queries
they want it to run and FetchKafka would send that JSON to GetMongo as it
comes in. Or you could build a REST service that writes the JSON to disk
and use GetFile to load it. Lots of ways to do this.

On Wed, May 2, 2018 at 6:42 AM Sivaprasanna 
wrote:

> Since I'm not so sure about your exact use case, I have just created a
> rough template based on the simple example flow that I had posted earlier
> which is GenerateFlowfile -> UpdateAttribute -> GetMongo. I have attached
> the template here.
>
> -
> Sivaprasanna
>
> On Wed, May 2, 2018 at 2:55 PM, Brajendra Mishra <
> brajendra_mis...@persistent.com> wrote:
>
>> Hi Sivaprasanna,
>>
>> Could you please provide me the sample template for the same, where I can
>> pass parameters (and get those parameters' value to process further) to
>> GetMongoDB processor?
>> It would be a great help for us.
>>
>> Brajendra Mishra
>> Persistent Systems Ltd.
>>
>> -Original Message-
>> From: Sivaprasanna 
>> Sent: Wednesday, May 02, 2018 2:28 PM
>> To: dev@nifi.apache.org
>> Subject: Re: GetMongoDB : How to pass parameters as input to GetMongoDB
>> processor
>>
>> Hi.
>>
>> GetMongo can take input. So technically you can use a processor before
>> and then connect it  to GetMongo.
>>
>> A simple example :
>> GenerateFlowfile -> UpdateAttribute -> GetMongo
>>
>> In the UpdateAttribute, you can add attributes for the database and
>> collection and then use them in GetMong using NiFi Expression Language.
>>
>> Let me know, if that doesn’t help.
>>
>> -
>> Sivaprasanna
>>
>> On Wed, 2 May 2018 at 1:26 PM, Brajendra Mishra <
>> brajendra_mis...@persistent.com> wrote:
>>
>> > Hi Team,
>> > We have found there is only 'GetMongoDB' processor to connect and
>> > query to MongoDB in Apache NiFi.
>> > Hence, we this processor does not take any type or input.
>> >
>> > Do we have another type to Apache NiFi processor which can take
>> > parameters as input (details of MongoDB, query, instance etc.) from
>> other processor?
>> > If not then please suggest when such type of processor can be expected
>> > in upcoming release?
>> >
>> > Brajendra Mishra
>> > Persistent Systems Ltd.
>> >
>> > DISCLAIMER
>> > ==
>> > This e-mail may contain privileged and confidential information which
>> > is the property of Persistent Systems Ltd. It is intended only for the
>> > use of the individual or entity to which it is addressed. If you are
>> > not the intended recipient, you are not authorized to read, retain,
>> > copy, print, distribute or use this message. If you have received this
>> > communication in error, please notify the sender and delete all copies
>> of this message.
>> > Persistent Systems Ltd. does not accept any liability for virus
>> > infected mails.
>> >
>> DISCLAIMER
>> ==
>> This e-mail may contain privileged and confidential information which is
>> the property of Persistent Systems Ltd. It is intended only for the use of
>> the individual or entity to which it is addressed. If you are not the
>> intended recipient, you are not authorized to read, retain, copy, print,
>> distribute or use this message. If you have received this communication in
>> error, please notify the sender and delete all copies of this message.
>> Persistent Systems Ltd. does not accept any liability for virus infected
>> mails.
>>
>
>

Re: GetSplunk : How to pass parameters as input to GetSplunk processor

[Bryan Bende]

Hello,

A ‘QuerySplunk’ processor that allowed incoming flow files probably makes sense.

If you want to work on this feel free to create a JIRA. I don’t see any 
existing tickets for Splunk related processors.

Thanks,

Bryan

> On May 2, 2018, at 3:56 AM, Brajendra Mishra 
>  wrote:
> 
> 
> Hi Team,
> We have found there is only 'GetSplunk' processor to connect and query to 
> Splunk in Apache NiFi.
> Hence, we this processor does not take any type or input.
> 
> Do we have another type to Apache NiFi processor which can take parameters as 
> input (details of Splunk indexes, query, instance etc.) from other processor?
> If not then please suggest when such type of processor can be expected in 
> upcoming release?
> 
> Brajendra Mishra
> Persistent Systems Ltd.
> 
> 
> 
> Brajendra Mishra
> Persistent Systems Ltd.
> 
> DISCLAIMER
> ==
> This e-mail may contain privileged and confidential information which is the 
> property of Persistent Systems Ltd. It is intended only for the use of the 
> individual or entity to which it is addressed. If you are not the intended 
> recipient, you are not authorized to read, retain, copy, print, distribute or 
> use this message. If you have received this communication in error, please 
> notify the sender and delete all copies of this message. Persistent Systems 
> Ltd. does not accept any liability for virus infected mails.



signature.asc
Description: Message signed with OpenPGP

Re: GetMongoDB : How to pass parameters as input to GetMongoDB processor

[Sivaprasanna]

Since I'm not so sure about your exact use case, I have just created a
rough template based on the simple example flow that I had posted earlier
which is GenerateFlowfile -> UpdateAttribute -> GetMongo. I have attached
the template here.

-
Sivaprasanna

On Wed, May 2, 2018 at 2:55 PM, Brajendra Mishra <
brajendra_mis...@persistent.com> wrote:

> Hi Sivaprasanna,
>
> Could you please provide me the sample template for the same, where I can
> pass parameters (and get those parameters' value to process further) to
> GetMongoDB processor?
> It would be a great help for us.
>
> Brajendra Mishra
> Persistent Systems Ltd.
>
> -Original Message-
> From: Sivaprasanna 
> Sent: Wednesday, May 02, 2018 2:28 PM
> To: dev@nifi.apache.org
> Subject: Re: GetMongoDB : How to pass parameters as input to GetMongoDB
> processor
>
> Hi.
>
> GetMongo can take input. So technically you can use a processor before and
> then connect it  to GetMongo.
>
> A simple example :
> GenerateFlowfile -> UpdateAttribute -> GetMongo
>
> In the UpdateAttribute, you can add attributes for the database and
> collection and then use them in GetMong using NiFi Expression Language.
>
> Let me know, if that doesn’t help.
>
> -
> Sivaprasanna
>
> On Wed, 2 May 2018 at 1:26 PM, Brajendra Mishra <
> brajendra_mis...@persistent.com> wrote:
>
> > Hi Team,
> > We have found there is only 'GetMongoDB' processor to connect and
> > query to MongoDB in Apache NiFi.
> > Hence, we this processor does not take any type or input.
> >
> > Do we have another type to Apache NiFi processor which can take
> > parameters as input (details of MongoDB, query, instance etc.) from
> other processor?
> > If not then please suggest when such type of processor can be expected
> > in upcoming release?
> >
> > Brajendra Mishra
> > Persistent Systems Ltd.
> >
> > DISCLAIMER
> > ==
> > This e-mail may contain privileged and confidential information which
> > is the property of Persistent Systems Ltd. It is intended only for the
> > use of the individual or entity to which it is addressed. If you are
> > not the intended recipient, you are not authorized to read, retain,
> > copy, print, distribute or use this message. If you have received this
> > communication in error, please notify the sender and delete all copies
> of this message.
> > Persistent Systems Ltd. does not accept any liability for virus
> > infected mails.
> >
> DISCLAIMER
> ==
> This e-mail may contain privileged and confidential information which is
> the property of Persistent Systems Ltd. It is intended only for the use of
> the individual or entity to which it is addressed. If you are not the
> intended recipient, you are not authorized to read, retain, copy, print,
> distribute or use this message. If you have received this communication in
> error, please notify the sender and delete all copies of this message.
> Persistent Systems Ltd. does not accept any liability for virus infected
> mails.
>



f6620488-0162-1000-acf2-cb751ab6e617
Hello Mongo


944a5b06-7f3e-383e--
ab629e9a-a9e2-3dcc--
1 GB
1

ab629e9a-a9e2-3dcc--
ec33b40f-e496-3032--
PROCESSOR

0 sec
1

success

ab629e9a-a9e2-3dcc--
c97a1213-a63e-38ea--
PROCESSOR

0


955cdf67-0ef5-32af--
ab629e9a-a9e2-3dcc--
1 GB
1

ab629e9a-a9e2-3dcc--
f9778f4b-ba15-3efb--
PROCESSOR

0 sec
1

success

ab629e9a-a9e2-3dcc--
ec33b40f-e496-3032--
PROCESSOR

0


fe76ca18-692e-3adb--
ab629e9a-a9e2-3dcc--
1 GB
1

502.5
429.0


ab629e9a-a9e2-3dcc--
53ce9b6e-7c8f-358c--
PROCESSOR

0 sec
1

success

ab629e9a-a9e2-3dcc--
f9778f4b-ba15-3efb--
PROCESSOR

0


20112edd-ab5f-3ab0--
ab629e9a-a9e2-3dcc--
1 GB
1

ab629e9a-a9e2-3dcc--
  

RE: GetMongoDB : How to pass parameters as input to GetMongoDB processor

[Brajendra Mishra]

Hi Sivaprasanna, 

Could you please provide me the sample template for the same, where I can pass 
parameters (and get those parameters' value to process further) to GetMongoDB 
processor?
It would be a great help for us.

Brajendra Mishra
Persistent Systems Ltd.

-Original Message-
From: Sivaprasanna  
Sent: Wednesday, May 02, 2018 2:28 PM
To: dev@nifi.apache.org
Subject: Re: GetMongoDB : How to pass parameters as input to GetMongoDB 
processor

Hi.

GetMongo can take input. So technically you can use a processor before and then 
connect it  to GetMongo.

A simple example :
GenerateFlowfile -> UpdateAttribute -> GetMongo

In the UpdateAttribute, you can add attributes for the database and collection 
and then use them in GetMong using NiFi Expression Language.

Let me know, if that doesn’t help.

-
Sivaprasanna

On Wed, 2 May 2018 at 1:26 PM, Brajendra Mishra < 
brajendra_mis...@persistent.com> wrote:

> Hi Team,
> We have found there is only 'GetMongoDB' processor to connect and 
> query to MongoDB in Apache NiFi.
> Hence, we this processor does not take any type or input.
>
> Do we have another type to Apache NiFi processor which can take 
> parameters as input (details of MongoDB, query, instance etc.) from other 
> processor?
> If not then please suggest when such type of processor can be expected 
> in upcoming release?
>
> Brajendra Mishra
> Persistent Systems Ltd.
>
> DISCLAIMER
> ==
> This e-mail may contain privileged and confidential information which 
> is the property of Persistent Systems Ltd. It is intended only for the 
> use of the individual or entity to which it is addressed. If you are 
> not the intended recipient, you are not authorized to read, retain, 
> copy, print, distribute or use this message. If you have received this 
> communication in error, please notify the sender and delete all copies of 
> this message.
> Persistent Systems Ltd. does not accept any liability for virus 
> infected mails.
>
DISCLAIMER
==
This e-mail may contain privileged and confidential information which is the 
property of Persistent Systems Ltd. It is intended only for the use of the 
individual or entity to which it is addressed. If you are not the intended 
recipient, you are not authorized to read, retain, copy, print, distribute or 
use this message. If you have received this communication in error, please 
notify the sender and delete all copies of this message. Persistent Systems 
Ltd. does not accept any liability for virus infected mails.

Re: GetMongoDB : How to pass parameters as input to GetMongoDB processor

[Sivaprasanna]

Hi.

GetMongo can take input. So technically you can use a processor before and
then connect it  to GetMongo.

A simple example :
GenerateFlowfile -> UpdateAttribute -> GetMongo

In the UpdateAttribute, you can add attributes for the database and
collection and then use them in GetMong using NiFi Expression Language.

Let me know, if that doesn’t help.

-
Sivaprasanna

On Wed, 2 May 2018 at 1:26 PM, Brajendra Mishra <
brajendra_mis...@persistent.com> wrote:

> Hi Team,
> We have found there is only 'GetMongoDB' processor to connect and query to
> MongoDB in Apache NiFi.
> Hence, we this processor does not take any type or input.
>
> Do we have another type to Apache NiFi processor which can take parameters
> as input (details of MongoDB, query, instance etc.) from other processor?
> If not then please suggest when such type of processor can be expected in
> upcoming release?
>
> Brajendra Mishra
> Persistent Systems Ltd.
>
> DISCLAIMER
> ==
> This e-mail may contain privileged and confidential information which is
> the property of Persistent Systems Ltd. It is intended only for the use of
> the individual or entity to which it is addressed. If you are not the
> intended recipient, you are not authorized to read, retain, copy, print,
> distribute or use this message. If you have received this communication in
> error, please notify the sender and delete all copies of this message.
> Persistent Systems Ltd. does not accept any liability for virus infected
> mails.
>

GetSplunk : How to pass parameters as input to GetSplunk processor

[Brajendra Mishra]

Hi Team,
We have found there is only 'GetSplunk' processor to connect and query to 
Splunk in Apache NiFi.
Hence, we this processor does not take any type or input.

Do we have another type to Apache NiFi processor which can take parameters as 
input (details of Splunk indexes, query, instance etc.) from other processor?
If not then please suggest when such type of processor can be expected in 
upcoming release?

Brajendra Mishra
Persistent Systems Ltd.



Brajendra Mishra
Persistent Systems Ltd.

DISCLAIMER
==
This e-mail may contain privileged and confidential information which is the 
property of Persistent Systems Ltd. It is intended only for the use of the 
individual or entity to which it is addressed. If you are not the intended 
recipient, you are not authorized to read, retain, copy, print, distribute or 
use this message. If you have received this communication in error, please 
notify the sender and delete all copies of this message. Persistent Systems 
Ltd. does not accept any liability for virus infected mails.

GetMongoDB : How to pass parameters as input to GetMongoDB processor

[Brajendra Mishra]

Hi Team,
We have found there is only 'GetMongoDB' processor to connect and query to 
MongoDB in Apache NiFi.
Hence, we this processor does not take any type or input.

Do we have another type to Apache NiFi processor which can take parameters as 
input (details of MongoDB, query, instance etc.) from other processor?
If not then please suggest when such type of processor can be expected in 
upcoming release?

Brajendra Mishra
Persistent Systems Ltd.

DISCLAIMER
==
This e-mail may contain privileged and confidential information which is the 
property of Persistent Systems Ltd. It is intended only for the use of the 
individual or entity to which it is addressed. If you are not the intended 
recipient, you are not authorized to read, retain, copy, print, distribute or 
use this message. If you have received this communication in error, please 
notify the sender and delete all copies of this message. Persistent Systems 
Ltd. does not accept any liability for virus infected mails.