Flow file movement

[Karthick Subramanian]

Hi All,

List File -> Fetch File -> Attrribute to CSV -> Merge Record -> Funnel

I am adding each processor one by one and make sure each processor is
working. While doing so, every time, I need to clear the state in the first
processor (List File) to start testing the next processor that I have
added. Is there a way, I can start from the processor until I have tested
successfully.

For example: If I successfully tested until Fetch File, how do I initiate
the flow from that point onwards to downstream.

Regards,
K

Re: Nifi installation - port 8080 being used even nifi installed with a different port

[Samarendra Sahoo]

Thanks a lot, it worked..

On Mon, 9 Mar, 2020, 5:36 PM Shawn Weeks,  wrote:

> You’ll need to add this line to your bootstrap.conf file to disable the
> Zookeeper Admin Server. We’ve done this for you in NiFi 1.11.x
>
>
>
> java.arg.17=-Dzookeeper.admin.enableServer=false
>
>
>
> *From: *Samarendra Sahoo 
> *Reply-To: *"users@nifi.apache.org" 
> *Date: *Friday, March 6, 2020 at 11:17 PM
> *To: *"users@nifi.apache.org" , "
> d...@nifi.apache.org" 
> *Subject: *Nifi installation - port 8080 being used even nifi installed
> with a different port
>
>
>
> We have installed Nfi 1.10.0 on RHEL7.2 to run on port 9778. However, we
> are seeing that its using port 8080 as well as per the below log message.
> Could you pls suggest how to make all of the nifi services run on port
> 9778?
>
>
>
> o.a.z.server.admin.JettyAdminServer Started AdminServer on address
> 0.0.0.0, port 8080
>
>
>
> Thanks
>
> Sam
>
>
>

Re: Apache NiFi 1.9.2 InferAvroSchema on csv file header with :

[Etienne Jouvin]

Ok thanks.

Finally in my case, this is not an issue.
Because the CSV reader does the job.



Garanti
sans virus. www.avast.com

<#DAB4FAD8-2DD7-40BB-A1B8-4E2AA1F9FDF2>

Le mer. 11 mars 2020 à 10:48, Edward Armes  a
écrit :

> Hi Jouvin,
>
> I believe you are correct that the inferAvroSchema and the convert record
> processor do work differently. I believe this is because the
> inferAvroSchema uses Apache Kite and the convert record derives the schema
> from the record reader itself.
>
> As an aside I have also noticed that when you use a validateRecord with a
> different types of reader and writer record handlers (i.e. json in avro
> out). You get different results l, while I'm not surprised by this I think
> it's worth just flagging up, for future reference.
>
> Edward
>
> On Wed, 11 Mar 2020, 09:35 Etienne Jouvin, 
> wrote:
>
>> Hello all.
>>
>> Just in case someone "can test".
>>
>> I have NiFi 1.9.2 and need to convert CSV to JSON. I do not planned to
>> upgrade for now (because of deployment procedure)
>> In the CSV, I have a column with value like prop:Name
>>
>> i set true for the property Get CSV Header Definition From Data
>>
>> The processor failed because of the name.
>>
>> But if I use a convertRecord with a CSV Reader, that infer schema, and a
>> JSON writer, this is working fine.
>>
>> Not the same algorithm to get infer schema from InferAvroSchema and the
>> reader ?
>>
>> Regards
>>
>> Etienne Jouvin
>>
>>
>>
>> 
>>  Garanti
>> sans virus. www.avast.com
>> 
>> <#m_-8081117188909953864_m_1566800260412186955_DAB4FAD8-2DD7-40BB-A1B8-4E2AA1F9FDF2>
>>
>

Re: Apache NiFi 1.9.2 InferAvroSchema on csv file header with :

[Edward Armes]

Hi Jouvin,

I believe you are correct that the inferAvroSchema and the convert record
processor do work differently. I believe this is because the
inferAvroSchema uses Apache Kite and the convert record derives the schema
from the record reader itself.

As an aside I have also noticed that when you use a validateRecord with a
different types of reader and writer record handlers (i.e. json in avro
out). You get different results l, while I'm not surprised by this I think
it's worth just flagging up, for future reference.

Edward

On Wed, 11 Mar 2020, 09:35 Etienne Jouvin,  wrote:

> Hello all.
>
> Just in case someone "can test".
>
> I have NiFi 1.9.2 and need to convert CSV to JSON. I do not planned to
> upgrade for now (because of deployment procedure)
> In the CSV, I have a column with value like prop:Name
>
> i set true for the property Get CSV Header Definition From Data
>
> The processor failed because of the name.
>
> But if I use a convertRecord with a CSV Reader, that infer schema, and a
> JSON writer, this is working fine.
>
> Not the same algorithm to get infer schema from InferAvroSchema and the
> reader ?
>
> Regards
>
> Etienne Jouvin
>
>
>
> 
>  Garanti
> sans virus. www.avast.com
> 
> <#m_1566800260412186955_DAB4FAD8-2DD7-40BB-A1B8-4E2AA1F9FDF2>
>

Apache NiFi 1.9.2 InferAvroSchema on csv file header with :

[Etienne Jouvin]

Hello all.

Just in case someone "can test".

I have NiFi 1.9.2 and need to convert CSV to JSON. I do not planned to
upgrade for now (because of deployment procedure)
In the CSV, I have a column with value like prop:Name

i set true for the property Get CSV Header Definition From Data

The processor failed because of the name.

But if I use a convertRecord with a CSV Reader, that infer schema, and a
JSON writer, this is working fine.

Not the same algorithm to get infer schema from InferAvroSchema and the
reader ?

Regards

Etienne Jouvin



Garanti
sans virus. www.avast.com

<#DAB4FAD8-2DD7-40BB-A1B8-4E2AA1F9FDF2>