Microsoft Access file

2017-01-24 Thread Selvam Raman
Hi, I have .dmp(MS access) file. How can i read this file in Nifi flow(like database) and store the result table in s3 location. -- Selvam Raman "லஞ்சம் தவிர்த்து நெஞ்சம் நிமிர்த்து"

Append data to flowfile

2017-01-16 Thread Selvam Raman
Hi, I am getting 1k flow file from http requet. Now i want to add some data at the end of flowfile, how can i do that. Please help me. Example: fileName: 0001.xml data content : .. Expected flow file content: .. data -- Selvam Raman "லஞ்சம் தவிர்த்து நெஞ்சம் நிமிர்த்து"

Re: importing data from postgresql to disk using NIFI

2016-10-05 Thread Selvam Raman
e performing as > expected for unknown types/values. > > Regards, > Matt > > > On Oct 4, 2016, at 6:30 PM, Selvam Raman <sel...@gmail.com> wrote: > > Hi, > > i am using listdatabasetable to list out the table then executing > executesql to fetch the data and

importing data from postgresql to disk using NIFI

2016-10-04 Thread Selvam Raman
(ScheduledThreadPoolExecutor.java:294) [na:1.8.0_91] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [na:1.8.0_91] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [na:1.8.0_91] at java.lang.Thread.run(Thread.java:745) [na:1.8.0_91] -- Selvam

Nifi for java Program

2016-10-04 Thread Selvam Raman
Hi, is there any processor in NIFI to run java program. -- Selvam Raman "லஞ்சம் தவிர்த்து நெஞ்சம் நிமிர்த்து"

Re: Routeonattribute

2016-10-08 Thread Selvam Raman
eds to do it > again to evaluate the resulting expression. > > Currently that is not how expression language works, it only performs the > first evaluation and in the case of RouteOnAttribute that needs to return a > boolean. > > -Bryan > > > On Fri, Oct 7, 2016 at 4:41 AM,

Routeonattribute

2016-10-06 Thread Selvam Raman
as a boolean clause in routeonattribute processor ? -- Selvam Raman "லஞ்சம் தவிர்த்து நெஞ்சம் நிமிர்த்து"

Re: Fetchs3Object

2016-10-06 Thread Selvam Raman
tion, I recommend using ListS3 to get flowfiles with > attributes referencing the S3 objects, then use FetchS3Object with the > following settings: > > Bucket: ${s3.bucket} > Object Key: ${filename} > Region: us-east-1 > > This might help sort out problems with permissions vs. pr

Routeonattribute

2016-10-07 Thread Selvam Raman
as a boolean clause in routeonattribute processor ? -- Selvam Raman "லஞ்சம் தவிர்த்து நெஞ்சம் நிமிர்த்து"

Re: Routeonattribute

2016-10-07 Thread Selvam Raman
the flow file would have an attribute like db.table.name and > then in RouteOnAttribute you would define a property like test = > ${db.table.name:equals('test')}. > > -Bryan > > On Thu, Oct 6, 2016 at 3:31 PM, Selvam Raman <sel...@gmail.com> wrote: > >> Hi, >

Re: PutS3 object returns jvm out of memory

2016-09-20 Thread Selvam Raman
This is the exact error. On Tue, Sep 20, 2016 at 4:30 PM, Selvam Raman <sel...@gmail.com> wrote: > HI, > > I am pushing data to s3 using puts3object. I have setup nifi 1.0 zero > master cluster. > > Ec2 instance having only 8GB of hard disk. Content repository writi

Re: Periodic delta pulls from a data source

2016-09-20 Thread Selvam Raman
If no columns are provided, all rows from the table will be > considered, which could have a performance impact. > > [1] https://nifi.apache.org/docs/nifi-docs/ > > Pierre > > > 2016-09-20 8:50 GMT+02:00 Selvam Raman <sel...@gmail.com>: > >> >> > Hi, >>

Fwd: Nifi Running mode

2016-09-20 Thread Selvam Raman
Hi, How to check nifi running mode (cluster, standalone). is there any command to check. Thanks, Selvam Raman "லஞ்சம் தவிர்த்து நெஞ்சம் நிமிர்த்து" -- Selvam Raman "லஞ்சம் தவிர்த்து நெஞ்சம் நிமிர்த்து"

Load balancing in remote process group

2016-09-23 Thread Selvam Raman
with respect to the other. I want to know how is load distributed using a Remote Process Group ? Can you please help me. -- Selvam Raman "லஞ்சம் தவிர்த்து நெஞ்சம் நிமிர்த்து"

Re: Load balancing in remote process group

2016-09-23 Thread Selvam Raman
factor of load that is considered when balancing the data, > meaning send less data to a node that already has a lot of processing > happening, maybe others could provide more insight on the details of that > > -Bryan > > On Fri, Sep 23, 2016 at 9:58 AM, Selvam Raman <sel...@gmail

Re: PutS3 object returns jvm out of memory or disk out of memory

2016-09-20 Thread Selvam Raman
a flow, NiFi holds onto this > until it finishes its path through the flow or is expunged via expiration > making it eligible for removal and/or archival from the backing content > repository. > > Thanks! > > On Tue, Sep 20, 2016 at 12:05 PM, Selvam Raman <sel...@gm

InvokeHTTP request fails for huge size

2016-09-27 Thread Selvam Raman
trying to get 200+MB of data. is there any way to get the data. Hopefully this error on the server side not nifi side.​ -- Selvam Raman "லஞ்சம் தவிர்த்து நெஞ்சம் நிமிர்த்து"

State management not captured in cluster mode

2016-09-28 Thread Selvam Raman
stored in local-p​rovider. local-state provider: /home/nifi/nifi-1.0.0/state/local/partition-* zk-provider:(empty directory) /opt/nifiroot any help on this. -- Selvam Raman "லஞ்சம் தவிர்த்து நெஞ்சம் நிமிர்த்து"

Re: State management not captured in cluster mode

2016-09-28 Thread Selvam Raman
e of state it stores, local or clustered. We should > consider adding this to the docs if it's not included already. > > -Bryan > > > On Wednesday, September 28, 2016, Selvam Raman <sel...@gmail.com> wrote: > >> Hi, >> >> This i

Json Validation for mandatory fields

2017-01-12 Thread Selvam Raman
Hi, I will get array of json files. There are some fields which are mandatory in json file, if not present i should not process file. How can i achieve it in nifi. -- Selvam Raman "லஞ்சம் தவிர்த்து நெஞ்சம் நிமிர்த்து"

Re: Json Validation for mandatory fields

2017-01-12 Thread Selvam Raman
quot; or you could > set the Routing Strategy to "Route to 'matched' if any matches" and then > the 'unmatched' relationship would indicate that the JSON is valid. > > Thanks > -Mark > > > On Jan 12, 2017, at 8:46 AM, Selvam Raman <sel...@gmail.com> wrote: > > Hi, >

How to log using logattribute processor

2017-01-10 Thread Selvam Raman
in NiFi that can help me log the errors/failure of other processors ? -- Selvam Raman "லஞ்சம் தவிர்த்து நெஞ்சம் நிமிர்த்து"

How to untar "tar.gz" file

2017-01-09 Thread Selvam Raman
Hi, I used Unpack content processor to extract files from tar.gz mime type. But it gives the tar.gz file as output. i am using nifi 1.0. Unpack processor does not have tar.gz in mime type. Can you please help me. -- Selvam Raman "லஞ்சம் தவிர்த்து நெஞ்சம் நிமிர்த்து"

Re: How to untar "tar.gz" file

2017-01-09 Thread Selvam Raman
corrected name xyzprocessor -> CompressContent processor (choose gzip) -> UnpackContent processor (choose tar)-> .. On Mon, Jan 9, 2017 at 2:28 PM, Selvam Raman <sel...@gmail.com> wrote: > Thank you Mark. I done the same. > > xyzprocessor -> decompress processor

Re: How to untar "tar.gz" file

2017-01-09 Thread Selvam Raman
ession format that wraps > the tar format. So you would want to use CompressContent set to Decompress > mode with gzip as the format. This would give you just a tar file that > UnpackContent can handle. > > Thanks > -Mark > > Sent from my iPhone > > On Jan 9, 2017, at 6:01 AM

Xml to Json or Xml to avro

2017-01-10 Thread Selvam Raman
ngle avro file from all flowfile content. -- Selvam Raman "லஞ்சம் தவிர்த்து நெஞ்சம் நிமிர்த்து"

Executestream command - stream closed

2016-12-20 Thread Selvam Raman
t 0 the data is written to txt file but always i am getting error as stream closed. Exact exception: write flow file stdin due to -> java.io.exception broken pipe java.lang.unixprocess ->java.io.exception stream closed can you please help to solve this. -- Selvam Raman "லஞ்சம் தவிர்த்து நெஞ்சம் நிமிர்த்து"