Re: Data anonymization in Nifi

2017-10-22 Thread Chris Herssens
Hello Vyshali below you can find python code example for hashing the fourth column of a CSV file using the ExecuteScript processor If you hash a field using SHA256 then the length of the field is changed. A sha256 is 256 bits long import hashlib import java.io from org.apache.commons.io import

Re: Data anonymization in Nifi

2017-10-17 Thread Chris Herssens
You can use the ExecuteScript processor for hashing some fields is for instance CSV data Regards, Chris On Tue, Oct 17, 2017 at 8:41 AM, Vyshali wrote: > Hi, > > Please suggest possible ways to do data anonymization in Nifi such that PII > data is not exposed. >

Re: using avro flume source in nifi

2017-08-11 Thread Chris Herssens
ith Flume so that might make getting help here a bit tougher. Are > you wanting NiFi to act as a TCP socket listener on a given port > receiving Avro objects? > > Thanks > > On Thu, Aug 3, 2017 at 11:22 PM, Chris Herssens > <chris.herss...@gmail.com> wrote: > > Hello Al

using avro flume source in nifi

2017-08-04 Thread Chris Herssens
Hello All, I want to configure a flume source processor using avro as flume source. When I start the ExecuteFlumeSource, I don't get any errors, but I can't connect to the source port. telnet localhost 5151 gives connection refused. The configuration is as follows type = avro agent name = a1

Re: nifi processor for IPFIX

2017-07-26 Thread Chris Herssens
retty slick and quite fast. I *think* Bryan Bende was > working on a ListenTCPRecord so maybe this could be tied into that. > > Thanks > > On Tue, Jul 25, 2017 at 9:06 AM, Chris Herssens > <chris.herss...@gmail.com> wrote: > > Hello All, > > > > Are there

nifi processor for IPFIX

2017-07-25 Thread Chris Herssens
Hello All, Are there plans to implement an IPFIX collector. The processor should listen on an UDP port, parse the content and convert it to AVRO or JSON Regards, Chris