Unsubscribe

2019-07-05 Thread Naveen K. Das
unsubscribe

Re: Kafka to parquet to s3

2019-07-05 Thread Andrew Grande
Interestingly enough, the ORC processor in NiFi can just use defaults if hadoop configs aren't provided, no additional config steps required. Is it something which can be improved for PutParquet maybe? Andrew On Fri, Jul 5, 2019, 4:18 AM Shanker Sneh wrote: > Hello Dweep, > > In putparquet pr

Re: Kafka to parquet to s3

2019-07-05 Thread Shanker Sneh
Hello Dweep, In putparquet processor you can set the attribute '*Hadoop Configuration Resources*' to a *core-site.xml* file whose content can be somewhat like below: fs.defaultFS file:///reservoir-dl Here the file:///reservoir-dl could be your path where in-trans

Nifi and SSL offloading

2019-07-05 Thread Nicolas Delsaux
Hi I'm trying to deploy Nifi in Kubernetes with authentcation. In Kubernetes, it is possible (and recommended in my organization) to have SSL managed by cluster at edge route level. Which means request seen by Nifi are http ones. According to nifi documentation, it seems to imply no authenticat

Kafka to parquet to s3

2019-07-05 Thread Dweep Sharma
Hi, I have been trying to move some JSON data to S3 in Parquet format. >From Kafka to s3 is straight forward but I cannot seem to find the right processor to convert JSON to parquet and move it to s3. putparquet does not take s3 bucket or credentials and requires hadoop to be installed. Can som