Re: why cant nifi perform user authentication over http

t; > questions while setting up HTTPS. > > > > If you truly do not need to worry about security for your use case and do > > not want to use HTTPS, then using HTTP without authorization is an option. > > > > Regards, > > Kevin > > > > [1] https://nif

Re: why cant nifi perform user authentication overhttp？

Hello Kevin， Your answers helps me a lot. Now i am trying to modify nifi`s sourcecode to enable http authentication, because the platform where i am using nifi is not that sensitive about security, and we use ldap as login-identity-providers whitch password is already encrypted by an uniq

how can i enable nifi to perform user authentication overhttp？

Hello Kevin， Your answers helps me a lot. Now i am trying to modify nifi`s sourcecode to enable http authentication, because the platform where i am using nifi is not that sensitive about security, and we use ldap as login-identity-providers whitch password is already encrypted by an uniq

Re: why cant nifi perform user authentication overhttp？

On 2017-07-21 19:07 (+0800), Kevin Doran wrote: > Hi, > > You are correct, NiFi requires an encrypted connection for user > authentication. This is because client identity is established in one of two > ways: > > - user name & password, which should not be sent over a non-encrypted > conne

Is it possible to import another template in say different window or tab?

Hello! I simple question - how can I import a say 5 different templates in different windows/tabs? These templates are logically different so don't want to see them in same window/screen. Thanks -- View this message in context: http://apache-nifi-developer-list.39713.n7.nabble.com/Is-it-po

Re: Nifi in a hung state

Thanks Mark, Joe, Joe and Joe :) for helping me out with your prompt replies! Just wanted to update that I got my problem resolved. There were 2 basic things, like mentioned in the chain before: 1. I was doing ListS3 -> FetchS3Object -> RouteOnAttribute which was fetching all the S3 files before f

Re: Nifi in a hung state

Hi Joe, I made those changes, also increase disk I hope this gets better. However I am still getting one error, which started appearing only now, not sure related to these changes with splitText, removing the putAttribute code from CustomProcessor and Adding RouteOnContent after ListS3. 2017-02-14

Re: Nifi in a hung state

Thanks for the help! Seems in this case, what is eating up space is the ListS3 and FetchS3, its somehow reading all objects in the bucket though I just wanted it to read only object added 'now'. -- View this message in context: http://apache-nifi-developer-list.39713.n7.nabble.com/Nifi-in-a-h

Re: Nifi in a hung state

Thanks for that information! Still trying to understand Nifi better. 1. SplitText (5000 'Line Split Count') -> SplitText (1 'Line Split Count') I added that, will see if that resolves the problem. 2. Usually breaks after running couple of hours, when content repository is full. I have disabled a

Re: Nifi in a hung state

Thanks Joe. I got out of the hung state now, I actually deleted those folders before but probably some data did not delete in first go. I am using Nifi 1.1. My flow is like: ListS3 -> FetchS3Object -> RouteOnAttribute -> SplitText -> JoltTransform -> CustomProcessor -> MergeContent (Bins=1, Entr

Nifi in a hung state

I am trying Nifi to evaluate and it got out of space very soon. I am reading approx 150 MB of data from S3 (using ListS3 and FetchS3) every 20 mins and posting it to http endpoint. Trying to fix this I already got into hung state. 1. I emptied the content repository but that got Nifi in hung stat

Merging content with n events with MergeContent / bin packing algorithm

Hi! I am reading a file of events, splitting the file into events, doing some transformations, merging the file back and posting events in groups of 100. It think this most common use case for data flow tools. I facing problems in last part of merging the events back. I am using MergeContent pro

In ListS3 processor, where does Nifi persists the state of objects?

Hi, I am currently evaluating Nifi, I came across ListS3 + FetchS3Object processors which am using for retrieving S3 objects as they are added, transforming and posting it to an external API. To be able to use it in production, I need some information on how this state is maintained and whether it

Nifi processor last execution time

I am working on a processor that loads data to HDFS for an RDBMS using ExecuteSQL processor. The data has a last update time that I would like to use to load records that have changed since the last load. How best can I go about saving the last execution time so I can use it as a filter in the que