Re: Nifi 1.16.1 migration failed for encrypted of sensitive values

t; attribute value to "aes/gcm" may work around the problem, >> but it sounds like this may need to be addressed in a Jira issue. >> >> Regards, >> David Handermann >> >> On Wed, May 4, 2022 at 11:22 AM sanjeet rath >> wrote: >> >>

Re: Nifi 1.16.1 migration failed for encrypted of sensitive values

/256. > > > > Another thing to check is whether you’re using Java 8-251 or newer as the > migration guidance states. > > > > Regards, > > > > Isha > > > > > > *Van:* sanjeet rath > *Verzonden:* woensdag 4 mei 2022 17:09 > *Aan:* user

Re: Nifi 1.16.1 migration failed for encrypted of sensitive values

Le mer. 4 mai 2022 à 16:46, sanjeet rath a > écrit : > >> Hi , >> >> I am facing one issue in migration from 1.12 to 1.16.1 . >> I have created one 1.16.1 cluster.And copied flow.xml , authoriser and >> authorisation user file my previous 1.12 version of clust

Nifi 1.16.1 migration failed for encrypted of sensitive values

Hi , I am facing one issue in migration from 1.12 to 1.16.1 . I have created one 1.16.1 cluster.And copied flow.xml , authoriser and authorisation user file my previous 1.12 version of cluster to this new cluster. When I am starting the cluster with all the keystone password in authoriser and

Re: SQLServer Active Directory Error

Hi Scott, I have also faced same issue in nifi 1.12.1 version, then i have checked with unenceipted nifi version(http) its working fine. Only issue is in encripted (https) .the issue is there. I tried few things , but nothing worked till now. I dont know ita a bug or not. Thanks, Sanjeet On

How to restrict custom processor execution time

Hi , I am building a custom processor and there is restriction i want to put for the processor that it should not schedule to run 2 times in 1 hour time period. I can acheive this by passing "run schedule" 60 mins. Is there any other way i can do in my custom processor code, So that it won't

Re: Sensitive context parameter from ExecuteScript

Hi Etienne, I have also have similar usecase of using sensitive parameter context in a non sesitive property like in ExecuteSql's " sql select query " property field. Did u find any way of doing that? Any other suggestion from anyone is really appriciated. Thanks, Sanjeet On Mon, 19 Jul 2021,

Re: Regarding jira issue: NIFI-7856

Hi, Any help input on my trailed mail is really appriciated . I am almost stuck here from past 2 weeks. Tried almost all the option i have. Thank u everyone in advance. Regards, Sanjeet On Tue, 15 Jun 2021, 7:56 pm sanjeet rath, wrote: > Hi, > > The symptoms mentioned in the j

Regarding jira issue: NIFI-7856

Hi, The symptoms mentioned in the jira issue( *https://issues.apache.org/jira/browse/NIFI-7856 *), i am observing this in one of our PROD clusters. ERROR [Compress Provenance Logs-1-thread-2] o.a.n.p.s.EventFileCompressor Failed to compress

DataDog reporting task is not working AWS EKS

Hi , My 3 node nifi cluster is running on AWS EKS.& for monitoring i have added Datadog reporting task. Our structure is data-agent is running as demonSet pod inside the host. and from nifi pod the datadog reporting task is sending the metrics to the dd_agent_host over UDP in 8125 port. i saw

Re: Concern regarding Nifi Processor's state is captured durning upgrade of nif cluster cluster

e is then stored in the ./state/local directory. > > So when you upgrade from 1.8 to 1.12.1 you should also copy over the state > directory to avoid losing any local state. But as long as the 1.12.1 > cluster is pointing at the same zookeeper, there is no need to migrate the > zookeeper stat

Concern regarding Nifi Processor's state is captured durning upgrade of nif cluster cluster

Hi, My use case is to upgrade the nifi cluster from 1.8 to 1.12.1 with state (we are using external zookeeper and its 3 node cluster ). So the approach I followed , -> created 3 node linux box and installed nifi 1.12.1 & zookeeper 3.5.8 -> brought the flow.xml.gz, users.xml and

Re: Nifi 1.12.1 cluster is getting hung after few days(15 days)

Hi All, Could someone please give me thoughts on the trailed mail issue, so i can do my further analysis. Regards, Sanjeet On Wed, 6 Jan 2021, 7:40 pm sanjeet rath, wrote: > Hi All, > > Happy New Year :) > > I have upgraded our cluster from 1.8 to 1.12.1, few days ago

Nifi 1.12.1 cluster is getting hung after few days(15 days)

Hi All, Happy New Year :) I have upgraded our cluster from 1.8 to 1.12.1, few days ago and everything is working fine. I observed that Nifi was like hanged after running for few days (I have observed its nearly after 15 days of nifi service start) issue is after login the browser keep on loading

Re: Regarding setting up multiple DistribitedMapCacheServer controler service

t; different Controller Services (generally not a problem) and ensure that you > have firewalls opened, etc. to access it. > > Thanks > -Mark > > On Dec 16, 2020, at 10:37 AM, sanjeet rath wrote: > > Hi All, > > Hope you are well. > I need one clarification regarding

Regarding setting up multiple DistribitedMapCacheServer controler service

Hi All, Hope you are well. I need one clarification regarding DistribitedMapCacheServer controler service. Our build structure is on same cluster 2 teams are working in 2 different PG. Now both team are using DetectDuplicate processor for which they need DustributedMapCacheClient. My question is

Nifi 1.12 processor is not auto upgrading default processor if it has a different version of custom processor

Hi All, I am facing one issue during the nifi cluster upgrade to 1.12 version from 1.8 version. I have a *custom processor for AWSCredentialsProviderControllerService controller service. this has been build on top of 1.8* version . the structure for custom processor in flow.xml.gz file is:

Re: Modifying putElasticSearchHTTP processor to use AWS IAM role based awscredentialprovide service for access

the best fit because they already use > controller services that use the official Elastic clients. > > Thanks, > > Mike > > On Wed, Sep 9, 2020 at 12:14 PM sanjeet rath > wrote: > > > > Hi , > > > > We are using AWS managed Elast

Modifying putElasticSearchHTTP processor to use AWS IAM role based awscredentialprovide service for access

Hi , We are using *AWS managed ElasticSearch* and our *nifi is hosted in EC2*. I have a use case of building a custom processor on top of putElasticSearchHTTP, where it will use aws IAM based role awscredentialprovider service to connect AWS ElasticSearch. This will be similar to PUTSQS where we

Jks password migration issue

Hi All, I am facing one ussue during my migration from 1.8 to 1.11.4 My 1.8 env has jks key password is "xyz" The newly created 1.11.4 has jks password "abc". The encripyion key used in the bootstrap file is same for both the env. I have modified the pasaword of the 1.11.4 env's jks file

NIFI migration behaviour in template( inside flow.xml.gz file)

Hi All, I have migrated the flows from 1.8 to 1.11.4 version I have realised all the processors are auto upgraded to 1.11.4 Howeever below two types are not auto upgraded. 1-> all the processors & controler of the *template* are not auto upgraded to 1.11.4 in flow.xml.gz file. 2->processor

Re: Nifi 1.11.4 three node cluster is taking longer time to up after migration from 1.8

hings in 1.11.4 that take a bit more > memory but nothing that I know of that would result in very significant > differences in memory footprint. > > Thanks > -Mark > > On Aug 14, 2020, at 9:18 AM, sanjeet rath wrote: > > Hi Mark/Team > > Any thoughts on this? Whe

Re: Nifi 1.11.4 three node cluster is taking longer time to up after migration from 1.8

Hi Mark/Team Any thoughts on this? Where should i analyse further. Regards, Sanjeet On Thu, 13 Aug 2020, 10:32 pm sanjeet rath, wrote: > Hi Mark, > Thanks for the response. > > My flow.xml.gz file size is 14 Mb. > > Regards, > Sanjeet > > On Thu, 13 Aug 2020,

Re: Nifi 1.11.4 three node cluster is taking longer time to up after migration from 1.8

wrote: > > Sanjeet, > > I believe this should be addressed in 1.12.0, which should be released > very soon. > > Thanks > -Mark > > On Aug 13, 2020, at 4:13 AM, sanjeet rath wrote: > > Hi Team, > > I have migrated my flows.xml.gz, users.xml, authorization

Nifi 1.11.4 three node cluster is taking longer time to up after migration from 1.8

Hi Team, I have migrated my flows.xml.gz, users.xml, authorization.xml from 1.8 env to 1.11.4 environment .(12k processor are therr in flow) There are no error in the log file, the issue is taking 10 mintues to server up and with all node connected. The warning logs , which i am suspecting is

Re: Nifi 1.8 to 1.11.4 migration issue

ix hasn’t yet been released. I would expect the > next release to come pretty soon, though. > > Thanks > -Mark > > On Jul 30, 2020, at 3:15 PM, sanjeet rath wrote: > > Hi Mark, > Thanks for responding. > Sorry, i can't share the log, Due to our company policy. > its k

Re: Nifi 1.8 to 1.11.4 migration issue

es or so) and providing that to understand why it’s > taking 30 minutes to startup. Specifically, the “main” thread will be of > interest. > > Thanks > -Mark > > > On Jul 30, 2020, at 2:04 PM, sanjeet rath wrote: > > Hi , > yes i am using external zookeeper 3.5 ver

Re: Nifi 1.8 to 1.11.4 migration issue

gt; 2. Add the client port to the end of the server string eg: >> server.1=localhost:2888:3888;2181 >> >> > You may also need to ensure your server certificates contain a DNS entry > in the Subject Alternative Name (SAN) for their respective hosts. > > On Thu, Ju

Re: Nifi 1.8 to 1.11.4 migration issue

uster are connected. Just bought flow.xml.gz ,user.xml & authorization.xml from other 1.8 server. Thanks & Regards Sanjeet On Thu, 30 Jul 2020, 7:37 pm sanjeet rath, wrote: > nifi-app.log file , i am getting constant error. > > Apache.nifi.controler.FlowControler Failed

Re: Nifi 1.8 to 1.11.4 migration issue

e > > On Jul 30, 2020, at 9:21 AM, sanjeet rath wrote: > >  > Hi Team, > > Any help on my trailed mail query will be highly appreciated.still i am > strgling yo fix yhe issue. > > In nifi-app.log file , i am getting constant error. > > Apache.nifi.co

Re: Nifi 1.8 to 1.11.4 migration issue

ards, Sanjeet On Tue, 28 Jul 2020, 10:21 pm sanjeet rath, wrote: > Hi Team, > > I am facing a wired issue while doing migration from 1.8 to 1.11.4 > I am bringing flow.xml.gz,user.xml,authorization.xml from a nifi > cluster(1.8 version) to a newly created 1.11.4 version cluster. >

Nifi 1.8 to 1.11.4 migration issue

Hi Team, I am facing a wired issue while doing migration from 1.8 to 1.11.4 I am bringing flow.xml.gz,user.xml,authorization.xml from a nifi cluster(1.8 version) to a newly created 1.11.4 version cluster. When i am starting the 1.11.4 cluster with this new files, i am getting node disconnected

Re: 3 node of nifi generating 3 different flow files

vely with the synced root > process group ID. > > Andy LoPresto > alopre...@apache.org > *alopresto.apa...@gmail.com * > He/Him > PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 > > On Jun 18, 2020, at 4:44 PM, sanjeet rath wrote: > > Thanks,

Re: 3 node of nifi generating 3 different flow files

nd NiFi will automatically encrypt and > decrypt the sensitive processor properties with it. > > > Andy LoPresto > alopre...@apache.org > *alopresto.apa...@gmail.com * > He/Him > PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 > > On Jun 18, 2020, at 3:55 AM

3 node of nifi generating 3 different flow files

Hi , I got a issue while starting a 3 node nifi cluster. nifi-app.log is showing exception that" local flow file is differet than cluster flow" The issue is i got 3 different flow files in each node.'rootGroupid' of each flow file is different. Previous i was facing no issue in creating 3 node

AWS custom processor build failing on upgrading nifi version to 1.11 from 1.8

Hi, I have created a custom aws controler service by creating a new java project. Where i have created a new java file is same as awsCredentialProviderControlerService with some of my changes. Public class awsCredentialProviderControlerService extends abstractcontrolerservice implements

Re: Storing output of shellscript in s3 bucket

command writes the JSON to stdout, then it should end up in the flow file. > > Thanks, > > Bryan > > > On Fri, Apr 10, 2020 at 11:23 AM sanjeet rath > wrote: > >> Hi, >> >> I have a scenario , where i have to Execute a shell script amd the output >> of

Storing output of shellscript in s3 bucket

Hi, I have a scenario , where i have to Execute a shell script amd the output of the script is a json file and i want to put the file in s3 bucket. I am able to do it by building 2 flows. One flow for executestremproces and store the json file in folder in System Then another flow to get the

Re: Nifi zookeeper state migration to different cluster

Hi, If someone could help me with my trailed query, then it would be really helpful. I eagerly await for your response. Regards, Sanjeet On Thu, Mar 26, 2020 at 3:20 PM sanjeet rath wrote: > > Hi Team, > > I am trying to achieve Nifi migration to a different cluster using >

Nifi zookeeper state migration to different cluster

Hi Team, I am trying to achieve Nifi migration to a different cluster using zookeeper state migration (in case of failure of cluster) Steps i am doing. zk-migrator.sh -r -z sourceHostname:sourceClientPort/sourceRootPath/components -f /path/to/export/zk-source-data.json zk-migrator.sh -s -z

Re: Exception is showing in nifi UI users page

idetifier value. Thanks a lot, Sanjeet On Fri, 6 Mar 2020, 8:07 pm sanjeet rath, wrote: > Yes Mat, > > But i cant upgrading nifi till next 2 months. > As i am not able to add user so its a blocker. > > Thats why asking u how the AD group name from the authoriser file is

Re: Exception is showing in nifi UI users page

g removed from a directory server. Even if you could identify > and remove the problematic entries, you could possibly hit this again if > another user or group were removed later. > > Thanks > > On Fri, Mar 6, 2020 at 6:35 AM sanjeet rath > wrote: > >> Hi

Re: Exception is showing in nifi UI users page

together. So that i can delete it in authoriser.xml file. Thanks, Sanjeet On Fri, Mar 6, 2020 at 12:04 AM sanjeet rath wrote: > Thanks Mat, > > For this quick response. > > Thanks a lot , > > Sanjeet > > On Thu, 5 Mar 2020, 11:43 pm Matt Gilman, wrote: > >> I

Re: Exception is showing in nifi UI users page

gt; > I believe you'll need to upgrade to a version that addresses the BUG. > > Thanks! > > On Thu, Mar 5, 2020 at 1:10 PM sanjeet rath > wrote: > >> Hi Team, >> >> I am using nifi cluster from 1 month & i am able to add new user policies >> everything.

Exception is showing in nifi UI users page

Hi Team, I am using nifi cluster from 1 month & i am able to add new user policies everything.its a LDAP based user addition. but suddenly from last 2 days , in nifi user addition page(after clicking on users in nifi UI) i am getting Error message "An unexcepted error has occure.please click logs

Regarding NiFi 1.10 parameter context

Hi , Previously i have used nipyapi.canvas.update_variable_registry() to update my processor group variables. I have updated it to nifi 1.10.So I want to use new feature parameter context which is present in 1.10 nifi version. I am able to update this parameters both sensitive and non sensitive

Need help regarding processor group

Hi , Is there any api to get all proces group details (considering multiple process groups are there in hierarchical order) by using invokeHTTP processor. like i have to send email notification to different process group regarding when there processor reaches back presure threshold value. Thanks

Re: Clarification regarding NiFi registry

blem? > > Starting with step 1 - download version xyz of Nifi > > On Tue, Dec 10, 2019 at 9:30 AM sanjeet rath > wrote: > > > > Thanks Andy for this quick response. > > Actually i am going in details because while restarting nifi i am > getting incorrect in

Re: Clarification regarding NiFi registry

.com * > PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 > > On Dec 10, 2019, at 1:51 PM, sanjeet rath wrote: > > Hi , > > I just have confusion but no where i am finding a proper documentation > regarding how nifi nodes intigrates with nifi registry

Clarification regarding NiFi registry

Hi , I just have confusion but no where i am finding a proper documentation regarding how nifi nodes intigrates with nifi registry. means internally how it works.as per the code , the node calls API to get the registry details and storing the entiry in RegistryDTO object. So my question is , Is

Re: Clarification regarding swap of flow file to storage

ects, it writes out the information about what was in the queue to > a swap file, but again its not the content of those flow files which > is why it is under flow file repo. > > Thanks, > > Bryan > > On Fri, Dec 6, 2019 at 5:10 AM sanjeet rath > wrote: > > >

Re: Clarification regarding swap of flow file to storage

Hi Team, Any help on my trailed mail query will be very helpful.One more thing if i add a new directory for swap storage will it improve any performance in processing. Thanks & Regards, Sanjeet On Thu, 5 Dec, 2019, 12:06 PM sanjeet rath, wrote: > Hi Team, > > As per the nifi d

Clarification regarding swap of flow file to storage

Hi Team, As per the nifi document, once the number of flow file in a connection queue will reach the threshold value, then it removed from hash map(Java heap space) and moved to disc. could u please confirm the deault which repository it moves to , it's content repository or to flowfile

Re: CI/CD for custom processor in aws nifi cluster

make List3 run on all nodes since each node needs to > get its own copy of the NAR. > > On Mon, Nov 18, 2019 at 11:42 AM sanjeet rath > wrote: > > > > > > Hi Team, > > > > I have a requirement of building CI/CD pipeline using jenkin & concourse >

CI/CD for custom processor in aws nifi cluster

Hi Team, I have a requirement of building CI/CD pipeline using jenkin & concourse to build and deploy custom nars in AWS nifi cluster. The CI part is completed successfully , but in the CD while doing the deployment using concourse pipeline, we have a problem , we can not ssh to port 22 of the

Re: Default Retry mechanism for NIFI puts3Object processor

m/apache/nifi/pull/3612 > > On Mon, Nov 11, 2019 at 6:15 PM sanjeet rath > wrote: > >> Hi Team, >> >> I am using puts3Object processor of the nifi , to uploading object from >> onprem to AWS s3 bucket. i believe we have 2 types of uploading , single >>

Default Retry mechanism for NIFI puts3Object processor

Hi Team, I am using puts3Object processor of the nifi , to uploading object from onprem to AWS s3 bucket. i believe we have 2 types of uploading , single part upload and multipart upload as per the threshold value defined for multipart. for multipart , 3 steps are followed

Re: Regarding AWScredentialproviderService

Hi , please ignore my previous mail.as i got the answer. On Wed, 30 Oct, 2019, 8:16 AM sanjeet rath, wrote: > Hi, > I have built custom controller service(AWS-CREDENTIAL-CONTROLER-SERVICE) > and use this one in processor service(NIFI-AWS-SERVICE).for puts3Object. > In this contro

Regarding AWScredentialproviderService

Hi, I have built custom controller service(AWS-CREDENTIAL-CONTROLER-SERVICE) and use this one in processor service(NIFI-AWS-SERVICE).for puts3Object. In this controller service i have used custom parameters to connect to aws and getting token , also using this token i am able to to use connect

Regarding limit of Puts3Object processor

Hi Team, I have question, why does puts3Object limit itself 14 msgs/Sec. can identify bottlenecks using some logs. Any code explanation will be very helpful. Thanks -- Sanjeet , mob- +91 8777577470

Re: Unit test is getting failed for custom ,Awscredentialprovidercontrolerservice

lsProviderControllerServiceTest.java > > > > It may be helpful for you to look at other things in the code base. Here > are the tests for the current service > > > > > > > > > > On October 21, 2019 at 22:31:38, sanjeet rath (rath.sanj...@gmail.com) &g

Unit test is getting failed for custom ,Awscredentialprovidercontrolerservice

Hi Team, Our project structure we have a custom controller service ,Awscredentialprovidercontrolerservice controller service to connect AWS with our defined 5 attributes means properties.(This is present in a separate project NIFI-AWS-CUSTOM_PING_CONTROLER). In NiFi UI this controller service

Re: Clarification Regarding custom controller service & AWS-CREDENTIAL-CONTROLER-SERVICE

would do two nars. The controller service nar and the processor nar > which depends on it. This way you can have other processor nars that also > depend on that controller service nar if necessary. > > Thanks > > On Sun, Oct 20, 2019 at 10:26 PM sanjeet rath > wrote: > &

Re: Clarification Regarding custom controller service & AWS-CREDENTIAL-CONTROLER-SERVICE

Hi Team, Please clarify my trailed mail query. On Sun, 20 Oct, 2019, 9:35 PM sanjeet rath, wrote: > Hi Team, > > I have a requirement of building a custom > controller service(AWS-CREDENTIAL-CONTROLER-SERVICE) and custom processor > service(NIFI-AWS-SERVICE).for puts3Object.

Clarification Regarding custom controller service & AWS-CREDENTIAL-CONTROLER-SERVICE

Hi Team, I have a requirement of building a custom controller service(AWS-CREDENTIAL-CONTROLER-SERVICE) and custom processor service(NIFI-AWS-SERVICE).for puts3Object. Already code changes are done for both of it. and i am building 2 separate nars . The custom controller

Re: Doubt regarding building email nar file

Thanks Mike :) On Sun, Oct 20, 2019 at 9:34 PM Mike Thomsen wrote: > The pom associated with the bundle. > > On Sun, Oct 20, 2019 at 11:41 AM sanjeet rath > wrote: > >> >> Hi Team, >> >> My requirement is build to custom email processor for >>

Doubt regarding building email nar file

Hi Team, My requirement is build to custom email processor for extractingBody(already code changes are done). I have implemented CI in this project using jenkin. SO my project structure is: NIFI-EMAIL-BOUNDLE ->NIFI-EMAIL-PROCESSOR ->NIFI-EMAIL-NAR So every above project has a pom file, my

Unable to do unit testing Awscredentialprovidercontrolerservice

Hi Team, I am new to this community, today i have joined and this is my first query.(already from last 15 days i got stuck here) I have build a nifi custom processor.to put a object in AWS s3 bucket.(Just Modified Puts3Object processor in NIFI- AWS-PROCESSOR project) In this processor