Re: Cassandra JDBC Driver

2024-09-11 Thread Peter Turcsanyi
Hi Deepanshu, Where did you put the Cassandra driver jar? Just a guess but it seems it was placed in the lib folder of NiFi. There should not be any additional jars in NIFI_HOME/lib directory. Regards, Peter Turcsanyi On Wed, Sep 11, 2024 at 8:15 AM Deepanshu Lodhi wrote: > Hii Raf

Re: ConsumeAMQP not delivering message from RMQ to Success

2024-07-08 Thread Peter Turcsanyi
alized and receive the messages? Best regards, Peter Turcsanyi On Mon, Jul 8, 2024 at 12:34 PM James McMahon wrote: > Wanted to follow up in case it serves others in the future. > I stepped through these changes before I got this to work: > > 1. My associate extended the heartbeat o

Re: [EXTERNAL] Re: Re: writing to adls - NiFi on Azure

2024-06-11 Thread Peter Turcsanyi
Hi Tahir, If you add your VM's virtual network to the allowed networks, does it not help? The stack trace can be found in logs/nifi-app.log. Regards, Peter Turcsanyi On Tue, Jun 11, 2024 at 4:05 PM Tahir Khan wrote: > Hi Peter, > > > > It is “Enabled from selected vir

Re: [EXTERNAL] Re: writing to adls - NiFi on Azure

2024-06-05 Thread Peter Turcsanyi
abled from all networks" and still get the error, I have no more idea at the moment. Please send the stack trace from the log in this case. Regards, Peter Turcsanyi On Tue, Jun 4, 2024 at 8:45 PM Tahir Khan wrote: > Hi Peter, > > We tried that , still does not work. Same error. >

Re: writing to adls - NiFi on Azure

2024-05-31 Thread Peter Turcsanyi
-request-is-not-authorized-t https://powerusers.microsoft.com/t5/Using-Connectors/Azure-Blob-Storage-this-request-is-not-authorized-to-perform/m-p/2475973#M20786 Based on these, I suggest checking the settings on the Networking tab in your Storage Account. Best, Peter Turcsanyi On Fri, May 31, 202

Re: writing to adls - NiFi on Azure

2024-05-31 Thread Peter Turcsanyi
R, You can unsubscribe by sending an email to users-unsubscr...@nifi.apache.org . Best, Peter Turcsanyi On Fri, May 31, 2024 at 10:11 PM R wrote: > please remove me from this list > > On Fri, May 31, 2024 at 4:04 PM Peter Turcsanyi > wrote: > >> Hi Tahir, >>

Re: writing to adls - NiFi on Azure

2024-05-31 Thread Peter Turcsanyi
Hi Tahir, Did you configure system-assigned or user-assigned managed identity for your VM on the Azure portal? Did you grant the right role (e.g. Storage Blob Data Owner) to that managed identity? Best regards, Peter Turcsanyi On Fri, May 31, 2024 at 8:10 PM Tahir Khan wrote: > Hi, > &g

Re: Unsubscribe

2024-02-15 Thread Peter Turcsanyi
Please send an email to users-unsubscr...@nifi.apache.org ! More info: https://nifi.apache.org/community/contact/ On Thu, Feb 15, 2024 at 4:54 PM Martin, Stanley L < stanley.mar...@hexagonusfederal.com> wrote: > > > > > >

Re: ConsumeMQTT with custom path for Broker URI

2024-01-09 Thread Peter Turcsanyi
Hi Marek, It has just been fixed in NIFI-12576 [1] which will be available in the next releases (1.25.0 / 2.0.0). Regards, Peter Turcsanyi [1] - https://issues.apache.org/jira/browse/NIFI-12576 On Thu, Nov 23, 2023 at 10:47 PM wrote: > Hello, > has anyone solved how to change the pa

Re: Azure managed identity in NiFi

2023-08-17 Thread Peter Turcsanyi
Event Hub level. After the Azure config, NiFi restart may be needed if the processor was started earlier with different settings (it seems the azure client library can cache tokens issued with different credentials). Regards, Peter Turcsanyi On Thu, Aug 17, 2023 at 1:25 AM Sean Davis wrote: > I

Re: Azure managed identity in NiFi

2023-08-16 Thread Peter Turcsanyi
Hi Sean, PutAzureEventHub processor has "Use Azure Managed Identity" property. Have you tried it? Regards, Peter Turcsanyi On Wed, Aug 16, 2023 at 8:24 PM Sean Davis wrote: > Hello, > > I'm trying to configure a PutAzureEventHub processor using system-assigned >

Re: Unsubscribe

2023-05-15 Thread Peter Turcsanyi
Jorge, Please send a mail to users-unsubscr...@nifi.apache.org. Further info: https://nifi.apache.org/mailing_lists.html Regards, Peter Turcsanyi On Mon, May 15, 2023 at 7:50 PM Jorge Machado wrote: >

Re: Snowflake processors 1.19.0 release

2023-02-13 Thread Peter Turcsanyi
/nifi-snowflake-processors-nar-1.20.0.nar You'll need to download the nar files and copy them to the 'lib' or 'extension' folder of your NiFi installation (on all nodes if you have a cluster). In case of 'extension' no restart is needed. Regards, Peter Turcsan

Re: Unsubscribe

2022-12-15 Thread Peter Turcsanyi
Dave, Please send a mail to users-unsubscr...@nifi.apache.org. https://nifi.apache.org/mailing_lists.html Regards, Peter Turcsanyi On Thu, Dec 15, 2022 at 10:39 PM Maza, Dave (NIH/CC/BTRIS) [C] via users wrote: > > unsubscribe > > > >

Re: DistributedMapCacheServer

2022-11-02 Thread Peter Turcsanyi
Embedded Hazelcast can also be an option. In that case, there is no need to set up an external cache but the Hazelcast instances are running on the NiFi nodes (in the same JVM as NiFi). Please note: no security/authentication is supported in embedded mode. https://nifi.apache.org/docs/nifi-docs/co

Re: unsubscribe

2022-03-24 Thread Peter Turcsanyi
Atul, Please send an email to users-unsubscr...@nifi.apache.org Further info: https://nifi.apache.org/mailing_lists.html On Fri, Mar 25, 2022 at 7:44 AM Atul Jadhav wrote: >

Re: [AWS][1.15.3] - Unable to use vpc endpoint

2022-03-08 Thread Peter Turcsanyi
Hi Maxime, It seems to be a similar issue as NIFI-8662 [1] where the AWS client library cannot parse the Region from a VPC-style endpoint and we need to get it from the Region property. I will look into it in more detail and get back to you. Regards, Peter Turcsanyi [1] https

Re: ADLSCredentialsControllerService with user-assigned managed identity

2022-02-25 Thread Peter Turcsanyi
Hi Isha, Only system-assigned managed identity is supported currently. Feel free to file a jira ticket for supporting ClientID / user-assigned identity too. (https://issues.apache.org/jira, project: Apache NiFi / NIFI). Best regards, Peter Turcsanyi On Fri, Feb 25, 2022 at 12:18 PM Isha Lamboo

Re: nifi 1.15.3 - GenerateFlowFile and ReplaceText

2022-01-21 Thread Peter Turcsanyi
Hi Michal, Most probably, it happens because the content repo is filling up your disk. The default setting is quite conservative (nifi.properties): nifi.content.repository.archive.max.usage.percentage=50% Please try to set it higher, e.g. 80% Best, Peter Turcsanyi On Fri, Jan 21, 2022 at 4:35

Re: unsubscribe

2021-12-17 Thread Peter Turcsanyi
You will need to send an email to users-unsubscr...@nifi.apache.org Further info: https://nifi.apache.org/mailing_lists.html On Sat, Dec 18, 2021 at 6:53 AM Maxime.Lézier wrote: > unsubscribe > > >

Re: CSVRecordSetWriter - Date format

2021-03-02 Thread Peter Turcsanyi
; This issue is occuring for the DATE field on oracle. There are other > fields which are timestampe in oracle for the same table. > > Sample Data in Oracle: Date Field type --> 01-NOV-20 > > May I know the field name and format that I need to use in csvrecordwriter > now? > > &

Re: CSVRecordSetWriter - Date format

2021-03-01 Thread Peter Turcsanyi
Hi Asmath, I would try to specify the format in the Timestamp Format property. Oracle's DATE type can contain HH:mm:ss part and I believe it is converted to a Timestamp and the Timestamp Format is applied. Regards, Peter On Mon, Mar 1, 2021 at 6:42 PM KhajaAsmath Mohammed wrote: > Hi, > > I ha

Re: Special Characters - Table name - Putddatabase record

2021-01-20 Thread Peter Turcsanyi
Hi Asmath, Scenarios 2 and 3 should work. When using quotes, the table / columns names are typically case sensitive in the database (though I don't know SAP). Are you sure your table exists in the database with the exact same name (in terms of lower/upper case)? Regards, Peter

Re: Special Characters - Table name - Putddatabase record

2021-01-20 Thread Peter Turcsanyi
Asmath, Setting the "Quote Table Identifiers" to true should work (no explicit quotes needed in "Table Name"). Please attach the exception stack trace if you get an error with these settings. Regards, Peter On Wed, Jan 20, 2021 at 12:10 AM KhajaAsmath Mohammed < mdkhajaasm...@gmail.com> wrote:

Re: Need help setting up NiFi PutS3Object processor

2020-12-10 Thread Peter Turcsanyi
dynamic property will be the value of the user-defined metadata. You can use expression language for the value (eg. referencing FF attributes or now() for the timestamp). Hope it helps. Best, Peter Turcsanyi On Thu, Dec 10, 2020 at 11:27 PM Dennis N Brown wrote: > Running NiFi v1.12.1 , attempt

Re: How to disconnect rabbitmq in PublishAMQP

2020-12-10 Thread Peter Turcsanyi
Hi Franco, If I understand your use case correctly, you do not ingest data continuously and would like PublishAMQP to disconnect after an idle period (when there are no messages to send to RabbitMQ). PublishAMQP is rather optimized for continuous / frequent data load and for this reason it pools t

Re: NiFi 1.11.4 HDFS/HBASE Processor Errors After Kerberos Ticket Expires

2020-10-21 Thread Peter Turcsanyi
Are there any exception stack traces in the log when the processors fail / before that? On Thu, Oct 22, 2020 at 12:28 AM wrote: > Hello! > > > > We’re running into a problem with NiFi 1.11.4. > > > > Our HBASE/HDFS/Parquet processors are all configured with a master > KeytabCredentialsService th

Re: IBM MQ message selector

2020-08-04 Thread Peter Turcsanyi
Hi Marc, Great, thanks for the feedback. Best, Peter On Mon, Aug 3, 2020 at 3:16 PM Marc Recht wrote: > Hi Peter, > > I tested it now quite a bit and it works like a charm! Thanks for > implementing it so swiftly. > > Best, > > Marc > On 27/07/2020 13:40, Peter T

Re: IBM MQ message selector

2020-07-27 Thread Peter Turcsanyi
Hi Marc, ConsumeJMS message selector support has been implemented and will be released in the upcoming 1.12 version. Best, Peter On Fri, Jul 24, 2020 at 7:40 AM Marc Recht wrote: > Hi Peter, > > OK, thanks! Will do. > > Best, > > Marc > On 23/07/2020 20:30, Peter Turc

Re: IBM MQ message selector

2020-07-23 Thread Peter Turcsanyi
Hi Marc, Message selectors are not supported by ConsumeJMS currently. Feel free to file a jira ticket (https://issues.apache.org/jira) to request for this improvement. Regards, Peter On Wed, Jul 22, 2020 at 5:51 PM Marc Recht wrote: > > > Hi, > > I try to use a message selector with NiFi and I

Re: Session state in cluster HandleHttpRequest and HandleHttpReponse

2020-06-30 Thread Peter Turcsanyi
Hi Jeremy, I don't think you can accept the request in one node and send back the response from another node. There is an open HTTP connection between the client and the NiFi node while the HandleHttpRequest -> ... -> HandleHttpResponse flow is running. Even if we passed the request/response conte

Re: NIFI JMS consuler : AMQP 1.0 trouble

2020-06-22 Thread Peter Turcsanyi
iel pendant vos temps non travaillés, il ne > requiert > ni prise de connaissance ni réponse immédiate de votre part. > > *De :* Peter Turcsanyi > *Envoyé :* vendredi 19 juin 2020 14:59 > *À :* users@nifi.apache.org > *Objet :* Re: NIFI JMS consuler : AMQP 1.0 trouble > &g

Re: NIFI JMS consuler : AMQP 1.0 trouble

2020-06-19 Thread Peter Turcsanyi
Hi Olivier, You can use Apache Qpid Proton AMQP client library [1] as recommended in the ActiveMQ AMQP configuration docs [2]. You'll want to download Qpid JMS (AMQP 1.0) and use the jars from the lib folder of the tarball. The JNDI Initial Context Factory Class needs to be configured: org.apache.

Re: AWS custom processor build failing on upgrading nifi version to 1.11 from 1.8

2020-06-08 Thread Peter Turcsanyi
Hi Sanjeet, IMO this topic is rather for the dev mailing list. Could you please attach the pom files you are using in your custom module? Regards, Peter On Fri, Jun 5, 2020 at 6:22 PM sanjeet rath wrote: > Hi, > > I have created a custom aws controler service by creating a new java > project

Re: Filtering Tweets by User Name

2019-11-15 Thread Peter Turcsanyi
ved tweets based on the metadata in the json: extract username with EvaluateJsonPath, then use RouteOnAttribute. Hope it helps. Regards, Peter Turcsanyi On Fri, Nov 15, 2019 at 2:06 AM Kayak28 wrote: > Hello, Comunity: > > I am a new user of Nifi, and currently using Nifi 1.10. &

Re: Default Retry mechanism for NIFI puts3Object processor

2019-11-12 Thread Peter Turcsanyi
Hi Sanjeet, There is an open issue [1] about retry handling in AWS processors with a pull request available [2] that might be interesting for you / solve your problem. Unfortunately it has not been merged yet. This would be a more generic solution for all AWS processors which also adds an option

Re: Influence about removing RequiresInstanceClassLoading from AbstractHadoopProcessor processor

2019-11-11 Thread Peter Turcsanyi
onsidering to remove it? Regards, Peter Turcsanyi On Mon, Nov 11, 2019 at 3:30 PM abellnotring wrote: > Hi,all > I’m considering removing the RequiresInstanceClassLoading annotation > from class AbstractHadoopProcessor, > Does anybody know the potential Influence? > > Thanks > By Hai Luo >

Re: HandleHTTPRequest 503 error issue

2019-10-30 Thread Peter Turcsanyi
Hi Wyllys, sorry for my late reply. 1.10 release in progress, expected soon. Regards, Peter Turcsanyi On Fri, Oct 4, 2019 at 10:22 PM Wyllys Ingersoll < wyllys.ingers...@keepertech.com> wrote: > > Yes, thanks. Is there an ETA for 1.10? > > On Fri, Oct 4, 2019 at 3:05

Re: DBCPConnectionPoolLookup

2019-10-04 Thread Peter Turcsanyi
name of the dynamic property, not to the name of the DBCPConnectionPool component. Please find attached my simple example. It contains only one DBCPConnectionPool that can be looked up, but a second one can be added in the same way. Regards, Peter Turcsanyi On Fri, Oct 4, 2019 at 10:13 PM John Fak

Re: HandleHTTPRequest 503 error issue

2019-10-04 Thread Peter Turcsanyi
Hi Wyllys, It has been fixed in NIFI-6317 <https://issues.apache.org/jira/browse/NIFI-6317> which will be shipped in the upcoming 1.10 release. Could you please retest your workload on that version when it is available? Regards, Peter Turcsanyi On Fri, Oct 4, 2019 at 6:28 PM Wyllys Ing

Re: NIFI - PUTSQL - sql.args.1.type

2019-09-24 Thread Peter Turcsanyi
If you navigate to Constant Field Values in the javadoc, you can see the integer constants. On Tue, Sep 24, 2019 at 6:10 AM KhajaAsmath Mohammed < mdkhajaasm...@gmail.com> wrote: > This link doesn’t have any val

Re: Variables to start a NiFi flow

2019-08-26 Thread Peter Turcsanyi
Hi Bimal, With Variable Registry, you can implement it in the following way: Put your flow into a Process Group. Use variable references in your processors (eg. ${db.table}) and define the variables at the process group level. Then copy the process group (by simply copying it or creating a templat

Re: java.lang.IllegalStateException: AsyncContext completed and/or Request lifecycle recycled ???

2019-05-24 Thread Peter Turcsanyi
The request has a timeout configured on HttpContextMap. If there is some delay in the flow and the response is being processed around the expiration time, it can happen that the clean-up mechanism in HttpContextMap closes the expired request and sends 503 response to the client (while the response

Re: PutS3Object failing when using non-Latin characters in filename

2019-03-14 Thread Peter Turcsanyi
PR is available with the fix: https://github.com/apache/nifi/pull/3373 On Thu, Mar 7, 2019 at 11:47 PM Peter Turcsanyi wrote: > I managed to reproduce the S3 Put error, but FetchFile works fine in my > local dev env, so I think the two issues are unrelated. > > I looked into

Re: PutS3Object failing when using non-Latin characters in filename

2019-03-07 Thread Peter Turcsanyi
I managed to reproduce the S3 Put error, but FetchFile works fine in my local dev env, so I think the two issues are unrelated. I looked into the code of PutS3Object and also checked the HTTP request sent to S3: The filename is being set in the Content-Disposition HTTP header and if it contains na

Re: couldn't set up logback to log to database

2019-03-05 Thread Peter Turcsanyi
Hi Kirill, What I don't understand is the duplicated tags at the beginning of your config snippet: ... Is it a copy-paste error in the mail (or in the config)? Could you please send over the exact / whole logback.xml file as you are trying to use it? Regards, Peter On Tue, Mar 5, 2019 at 11