an convert the values to string with the
desired format right in the SQL query.
Regards,
Isha
Van: Tiago Luís Sebastião (DSI)
mailto:tiago.luis.sebast...@cgd.pt>>
Verzonden: woensdag 19 april 2023 12:56
Aan: users@nifi.apache.org<mailto:users@nifi.apache.org>
Onderwerp: NiFi 1.19.1
Hi,
I’m using a standalone deployment (Nifi 1.19.1) that runs directly on the
server.
I’ve noticed something tricky for the first time…
When executing a query with Nifi processor ExecuteSQL the maximum decimal
precision that it returns is 6, anything above that returns “0E-7”.
Query:
“
select
fails for the flow.xml.gz specifically,
then deleting the xml during migration might be an easier fix.
Regards,
Isha
Van: Tiago Luís Sebastião (DSI)
mailto:tiago.luis.sebast...@cgd.pt>>
Verzonden: dinsdag 6 december 2022 17:24
Aan: users@nifi.apache.org<mailto:users@nifi.apache.org&g
|
tiago.luis.sebast...@cgd.pt<mailto:tiago.luis.sebast...@cgd.pt>
[cid:image002.jpg@01D52816.782219F0]
DSI - Data Office – USI6.2 Unidade de Serviços de Dados
www.cgd.pt<http://www.cgd.pt/>
Antes de imprimir esta mensagem, pense no meio ambiente.
Esta mensagem e-mail, assim como
e WARN.
Sorry for the long email…
Regards.
Tiago Sebastião
From: Tiago Luís Sebastião (DSI)
Sent: 28 de outubro de 2022 09:48
To: users@nifi.apache.org<mailto:users@nifi.apache.org>
Subject: RE: NiFi 1.18.0 Sensitive Property broken after Upgrade
Hi David,
It’s a standalone deploym
Oct 27, 2022 at 10:35 AM Tiago Luís Sebastião (DSI)
mailto:tiago.luis.sebast...@cgd.pt>> wrote:
Hi all,
I'm having the same “problem”.
I upgraded nifi version from 1.17.0 to 1.18.0 and that same warning started to
appear 500k times a day.
"
WARN [Flow Servi
Hi all,
I'm having the same “problem”.
I upgraded nifi version from 1.17.0 to 1.18.0 and that same warning started to
appear 500k times a day.
"
WARN [Flow Service Tasks Thread-1] d.o.a.n.s.u.c.NiFiLegacyCipherProvider
Insecure Cipher Provider Algorithm [PBEWITHMD5AND256BITAES-CBC-OPENSSL]
Hello all,
I'm leaving from my present job ( I'm a old guy :)), its my last day and I
just send this mail to say thank you to all.
We worked with Nifi in the last 6 years and my colleagues will continue to use
this great tool. We created several http services in Nifi for example:
Hello,
I'm using a ScriptedTransformRecord (Nifi 1.12.1) and sometimes when an error
arise in the reader its expected according the documentation the attribute
record.error.message is setted but this doesn't happen.
In the source code
This is from the same author, Matt Burgess, older but good:
https://funnifi.blogspot.com/
Carlos
From: Steven Matison [mailto:steven.mati...@datastax.com]
Sent: 21 de maio de 2021 16:47
To: users@nifi.apache.org
Subject: Re: ExecuteScript Documentation
*** ATENÇÃO: esta mensagem de e-mail tem
Hi Cristiano,
Take a look on Nifi processor PutDatabaseRecord wich can read from a csv
source (and others json, avro,ect) and put the records on a existent table on
database.
If you need to create a table based on the schema of CSV you probably need a
custom script, take a look in this post:
if the problem persists?
Thanks,
Matt
On Mon, Apr 19, 2021 at 4:11 PM Carlos Manuel Fernandes (DSI)
wrote:
>
> Hello,
>
>
>
> After upgrading to Nifi 1.13.2 from Nifi 1.9.2, I notice a problem with
> DBCPConnectionPool, several connections remain on pool above ‘Max Idle
> C
Hello,
After upgrading to Nifi 1.13.2 from Nifi 1.9.2, I notice a problem with
DBCPConnectionPool, several connections remain on pool above 'Max Idle
Connections' number after the 'Minimum Evictable Idle Time' is passed'.
To reproduce the issue I use a simple flow: ExecuteSql (Concurrent
Hello,
I am trying to connect Nifi with Apache Ignite to put some data on Ignite
cache using ExecuteScript because putIgniteCache and GetIgniteCache
processors are bounded to an older Ignite version.
I made Test1 (below) using standalone groovy without Nifi and work Well.
Test2(below)
Hello,
I made an upgrade of Nifi from 1.9.2 to 1.11.3 and I see a problem when
Terminate a Groovy ExecuteScript process.
The steps to replicate are :
GenerateFlowFile -> Groovy ExecuteScript -> LogAttribute
The executeScript code:
def flowFile = session.get()
sleep(20)
Hello,
I'm trying to build a groovy excuteScript to make some actions on hadoop
hdfs. I follow this answer, from Matt Burgess to a similar question
(https://community.hortonworks.com/questions/47493/nifi-executescript-using-external-libarries-with-g.html),
but with no success.
I test
users@nifi.apache.org
Subject: Re: Content Claim
Carlos,
A FlowFile can only reference a single claim at a time. It initially referenced
...-40. It then changed its reference to ...-42. At that point, it no longer
referenced ...-40.
On Jul 9, 2019, at 10:45 AM, Carlos
is enabled in nifi.properties.
On Jul 9, 2019, at 10:17 AM, Carlos Manuel Fernandes (DSI)
mailto:carlos.antonio.fernan...@cgd.pt>> wrote:
Hello, sorry i dont finish the last mail.
I had some problems with data on content repository not claimed using nifi
version 1.9.2. Trying to underst
Hello, sorry i dont finish the last mail.
I had some problems with data on content repository not claimed using nifi
version 1.9.2. Trying to understand da root cause I make a simple flow :
generate flow file with 10 bytes -> replaceText -> logAttributte and see in
data provenance :
Hello,
I had some problems with data on content repository not claimed using nifi
version 1.9.2. Trying to understand da root cause I make a simple flow :
generate flow file with 10 bytes -> replaceText -> logAttributte and see in
data provenance :
Type
n idea how to resolve the log4j jar hell, I’m
> open for ideas.
>
>
>
> Cheers Josef
>
>
>
>
>
>
>
> From: "Carlos Manuel Fernandes (DSI)"
> Reply-To: "users@nifi.apache.org"
> Date: Friday, 7 June 2019 at 16:30
> To: &q
Hello,
I' m trying to connect Nifi (version 1.9.2) to Impala (3.2.0-cdh6.2.0) with
DBCPConnectionPool using jdbc driver ImpalaJDBC41.jar, using Kerberos
authentication.
I Configured a controller KeytabCredentials pointing to keytab and in
nifi.properties i set nifi.kerberos.krb5.file to
Hi Ryan,
If I understand well, you have a jolt map specification for each user. In that
case you can put the relation guid, map_spec in some table of a external
database.
After that in your flow before JoltTransformJSON you create a custom processor
to read the configuration from the table
I walter,
try setting validation query property on database controller service. Probably
in you installation there is some firewall which drops idle connections. With
this property set (ex: select 1 for Sqlserver) if the processor get an invalid
connection that connection is dropped and a new
Nifi simple principles of flow, attributes of flow , processes and properties
of processors are very powerful and permit a lot of great combinations.
The problem i see, is the tendency to repeat flows to make the same thing,
because some properties are hardwire (properties without
with the stacktrace you show and also include a complete nifi
thread dump with it as well as showing your nifi.properties settings for at
least the provenance repository.
Thanks
On Wed, Jan 17, 2018 at 10:48 AM, Carlos Manuel Fernandes (DSI)
<carlos.antonio.fernan...@cgd.pt> wrote
Hi,
I'm on Nifi 1.4 and provenance properties by default. Time to times I Get the
Exception below. After this Exception the CPU is always high , the UI is slow
and some processes get Stucked. After nifi restart all be ok.
1.I think this is related with
good to go on the newest version of NiFi.
Thanks
-Mark
[1] https://issues.apache.org/jira/browse/NIFI-3281
On Oct 20, 2017, at 6:07 AM, Carlos Manuel Fernandes (DSI)
<carlos.antonio.fernan...@cgd.pt<mailto:carlos.antonio.fernan...@cgd.pt>> wrote:
Hi,
I configured a fetchSftp
: Re: FetchSftp with user/password dont move the file
Hi Carlos,
Is the user allowed to move the file on the FTP server? Are the permissions on
the file correct?
Pierre
2017-10-20 12:07 GMT+02:00 Carlos Manuel Fernandes (DSI)
<carlos.antonio.fernan...@cgd.pt<mailto:carlos.antonio.
Hi,
I configured a fetchSftp with username/password (no privatekey for
certificate) and the processor is able to fetch the file but gives an error
when try to move the file.
Apparently to move the file the processor try use authentication with
certificate, not user/pwd. I'm using NIFI
together on a feature proposal?
On Oct 3, 2017 12:03 PM, "Carlos Manuel Fernandes (DSI)"
<carlos.antonio.fernan...@cgd.pt<mailto:carlos.antonio.fernan...@cgd.pt>> wrote:
Hello, with a large number of scheduled processors , would be interesting a UI
option to list (search)
Hello, with a large number of scheduled processors , would be interesting a UI
option to list (search) which processors runs in some time intervals.
This would be useful when something goes wrong and we must identify which
processors didn't executed at all during the crash period. Other
Hi Vikram,
I had the same requirements like you , and my solution is a service:
HandleHttpRequest (prepared to handle
http://host:8085/ods?sourceTable=tableName=tableName=Y) ->
ExecuteScript (Script reads the http parameters and/or read extra parameters
from a database table and make the
On May 26, 2017, at 2:08 PM, Carlos Manuel Fernandes (DSI)
<carlos.antonio.fernan...@cgd.pt<mailto:carlos.antonio.fernan...@cgd.pt>> wrote:
Congratulations Team for 1.2 release and especially for the Record Oriented
Paradigm. It’s a great abstraction and permit create more concise a
Congratulations Team for 1.2 release and especially for the Record Oriented
Paradigm. It's a great abstraction and permit create more concise and
reusable flows . My first experience was a simple use case:
Create a service who accepts file parameters (ex: file.name,
file.avro.schema,
James, one idea, if your common workflow was wrapped with HandleHttpRequest and
HandleHttpResponse you can reuse them (calling with invokeHttp) since you pass
all the parameters in the request and your workflow use them as attributes.
Your common workflow behaves like a Micro Service.
Of
Hello Frank,
I had this issue with Nifi-1.1.1 when copied a processor group from one
location to another. When I create a new processor group from scratch and
copy just the processors inside the problem disappear. The problem, for me,
just emerged in copied processor groups. Its your
in my last response.
This "lock" idea is interesting, I will give it some more thought, perhaps
there is something we could do in the framework and/or extensions to enable
this, if it is a common use case. There have been different Jira cases and
discussions about barriers and general aggregat
los Manuel Fernandes (DSI)
<carlos.antonio.fernan...@cgd.pt> wrote:
> Hello,
>
>
>
> I ‘m using NIFI to replicate tables from one relational
> Database(Mainframe) to other Database, with incremental updates,
> based on a timestamp and primary key. The process i
Hello,
I 'm using NIFI to replicate tables from one relational Database(Mainframe) to
other Database, with incremental updates, based on a timestamp and primary
key. The process is made with tree custom processors:
GenerateListOfTablesToSyncronize -> CreteTableIfNotExists ->
Hello Wayne,
Have you tried this connection on a Sql client tool , like Squirrel,
dbvisualizer, etc?
I have a connection to SqlServer but the Url connection is :
jdbc:sqlserver://:1433;databaseName= using sqljdbc4.jar.
Carlos
From: Wayne Richard [mailto:wayne.rich...@xpo.com]
Sent:
ated to handle ETL.
Em 06/10/2016 10:39, "Carlos Manuel Fernandes (DSI)"
<carlos.antonio.fernan...@cgd.pt<mailto:carlos.antonio.fernan...@cgd.pt>>
escreveu:
Hi Uwe,
I saw you had developed similar approach of mine. Joe Witt lunched a challenge
to build a processor based
Hi Peter , the simplest way I see, need to transverse the all file, using a
processor property. Ex: N_lines (number of Lines to Strip on file)
import java.nio.charset.StandardCharsets
//Read the flowFile
def flowFile = session.get()
if (!flowFile) return
//Read Processor property
def
n a modified version of the
code.
Regards,
Peter
From: Carlos Manuel Fernandes (DSI)
[mailto:carlos.antonio.fernan...@cgd.pt<mailto:carlos.antonio.fernan...@cgd.pt>]
Sent: Thursday, August 11, 2016 9:20 AM
To: users@nifi.apache.org<mailto:users@nifi.apache.org>
Subject: Exception on Pr
Hi All,
I am making some tests to move data from Db2 to Netezza using Nifi. If I
don't use costume processors, it's a indirect away :
ExecuteSQL(on db2) -> ConvertAvroToJSON -> ConvertJSONToSQL -> PutSQL (bulk on
netezza)
and this away, I have an Exception on ConvertJSONToSQL:
you create Jira ticket.
Thanks
Toivo
2016-07-21 21:22 GMT+03:00 Carlos Manuel Fernandes (DSI)
<carlos.antonio.fernan...@cgd.pt<mailto:carlos.antonio.fernan...@cgd.pt>>:
Hi all,
I have a DBCPConnectionPool to Netezza with 8 Connections, but if some
connections go idle too much ti
46 matches
Mail list logo
