name / id are you referring to?
>
> On Tue, Feb 13, 2024 at 8:43 AM Etienne Jouvin
> wrote:
>
>> Hello all.
>>
>> Just simple question, is there a way to access, from controller service,
>> to the instance name / id event in not cluster implementation?
>>
>> Regards
>>
>> Etienne Jouvin
>>
>
Hello all.
Just simple question, is there a way to access, from controller service, to
the instance name / id event in not cluster implementation?
Regards
Etienne Jouvin
Hello.
I also think the problem is more about the processor, I guess ExecuteSQL.
Should play with batch configuration and commit flag to commit intermediate
FlowFile.
The out of memory exception makes me believe the full table is retrieved,
and if it is huge the FlowFile content is very large.
ns? I do
> wonder if perhaps we should offer one that doesn't tie to all our ASF-isms
>
> Thanks
>
> On Sat, Dec 9, 2023 at 10:54 AM Etienne Jouvin
> wrote:
>
>> Hello all;
>>
>> Since now, I never push my extensions to any Nexus or Artifactory.
>> But now I m
inside a profile ?
Like this, we will not have to add a custom configuration.
Regards
Etienne Jouvin
;
> But always failed ..
>
>
> *Envoyé:* lundi 27 novembre 2023 à 11:00
> *De:* "Etienne Jouvin"
> *À:* users@nifi.apache.org
> *Objet:* Re: invokeHTTP SSL error NIFI : 1.23.2
> Oh I did not get this is an external api.
>
> Yes because it is https, you should i
il now, I don't use SSL context
> and it is working.
>
> Good anyway, I will get the server certificate and add it in the
> truststore and configure invokeHTTP to user SSL context also
>
> Thanks
>
> Minh
>
>
> *Envoyé:* lundi 27 novembre 2023 à 10:48
> *De:* &
Hello;
For sure, the certificate for the target server is not valid.
We had this issue also, because in the certificate the alias was missing.
Check your certificate, and I guess you will have to generate it again,
import it in the truststore.
Regards
Le lun. 27 nov. 2023 à 10:28, a écrit :
>
Hello all.
You can decrease the penalty value on the processor.
Set to 0 for example.
Le lun. 25 oct. 2021 à 16:22, Bilal Bektas a
écrit :
> Hi Community,
>
>
>
> We use LookupAttribute processor in order to get lookup value from
> Teradata or Oracle DB. Processors work as follows:
>
>
>
>
Hello.
I may have notice something similar.
And it was a matter of disk Space for the provenance repository.
There was not enough space, and flowfile with large content
NiFi was waiting to free some spaces.
Regards
Etienne Jouvin
Le lun. 2 août 2021 à 20:20, scott a écrit :
> I'm us
Hello.
What you can do, is to write the expected JSON.
Then do a process with convert record, with a JSON tree reader and a
writer. On the writer, specify that you want to write the schema in
property.
Like this, yo uwil have the wanted schema.
Etienne
Le mer. 28 juil. 2021 à 14:51, Jens M.
one is really appriciated.
>
> Thanks,
> Sanjeet
>
> On Mon, 19 Jul 2021, 9:18 pm Etienne Jouvin,
> wrote:
>
>> Hye All.
>>
>> I was wondering what is the best way to access a sensitive context
>> parameter from ExecuteScript.
>> When adding a prop
Hye All.
I was wondering what is the best way to access a sensitive context
parameter from ExecuteScript.
When adding a property on the ExecuteScript process, I can not put the
sensitive property.
Thanks for any input.
Regards
Etienne Jouvin
ma*
>
>
>
> On Thu, Mar 25, 2021 at 4:18 PM Etienne Jouvin
> wrote:
>
>> Hello.
>>
>> What you can do it to prefix your log message, with something like
>> [MY_TABLE]
>> and then in the logback configuration use an EvaluatorFilter.
>>
org.codehaus.janino.janino
Those libraries are potentially already used in standard processors /
services.
Depending on your NiFi version, check which version you need to deploy.
Regards
Etienne Jouvin
Le jeu. 25 mars 2021 à 11:23, Vibhath Ileperuma
a écrit :
> Hi All,
>
> I'm developing a NIFI f
in the logs.
Good luck.
Etienne Jouvin
Le ven. 12 mars 2021 à 18:55, Sim, Yoosuk a écrit :
> This is most interesting. The NiFi administrative guide did mention
> normalizing, but this totally escaped my mind.
>
> I do have one question: What class should I debug on logbac
nifi.security.identity.mapping.transform.ldapCertNode=NONE
Hope this can help
Etienne Jouvin
Le jeu. 11 mars 2021 à 22:27, Sim, Yoosuk a écrit :
> That’s interesting. How did you go about fixing it?
>
>
>
> *From:* Etienne Jouvin
> *Sent:* March-11-21 3:57 PM
> *To:*
in LDAP dis not contrains any spaces.
So in fact, the problem was about thé user CN validation from the call
against the one in certificate.
To analyze that, I turn on remote debug, and debug step by step during the
validation.
Hope it can help
Etienne Jouvin
Le jeu. 11 mars 2021 à 20:34, Sim
Hello.
Not sure, but I already did something like this.
But unlike Java, I defined variable with keyword def
flowfile = session.get()
> if(!flowfile) return
> def filePath = flowfile.getAttribute('file_path')
> def file = new File(file_path)
> if(file.exists()){
> session.transfer(flowfile,
is necessary on dependencies. But it also means
that we can not develop custom processors / services with a different group.
Or may be there is a specific profile for packaging during development
phase, with SNAPSHOTS ?
ANy idea ?
Regards
Etienne Jouvin
Hi.
You have to generate a certificate for client, to inject in the browser.
I never did it, always setup accounts with LDAPs.
But there is a nice guide :
https://nifi.apache.org/docs/nifi-docs/html/walkthroughs.html#securing-nifi-with-provided-certificates
Etienne
Le ven. 11 déc. 2020 à
hanks,
> Pierre
>
> Le jeu. 10 déc. 2020 à 16:03, Etienne Jouvin a
> écrit :
>
>> Hello all.
>>
>> Strange behaviour on the GUI.
>> For background, I have 3 nodes in cluster.
>> Authentication based on LDAP.
>> Groups based also on LDA
Hello all.
Strange behaviour on the GUI.
For background, I have 3 nodes in cluster.
Authentication based on LDAP.
Groups based also on LDAP.
In nifi.properties
nifi.security.allow.anonymous.authentication=false
And with this, when I want to access the advanced setting of
UpdateAttribute :
/administrators to
> have a painful process when configuring all of this.
>
> Thanks,
> Pierre
>
> Le jeu. 26 nov. 2020 à 12:01, Etienne Jouvin a
> écrit :
>
>> Hello all.
>>
>> And finally I got it.
>> When I am not able to find in the documentation, b
t is cn=mig1.amexio.ch <http://mig1.assura.ch/>
,ou=users,ou=nifi,dc=amexio,dc=ch
And it is exactly matching identity retrieved from the LDAP for the node.
Et voilà.
Hard work (for me) and happy to find the way to manage this.
Thanks all for your help.
Etienne
Le mer. 25 nov
he same as the log.
>
> On Wed, Nov 25, 2020 at 1:30 PM Etienne Jouvin
> wrote:
>
>> Hello all.
>>
>> Still no luck.
>> I follow steps from here :
>> https://nifi.apache.org/docs/nifi-docs/html/walkthroughs.html#creating-and-securing-a-nifi-cluster-with-the-tls-t
then it sounds like a configuration issue with the
> Node Group, either on the LDAP server, or in the way NiFi is attempting to
> query LDAP.
>
> Regards,
> David Handermann
>
> On Wed, Nov 25, 2020 at 5:19 AM Etienne Jouvin
> wrote:
>
>> Just for information, did not have ti
, Etienne Jouvin a
écrit :
> Hello.
>
> I made some progress yesterday.
> I did setup in LDAP groups and person
>
>
>
>
>
> Groups :
> cn=administrators,ou=groups,ou=nifi,dc=amexio,dc=ch : for administrators
> cn=supervisors,ou=groups,ou=nifi,dc=amexio,dc=ch : for
e
> keystore.
>
> NiFi will get an incoming request, see that there is an X509 cert,
> take the DN and go to the user group provider and ask for the user
> with this identity.
>
> On Mon, Nov 23, 2020 at 12:01 PM Etienne Jouvin
> wrote:
> >
> > Hum OK,
> >
>
ate which comes from the
> keystore.
>
> NiFi will get an incoming request, see that there is an X509 cert,
> take the DN and go to the user group provider and ask for the user
> with this identity.
>
> On Mon, Nov 23, 2020 at 12:01 PM Etienne Jouvin
> wrote:
> >
> &g
ch
> you then put "foo" into the "Node Group".
>
> On Mon, Nov 23, 2020 at 11:50 AM Etienne Jouvin
> wrote:
> >
> > Thanks Bryan.
> >
> > With your answer I will go to the Node Group and assign node
> identities.
> > Better for de
the
> UI/REST API and grant it proxy, then actually connect it to the
> cluster.
>
> Thanks,
>
> Bryan
>
>
> On Mon, Nov 23, 2020 at 7:58 AM Etienne Jouvin
> wrote:
> >
> > Hello all.
> >
> >
> > I am currently setting up a NiFi, 1.12.1, Cluster
: cn=nifi-1,ou=people,dc=example,dc=com
In that case, what should be the obejct class for the node cn=nifi-1 in the
LDAP ?
Any documentation links will be appreciated.
Regards.
Etienne Jouvin
Hello all.
I know, this is not a good idea to setup a cluster on the same computer.
But for dev purpose, it could be useful.
As I spent 1 or 2 days to setup the cluster (not secured) on my computer
and read a lot of thread on Internet, I want to share my experience.
The purpose, having three
Hello.
InvokeHTTP is using OkHttpClient
See on OkHttpClient the logging configuration.
But if it required to add an interceptor, it will not be easy.
But in the code, you will find something like :
private void logRequest(ComponentLog logger, Request request) {
lf? Kinda.
>
> Anyway
>
> I was hoping that the NIFI infrastructure had a generalized, centralized
> (REST API? or other) that would give me the answer is this NODE up and
> listening on this PORT, and that it could be called by a Load Balancer?
>
> ~John
>
>
>
> On Sep
Because you implemented a HandleHttpRequest listing, why don't you
configure an handle on something like http(s)://server/ping
And the response is just pong
Le ven. 4 sept. 2020 à 18:02, jgunvaldson a écrit :
> Hi,
>
> Our network administrators are unable to wire up advanced Load Balancer
>
Got it thanks to
https://community.cloudera.com/t5/Community-Articles/Setting-Up-a-Secure-NiFi-to-Integrate-with-a-Secure-NiFi/ta-p/247765
Next steps would be to have NiFi and Registry on different hosts and see
how connections are made.
Le mar. 30 juin 2020 à 11:43, Etienne Jouvin a
écrit
But now, I have NiFi and Registry with secure access (LDAP + SSL)
I need to find out how to configure the Registry in NiFi, because for now I
did not have to specify login.
And even if my first bucket is Public, it is not accessible from NiFi.
Le mar. 30 juin 2020 à 11:29, Etienne Jouvin
stry.properties»:
>
> nifi.registry.security.needClientAuth=false
>
>
>
> Cheers Josef
>
>
>
>
>
> *From: *Etienne Jouvin
> *Reply to: *"users@nifi.apache.org"
> *Date: *Tuesday, 30 June 2020 at 10:46
> *To: *"users@nifi.apache.org"
> *Subject: *Ne
cate error
: ERR_BAD_SSL_CLIENT_AUTH_CERT
How can I force the authentication to not request a client side certificate
?
Thanks for any input.
Etienne Jouvin
Hello all.
Got it.
It was a matter of signature version.
Because I use s3Ninja, I needed to set with V2 :
[image: image.png]
Le ven. 26 juin 2020 à 15:43, Etienne Jouvin a
écrit :
> Hello all.
>
> I am trying to use S3 storage (s3Ninja for "unit test") and I am really
a or input for investigation ?
Regards
Etienne Jouvin
t;
> We have Maven archetypes for the processor and service bundles. I wonder
> if you could compare the resulting projects/poms with yours to see what
> seems different?
>
>
> https://cwiki.apache.org/confluence/display/NIFI/Maven+Projects+for+Extensions
>
>
> On Fri, Jun 19, 202
Then you go to
> each processor from 1.0 and right-click and select "Change Version" and
> pick 1.1.
>
> There is currently no bulk upgrade for processors, but would be a nice
> future enhancement.
>
>
>
> On Fri, Jun 19, 2020 at 12:46 PM Etienne Jouvin
> wrote:
&
, there is like NiFi upgrade, but for now I did not see how to
update all process with a new version.
Regards
Etienne Jouvin
if this is the correct fix, I will way the pull request review.
Etienne
Le ven. 19 juin 2020 à 15:19, Bryan Bende a écrit :
> If you are not using nifi-nar-bundles as your parent (which is fine), then
> you should be explicitly setting versions for nifi-api and
> nifi-framework-api.
>
ings. Try posting your
> POMs here or as a GitHub gist.
>
> On Fri, Jun 19, 2020 at 3:36 AM Etienne Jouvin
> wrote:
>
>> Hello all.
>>
>> Do not know where to post the message, guide me if I should send to
>> another mailing list.
>> A simple summary
r " +
> artifact + " when attempting to determine the expected version of NiFi
> API", e);
> }
> }
> return null;
> }
Should not be return dependency.getVersion() ?
Because the artifact is the currently parsed artifact and not the
depende
Hello all.
Do not know where to post the message, guide me if I should send to another
mailing list.
A simple summary in first step.
I created a simple project to build a new service.
I extend the nifi-nar-bundles artifact with version 1.11.4.
My project version is currently 0.0.1-SNAPSHOT.
https://nifi.apache.org/docs/nifi-docs/html/user-guide.html#Variables
>
> "Variables and the nifi.variable.registry.properties property will be
> removed in a future release. As a result, it is highly recommended to
> switch to Parameters."
>
> Or am I thinking of the wro
Hi.
In this case why don't you use variables ?
Etienne
Le mar. 19 mai 2020 à 09:41, James a écrit :
> Hi
>
> For the life of me, I can't find anything related to exporting templates
> to new systems/environments along with the parameters.
>
> I don't need the parameter values necessarily,
Hello.
I did it with a processor ExecuteGroovyScript.
The script body is something like :
import org.apache.http.entity.mime.MultipartEntityBuilder
import org.apache.http.entity.ContentType
flowFileList = session.get(100)
if(!flowFileList.isEmpty()) {
flowFileList.each { flowFile ->
def
which adds a record to a sub-field
>
> {
>"name":"this and that",
>"field":"value",
>"others": [
> {"name":"here and there"}
> ]
> }
>
> passes to Processor #3 which also adds a re
t; join them into a single JSON?
>
> thanks in advance!
> Darren
>
>
> --
> *From:* Etienne Jouvin
> *Sent:* Tuesday, March 31, 2020 8:52 AM
> *To:* users@nifi.apache.org
> *Subject:* Re: Adding Nested Properties/JSON
>
> Hello.
>
> Jolt transformation
Hello.
Jolt transformation.
Etienne
Le mar. 31 mars 2020 à 14:40, Darren Govoni a écrit :
> Hi,
>I want to use Nifi to design a flow that modifies, updates, etc a
> nested JSON document (or that can finally output one at the end).
>
> For example:
>
> {
>"name":"this and that",
>
get different results l, while I'm not surprised by this I think
> it's worth just flagging up, for future reference.
>
> Edward
>
> On Wed, 11 Mar 2020, 09:35 Etienne Jouvin,
> wrote:
>
>> Hello all.
>>
>> Just in case someone "can test".
>>
From Data
The processor failed because of the name.
But if I use a convertRecord with a CSV Reader, that infer schema, and a
JSON writer, this is working fine.
Not the same algorithm to get infer schema from InferAvroSchema and the
reader ?
Regards
Etienne Jouvin
<https://www.avast.com/sig-ema
at case, you don't
> want to constantly hit the database and give some time before trying again.
>
> HTH,
> Pierre
>
> Le lun. 10 févr. 2020 à 06:03, Etienne Jouvin a
> écrit :
>
>> Put 0 seconds to penalized and it goes to the logger processor without
>> waiting.
&
Put 0 seconds to penalized and it goes to the logger processor without
waiting.
That's fine.
I just do not understand weel why there is a penalty or yield failure, but
now that I know this, this is ok.
Le lun. 10 févr. 2020 à 14:58, Etienne Jouvin a
écrit :
> Mark,
>
> Hu
cs/html/user-guide.html#settings-tab
>
> > On Feb 10, 2020, at 8:47 AM, Etienne Jouvin
> wrote:
> >
> > Hello All.
> >
> > Here is an extract of my process
> >
> >
> > If the executeSQL failed (invalid SQL for example), the flowfile goes to
> the
Hi.
If I well understand, you can configure the InvokeHTTP to always output the
response.
In this case, the response will be routed to the response relation in any
case.
Then yo ucan do a RouteOnAttribute to check the response status. And if
HTTP code, from attribute, is 500 go to a specific
I didn't find how to
> share the sessionID after the Notify.
>
> I just hope that storing the content in the distributed cache is better
> than having it as an attribute.
>
>
> El lun., 27 ene. 2020 a las 11:14, Etienne Jouvin (<
> lapinoujou...@gmail.com>) escribió:
>
>
Hello.
I manage to do this in two ways :
1. Use Wait / Notify process. Put the original content in the wait, and
after your post is finished call the Notify to free the original one.
2. Or use a distribute cache map. Store the original content in the cache,
do your stuff and then request the
registry-docs/index.html
> [3] https://semver.org
> [4] https://issues.apache.org/jira/browse/NIFIREG-288
>
> Andy LoPresto
> alopre...@apache.org
> *alopresto.apa...@gmail.com *
> PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69
>
> On Jan 3, 2020, at
lem could be the implementation that may produce circular
reference. But it is not our fault if user make things stupid.
What do you think about that ?
Regards
Etienne Jouvin
lue if any?
>
> Thanks.
>
> Dieter
>
> Am 18.12.2019 um 13:30 schrieb Etienne Jouvin:
>
> Ok sorry.
>
> I've never seen that. At least the list is empty sometimes and I have to go
> into filters to refresh.
>
> Did you check search filter after display the data prov
r
>
> Am 18.12.2019 um 11:36 schrieb Etienne Jouvin:
>
> Hello.
>
> You have this when you right click on the processor and then call the data
> provenance.
>
> Data provenance from the menu is for the instance in global.
>
> Etienne
>
>
> Le mer. 18 déc.
Hello.
You have this when you right click on the processor and then call the data
provenance.
Data provenance from the menu is for the instance in global.
Etienne
Le mer. 18 déc. 2019 à 11:21, Dieter Scholz a écrit :
> Hello,
>
> in the past when I opened the data provenance menu of a
building on the capabilities of the
> ICU-J library. The Advanced level also includes APIs which allow additional
> languages to be supported.
So it is clear, with version HE of Saxon, no way to have localization
functions on date in the XSL.
Need to check how to do that now in other way
, I just tried to copy the ICU4J library, after download, in the lib
folder. But nothing better.
I will try to put it in the nar file and see what happens.
Does someone have the same requirements ?
Regards
Etienne Jouvin
Hello.
Why don't you use NiFi registry ?
Discover this couple if weeks ago, ans ont ils really cool
Le ven. 6 déc. 2019 à 19:14, Boris Tyukin a écrit :
> Hi,
>
> We have a single NiFi Registry and DEV/PROD NiFi clusters. When we deploy
> changes to PROD NiFi (after initial commit), we often
that you recommend?
>
> On Thu, Dec 5, 2019 at 8:57 AM Etienne Jouvin
> wrote:
>
>> Hello.
>>
>> You are right. If it works and you are satisfied, you should keep your
>> solution.
>> By the wya JoltTransformation may be difficult at the very beginning
Hello.
You are right. If it works and you are satisfied, you should keep your
solution.
By the wya JoltTransformation may be difficult at the very beginning. But
it is very powerful and with some pratice, it begins to be easy.
For study, you may give it a try.
Regards.
Etienne Jouvin
Le jeu
Hello.
Why don't you use a JoltTransformation process first to produce multiple
element in JSON according value in the array, and duplicate common
attributes for all.
And then, you do the split.
Etienne
Le jeu. 5 déc. 2019 à 14:11, James McMahon a écrit :
> Daeho and Matt, thank you for all
Etienne Jouvin
Le mer. 4 déc. 2019 à 20:31, Etienne Jouvin a
écrit :
> Hello all.
>
> I am trying a little bit the LookupRecord with RestlookupService.
>
> When watching the code for RestLookupService, we can see the following in
> the lookup function :
>
ody should be retrieve from a
record path evaluate on the flowfile body content ?
Regards.
Etienne Jouvin
er. It should have no impact on the schema registry controller
> service. This is different.
>
> Thanks
>
> On Wed, Nov 20, 2019 at 10:26 AM Etienne Jouvin
> wrote:
>
>> Yes it would be a ControllerService as you described.
>>
>> There is currently three implementati
gistry controller
> service. This is different.
>
> Thanks
>
> On Wed, Nov 20, 2019 at 10:26 AM Etienne Jouvin
> wrote:
>
>> Yes it would be a ControllerService as you described.
>>
>> There is currently three implementation :
>>
that is a great idea, I’d suggest the same thing for protobuf
>> specs as well.
>>
>> Even if the first step is the registry supporting raw bytes access and
>> support….
>>
>>
>>
>>
>> On November 20, 2019 at 09:28:23, Etienne Jouvin (lapinoujou...@gm
same as schema registry.
Regards.
Etienne Jouvin
e bin can be considered as full but it is wrong.
First call, with fragement identifier --> FRAG1
Second call with fragement identifier --> FRAG2
But during the second call, the check for first bean will return true. It
is not fullEnough, but it is older than the "specify" max age.
Do you confirm than ?
If yes, this is expected behavior ?
Regards.
Etienne Jouvin
sions.
I also tried to set current task, for the merge to 1 and set a Run Schedule
to 0.1
But it was "pretty slow", almost not as fast as I expected.
But now, working with a new identifier, and set maximum bean number relly
greater than expected possible (6x more) I works as expected.
I will surve
0.1 second ?
Regards
Etienne Jouvin
84 matches
Mail list logo
