We are considering using Kylo on top of NiFi. It is my understanding that while
Kylo manages both NiFi and Spark, its designers decided to utilize Scoop from
Spark in order to ingest the data from relational databases. I am also aware
that it is possible to drive Scoop from NiFi using one of
find
it?
You’ve mentioned that you wrote a cook book on NiFi patterns. Did you publish
it anywhere? Thanks.
Vitaly Krivoy
From: Matt Burgess
Sent: Tuesday, July 17, 2018 2:15 PM
To: users@nifi.apache.org
Subject: Re: NiFi processor to execute a Java class
In addition to Andy’s great links
the cool sqoop features amd it's high
performance, and just need to ingest data, you will be fine using NiFi
processors.
Boris
On Fri, Aug 3, 2018, 15:28 Vitaly Krivoy
mailto:vitaly_kri...@jhancock.com>> wrote:
We are considering using Kylo on top of NiFi. It is my understanding that
hat to a flowfile. Anything beyond that you'd need to do yourself.
On Mon, Jul 16, 2018 at 11:18 AM Vitaly Krivoy
mailto:vitaly_kri...@jhancock.com>> wrote:
Thank you Mike. The objective of my custom class is to query data from
salesforce. Will ExecuteStreamCommand processor automatically
Now this is awesome! Thanks!
From: Andy LoPresto [mailto:alopre...@apache.org]
Sent: Tuesday, July 17, 2018 12:29 PM
To: Vitaly Krivoy
Cc: users@nifi.apache.org
Subject: Re: NiFi processor to execute a Java class
Groovy is line-by-line compatible with pure Java and compiles to byte code. You
or later because those
releases have a REPL loop? Thanks.
Vitaly Krivoy
STATEMENT OF CONFIDENTIALITY The information contained in this email message
and any attachments may be confidential and legally privileged and is intended
for the use of the addressee(s) only. If you are not an intended
that it could be directed to other
processors in a pipeline. Any recommendations? Thank you.
Vitaly Krivoy
STATEMENT OF CONFIDENTIALITY The information contained in this email message
and any attachments may be confidential and legally privileged and is intended
for the use of the addressee(s) only
is ExecuteStreamCommand.
On Mon, Jul 16, 2018 at 10:54 AM Vitaly Krivoy
mailto:vitaly_kri...@jhancock.com>> wrote:
What would be the best NiFi processor to execute a Java class? I’ve seen some
references to ExecuteScript, InvokeScriptedProcessor and ExecuteStreamCommand
processors, but n
Has anyone seen a detailed example of setting up InvokeHttp nifi processor with
Salesforce.com REST API to get the data from Salesforce into NiFi? I found
references on the web, but none of them go provide the necessary level of
detail? Thanks.
STATEMENT OF CONFIDENTIALITY The information
Has anyone tried to use Reliersoft jdbc driver to pull data from Salesforce
using ExecuteSQL processor? I've created an object Pricipal__c in Salesforce
which contains three records.
I can run "select * from Pricipal__c" in DbVisualizer and it works as
expected. But I get neither data nor
I am trying to update processors for a workflow, which was previously generated
from a template by instantiating it. All work is done from a Java program
through NiFi REST API. Template holds processors in a group. Since I know the
template group name and strategy by which NiFi assigns a new
only
need to pass in the revision (RevisionDTO) and the configuration
(ProcessorDTO). Check out the Developer Tools in your browser to see various
requests in action.
Hope this helps.
Matt
On Tue, Mar 13, 2018 at 2:45 PM, Vitaly Krivoy
<vitaly_kri...@jhancock.com<mailto:vita
SSL context.
Matt
Sent from my iPhone
On Apr 6, 2018, at 11:15 AM, Vitaly Krivoy
<vitaly_kri...@jhancock.com<mailto:vitaly_kri...@jhancock.com>> wrote:
When I start a group from NiFi UI and I examine the request in Chrome
Developers Tools, it is identical to the one that I send
in a valid state to be
started... any processors that have validation errors cannot be started, and
also controller services need to be started separately.
On Fri, Apr 6, 2018 at 2:14 PM, Vitaly Krivoy <vitaly_kri...@jhancock.com>
wrote:
> Thank you for replying Matt. It’s not secured.
I am trying to use PUT/flow/process-groups/{id} to start a processing group
from a Java program, but nothing is happening. I set state RUNNING in
ScheduleComponentsEntity and when an API call returns it shows the state in the
returned object as RUNNING. But I see on the canvas that the group
When I start a group from NiFi UI and I examine the request in Chrome
Developers Tools, it is identical to the one that I send from a Java program.
What gives?
From: Vitaly Krivoy [mailto:vitaly_kri...@jhancock.com]
Sent: Thursday, April 05, 2018 5:49 PM
To: users@nifi.apache.org
Subject: PUT
stacktrace for that exception in nifi-app.log and provide
it here, it may be helpful to see what is going on.
On Fri, Apr 20, 2018 at 11:00 AM, Vitaly Krivoy <vitaly_kri...@jhancock.com>
wrote:
> Charlie,
>
>
>
> I modified my code so that it would create a controller first and
> then
et
.state(ControllerServiceDTO.StateEnum.ENABLED)
But rather create it, then enable it as a next step.
In debugging these things, I have extensively used the chrome developer tools
as I make actions in the UI, then get my payloads from my java client to match
those exactly. If a field isnt
Hi,
I am trying to programmatically create a DBCP Controller Service from a Java
program and I am getting an error returned from
POST/process-groups/{id}/controller-services.
Exception when calling: ControllerServicesApi#createControllerService
Response body: Unable to create
I am using a SelectSQL processor to pull data from DB2 in AVRO format with
complete table selection query of the type: "select * from
schema_name.table_name".
Initially I set "Use AVRO Logical Types" SelectSQL property to true. VARCHAR
text fields were extracted fine, but dates were extracted
always return 19, which = MAX_DIGITS_IN_BIGINT
User specified precision, which is passed into the method, but ignored, should
have been used in this line.
Cheers!
From: Vitaly Krivoy [mailto:vitaly_kri...@jhancock.com]
Sent: Wednesday, March 28, 2018 2:08 PM
To: users@nifi.apache.org
Subject: Sel
“git checkout ” to checkout the version you
want.
Cheers,
Kevin
From: Vitaly Krivoy
mailto:vitaly_kri...@jhancock.com>>
Reply-To: mailto:users@nifi.apache.org>>
Date: Thursday, June 28, 2018 at 11:54
To: "users@nifi.apache.org<mailto:users@nifi.apache.org>"
mailto:use
If I do "git checkout master", that would check out the next version of nifi
which is 1.7
How do I check out current version 1.6? I don't see it when I list all
branches. Thanks.
Vitaly Krivoy
STATEMENT OF CONFIDENTIALITY The information contained in this email message
and any a
browser. Anything
viewable/doable in the NiFi UI is a doable through REST API endpoints.
[1] https://nifi.apache.org/docs/nifi-docs/rest-api/
Thanks,
Pierre
Le lun. 12 nov. 2018 à 18:36, Vitaly Krivoy
mailto:vitaly_kri...@jhancock.com>> a écrit :
Is there a REST API to list all NiFi proc
If a process group template contains multiple processors of the same type, I
need to make sure that they have different names. Is there an easier way of
parsing a template outside of instantiating it and then getting all processors
from a resulting process group? I do already have the code to
Easiest way to find out is to use the developer tool of your browser. Anything
viewable/doable in the NiFi UI is a doable through REST API endpoints.
[1] https://nifi.apache.org/docs/nifi-docs/rest-api/
Thanks,
Pierre
Le lun. 12 nov. 2018 à 18:36, Vitaly Krivoy
mailto:vitaly_kri...@jhancock.com>&
Is there a REST API to list all NiFi processors in a current NiFi release?
Thanks.
STATEMENT OF CONFIDENTIALITY The information contained in this email message
and any attachments may be confidential and legally privileged and is intended
for the use of the addressee(s) only. If you are not an
/ITReportLineageToAtlas.java#L100
Thanks,
Koji
On Wed, Nov 14, 2018 at 7:23 AM Vitaly Krivoy
wrote:
>
> If a process group template contains multiple processors of the same type, I
> need to make sure that they have different names. Is there an easier way of
> parsing a template outside of i
be added. Right now there is an end-point
like "/flow/processor-types" which is used to retrieve the list of processors
when adding a new processor, but this response doesn't have the properties of
each processor.
Thanks,
Bryan
On Mon, Jan 14, 2019 at 1:07 PM Vitaly Kriv
This is a follow-on question to Apache/HortonWorks, rather than an answer to
the question posted by Marcelo. Outside of CaptureChangeMySQL, are there plans
underway to add similar processors for other databases? I realize that a
database would have to produce a capture data change log for this
Is it possible to obtain all processor property names through the REST API
without having to create an instance of a processor first? Thanks.
STATEMENT OF CONFIDENTIALITY The information contained in this email message
and any attachments may be confidential and legally privileged and is
on "change data capture logs marketed
advantages" ;)
On Fri, Jan 18, 2019 at 12:07 PM Vitaly Krivoy
mailto:vitaly_kri...@jhancock.com>> wrote:
This is a follow-on question to Apache/HortonWorks, rather than an answer to
the question posted by Marcelo. Outside of CaptureChangeMySQL,
, 2019 at 12:07 PM Vitaly Krivoy
wrote:
>
> This is a follow-on question to Apache/HortonWorks, rather than an answer to
> the question posted by Marcelo. Outside of CaptureChangeMySQL, are there
> plans underway to add similar processors for other databases? I realize that
> a
33 matches
Mail list logo
