By Hai Luo,
I haven't personally attempted to use NiFi with Hadoop in the way you
described. If your Hadoop clusters are not secured I don't think you'll
have issues with UGI. I wouldn't recommend running NiFi and Hadoop
clusters unsecured, however.
On Tue, Nov 12, 2019 at 8:40 PM abellnotring
Thanks. You were right .
Sent from my iPhone
> On Nov 20, 2019, at 6:10 PM, Bimal Mehta wrote:
>
> Click on the Process Group and open Variable Registry. Most likely it's
> defined as Process Group variable inside Variable Registry
>
>> On Wed, Nov 20, 2019, 1:24 PM KhajaAsmath Mohammed
That was it. Such a careless oversight. Thanks very much Mark.
On Wed, Nov 20, 2019 at 1:51 PM Mark Payne wrote:
> Hi,
>
> The problem here, I think is that you're attempting to call `toUpper()` as
> a function that takes an argument. You'd need to change it instead to:
>
>
Hi,
The problem here, I think is that you're attempting to call `toUpper()` as a
function that takes an argument. You'd need to change it instead to:
${filename:toUpper():substringAfter( ${myTokens:toUpper()} )}
Thanks
-Mark
> On Nov 20, 2019, at 1:18 PM, James McMahon wrote:
>
> I have an
I have an incoming filename value of LarryCurlyMoe_ABCDstooges.
I want to apply an expression in an UpdateAttribute processor that performs
a substringAfter with a Registry variable reference.
My Registry variable myTokens has value ABCD.
I'd like to apply
A while back, I suggested (there is a JIRA for it) something similar for
Grok patterns (being able to have a global CS managing the grok patterns
instead of relying on local files to be distributed on the NiFi nodes). Not
the same but wanted to mention it in case it would drive towards something
Well, not really. The Avro Schema Registry does perform validation of the Avro
Schema. Which is something that a 'generic blob store' type of mechanism would
not really provide. I think I recant my recommendation of making it more
generic. There are definitely benefits to it being more
Fair enough. I forgot that we had the advanced UI for the Jolt Spec. That would
definitely be beneficial.
On Nov 20, 2019, at 10:47 AM, Joe Witt
mailto:joe.w...@gmail.com>> wrote:
...specific or generic - tradeoffs. A specific service would allow Jolt Spec
editing to have context and
Does it means that AvroSchemaRegistry is "not a good idea actually" ?
I am pretty sure I misunderstood, because in this case there is a kind of
compilation on schema.
But you are right, the registry for JOLT specification is just a storage of
blob.
Le mer. 20 nov. 2019 à 16:36, Mark Payne a
...specific or generic - tradeoffs. A specific service would allow Jolt
Spec editing to have context and meaning. A generic service for just blobs
would not. I think our Jolt stuff has an advanced UI that makes writing
the specs a bit easier. If true a more specific service would make sense.
I would recommend that we also be careful about the naming here and tying this
to Jolt. Really, this is just a mechanism for externalizing a big blob of text
(or bytes). There are several other processors and controller services that do
this, such as scripted components, Hadoop related
For the PR...
If only I would have enough time for that ;)
Soon it will be end year holidays, may be...
Le mer. 20 nov. 2019 à 16:28, Joe Witt a écrit :
> Yeah filing a JIRA would be good. Contributing a PR for it would be even
> better. It should have no impact on the schema registry
Yes it would be a ControllerService as you described.
There is currently three implementation :
* AvroSchemaRegistry
* ConfluentSchemaRegistry
* HortonworksSchemaRegistry
It could be based on something like them.
May be I should send something on Jira or somewhere else to submit the idea
to
Hello
Is the idea to have a place to store Jolt specifications that you could
then access in various components?
If so a simple ControllerService such as 'JoltSpecControllerService' which
has a list of keys (names of specs) and values (the spec) would probably do
the trick.
Thanks
On Wed, Nov
I think that is a great idea, I’d suggest the same thing for protobuf specs
as well.
Even if the first step is the registry supporting raw bytes access and
support….
On November 20, 2019 at 09:28:23, Etienne Jouvin (lapinoujou...@gmail.com)
wrote:
Hello all.
For reader and writers, there
Hello all.
For reader and writers, there is the possibility to store the schema inside
a schema registry.
What do you think about having this type of mechanism for
JolftTransformation ?
Currently, I can put Jolt specification in variables and get them from it,
but I think it could be nice tohave
16 matches
Mail list logo