Re: Create nested records

2018-02-09 Thread Charlie Frasure
would also like to map phone1 and phone2 attributes to phone[0] ... phone[n]. Can this be completed with the record writers? On Thu, Feb 8, 2018 at 10:25 PM, Charlie Frasure <charliefras...@gmail.com> wrote: > Hi, > > I'm having trouble taking a flat record and building an avro sch

Create nested records

2018-02-08 Thread Charlie Frasure
Hi, I'm having trouble taking a flat record and building an avro schema that lets me nest it. I found this example schema, but after using a ConvertRecord or UpdateRecord, I receive the equivalent of [{"parent" = null}] {"type": "record", "name": "CustomerInput", "namespace":

Re: AttributesToJSON

2017-09-19 Thread Charlie Frasure
you could see the provenance example for configuration. If you > want to share a sample line of the delimited data and a sample of the > output JSON I can share you back a template that would help you get > started. > > Thanks > Joe > > On Tue, Sep 19, 2017 at 11:29 AM, Charlie

AttributesToJSON

2017-09-19 Thread Charlie Frasure
I have a data flow that takes delimited input using GetFile, extracts some of that into attributes, converts the attributes to a JSON object, reformats the JSON using the Jolt transformer, and then does additional processing before using PutFile to move the original file based on the dataflow

Re: Expression language escape character?

2017-08-15 Thread Charlie Frasure
quotes as text within a function. Andy's suggestion of literal() with a hex or decimal value would probably work, or HTML encoding of the character, then back again, but those options seem just as much of a hack as the replace I was doing. Any more ideas? Best, Charlie On Mon, Aug 14, 2017 at 9

Re: Expression language escape character?

2017-08-14 Thread Charlie Frasure
guage-guide. > html#escapejson > [2] https://nifi.apache.org/docs/nifi-docs/html/expression-language-guide. > html#unescapejson > [3] https://nifi.apache.org/docs/nifi-docs/html/expression-language-guide. > html#literal > > Andy LoPresto > alopre...@apache.org > *alopres

Expression language escape character?

2017-08-14 Thread Charlie Frasure
Hi all, We found that the ConvertJSONToSQL did not give us the control we wanted over the SQL being created from an existing JSON object, so we built our own query using the UpdateAttribute processor. In doing so, we ran into a problem setting the SQL value from the JSON data because of

Re: Re: List Files

2016-03-04 Thread Charlie Frasure
ah you're right that is a viable option now too. And we support > environment variables from the system too. So for things that support > expression language that helps. > > The variable registry obviously will give us a nice step forward. > > Thanks > Joe > > On Fr

Re: Re: List Files

2016-03-04 Thread Charlie Frasure
of files from a > >> rotating directory that gets created every hour. To do that they would > need > >> to use the date functions included in Expression Language. > >> > >> Does forbidding input hinder a specific use-case you have? > >> > >> Jo

List Files

2016-03-04 Thread Charlie Frasure
I'm using the 0.5.1 build and having what I think is odd behavior for ListFile. The processor supports expression language in the Input Directory property, however I can't figure out how to configure an attribute as input. I tried using UpdateAttribute prior to ListFile, but ListFile doesn't

Re: Mirroring nifi lists on gmane

2015-12-14 Thread Charlie Frasure
For whatever my opinion is worth, why not? I would use it. It extends access for those who still utilize real news clients. The web interface isn't slick, but I doubt that's the intent, and it does at least provide a built in search function. On Mon, Dec 14, 2015 at 12:50 PM, Joe Percivall

connector "bends"

2015-12-01 Thread Charlie Frasure
What's the "right way" to add bends in a connector? When I connect two processors, the lines always default to a straight line, and I haven't found a way to adjust them. When I connect a processor to itself first, I get two yellow dots (bends) that allow you to adjust the layout. Then I move

Re: archive files

2015-11-30 Thread Charlie Frasure
le to any of the bins until the timeout occurs and as > a result it will immediately evict the oldest bin. > > Thanks > -Mark > > > > On Nov 30, 2015, at 3:05 PM, Charlie Frasure <charliefras...@gmail.com> > wrote: > > Joe, > > Thanks for checking in. I tried it

Re: queued files

2015-11-24 Thread Charlie Frasure
tputs the encoding to the "encoding" attribute of the original > FlowFile. > > [1] https://github.com/BYVoid/uchardet > > If this doesn't satisfy your needs just let me know! > Joe > > - - - - - - > Joseph Percivall > linkedin.com/in/Percivall > e: joeperciv...@ya

Re: archive files

2015-11-23 Thread Charlie Frasure
ifference sounds very minor but it will help me to understand how > best to respond. > > Thanks > Joe > > On Mon, Nov 23, 2015 at 10:54 AM, Charlie Frasure > <charliefras...@gmail.com> wrote: > > Use case: Archive and compress files by category and month, store like &

queued files

2015-11-19 Thread Charlie Frasure
I have a question on troubleshooting a flow. I've built a flow with no exception routing, just trying to process the expected values first. When a file exposes a problem with the logic in my flow, it queues up prior to the flow that is raising the bulletin. In the bulletin, I can see an id, but

Re: Expression language

2015-11-12 Thread Charlie Frasure
Typos on my regex were just in the email, not the processor. It should have read ${encoding:match... On Thu, Nov 12, 2015 at 6:03 PM, Charlie Frasure <charliefras...@gmail.com> wrote: > This expression does not parse without error: > ${literal('utf-8 utf-16 utf-16be utf-16le us-asci

Expression language

2015-11-12 Thread Charlie Frasure
This expression does not parse without error: ${literal('utf-8 utf-16 utf-16be utf-16le us-ascii iso-8859-1'):contains(encoding)} Is it not possible to use an attribute in a comparison function? Unexpected token 'encoding' at line 1, column 73. Query: ${literal(utf-8 utf-16 utf-16be utf-16le

Re: NiFi for CEP

2015-10-29 Thread Charlie Frasure
Bob, I can relate to your background, and thought process for NiFi. My limited experience with it has highlighted the "simple event processing" portion of the tool. It can replace some of the things that SSIS, Informatica, or AbInitio are used for, but has a much wider and more shallow focus.

Re: ConvertCharacterSet

2015-10-28 Thread Charlie Frasure
@yahoo.com > > > > > On Tuesday, October 27, 2015 5:15 PM, Charlie Frasure < > charliefras...@gmail.com> wrote: > > > > Thank you both for the replies. I built a flow that adds the "fragment" > attributes early on, and splits the feed after the Execut

Re: ConvertCharacterSet

2015-10-27 Thread Charlie Frasure
If anyone doesn't have objections >> I'll put in a ticket later today and knock it out real quick. >> >> >> Joe >> - - - - - - >> Joseph Percivall >> linkedin.com/in/Percivall >> e: joeperciv...@yahoo.com >> >> >> >> >> On