Re: Help with loading a file into a cache

2018-11-30 Thread Matt Burgess
Dave, Depending on the processor you're going to use to store these records into cache (see Mike's reply), if you want to convert each of the lines to JSON objects, you can use ReplaceText: Search Value: ^([^:]+):(.*) Replacement Value: {"$1":$2} Replacement Strategy: Line By Line This creates a

Re: Help with loading a file into a cache

2018-11-30 Thread Mike Thomsen
What level of comfort do you have writing scripts or Java code, and what product will do the storage? On Fri, Nov 30, 2018 at 2:47 PM DAVID SMITH wrote: > Hi > > As requested here is an example file with some redacted data: > > ZA105:{"Aircraft Type":"Sea King", "Lifed Items":{ "port engine > se

Re: Help with loading a file into a cache

2018-11-30 Thread DAVID SMITH
Hi As requested here is an example file with some redacted data: ZA105:{"Aircraft Type":"Sea King", "Lifed Items":{ "port engine ser#":"RR-P1234", "starboard engine ser#":"RR-S1234","gearboxes ser#":[ "WHM1234", "WHI1234", "WHT1234" ] }} ZA106:{"Aircraft Type":"Sea King", "Lifed Items":{ "port

RE: [EXT] Custom UI for Custom Service Controller

2018-11-30 Thread Peter Wicks (pwicks)
I haven't done this before either, but you named your file: META-INF/nifi-controller-service-configuration? -Original Message- From: Ron Aday [mailto:ronaday@outlook.com] Sent: Friday, November 30, 2018 10:12 AM To: dev@nifi.apache.org Subject: [EXT] Custom UI for Custom Service Cont

Custom UI for Custom Service Controller

2018-11-30 Thread Ron Aday
Good day to all! I have built many custom processors with custom ui's with success, but I can't seem to get it to work with a custom controller. By that I mean the "Advanced" button never shows up on the controller no matter what I do (so far). Is there any relevant information available pertain

Re: Help with loading a file into a cache

2018-11-30 Thread Mike Thomsen
Dave, Can you post a redacted example with dummy data? Thanks, Mike On Fri, Nov 30, 2018 at 7:08 AM DAVID SMITH wrote: > Hi Devs > I am running a NiFi 1.8 cluster, each node has 128Gb of Ram. I need to > load the contents of a file of which is around 5Gb in size into a > Key/Value cache. > T

Persitant workflow file with NiFi and Docker[ra]

2018-11-30 Thread Doug McDonald
Hi all, I recently had an issue with how to use docker and NiFi to persist workflows which I posted on stackoverflow. https://stackoverflow.com/questions/50486952/start-nifi-docker-with-custom-nar-and-workflow I was recommended to post an article I wrote documenting the process in case it woul

Help with loading a file into a cache

2018-11-30 Thread DAVID SMITH
Hi Devs I am running a NiFi 1.8 cluster, each node has 128Gb of Ram. I need to load the contents of a file of which is around 5Gb in size  into a Key/Value cache. The file I want to load is produced by another company so the format it comes in is not negotiable. The file contains thousands of lin