RE: Content repository filling up

2017-04-25 Thread Olav Jordens
s" property but it looks like that was lost in a refactoring that happened. My apologies for that. Thanks for bringing this to our attention! Thanks -Mark [1] https://issues.apache.org/jira/browse/NIFI-3736 On Apr 24, 2017, at 11:19 PM, Olav Jordens <olav.jord...@2degreesmobile.co.

RE: FW: Content repository filling up

2017-04-24 Thread Olav Jordens
n/nifi.sh dump' Thanks JOe On Mon, Apr 24, 2017 at 10:10 PM, Olav Jordens <olav.jord...@2degreesmobile.co.nz<mailto:olav.jord...@2degreesmobile.co.nz>> wrote: Hi Joe, Thanks so much for your quick response. My content repository has about 400GB storage, and large files are about

RE: FW: Content repository filling up

2017-04-24 Thread Olav Jordens
find after a nifi restart that a bunch of files get deleted out of the content repository? To generate a thread dump run 'bin/nifi.sh dump' Thanks JOe On Mon, Apr 24, 2017 at 10:10 PM, Olav Jordens <olav.jord...@2degreesmobile.co.nz<mailto:olav.jord...@2degreesmobile.co.nz>> w

RE: FW: Content repository filling up

2017-04-24 Thread Olav Jordens
large is a large file? How many transformation steps exist in your flow from receipt through delivery of that large file? Thanks Joe On Mon, Apr 24, 2017 at 9:31 PM, Olav Jordens <olav.jord...@2degreesmobile.co.nz<mailto:olav.jord...@2degreesmobile.co.nz>> wrote: Apologies – forgo

Content repository filling up

2017-04-24 Thread Olav Jordens
looking at this incorrectly? Thanks, Olav [cid:image83e411.JPG@dd1fc3aa.45a6ac81] Olav Jordens Senior ETL Developer +64 226 202 429 +64 9 919 7000 2degreesmobile.co.nz<http://www.2degreesmobile.co.nz> Two Degrees Mobile Limited | 47-49 George Street | Newmarket | Auckland | New Zealand

RE: Hanging on SplitJSON

2016-11-29 Thread Olav Jordens
. Olav Jordens Senior ETL Developer Two Degrees Mobile Limited === (M) 022 620 2429 (P) 09 919 7000 www.2degreesmobile.co.nz<http://www.2degreesmobile.co.nz> [cid:imagedb0c5d.JPG@7eab90ed.4daebdae] Two Degrees Mobile Limited | 47-49 George Street | Newmarket | Auckland

RE: Hanging on SplitJSON

2016-11-29 Thread Olav Jordens
definitely do better. Thanks Joe On Tue, Nov 29, 2016 at 8:09 PM, Olav Jordens <olav.jord...@2degreesmobile.co.nz<mailto:olav.jord...@2degreesmobile.co.nz>> wrote: Hi, My bad – the problem appears to be that the 36MB JSON file would be split into > 400 000 individual records

error with flow.xml.gz

2016-11-29 Thread Olav Jordens
processors to be in the ‘stopped’ state? The problem is definitely with the workflow as I have managed to start nifi with no problems using the initial blank flow.xml.gz. Any advice? Thanks, Olav Olav Jordens Senior ETL Developer Two Degrees Mobile Limited === (M) 022

RE: PutHiveStreaming has only one concurrent task

2016-11-07 Thread Olav Jordens
that for any processor which does not offer controls on the number of concurrent tasks then it means that processor is meant to run serially by design. Thanks Joe On Sun, Nov 6, 2016 at 7:06 PM, Olav Jordens <olav.jord...@2degreesmobile.co.nz<mailto:olav.jord...@2degreesmobile.co.nz>

PutHiveStreaming has only one concurrent task

2016-11-06 Thread Olav Jordens
a DistributeLoad processor followed by a sequence of PutHiveStreaming processors, which would all be streaming into the same Hive table? Thanks, Olav Olav Jordens Senior ETL Developer Two Degrees Mobile Limited === (M) 022 620 2429 (P) 09 919 7000 www.2degreesmobile.co.nz<http://