Mattie, How large is the Java heap? This value is in the conf/bootstrap.conf file. You'll typically see something like:
java.arg.3=-Xmx512m Do you have any custom processors running in your flow, or are you using only Apache NiFi provided processors? Thanks -Mark ________________________________ > From: [email protected] > To: [email protected] > Subject: Re: GitHTTP out of memory error > Date: Fri, 4 Sep 2015 14:57:49 +0000 > > Hi, > > I am 8 GetHTTP processors which run nightly, however 5 hours after > these run some threads out of memory: > > > ERROR [Timer-Driven Process Thread-23] > o.a.nifi.processors.standard.GetHTTP > GetHTTP[id=021562be-b123-4b3f-b5ed-2b8c47af6d4c] > GetHTTP[id=021562be-b123-4b3f-b5ed-2b8c47af6d4c] failed to process > session due to java.lang.OutOfMemoryError: Java heap space: > java.lang.OutOfMemoryError: Java heap space > > 2015-09-03 07:10:41,167 ERROR [Timer-Driven Process Thread-11] > o.a.nifi.processors.standard.GetHTTP > GetHTTP[id=0a5158d2-f082-4007-b646-3da8fb436fd0] > GetHTTP[id=0a5158d2-f082-4007-b646-3da8fb436fd0] failed to process > session due to java.lang.OutOfMemoryError: Java heap space: > java.lang.OutOfMemoryError: Java heap space > > 2015-09-03 07:10:41,168 WARN [Timer-Driven Process Thread-23] > o.a.n.c.t.ContinuallyRunProcessorTask Administratively Yielding > GetHTTP[id=021562be-b123-4b3f-b5ed-2b8c47af6d4c] due to uncaught > Exception: java.lang.OutOfMemoryError: Java heap space > > 2015-09-03 07:10:41,168 WARN [Timer-Driven Process Thread-11] > o.a.n.c.t.ContinuallyRunProcessorTask Administratively Yielding > GetHTTP[id=0a5158d2-f082-4007-b646-3da8fb436fd0] due to uncaught > Exception: java.lang.OutOfMemoryError: Java heap space > > I am running on Amazon Linux and have tuned the server as described in > the admin page. > > Thanks! > > Mattie Whitmore > Lead Technologist > > Booz | Allen | Hamilton > ________________________ > >
