The files arent read into memory anyway. The class space filling up is what to focus on.
On Wed, Jul 22, 2020 at 2:34 AM Mohit Jain <[email protected]> wrote: > Those are the small files not more than 100 MB each. > Nifi is configured to 16g. > > Thanks > > Get Outlook for iOS <https://aka.ms/o0ukef> > ------------------------------ > *From:* Jorge Machado <[email protected]> > *Sent:* Wednesday, July 22, 2020 2:55:26 PM > > *To:* [email protected] <[email protected]> > *Subject:* Re: Urgent: HDFS processors throwing OOM - Compressed class > space exception > > How big are the files that you are trying to store? How much memory did > you configure nifi ? > > > On 22. Jul 2020, at 06:13, Mohit Jain <[email protected]> wrote: > > > > Hi team, > > > > I’ve been facing the issue while using any HDFS processor, e.g. - > PutHDFS throws the error - > > Failed to write to HDFS due to compressed class space: > java.lang.OutOFMemoryError > > > > Eventually the node gets disconnected. > > > > Any help would be appreciated. > > > > Regards, > > Mohit > > <Image.jpeg> > >
