I tried increasing the limit to 200000 following the steps mentioned here for OSX: https://superuser.com/a/1171026
$ launchctl limit cpu unlimited unlimited filesize unlimited unlimited data unlimited unlimited stack 8388608 67104768 core 0 unlimited rss unlimited unlimited memlock unlimited unlimited maxproc 2048 2048 maxfiles 200000 200000 I even tried to reduce the `nifi.flowfile.repository.partitions`, but still keep running into "Too many open files". Would greatly appreciate if there are any other suggestions on how to increase open file limit on Mac OSX (Sierra), thanks! On Fri, May 5, 2017 at 11:07 AM, Andy LoPresto <[email protected]> wrote: > Please follow the configuration best practices [1] to raise the open file > handle limit on your system. > > [1] https://nifi.apache.org/docs/nifi-docs/html/administration-guide.html# > configuration-best-practices > > > Andy LoPresto > [email protected] > *[email protected] <[email protected]>* > PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 > > On May 5, 2017, at 2:00 PM, Buntu Dev <[email protected]> wrote: > > I was able to build from master branch but when starting Nifi on Mac, I > run into "Too many open files" error. > > $ ulimit -n > 2048 > > Any suggestions on how to fix this error? > > ~~~~~ > org.apache.nifi.web.server.JettyServer Failed to start web server... > shutting down. > org.apache.nifi.web.NiFiCoreException: Unable to start Flow Controller. > at org.apache.nifi.web.contextlistener.ApplicationStartupContextListe > ner.contextInitialized(ApplicationStartupContextListener.java:88) > at org.eclipse.jetty.server.handler.ContextHandler.callContextInitialized( > ContextHandler.java:876) > at org.eclipse.jetty.servlet.ServletContextHandler.callContextInitialized( > ServletContextHandler.java:532) > at org.eclipse.jetty.server.handler.ContextHandler. > startContext(ContextHandler.java:839) > at org.eclipse.jetty.servlet.ServletContextHandler.startContext( > ServletContextHandler.java:344) > at org.eclipse.jetty.webapp.WebAppContext.startWebapp( > WebAppContext.java:1480) > at org.eclipse.jetty.webapp.WebAppContext.startContext( > WebAppContext.java:1442) > at org.eclipse.jetty.server.handler.ContextHandler. > doStart(ContextHandler.java:799) > at org.eclipse.jetty.servlet.ServletContextHandler.doStart( > ServletContextHandler.java:261) > at org.eclipse.jetty.webapp.WebAppContext.doStart(WebAppContext.java:540) > at org.eclipse.jetty.util.component.AbstractLifeCycle. > start(AbstractLifeCycle.java:68) > at org.eclipse.jetty.util.component.ContainerLifeCycle. > start(ContainerLifeCycle.java:131) > at org.eclipse.jetty.util.component.ContainerLifeCycle. > doStart(ContainerLifeCycle.java:113) > at org.eclipse.jetty.server.handler.AbstractHandler. > doStart(AbstractHandler.java:113) > at org.eclipse.jetty.util.component.AbstractLifeCycle. > start(AbstractLifeCycle.java:68) > at org.eclipse.jetty.util.component.ContainerLifeCycle. > start(ContainerLifeCycle.java:131) > at org.eclipse.jetty.util.component.ContainerLifeCycle. > doStart(ContainerLifeCycle.java:105) > at org.eclipse.jetty.server.handler.AbstractHandler. > doStart(AbstractHandler.java:113) > at org.eclipse.jetty.server.handler.gzip.GzipHandler. > doStart(GzipHandler.java:290) > at org.eclipse.jetty.util.component.AbstractLifeCycle. > start(AbstractLifeCycle.java:68) > at org.eclipse.jetty.util.component.ContainerLifeCycle. > start(ContainerLifeCycle.java:131) > at org.eclipse.jetty.server.Server.start(Server.java:452) > at org.eclipse.jetty.util.component.ContainerLifeCycle. > doStart(ContainerLifeCycle.java:105) > at org.eclipse.jetty.server.handler.AbstractHandler. > doStart(AbstractHandler.java:113) > at org.eclipse.jetty.server.Server.doStart(Server.java:419) > at org.eclipse.jetty.util.component.AbstractLifeCycle. > start(AbstractLifeCycle.java:68) > at org.apache.nifi.web.server.JettyServer.start(JettyServer.java:695) > at org.apache.nifi.NiFi.<init>(NiFi.java:160) > at org.apache.nifi.NiFi.main(NiFi.java:267) > Caused by: java.io.FileNotFoundException: > ./flowfile_repository/partition-110/1.journal > (Too many open files) > at java.io.FileOutputStream.open0(Native Method) > at java.io.FileOutputStream.open(FileOutputStream.java:270) > at java.io.FileOutputStream.<init>(FileOutputStream.java:213) > at java.io.FileOutputStream.<init>(FileOutputStream.java:162) > at org.wali.MinimalLockingWriteAheadLog$Partition.endRecovery( > MinimalLockingWriteAheadLog.java:1076) > at org.wali.MinimalLockingWriteAheadLog.recoverFromEdits( > MinimalLockingWriteAheadLog.java:487) > at org.wali.MinimalLockingWriteAheadLog.recoverRecords( > MinimalLockingWriteAheadLog.java:301) > at org.apache.nifi.controller.repository.WriteAheadFlowFileRepository. > loadFlowFiles(WriteAheadFlowFileRepository.java:381) > at org.apache.nifi.controller.FlowController.initializeFlow( > FlowController.java:712) > at org.apache.nifi.controller.StandardFlowService.initializeController( > StandardFlowService.java:953) > at org.apache.nifi.controller.StandardFlowService.load( > StandardFlowService.java:534) > at org.apache.nifi.web.contextlistener.ApplicationStartupContextListe > ner.contextInitialized(ApplicationStartupContextListener.java:72) > ... 28 common frames omitted > ~~~~~~ > > Thanks! > > >
