Livy garbage collects jobs. These setting in conf/livy.com are available to control how Livy garbage collects sessions. livy.server.session.timeout-check ivy.server.session.timeout livy.server.session.state-retain.sec
In our clusters, we have seen sometimes batch jobs fail to start and remain in the starting state forever. With the current logic for garbage collection in Livy, such jobs are never garbage collected. We modified the garbage collection logic so that all jobs are eventually garbage collected unless they are in running state. Thanks, Meisam On Tue, Jul 25, 2017 at 11:00 AM Marcelo Vanzin <[email protected]> wrote: > On Tue, Jul 25, 2017 at 8:35 AM, Joaquín Silva <[email protected]> > wrote: > > 17/07/25 14:21:46 ERROR yarn.ApplicationMaster: User class threw > exception: > > java.lang.OutOfMemoryError: PermGen space > > > > So in order to solve this issue I increased the executor and driver > memory: > > "driverMemory":"15g","executorMemory":"15g". But I still seen this error. > > That error won't be fixed by adding more memory; you need to set > "XX:MaxPermSize=blah" to fix it, or use Java 8. > > Still it shouldn't cause the app to just hang, it should eventually > fail. So perhaps there's a bug in Livy's error handling path > somewhere. > > -- > Marcelo >
