Re: [Neo4j] Server couldn't start after java.lang.OutOfMemoryError

[Adriano Henrique de Almeida]

Hey Nuo,

Good it worked, and yes, enlarging the permgen size was just a palliative
action. In fact, I forgot to check which version you were running (shame on
me).

But as I said, good to know that now it works smoothly.

Cheers

Adriano Almeida
@adrianoalmeida7 

2011/9/7 Peter Neubauer 

> Nice,
> glad to see it worked out!
>
> Cheers,
>
> /peter neubauer
>
> GTalk:  neubauer.peter
> Skype   peter.neubauer
> Phone   +46 704 106975
> LinkedIn   http://www.linkedin.com/in/neubauer
> Twitter  http://twitter.com/peterneubauer
>
> http://www.neo4j.org   - Your high performance graph database.
> http://startupbootcamp.org/- Öresund - Innovation happens HERE.
> http://www.thoughtmade.com - Scandinavia's coolest Bring-a-Thing party.
>
>
> On Wed, Sep 7, 2011 at 8:12 PM, Nuo Yan  wrote:
>
> >
> > According to this: http://neo4j.org/forums/#nabble-td3248377, I upgraded
> > to 1.4.1 and the problem goes away.
> >
> > I guess there must be a bug in the 1.4.0 REST API that leaks classloader
> > memory or so, and GC didn't happen as expected in PermGen. Anyways, it
> looks
> > great after upgrading to 1.4.1. Memory monitoring graph shows GC happens
> as
> > desired in PermGen.
> >
> > Thank you!
> >
> > On Sep 6, 2011, at 11:30 PM, Nuo Yan wrote:
> >
> > > Hey Adriano and everyone,
> > >
> > > I finally got a chance to monitor/profile the neo4j process with
> VisualVM
> > when I run my set of tests.
> > >
> > > It seems that after running the set of tests once, ~ 50M of PermGen was
> > used. However, subsequent test runs simply multiples that, which worries
> me
> > a little. After the fourth run of the tests, ~ 200M of PermGen space was
> > used.
> > >
> > > My app accesses to neo4j completely using the REST interface. During
> the
> > test run, new nodes and relationships are  being frequently created.
> There
> > are batch requests that performs multiple actions at once (number of
> actions
> > is reasonable, really small in this case, usually a few, or tenth). There
> > are also gremlin script executions through REST (send the gremlin query
> over
> > to the server through REST API). Most of the gremlin queries are
> traversals
> > and returns the vertices or edges match the constraints.
> > >
> > > Total number of nodes created during a test run is only hundreds. There
> > are more relationships, but at most thousands.
> > >
> > > That's basically all of the things that are done against neo4j server
> > during a test run. Given this, do you think the PermGen usage is
> reasonable?
> > Or do you think something is very wrong? I worried that setting a larger
> > PermGen would only postpone but not resolve the OutOfMemory problem.
> > >
> > > Let me know if any other info is needed.
> > >
> > > Thanks much,
> > > Nuo
> > >
> > >
> > >
> > >
> > > On Aug 29, 2011, at 6:09 AM, Adriano Henrique de Almeida wrote:
> > >
> > >> Hi Nuo, any results here?
> > >>
> > >> Cheers
> > >>
> > >> 2011/8/26 Nuo Yan 
> > >>
> > >>> Hey Adriano,
> > >>>
> > >>> Thanks very much for your reply. I will try with MaxPermSize.
> > >>>
> > >>> It's on my local machine, we are evaluating Neo4j and do not have it
> on
> > >>> production yet. I'm accessing the server through the REST APIs, the
> app
> > is
> > >>> separate from Neo. I will see if I can do some profiling on Neo when
> I
> > run
> > >>> my tests.
> > >>>
> > >>> Thanks,
> > >>> Nuo
> > >>>
> > >>>
> > >>>
> > >>> On Fri, Aug 26, 2011 at 3:53 PM, Adriano Henrique de Almeida <
> > >>> adrianoalmei...@gmail.com> wrote:
> > >>>
> >  Hey Nuo,
> > 
> >  wrapper.java.maxmemory and Xmx won't help, since it is a
> PermGenSpace
> >  problem, and they only deal with HeapSpace. Did you try with:
> >  -XX:*MaxPermSize
> >  **?*
> > 
> >  Anyway, something very wrong is happening, since you have few nodes.
> > 
> >  It is happening only on production, or development also? If it is
> > >>> happening
> >  on development, try to isolate the situation where you're stucking
> the
> >  permgen. Run you app with VisualVM, for instance, or any other
> > profiler.
> >  Aren't you dealing with classloaders on your app?
> > 
> >  Cheers
> > 
> >  Adriano Almeida
> > 
> > 
> > 
> >  2011/8/26 Jim Webber 
> > 
> > > Hi Nuo,
> > >
> > > if you're using Neo4j server then you can edit the value in
> > > conf/neo-wrapper.conf
> > >
> > > wrapper.java.maxmemory=1024
> > >
> > > Jim
> > > ___
> > > Neo4j mailing list
> > > User@lists.neo4j.org
> > > https://lists.neo4j.org/mailman/listinfo/user
> > >
> > 
> > 
> > 
> >  --
> >  Adriano Almeida
> >  Caelum | Ensino e Inovação
> >  www.caelum.com.br
> >  ___
> >  Neo4j mailing list
> >  User@lists.neo4j.org
> >  https://lists.n

Re: [Neo4j] Server couldn't start after java.lang.OutOfMemoryError

[Peter Neubauer]

Nice,
glad to see it worked out!

Cheers,

/peter neubauer

GTalk:  neubauer.peter
Skype   peter.neubauer
Phone   +46 704 106975
LinkedIn   http://www.linkedin.com/in/neubauer
Twitter  http://twitter.com/peterneubauer

http://www.neo4j.org   - Your high performance graph database.
http://startupbootcamp.org/- Öresund - Innovation happens HERE.
http://www.thoughtmade.com - Scandinavia's coolest Bring-a-Thing party.


On Wed, Sep 7, 2011 at 8:12 PM, Nuo Yan  wrote:

>
> According to this: http://neo4j.org/forums/#nabble-td3248377, I upgraded
> to 1.4.1 and the problem goes away.
>
> I guess there must be a bug in the 1.4.0 REST API that leaks classloader
> memory or so, and GC didn't happen as expected in PermGen. Anyways, it looks
> great after upgrading to 1.4.1. Memory monitoring graph shows GC happens as
> desired in PermGen.
>
> Thank you!
>
> On Sep 6, 2011, at 11:30 PM, Nuo Yan wrote:
>
> > Hey Adriano and everyone,
> >
> > I finally got a chance to monitor/profile the neo4j process with VisualVM
> when I run my set of tests.
> >
> > It seems that after running the set of tests once, ~ 50M of PermGen was
> used. However, subsequent test runs simply multiples that, which worries me
> a little. After the fourth run of the tests, ~ 200M of PermGen space was
> used.
> >
> > My app accesses to neo4j completely using the REST interface. During the
> test run, new nodes and relationships are  being frequently created. There
> are batch requests that performs multiple actions at once (number of actions
> is reasonable, really small in this case, usually a few, or tenth). There
> are also gremlin script executions through REST (send the gremlin query over
> to the server through REST API). Most of the gremlin queries are traversals
> and returns the vertices or edges match the constraints.
> >
> > Total number of nodes created during a test run is only hundreds. There
> are more relationships, but at most thousands.
> >
> > That's basically all of the things that are done against neo4j server
> during a test run. Given this, do you think the PermGen usage is reasonable?
> Or do you think something is very wrong? I worried that setting a larger
> PermGen would only postpone but not resolve the OutOfMemory problem.
> >
> > Let me know if any other info is needed.
> >
> > Thanks much,
> > Nuo
> >
> >
> >
> >
> > On Aug 29, 2011, at 6:09 AM, Adriano Henrique de Almeida wrote:
> >
> >> Hi Nuo, any results here?
> >>
> >> Cheers
> >>
> >> 2011/8/26 Nuo Yan 
> >>
> >>> Hey Adriano,
> >>>
> >>> Thanks very much for your reply. I will try with MaxPermSize.
> >>>
> >>> It's on my local machine, we are evaluating Neo4j and do not have it on
> >>> production yet. I'm accessing the server through the REST APIs, the app
> is
> >>> separate from Neo. I will see if I can do some profiling on Neo when I
> run
> >>> my tests.
> >>>
> >>> Thanks,
> >>> Nuo
> >>>
> >>>
> >>>
> >>> On Fri, Aug 26, 2011 at 3:53 PM, Adriano Henrique de Almeida <
> >>> adrianoalmei...@gmail.com> wrote:
> >>>
>  Hey Nuo,
> 
>  wrapper.java.maxmemory and Xmx won't help, since it is a PermGenSpace
>  problem, and they only deal with HeapSpace. Did you try with:
>  -XX:*MaxPermSize
>  **?*
> 
>  Anyway, something very wrong is happening, since you have few nodes.
> 
>  It is happening only on production, or development also? If it is
> >>> happening
>  on development, try to isolate the situation where you're stucking the
>  permgen. Run you app with VisualVM, for instance, or any other
> profiler.
>  Aren't you dealing with classloaders on your app?
> 
>  Cheers
> 
>  Adriano Almeida
> 
> 
> 
>  2011/8/26 Jim Webber 
> 
> > Hi Nuo,
> >
> > if you're using Neo4j server then you can edit the value in
> > conf/neo-wrapper.conf
> >
> > wrapper.java.maxmemory=1024
> >
> > Jim
> > ___
> > Neo4j mailing list
> > User@lists.neo4j.org
> > https://lists.neo4j.org/mailman/listinfo/user
> >
> 
> 
> 
>  --
>  Adriano Almeida
>  Caelum | Ensino e Inovação
>  www.caelum.com.br
>  ___
>  Neo4j mailing list
>  User@lists.neo4j.org
>  https://lists.neo4j.org/mailman/listinfo/user
> 
> >>> ___
> >>> Neo4j mailing list
> >>> User@lists.neo4j.org
> >>> https://lists.neo4j.org/mailman/listinfo/user
> >>>
> >>
> >>
> >>
> >> --
> >> Adriano Almeida
> >> Caelum | Ensino e Inovação
> >> www.caelum.com.br
> >> ___
> >> Neo4j mailing list
> >> User@lists.neo4j.org
> >> https://lists.neo4j.org/mailman/listinfo/user
> >
>
> ___
> Neo4j mailing list
> User@lists.neo4j.org
> https://lists.neo4j.org/mailman/listinfo/user
>
__

Re: [Neo4j] Server couldn't start after java.lang.OutOfMemoryError

[Nuo Yan]

According to this: http://neo4j.org/forums/#nabble-td3248377, I upgraded to 
1.4.1 and the problem goes away.

I guess there must be a bug in the 1.4.0 REST API that leaks classloader memory 
or so, and GC didn't happen as expected in PermGen. Anyways, it looks great 
after upgrading to 1.4.1. Memory monitoring graph shows GC happens as desired 
in PermGen.

Thank you!

On Sep 6, 2011, at 11:30 PM, Nuo Yan wrote:

> Hey Adriano and everyone,
> 
> I finally got a chance to monitor/profile the neo4j process with VisualVM 
> when I run my set of tests.
> 
> It seems that after running the set of tests once, ~ 50M of PermGen was used. 
> However, subsequent test runs simply multiples that, which worries me a 
> little. After the fourth run of the tests, ~ 200M of PermGen space was used.
> 
> My app accesses to neo4j completely using the REST interface. During the test 
> run, new nodes and relationships are  being frequently created. There are 
> batch requests that performs multiple actions at once (number of actions is 
> reasonable, really small in this case, usually a few, or tenth). There are 
> also gremlin script executions through REST (send the gremlin query over to 
> the server through REST API). Most of the gremlin queries are traversals and 
> returns the vertices or edges match the constraints.
> 
> Total number of nodes created during a test run is only hundreds. There are 
> more relationships, but at most thousands.
> 
> That's basically all of the things that are done against neo4j server during 
> a test run. Given this, do you think the PermGen usage is reasonable? Or do 
> you think something is very wrong? I worried that setting a larger PermGen 
> would only postpone but not resolve the OutOfMemory problem. 
> 
> Let me know if any other info is needed.
> 
> Thanks much,
> Nuo
> 
> 
> 
> 
> On Aug 29, 2011, at 6:09 AM, Adriano Henrique de Almeida wrote:
> 
>> Hi Nuo, any results here?
>> 
>> Cheers
>> 
>> 2011/8/26 Nuo Yan 
>> 
>>> Hey Adriano,
>>> 
>>> Thanks very much for your reply. I will try with MaxPermSize.
>>> 
>>> It's on my local machine, we are evaluating Neo4j and do not have it on
>>> production yet. I'm accessing the server through the REST APIs, the app is
>>> separate from Neo. I will see if I can do some profiling on Neo when I run
>>> my tests.
>>> 
>>> Thanks,
>>> Nuo
>>> 
>>> 
>>> 
>>> On Fri, Aug 26, 2011 at 3:53 PM, Adriano Henrique de Almeida <
>>> adrianoalmei...@gmail.com> wrote:
>>> 
 Hey Nuo,
 
 wrapper.java.maxmemory and Xmx won't help, since it is a PermGenSpace
 problem, and they only deal with HeapSpace. Did you try with:
 -XX:*MaxPermSize
 **?*
 
 Anyway, something very wrong is happening, since you have few nodes.
 
 It is happening only on production, or development also? If it is
>>> happening
 on development, try to isolate the situation where you're stucking the
 permgen. Run you app with VisualVM, for instance, or any other profiler.
 Aren't you dealing with classloaders on your app?
 
 Cheers
 
 Adriano Almeida
 
 
 
 2011/8/26 Jim Webber 
 
> Hi Nuo,
> 
> if you're using Neo4j server then you can edit the value in
> conf/neo-wrapper.conf
> 
> wrapper.java.maxmemory=1024
> 
> Jim
> ___
> Neo4j mailing list
> User@lists.neo4j.org
> https://lists.neo4j.org/mailman/listinfo/user
> 
 
 
 
 --
 Adriano Almeida
 Caelum | Ensino e Inovação
 www.caelum.com.br
 ___
 Neo4j mailing list
 User@lists.neo4j.org
 https://lists.neo4j.org/mailman/listinfo/user
 
>>> ___
>>> Neo4j mailing list
>>> User@lists.neo4j.org
>>> https://lists.neo4j.org/mailman/listinfo/user
>>> 
>> 
>> 
>> 
>> -- 
>> Adriano Almeida
>> Caelum | Ensino e Inovação
>> www.caelum.com.br
>> ___
>> Neo4j mailing list
>> User@lists.neo4j.org
>> https://lists.neo4j.org/mailman/listinfo/user
> 

___
Neo4j mailing list
User@lists.neo4j.org
https://lists.neo4j.org/mailman/listinfo/user

Re: [Neo4j] Server couldn't start after java.lang.OutOfMemoryError

[Nuo Yan]

Hey Adriano and everyone,

I finally got a chance to monitor/profile the neo4j process with VisualVM when 
I run my set of tests.

It seems that after running the set of tests once, ~ 50M of PermGen was used. 
However, subsequent test runs simply multiples that, which worries me a little. 
After the fourth run of the tests, ~ 200M of PermGen space was used.

My app accesses to neo4j completely using the REST interface. During the test 
run, new nodes and relationships are  being frequently created. There are batch 
requests that performs multiple actions at once (number of actions is 
reasonable, really small in this case, usually a few, or tenth). There are also 
gremlin script executions through REST (send the gremlin query over to the 
server through REST API). Most of the gremlin queries are traversals and 
returns the vertices or edges match the constraints.

Total number of nodes created during a test run is only hundreds. There are 
more relationships, but at most thousands.

That's basically all of the things that are done against neo4j server during a 
test run. Given this, do you think the PermGen usage is reasonable? Or do you 
think something is very wrong? I worried that setting a larger PermGen would 
only postpone but not resolve the OutOfMemory problem. 

Let me know if any other info is needed.

Thanks much,
Nuo




On Aug 29, 2011, at 6:09 AM, Adriano Henrique de Almeida wrote:

> Hi Nuo, any results here?
> 
> Cheers
> 
> 2011/8/26 Nuo Yan 
> 
>> Hey Adriano,
>> 
>> Thanks very much for your reply. I will try with MaxPermSize.
>> 
>> It's on my local machine, we are evaluating Neo4j and do not have it on
>> production yet. I'm accessing the server through the REST APIs, the app is
>> separate from Neo. I will see if I can do some profiling on Neo when I run
>> my tests.
>> 
>> Thanks,
>> Nuo
>> 
>> 
>> 
>> On Fri, Aug 26, 2011 at 3:53 PM, Adriano Henrique de Almeida <
>> adrianoalmei...@gmail.com> wrote:
>> 
>>> Hey Nuo,
>>> 
>>> wrapper.java.maxmemory and Xmx won't help, since it is a PermGenSpace
>>> problem, and they only deal with HeapSpace. Did you try with:
>>> -XX:*MaxPermSize
>>> **?*
>>> 
>>> Anyway, something very wrong is happening, since you have few nodes.
>>> 
>>> It is happening only on production, or development also? If it is
>> happening
>>> on development, try to isolate the situation where you're stucking the
>>> permgen. Run you app with VisualVM, for instance, or any other profiler.
>>> Aren't you dealing with classloaders on your app?
>>> 
>>> Cheers
>>> 
>>> Adriano Almeida
>>> 
>>> 
>>> 
>>> 2011/8/26 Jim Webber 
>>> 
 Hi Nuo,
 
 if you're using Neo4j server then you can edit the value in
 conf/neo-wrapper.conf
 
 wrapper.java.maxmemory=1024
 
 Jim
 ___
 Neo4j mailing list
 User@lists.neo4j.org
 https://lists.neo4j.org/mailman/listinfo/user
 
>>> 
>>> 
>>> 
>>> --
>>> Adriano Almeida
>>> Caelum | Ensino e Inovação
>>> www.caelum.com.br
>>> ___
>>> Neo4j mailing list
>>> User@lists.neo4j.org
>>> https://lists.neo4j.org/mailman/listinfo/user
>>> 
>> ___
>> Neo4j mailing list
>> User@lists.neo4j.org
>> https://lists.neo4j.org/mailman/listinfo/user
>> 
> 
> 
> 
> -- 
> Adriano Almeida
> Caelum | Ensino e Inovação
> www.caelum.com.br
> ___
> Neo4j mailing list
> User@lists.neo4j.org
> https://lists.neo4j.org/mailman/listinfo/user

___
Neo4j mailing list
User@lists.neo4j.org
https://lists.neo4j.org/mailman/listinfo/user

Re: [Neo4j] Server couldn't start after java.lang.OutOfMemoryError

[Nuo Yan]

Hey Adriano,

Thanks so much for following up. I haven't had chance to profile the neo4j
server yet due to other tasks on hand and meetings. I will find some time to
do it this week and let you know.

I did set -XX:MaxPermSize to 1024M though, and haven't got OutOfMemory yet
after it.

Thanks,
Nuo

On Mon, Aug 29, 2011 at 6:09 AM, Adriano Henrique de Almeida <
adrianoalmei...@gmail.com> wrote:

> Hi Nuo, any results here?
>
> Cheers
>
> 2011/8/26 Nuo Yan 
>
> > Hey Adriano,
> >
> > Thanks very much for your reply. I will try with MaxPermSize.
> >
> > It's on my local machine, we are evaluating Neo4j and do not have it on
> > production yet. I'm accessing the server through the REST APIs, the app
> is
> > separate from Neo. I will see if I can do some profiling on Neo when I
> run
> > my tests.
> >
> > Thanks,
> > Nuo
> >
> >
> >
> > On Fri, Aug 26, 2011 at 3:53 PM, Adriano Henrique de Almeida <
> > adrianoalmei...@gmail.com> wrote:
> >
> > > Hey Nuo,
> > >
> > > wrapper.java.maxmemory and Xmx won't help, since it is a PermGenSpace
> > > problem, and they only deal with HeapSpace. Did you try with:
> > > -XX:*MaxPermSize
> > > **?*
> > >
> > > Anyway, something very wrong is happening, since you have few nodes.
> > >
> > > It is happening only on production, or development also? If it is
> > happening
> > > on development, try to isolate the situation where you're stucking the
> > > permgen. Run you app with VisualVM, for instance, or any other
> profiler.
> > > Aren't you dealing with classloaders on your app?
> > >
> > > Cheers
> > >
> > > Adriano Almeida
> > >
> > >
> > >
> > > 2011/8/26 Jim Webber 
> > >
> > > > Hi Nuo,
> > > >
> > > > if you're using Neo4j server then you can edit the value in
> > > > conf/neo-wrapper.conf
> > > >
> > > > wrapper.java.maxmemory=1024
> > > >
> > > > Jim
> > > > ___
> > > > Neo4j mailing list
> > > > User@lists.neo4j.org
> > > > https://lists.neo4j.org/mailman/listinfo/user
> > > >
> > >
> > >
> > >
> > > --
> > > Adriano Almeida
> > > Caelum | Ensino e Inovação
> > > www.caelum.com.br
> > > ___
> > > Neo4j mailing list
> > > User@lists.neo4j.org
> > > https://lists.neo4j.org/mailman/listinfo/user
> > >
> > ___
> > Neo4j mailing list
> > User@lists.neo4j.org
> > https://lists.neo4j.org/mailman/listinfo/user
> >
>
>
>
> --
> Adriano Almeida
> Caelum | Ensino e Inovação
> www.caelum.com.br
> ___
> Neo4j mailing list
> User@lists.neo4j.org
> https://lists.neo4j.org/mailman/listinfo/user
>
___
Neo4j mailing list
User@lists.neo4j.org
https://lists.neo4j.org/mailman/listinfo/user

Re: [Neo4j] Server couldn't start after java.lang.OutOfMemoryError

[Adriano Henrique de Almeida]

Hi Nuo, any results here?

Cheers

2011/8/26 Nuo Yan 

> Hey Adriano,
>
> Thanks very much for your reply. I will try with MaxPermSize.
>
> It's on my local machine, we are evaluating Neo4j and do not have it on
> production yet. I'm accessing the server through the REST APIs, the app is
> separate from Neo. I will see if I can do some profiling on Neo when I run
> my tests.
>
> Thanks,
> Nuo
>
>
>
> On Fri, Aug 26, 2011 at 3:53 PM, Adriano Henrique de Almeida <
> adrianoalmei...@gmail.com> wrote:
>
> > Hey Nuo,
> >
> > wrapper.java.maxmemory and Xmx won't help, since it is a PermGenSpace
> > problem, and they only deal with HeapSpace. Did you try with:
> > -XX:*MaxPermSize
> > **?*
> >
> > Anyway, something very wrong is happening, since you have few nodes.
> >
> > It is happening only on production, or development also? If it is
> happening
> > on development, try to isolate the situation where you're stucking the
> > permgen. Run you app with VisualVM, for instance, or any other profiler.
> > Aren't you dealing with classloaders on your app?
> >
> > Cheers
> >
> > Adriano Almeida
> >
> >
> >
> > 2011/8/26 Jim Webber 
> >
> > > Hi Nuo,
> > >
> > > if you're using Neo4j server then you can edit the value in
> > > conf/neo-wrapper.conf
> > >
> > > wrapper.java.maxmemory=1024
> > >
> > > Jim
> > > ___
> > > Neo4j mailing list
> > > User@lists.neo4j.org
> > > https://lists.neo4j.org/mailman/listinfo/user
> > >
> >
> >
> >
> > --
> > Adriano Almeida
> > Caelum | Ensino e Inovação
> > www.caelum.com.br
> > ___
> > Neo4j mailing list
> > User@lists.neo4j.org
> > https://lists.neo4j.org/mailman/listinfo/user
> >
> ___
> Neo4j mailing list
> User@lists.neo4j.org
> https://lists.neo4j.org/mailman/listinfo/user
>



-- 
Adriano Almeida
Caelum | Ensino e Inovação
www.caelum.com.br
___
Neo4j mailing list
User@lists.neo4j.org
https://lists.neo4j.org/mailman/listinfo/user

Re: [Neo4j] Server couldn't start after java.lang.OutOfMemoryError

[Nuo Yan]

Hey Adriano,

Thanks very much for your reply. I will try with MaxPermSize.

It's on my local machine, we are evaluating Neo4j and do not have it on
production yet. I'm accessing the server through the REST APIs, the app is
separate from Neo. I will see if I can do some profiling on Neo when I run
my tests.

Thanks,
Nuo



On Fri, Aug 26, 2011 at 3:53 PM, Adriano Henrique de Almeida <
adrianoalmei...@gmail.com> wrote:

> Hey Nuo,
>
> wrapper.java.maxmemory and Xmx won't help, since it is a PermGenSpace
> problem, and they only deal with HeapSpace. Did you try with:
> -XX:*MaxPermSize
> **?*
>
> Anyway, something very wrong is happening, since you have few nodes.
>
> It is happening only on production, or development also? If it is happening
> on development, try to isolate the situation where you're stucking the
> permgen. Run you app with VisualVM, for instance, or any other profiler.
> Aren't you dealing with classloaders on your app?
>
> Cheers
>
> Adriano Almeida
>
>
>
> 2011/8/26 Jim Webber 
>
> > Hi Nuo,
> >
> > if you're using Neo4j server then you can edit the value in
> > conf/neo-wrapper.conf
> >
> > wrapper.java.maxmemory=1024
> >
> > Jim
> > ___
> > Neo4j mailing list
> > User@lists.neo4j.org
> > https://lists.neo4j.org/mailman/listinfo/user
> >
>
>
>
> --
> Adriano Almeida
> Caelum | Ensino e Inovação
> www.caelum.com.br
> ___
> Neo4j mailing list
> User@lists.neo4j.org
> https://lists.neo4j.org/mailman/listinfo/user
>
___
Neo4j mailing list
User@lists.neo4j.org
https://lists.neo4j.org/mailman/listinfo/user

Re: [Neo4j] Server couldn't start after java.lang.OutOfMemoryError

[Adriano Henrique de Almeida]

Hey Nuo,

wrapper.java.maxmemory and Xmx won't help, since it is a PermGenSpace
problem, and they only deal with HeapSpace. Did you try with: -XX:*MaxPermSize
**?*

Anyway, something very wrong is happening, since you have few nodes.

It is happening only on production, or development also? If it is happening
on development, try to isolate the situation where you're stucking the
permgen. Run you app with VisualVM, for instance, or any other profiler.
Aren't you dealing with classloaders on your app?

Cheers

Adriano Almeida



2011/8/26 Jim Webber 

> Hi Nuo,
>
> if you're using Neo4j server then you can edit the value in
> conf/neo-wrapper.conf
>
> wrapper.java.maxmemory=1024
>
> Jim
> ___
> Neo4j mailing list
> User@lists.neo4j.org
> https://lists.neo4j.org/mailman/listinfo/user
>



-- 
Adriano Almeida
Caelum | Ensino e Inovação
www.caelum.com.br
___
Neo4j mailing list
User@lists.neo4j.org
https://lists.neo4j.org/mailman/listinfo/user

Re: [Neo4j] Server couldn't start after java.lang.OutOfMemoryError

[Jim Webber]

Hi Nuo,

if you're using Neo4j server then you can edit the value in 
conf/neo-wrapper.conf 

wrapper.java.maxmemory=1024

Jim
___
Neo4j mailing list
User@lists.neo4j.org
https://lists.neo4j.org/mailman/listinfo/user

Re: [Neo4j] Server couldn't start after java.lang.OutOfMemoryError

[Nuo Yan]

I later changed -Xmx to 1024m in the neo4j start script (./bin/neo4j line
109):

JAVA_OPTS="-server ${wrapper_java_additional} -Xmx1024m"

I only have a few thousands nodes so I thought 1G should be enough (when my
tests run, new nodes are being created frequently, but total number of nodes
is certainly below 10k when it went out of memory).

Increasing memory this way didn't help. Did I do it right?


On Fri, Aug 26, 2011 at 2:18 AM, Mattias Persson
wrote:

> Tried with more memory?
>
> 2011/8/26 Nuo Yan 
>
> > Hey Jim,
> >
> > It happened again and I'm pretty sure there was no other server process
> > running.
> >
> > Also this time when it crashed I saw this line in the console log (not
> > seeing this previously):
> >
> >  Could not load hsdis-.jnilib; library not loadable; PrintAssembly is
> > disabled
> >
> > When I tried to restart, data/graph.db/message.log shows a lot of lines
> > like
> > the following and fail with the error message in my last email:
> >
> > Thu Aug 25 15:18:15 PDT 2011: Injected one phase commit, txId=11611
> > Thu Aug 25 15:18:15 PDT 2011: Injected one phase commit, txId=11612
> > Thu Aug 25 15:18:15 PDT 2011: Injected one phase commit, txId=11613
> >
> >
> > On Tue, Aug 23, 2011 at 6:23 PM, Jim Webber 
> wrote:
> >
> > > Hi Nuo,
> > >
> > > > process [26266]... waiting for server to be
> > > >
> > >
> >
> ready.
> > > > BAD.
> > > > another server-process is running with []
> > >
> > > Just to check before we dig deeper, are you certain you don't have
> > another
> > > server process running?
> > >
> > > Jim
> > > ___
> > > Neo4j mailing list
> > > User@lists.neo4j.org
> > > https://lists.neo4j.org/mailman/listinfo/user
> > >
> > ___
> > Neo4j mailing list
> > User@lists.neo4j.org
> > https://lists.neo4j.org/mailman/listinfo/user
> >
>
>
>
> --
> Mattias Persson, [matt...@neotechnology.com]
> Hacker, Neo Technology
> www.neotechnology.com
> ___
> Neo4j mailing list
> User@lists.neo4j.org
> https://lists.neo4j.org/mailman/listinfo/user
>
___
Neo4j mailing list
User@lists.neo4j.org
https://lists.neo4j.org/mailman/listinfo/user

Re: [Neo4j] Server couldn't start after java.lang.OutOfMemoryError

[Mattias Persson]

Tried with more memory?

2011/8/26 Nuo Yan 

> Hey Jim,
>
> It happened again and I'm pretty sure there was no other server process
> running.
>
> Also this time when it crashed I saw this line in the console log (not
> seeing this previously):
>
>  Could not load hsdis-.jnilib; library not loadable; PrintAssembly is
> disabled
>
> When I tried to restart, data/graph.db/message.log shows a lot of lines
> like
> the following and fail with the error message in my last email:
>
> Thu Aug 25 15:18:15 PDT 2011: Injected one phase commit, txId=11611
> Thu Aug 25 15:18:15 PDT 2011: Injected one phase commit, txId=11612
> Thu Aug 25 15:18:15 PDT 2011: Injected one phase commit, txId=11613
>
>
> On Tue, Aug 23, 2011 at 6:23 PM, Jim Webber  wrote:
>
> > Hi Nuo,
> >
> > > process [26266]... waiting for server to be
> > >
> >
> ready.
> > > BAD.
> > > another server-process is running with []
> >
> > Just to check before we dig deeper, are you certain you don't have
> another
> > server process running?
> >
> > Jim
> > ___
> > Neo4j mailing list
> > User@lists.neo4j.org
> > https://lists.neo4j.org/mailman/listinfo/user
> >
> ___
> Neo4j mailing list
> User@lists.neo4j.org
> https://lists.neo4j.org/mailman/listinfo/user
>



-- 
Mattias Persson, [matt...@neotechnology.com]
Hacker, Neo Technology
www.neotechnology.com
___
Neo4j mailing list
User@lists.neo4j.org
https://lists.neo4j.org/mailman/listinfo/user

Re: [Neo4j] Server couldn't start after java.lang.OutOfMemoryError

[Nuo Yan]

Hey Jim,

It happened again and I'm pretty sure there was no other server process
running.

Also this time when it crashed I saw this line in the console log (not
seeing this previously):

  Could not load hsdis-.jnilib; library not loadable; PrintAssembly is
disabled

When I tried to restart, data/graph.db/message.log shows a lot of lines like
the following and fail with the error message in my last email:

Thu Aug 25 15:18:15 PDT 2011: Injected one phase commit, txId=11611
Thu Aug 25 15:18:15 PDT 2011: Injected one phase commit, txId=11612
Thu Aug 25 15:18:15 PDT 2011: Injected one phase commit, txId=11613


On Tue, Aug 23, 2011 at 6:23 PM, Jim Webber  wrote:

> Hi Nuo,
>
> > process [26266]... waiting for server to be
> >
> ready.
> > BAD.
> > another server-process is running with []
>
> Just to check before we dig deeper, are you certain you don't have another
> server process running?
>
> Jim
> ___
> Neo4j mailing list
> User@lists.neo4j.org
> https://lists.neo4j.org/mailman/listinfo/user
>
___
Neo4j mailing list
User@lists.neo4j.org
https://lists.neo4j.org/mailman/listinfo/user

Re: [Neo4j] Server couldn't start after java.lang.OutOfMemoryError

[Nuo Yan]

Sent through direct mail.

Also one thing I forgot to mention was that for a few occasions that the
server was able to start after a few tries after the error; other times I
tried enough times and since it's my dev machine so I decided to clear/move
the database and restart (which has always led to success).



On Tue, Aug 23, 2011 at 10:29 PM, Mattias Persson  wrote:

> It would also be very useful if you could send data/db/messages.log (to me
> directly since the mailing list doesn't like attachments) after such an
> error.
>
> thanks,
> Mattias
>
> Den onsdagen den 24:e augusti 2011 skrev Nuo Yan:
> > I don't think another process was running but I'm not 100% certain
> (didn't
> > check other than doing ./bin/neo4j status which shows not running). When
> it
> > happens again I will check further and let you know.
> >
> > Thanks!
> > Nuo
> >
> > On Tue, Aug 23, 2011 at 6:23 PM, Jim Webber 
> wrote:
> >
> >> Hi Nuo,
> >>
> >> > process [26266]... waiting for server to be
> >> >
> >>
>
> ready.
> >> > BAD.
> >> > another server-process is running with []
> >>
> >> Just to check before we dig deeper, are you certain you don't have
> another
> >> server process running?
> >>
> >> Jim
> >> ___
> >> Neo4j mailing list
> >> User@lists.neo4j.org
> >> https://lists.neo4j.org/mailman/listinfo/user
> >>
> > ___
> > Neo4j mailing list
> > User@lists.neo4j.org
> > https://lists.neo4j.org/mailman/listinfo/user
> >
>
> --
> Mattias Persson, [matt...@neotechnology.com]
> Hacker, Neo Technology
> www.neotechnology.com
> ___
> Neo4j mailing list
> User@lists.neo4j.org
> https://lists.neo4j.org/mailman/listinfo/user
>
___
Neo4j mailing list
User@lists.neo4j.org
https://lists.neo4j.org/mailman/listinfo/user

Re: [Neo4j] Server couldn't start after java.lang.OutOfMemoryError

[Mattias Persson]

It would also be very useful if you could send data/db/messages.log (to me
directly since the mailing list doesn't like attachments) after such an
error.

thanks,
Mattias

Den onsdagen den 24:e augusti 2011 skrev Nuo Yan:
> I don't think another process was running but I'm not 100% certain (didn't
> check other than doing ./bin/neo4j status which shows not running). When
it
> happens again I will check further and let you know.
>
> Thanks!
> Nuo
>
> On Tue, Aug 23, 2011 at 6:23 PM, Jim Webber  wrote:
>
>> Hi Nuo,
>>
>> > process [26266]... waiting for server to be
>> >
>>
ready.
>> > BAD.
>> > another server-process is running with []
>>
>> Just to check before we dig deeper, are you certain you don't have
another
>> server process running?
>>
>> Jim
>> ___
>> Neo4j mailing list
>> User@lists.neo4j.org
>> https://lists.neo4j.org/mailman/listinfo/user
>>
> ___
> Neo4j mailing list
> User@lists.neo4j.org
> https://lists.neo4j.org/mailman/listinfo/user
>

-- 
Mattias Persson, [matt...@neotechnology.com]
Hacker, Neo Technology
www.neotechnology.com
___
Neo4j mailing list
User@lists.neo4j.org
https://lists.neo4j.org/mailman/listinfo/user

Re: [Neo4j] Server couldn't start after java.lang.OutOfMemoryError

[Nuo Yan]

I don't think another process was running but I'm not 100% certain (didn't
check other than doing ./bin/neo4j status which shows not running). When it
happens again I will check further and let you know.

Thanks!
Nuo

On Tue, Aug 23, 2011 at 6:23 PM, Jim Webber  wrote:

> Hi Nuo,
>
> > process [26266]... waiting for server to be
> >
> ready.
> > BAD.
> > another server-process is running with []
>
> Just to check before we dig deeper, are you certain you don't have another
> server process running?
>
> Jim
> ___
> Neo4j mailing list
> User@lists.neo4j.org
> https://lists.neo4j.org/mailman/listinfo/user
>
___
Neo4j mailing list
User@lists.neo4j.org
https://lists.neo4j.org/mailman/listinfo/user

Re: [Neo4j] Server couldn't start after java.lang.OutOfMemoryError

[Jim Webber]

Hi Nuo,

> process [26266]... waiting for server to be
> ready.
> BAD.
> another server-process is running with []

Just to check before we dig deeper, are you certain you don't have another 
server process running?

Jim
___
Neo4j mailing list
User@lists.neo4j.org
https://lists.neo4j.org/mailman/listinfo/user

[Neo4j] Server couldn't start after java.lang.OutOfMemoryError

[Nuo Yan]

The neo4j server refuses to start after getting a Java OutOfMemory Error. I
was trying to start the server using the ./bin/neo4j start command.

Starting neo4j-service...WARNING: not changing user
 process [26266]... waiting for server to be
ready.
BAD.
 another server-process is running with []

Console log:

Exception in thread "Statistics Gatherer" java.lang.OutOfMemoryError:
PermGen space
at java.lang.Class.getDeclaredMethods0(Native Method)
 at java.lang.Class.privateGetDeclaredMethods(Class.java:2427)
at java.lang.Class.getMethod0(Class.java:2670)
 at java.lang.Class.getMethod(Class.java:1603)
at org.neo4j.helpers.Service.java6Loader(Service.java:330)
 at org.neo4j.helpers.Service.load(Service.java:191)
at org.neo4j.helpers.Service.load(Service.java:207)
 at
org.neo4j.kernel.EmbeddedGraphDbImpl.getManagementBean(EmbeddedGraphDbImpl.java:221)
at
org.neo4j.kernel.EmbeddedGraphDatabase.getManagementBean(EmbeddedGraphDatabase.java:156)
 at
org.neo4j.server.rrd.DatabasePrimitivesSampleableBase.getObjectName(DatabasePrimitivesSampleableBase.java:86)
at
org.neo4j.server.rrd.DatabasePrimitivesSampleableBase.getValue(DatabasePrimitivesSampleableBase.java:53)
 at org.neo4j.server.rrd.RrdSampler.updateSample(RrdSampler.java:62)
at org.neo4j.server.rrd.RrdJob.run(RrdJob.java:41)
 at org.neo4j.server.rrd.ScheduledJob$1.run(ScheduledJob.java:47)
at java.util.TimerThread.mainLoop(Timer.java:512)
 at java.util.TimerThread.run(Timer.java:462)

neo4j log:

Aug 23, 2011 4:23:11 PM org.neo4j.server.logging.Logger log
INFO: Starting Neo Server on port [7474] with [80] threads available
Aug 23, 2011 4:23:11 PM org.mortbay.log.Slf4jLog info
INFO: Logging to org.slf4j.impl.JDK14LoggerAdapter(org.mortbay.log) via
org.mortbay.log.Slf4jLog
Aug 23, 2011 4:23:11 PM org.neo4j.server.logging.Logger log
INFO: Using database at /Users/nuo/5star/neo4j-community-1.4/data/graph.db
Aug 23, 2011 4:23:11 PM
org.neo4j.kernel.impl.transaction.xaframework.XaLogicalLog
doInternalRecovery
INFO: Non clean shutdown detected on log
[/Users/nuo/5star/neo4j-community-1.4/data/graph.db/nioneo_logical.log.1].
Recovery started ...
Aug 23, 2011 4:23:13 PM
org.neo4j.kernel.impl.transaction.xaframework.XaLogicalLog
doInternalRecovery
INFO: Non clean shutdown detected on log
[/Users/nuo/5star/neo4j-community-1.4/data/graph.db/index/lucene.log.1].
Recovery started ...


Does anybody have any insights on what's happening? Is the recovery not
finishing up and timing out or something else is happening? It starts fine
if I clear the data (graph.db).

In addition, I've modified line 109 of the ./bin/lib/neo4j script
to JAVA_OPTS="-server ${wrapper_java_additional} -Xmx512m" (basically adding
-Xmx512m) and also updated the conf/neo4j.properties file to set
mapped_memory for nodes and relationships to be 100M; but I was still seeing
the out of memory exception. Did I do it right to increase the memory
allocation to neo?


Thanks,
Nuo Yan
___
Neo4j mailing list
User@lists.neo4j.org
https://lists.neo4j.org/mailman/listinfo/user