[Neo4j] Re: Too many open files on a huge dataset with 110 labels

2016-10-16 Thread Mohammad Hossain Namaki
In total 110 distinct labels for all nodes. So, each label has a large number of corresponding nodes in datagraph. The problem was originally from my code. On Tuesday, October 4, 2016 at 8:24:52 PM UTC-7, Mohammad Hossain Namaki wrote: > > Hi, > I've imported a huge dataset into Neo4j. 33M

[Neo4j] Re: Too many open files on a huge dataset with 110 labels

2016-10-16 Thread 'John Singer' via Neo4j
when you say you have 110 labels do you mean in total or do you have individual nodes with that many labels? Not sure that this is the cause of your problem but you never know. On Tuesday, October 4, 2016 at 10:24:52 PM UTC-5, Mohammad Hossain Namaki wrote: > > Hi, > I've imported a huge

Re: [Neo4j] Re: Too many open files on a huge dataset with 110 labels

2016-10-07 Thread 'Michael Hunger' via Neo4j
No worries. I was already wondering :) On Fri, Oct 7, 2016 at 8:40 AM, Mohammad Hossain Namaki wrote: > :( > I'm so sorry. It seems that there was a bug in my code that didn't close > open files in some cases. However, as I've seen this problem in forums I've > thought

Re: [Neo4j] Re: Too many open files on a huge dataset with 110 labels

2016-10-07 Thread 'Michael Hunger' via Neo4j
Also I'm not sure if the ulimit is per user or per process. So there might also be a per-user limit. Can you see if you have any other file-consuming apps open? Like an IDE or such? On Fri, Oct 7, 2016 at 8:37 AM, Michael Hunger < michael.hun...@neotechnology.com> wrote: > Are you sure you're

Re: [Neo4j] Re: Too many open files on a huge dataset with 110 labels

2016-10-07 Thread 'Michael Hunger' via Neo4j
Are you sure you're closing your own files? Do you open any other files in your code? On Fri, Oct 7, 2016 at 8:16 AM, Mohammad Hossain Namaki wrote: > I've removed the label folder and run it again. I was watching the folder. > it first created a lot of files then removed

[Neo4j] Re: Too many open files on a huge dataset with 110 labels

2016-10-07 Thread Mohammad Hossain Namaki
I've removed the label folder and run it again. I was watching the folder. it first created a lot of files then removed all of them and created just 14 items including write.lock and segments_1. but again at this line, I've got the error. FileOutputStream fos = new FileOutputStream(fout); I'll