Re: Ignite - FileNotFoundException

2016-10-13 Thread Taras Ledkov 

I guess 64K-128K must be enough.


On 13.10.2016 13:04, Anil wrote:

What is the recommended file descriptor limit for ignite data load ?

Thanks.

On 13 October 2016 at 15:16, Taras Ledkov > wrote:


Please check the file descriptors OS limits.


On 13.10.2016 12:36, Anil wrote:


When loading huge data into ignite - i see the following
exception.. my configuration include off heap as 0 and swap
storage to true.

 org.apache.ignite.logger.java.JavaLogger error
SEVERE: Failed to process directory: /tmp/ignite/work/ipc/shmem
java.io.FileNotFoundException:
/tmp/ignite/work/ipc/shmem/lock.file (Too many open files)
at java.io.RandomAccessFile.open0(Native Method)
at
java.io.RandomAccessFile.open(RandomAccessFile.java:316)
at
java.io.RandomAccessFile.(RandomAccessFile.java:243)
at

org.apache.ignite.internal.util.ipc.shmem.IpcSharedMemoryServerEndpoint$GcWorker.cleanupResources(IpcSharedMemoryServerEndpoint.java:608)
at

org.apache.ignite.internal.util.ipc.shmem.IpcSharedMemoryServerEndpoint$GcWorker.body(IpcSharedMemoryServerEndpoint.java:565)
at

org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
at java.lang.Thread.run(Thread.java:745)


Looks like it is due to high load.

How can we avoid this exception? thanks.

Thanks.



-- 
Taras Ledkov

Mail-To: tled...@gridgain.com 




--
Taras Ledkov
Mail-To: tled...@gridgain.com

Re: Ignite - FileNotFoundException

2016-10-13 Thread Anil 
What is the recommended file descriptor limit for ignite data load ?

Thanks.

On 13 October 2016 at 15:16, Taras Ledkov  wrote:

> Please check the file descriptors OS limits.
>
>
> On 13.10.2016 12:36, Anil wrote:
>
>>
>> When loading huge data into ignite - i see the following exception.. my
>> configuration include off heap as 0 and swap storage to true.
>>
>>  org.apache.ignite.logger.java.JavaLogger error
>> SEVERE: Failed to process directory: /tmp/ignite/work/ipc/shmem
>> java.io.FileNotFoundException: /tmp/ignite/work/ipc/shmem/lock.file (Too
>> many open files)
>> at java.io.RandomAccessFile.open0(Native Method)
>> at java.io.RandomAccessFile.open(RandomAccessFile.java:316)
>> at java.io.RandomAccessFile.(RandomAccessFile.java:243)
>> at org.apache.ignite.internal.util.ipc.shmem.IpcSharedMemorySer
>> verEndpoint$GcWorker.cleanupResources(IpcSharedMemo
>> ryServerEndpoint.java:608)
>> at org.apache.ignite.internal.util.ipc.shmem.IpcSharedMemorySer
>> verEndpoint$GcWorker.body(IpcSharedMemoryServerEndpoint.java:565)
>> at org.apache.ignite.internal.util.worker.GridWorker.run(GridWo
>> rker.java:110)
>> at java.lang.Thread.run(Thread.java:745)
>>
>>
>> Looks like it is due to high load.
>>
>> How can we avoid this exception? thanks.
>>
>> Thanks.
>>
>>
>>
> --
> Taras Ledkov
> Mail-To: tled...@gridgain.com
>
>

Re: Ignite - FileNotFoundException

2016-10-13 Thread Taras Ledkov 

Please check the file descriptors OS limits.


On 13.10.2016 12:36, Anil wrote:


When loading huge data into ignite - i see the following exception.. 
my configuration include off heap as 0 and swap storage to true.


 org.apache.ignite.logger.java.JavaLogger error
SEVERE: Failed to process directory: /tmp/ignite/work/ipc/shmem
java.io.FileNotFoundException: /tmp/ignite/work/ipc/shmem/lock.file 
(Too many open files)

at java.io.RandomAccessFile.open0(Native Method)
at java.io.RandomAccessFile.open(RandomAccessFile.java:316)
at java.io.RandomAccessFile.(RandomAccessFile.java:243)
at 
org.apache.ignite.internal.util.ipc.shmem.IpcSharedMemoryServerEndpoint$GcWorker.cleanupResources(IpcSharedMemoryServerEndpoint.java:608)
at 
org.apache.ignite.internal.util.ipc.shmem.IpcSharedMemoryServerEndpoint$GcWorker.body(IpcSharedMemoryServerEndpoint.java:565)
at 
org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)

at java.lang.Thread.run(Thread.java:745)


Looks like it is due to high load.

How can we avoid this exception? thanks.

Thanks.




--
Taras Ledkov
Mail-To: tled...@gridgain.com