Re: Data Loading Performance Issue

2015-11-17 Thread diopek
Hi Denis, please see my answers below; >>1) How big is the data set you're preloading? ~10 GB >>2) What is your grid configuration? How many nodes are there? Attache Ignite configuration you use to start the grid nodes. 1 node/JVM, My ignite configuration is as the following; ignite-cache.xml

Re: IGFS backed by persistence on physical filesystem

2015-11-17 Thread Paolo Di Tommaso
What if you have multiple nodes in a cluster using org.apache.hadoop.fs.LocalFileSystem as a secondary file system? Each node saves the IGFS content locally? Could it be used to save the data over a NFS mount ? Anyway I think that LocalFileSystem would introduce a dependency the Hadoop components

Re: IGFS backed by persistence on physical filesystem

2015-11-17 Thread Ivan Veselovsky
Paolo Di Tommaso wrote > What if you have multiple nodes in a cluster using > org.apache.hadoop.fs.LocalFileSystem as a secondary file system? Each node > saves the IGFS content locally? In my understanding yes, each node that was requested to do the file operation will store the file locally.

Re: Is this also correct behavior? Unable to connect to Local Node Only

2015-11-17 Thread Oru
I migrated to Linux. Goodbye Microsoft! Problem Solved! -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Unable-to-connect-to-Local-Node-Only-tp1852p1996.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Failed to start manager: GridManagerAdapter

2015-11-17 Thread Oru
Hi There! My situation- I am running a server node via Java application successfully. However when I start to run ignite.sh it gives me the following error. I have disabled setLocalAddress in Java app, but still no luck. What's wrong? * Java HotSpot(TM) 64-Bit Server VM warning: ignoring option

Re: Failed to start manager: GridManagerAdapter

2015-11-17 Thread Oru
Solved! Disabled this line in Java. //cfg.setLocalHost("127.0.0.1"); Hope this will help someone. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Failed-to-start-manager-GridManagerAdapter-tp1997p1998.html Sent from the Apache Ignite Users mailing list archive

Re: IGFS backed by persistence on physical filesystem

2015-11-17 Thread Paolo Di Tommaso
This sound interesting. Yes, the idea here is to have a secondary file system storage alternative to Hadoop. My idea is a to have a IgfsSecondaryFileSystem implementation based on java.nio.file.Path. This would make it possible to use a local file system or a NFS storage via the POSIX interface

Re: IGFS backed by persistence on physical filesystem

2015-11-17 Thread Ivan V.
Valentin, my reply possibly was not enough exact, sorry, so let me bring clarity there. If we store a file, in case of LocalFileSystem secondary Fs the file will be stored locally not on *each* Ignite node in the cluster, but *only* on the node where the operation was requested. E.g. if a cluster