Valentin, my reply possibly was not enough exact, sorry, so let me bring clarity there. If we store a file, in case of LocalFileSystem secondary Fs the file will be stored locally not on *each* Ignite node in the cluster, but *only* on the node where the operation was requested. E.g. if a cluster consists of nodes A, B, C, we connect to node A and write file "/tmp/f", the file "/tmp/f" will be written locally only on the node where node A runs, and nowhere else. Yes, data cache in IGFS is patitioned, so file blocks are distributed. But this is about IGFS, which in DUAL mode only plays role of intermediate layer (a cache) between secondary Fs and the client.
On Wed, Nov 18, 2015 at 12:24 AM, Valentin Kulichenko < [email protected]> wrote: > Moving this discussion to the dev list. > > As far as I know, IGFS stores data in blocks, so one file can be > distributed across nodes. So I don't see how each node can persist locally. > In my understanding it should be designated shared directory where all > files are persisted. This is actually analogous to how our persistence > store works for regular cache data. > > Ivan, correct me if I'm wrong. > > -Val > > ---------- Forwarded message ---------- > From: Ivan Veselovsky <[email protected]> > Date: Tue, Nov 17, 2015 at 11:48 AM > Subject: Re: IGFS backed by persistence on physical filesystem > To: [email protected] > > > Paolo Di Tommaso wrote > > What if you have multiple nodes in a cluster using > > org.apache.hadoop.fs.LocalFileSystem as a secondary file system? Each > node > > saves the IGFS content locally? > > In my understanding yes, each node that was requested to do the file > operation will store the file locally. > > > Paolo Di Tommaso wrote > > Could it be used to save the data over a NFS mount ? > > LocalFileSystem runs over OS file system with "/" being the roott of the > file system, so if an NFS path is mounted , say, in /mnt/nfs/, the files > written under there will be shared. We may think about some kind of > "chroot" > there to isolate the Ignite file system from other things. > > > > -- > View this message in context: > > http://apache-ignite-users.70518.x6.nabble.com/IGFS-backed-by-persistence-on-physical-filesystem-tp1882p1991.html > Sent from the Apache Ignite Users mailing list archive at Nabble.com. >
