Pluggable SecondaryFileSystemProvider?

2015-12-17 Thread Ivan V.
Hi, dev, one of Ignite users discovered that IGFS does not correctly work with secondary HDFS file system if that HDFS is "kerberised". The issue is described in https://issues.apache.org/jira/browse/IGNITE-2195 (This may also be close to this issue:

Re: Pluggable SecondaryFileSystemProvider?

2015-12-17 Thread Vladimir Ozerov
+ 1 for idea in general, but I have several concerns: 1) SecondaryFileSystemProvider is internal class and cannot be exposed. We need some other interface here. 2) I would avoid setting properties through constructor because it is error-prone when Spring is used. Instead, I would create setters

Re: Pluggable SecondaryFileSystemProvider?

2015-12-17 Thread Ivan V.
To summarize suggested change in short: we add constructor org.apache.ignite.hadoop.fs.IgniteHadoopIgfsSecondaryFileSystem#IgniteHadoopIgfsSecondaryFileSystem(java.lang.String, org.apache.ignite.internal.processors.hadoop.SecondaryFileSystemProvider) , allowing to plug an arbitrary