@hsy541 -
This could be problem with your hadoop setup. I too had this problem and
thought it was problem with Slider. Turned out that I hadn't setfollowing
variable
HADOOP_CONF_DIR
YARN_CONF_DIR
One way to verify if your 'core-site.xml' and 'yar-site.xml' ... are being
read in Configuration, It to dump it using Configuration object from
SliderAppMaster class. Here is what I added to getClusterFS() function in
SliderAppMaster.java
public SliderFileSystem getClusterFS() throws IOException {
log.info("Config is {}", conf.toString());
return new SliderFileSystem(conf);
}
Oputput clearly indicated me that my core-site.xml yarn-site.xml and
hdfs-site.xml were not being read. On further investigation I realized that
my HADOOP_CONF_DIR and YARN_CONF_DIR were not set.
On Wed, Oct 29, 2014 at 8:32 AM, Steve Loughran <[email protected]>
wrote:
> On 27 October 2014 14:54, Pushkar Raste <[email protected]> wrote:
>
> > I am trying to to deploy memcached package using slider (0.40.0
> version). I
> > keep getting "Wrong FS:
> > hdfs://localhost:9000/user/root/.slider/cluster/c100, expected: file:///"
> > error
> >
>
>
> That's the warning hadoop gives when the filesystem is different from the
> path URL handed in. Here something thinks the filesystem is file://, but
> the path to the cluster is
> hdfs://localhost:9000/user/root/.slider/cluster/c100
>
> Now, file:// is the default filesystem of Hadoop —its presence is warning
> sign that that the configuration that the application has loaded is not
> picking up the core-site.xml of that cluster.
>
> We've been changing bin/slider & slider.py to pick up the local Hadoop
> config dirs if present, but I suspect this message may actually be coming
> from the deployed slider application master. If that's the case, the
> probable cause is that whatever classpath it is using to pick up the hadoop
> JARs, this path does not include the Hadoop configuration directory.
>
> --
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity to
> which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader
> of this message is not the intended recipient, you are hereby notified that
> any printing, copying, dissemination, distribution, disclosure or
> forwarding of this communication is strictly prohibited. If you have
> received this communication in error, please contact the sender immediately
> and delete it from your system. Thank You.
>
