Hi, I am trying to to deploy memcached package using slider (0.40.0 version). I keep getting "Wrong FS: hdfs://localhost:9000/user/root/.slider/cluster/c100, expected: file:///" error
I saw that 'Rui Zhang' had similar issue, but she got around by setting SLIDER_CLASSPATH_EXTRA. Unfortunately that solution did not work for me. Here is my setup 1. slider-client.xml <?xml version="1.0"?> <?xml-stylesheet type="text/xsl" href="configuration.xsl"?> <!-- Licensed to the Apache Software Foundation (ASF) under one or more contributor license agreements. See the NOTICE file distributed with this work for additional information regarding copyright ownership. The ASF licenses this file to You under the Apache License: Version 2.0 (the "License"); you may not use this file except in compliance with the License. You may obtain a copy of the License at http://www.apache.org/licenses/LICENSE-2.0 Unless required by applicable law or agreed to in writing: software distributed under the License is distributed on an "AS IS" BASIS: WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND: either express or implied. See the License for the specific language governing permissions and limitations under the License. --> <!-- Properties set here are picked up in the client. --> <configuration> <property> <name>slider.client.resource.origin</name> <value>conf/slider-client.xml</value> <description>This is just for diagnostics</description> </property> <property> <name>yarn.log-aggregation-enable</name> <value>true</value> </property> <property> <name>slider.yarn.queue</name> <value>default</value> <description>YARN queue for the Application Master</description> </property> <!-- <property> <name>yarn.resourcemanager.address</name> <value>master:8032</value> </property> <property> <name>fs.defaultFS</name> <value>hdfs://master:9090</value> </property> <property> <name>yarn.resourcemanager.principal</name> <value>yarn/master@MINICLUSTER</value> </property> <property> <name>slider.security.enabled</name> <value>true</value> </property> <property> <name>dfs.namenode.kerberos.principal</name> <value>hdfs/master@MINICLUSTER</value> </property> --> <property> <name>yarn.application.classpath</name> <value>/usr/local/hadoop/etc/hadoop/*:/usr/local/hadoop/share/hadoop/common/*:/usr/local/hadoop/share/hadoop/common/lib/*:/usr/local/hadoop/share/hadoop/hdfs/*:/usr/local/hadoop/share/hadoop/hdfs/lib/*:/usr/local/hadoop/share/hadoop/yarn/*:/usr/local/hadoop/share/hadoop/yarn/lib/*:/usr/local/hadoop/share/hadoop/mapreduce/*:/usr/local/hadoop/share/hadoop/mapreduce/lib/*</value> </property> <property> <name>slider.zookeeper.quorum</name> <value>localhost:2181</value> </property> <property> <name>yarn.resourcemanager.address</name> <value>localhost:8032</value> </property> <property> <name>yarn.resourcemanager.scheduler.address</name> <value>localhost:8030</value> </property> <property> <name>fs.defaultFS</name> <value>hdfs://localhost:9000</value> </property> </configuration> 2. Environment variables in my ~/.bashrc export JAVA_HOME=/usr/lib/jvm/java-7-openjdk-amd64 export HADOOP_INSTALL=/usr/local/hadoop export PATH=$PATH:$HADOOP_INSTALL/bin export PATH=$PATH:$HADOOP_INSTALL/sbin export HADOOP_MAPRED_HOME=$HADOOP_INSTALL export HADOOP_COMMON_HOME=$HADOOP_INSTALL export HADOOP_HDFS_HOME=$HADOOP_INSTALL export YARN_HOME=$HADOOP_INSTALL export HADOOP_COMMON_LIB_NATIVE_DIR=$HADOOP_INSTALL/lib/native export HADOOP_OPTS="-Djava.library.path=$HADOOP_INSTALL/lib" export HADOOP_CONF_DIR=$HADOOP_INSTALL/etc/hadoop export SLIDER_CLASSPATH_EXTRA=$HADOOP_CONF_DIR/*:/usr/local/hadoop/etc/hadoop/*:/usr/local/hadoop/share/hadoop/common/*:/usr/local/hadoop/share/hadoop/common/lib/*:/usr/local/hadoop/share/hadoop/hdfs/*:/usr/local/hadoop/share/hadoop/hdfs/lib/*:/usr/local/hadoop/share/hadoop/yarn/*:/usr/local/hadoop/share/hadoop/yarn/lib/*:/usr/local/hadoop/share/hadoop/mapreduce/*:/usr/local/hadoop/share/hadoop/mapreduce/lib/* export YARN_CONF_DIR=$HADOOP_INSTALL/etc/hadoop 3. Output when I run 'python slider.py version' slider_home = "/usr/local/slider/slider-0.40" slider_jvm_opts = "-Djava.net.preferIPv4Stack=true -Djava.awt.headless=true -Xmx256m -Djava.confdir=/usr/local/slider/slider-0.40/conf" slider_classpath = "/usr/local/slider/slider-0.40/lib/*:/usr/local/slider/slider-0.40/conf:/usr/local/hadoop/etc/hadoop/*:/usr/local/hadoop/etc/hadoop/*:/usr/local/hadoop/share/hadoop/common/*:/usr/local/hadoop/share/hadoop/common/lib/*:/usr/local/hadoop/share/hadoop/hdfs/*:/usr/local/hadoop/share/hadoop/hdfs/lib/*:/usr/local/hadoop/share/hadoop/yarn/*:/usr/local/hadoop/share/hadoop/yarn/lib/*:/usr/local/hadoop/share/hadoop/mapreduce/*:/usr/local/hadoop/share/hadoop/mapreduce/lib/*" ready to exec : ['java', '-Djava.net.preferIPv4Stack=true', '-Djava.awt.headless=true', '-Xmx256m', '-Djava.confdir=/usr/local/slider/slider-0.40/conf', '-classpath', '/usr/local/slider/slider-0.40/lib/*:/usr/local/slider/slider-0.40/conf:/usr/local/hadoop/etc/hadoop/*:/usr/local/hadoop/etc/hadoop/*:/usr/local/hadoop/share/hadoop/common/*:/usr/local/hadoop/share/hadoop/common/lib/*:/usr/local/hadoop/share/hadoop/hdfs/*:/usr/local/hadoop/share/hadoop/hdfs/lib/*:/usr/local/hadoop/share/hadoop/yarn/*:/usr/local/hadoop/share/hadoop/yarn/lib/*:/usr/local/hadoop/share/hadoop/mapreduce/*:/usr/local/hadoop/share/hadoop/mapreduce/lib/*', 'org.apache.slider.Slider', 'version'] SLF4J: Class path contains multiple SLF4J bindings. 2014-10-27 14:52:17,995 [main] INFO client.RMProxy - Connecting to ResourceManager at localhost/127.0.0.1:8032 SLF4J: Found binding in [jar:file:/usr/local/slider/slider-0.40/lib/slf4j-log4j12-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2014-10-27 14:52:18,121 [main] INFO client.SliderClient - Slider Core-0.40 Built against commit# ddf7338759 on Java 1.7.0_67 by praste SLF4J: Found binding in [jar:file:/usr/local/hadoop/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2014-10-27 14:52:18,125 [main] INFO client.SliderClient - Compiled against Hadoop 2.4.0 SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory] 2014-10-27 14:52:18,129 [main] INFO client.SliderClient - Hadoop runtime version branch-2.4.0 with source checksum 375b2832a6641759c6eaf6e3e998147 and build date 2014-03-31T08:31Z 2014-10-27 14:52:18,133 [main] INFO util.ExitUtil - Exiting with status 0
