I think the problem is probably in your appConfig file (e.g. referencing an application package from the the local filesystem as opposed to HDFS). Can you attach that?
— Jon On Oct 27, 2014, at 10:54 AM, Pushkar Raste <[email protected]> wrote: > Hi, > I am trying to to deploy memcached package using slider (0.40.0 version). I > keep getting "Wrong FS: > hdfs://localhost:9000/user/root/.slider/cluster/c100, expected: file:///" > error > > I saw that 'Rui Zhang' had similar issue, but she got around by > setting SLIDER_CLASSPATH_EXTRA. > Unfortunately that solution did not work for me. Here is my setup > 1. slider-client.xml > <?xml version="1.0"?> <?xml-stylesheet type="text/xsl" > href="configuration.xsl"?> <!-- Licensed to the Apache Software Foundation > (ASF) under one or more contributor license agreements. See the NOTICE file > distributed with this work for additional information regarding copyright > ownership. The ASF licenses this file to You under the Apache License: > Version 2.0 (the "License"); you may not use this file except in compliance > with the License. You may obtain a copy of the License at > http://www.apache.org/licenses/LICENSE-2.0 Unless required by applicable > law or agreed to in writing: software distributed under the License is > distributed on an "AS IS" BASIS: WITHOUT WARRANTIES OR CONDITIONS OF ANY > KIND: either express or implied. See the License for the specific language > governing permissions and limitations under the License. --> <!-- > Properties set here are picked up in the client. --> <configuration> > <property> <name>slider.client.resource.origin</name> > <value>conf/slider-client.xml</value> <description>This is just for > diagnostics</description> </property> <property> > <name>yarn.log-aggregation-enable</name> <value>true</value> </property> > <property> <name>slider.yarn.queue</name> <value>default</value> > <description>YARN queue for the Application Master</description> > </property> <!-- <property> <name>yarn.resourcemanager.address</name> > <value>master:8032</value> </property> <property> <name>fs.defaultFS</name> > <value>hdfs://master:9090</value> </property> <property> > <name>yarn.resourcemanager.principal</name> > <value>yarn/master@MINICLUSTER</value> > </property> <property> <name>slider.security.enabled</name> > <value>true</value> </property> <property> > <name>dfs.namenode.kerberos.principal</name> > <value>hdfs/master@MINICLUSTER</value> > </property> --> <property> <name>yarn.application.classpath</name> > <value>/usr/local/hadoop/etc/hadoop/*:/usr/local/hadoop/share/hadoop/common/*:/usr/local/hadoop/share/hadoop/common/lib/*:/usr/local/hadoop/share/hadoop/hdfs/*:/usr/local/hadoop/share/hadoop/hdfs/lib/*:/usr/local/hadoop/share/hadoop/yarn/*:/usr/local/hadoop/share/hadoop/yarn/lib/*:/usr/local/hadoop/share/hadoop/mapreduce/*:/usr/local/hadoop/share/hadoop/mapreduce/lib/*</value> > </property> <property> <name>slider.zookeeper.quorum</name> > <value>localhost:2181</value> </property> <property> > <name>yarn.resourcemanager.address</name> <value>localhost:8032</value> > </property> <property> <name>yarn.resourcemanager.scheduler.address</name> > <value>localhost:8030</value> </property> <property> > <name>fs.defaultFS</name> <value>hdfs://localhost:9000</value> </property> > </configuration> > > 2. Environment variables in my ~/.bashrc > export JAVA_HOME=/usr/lib/jvm/java-7-openjdk-amd64 export > HADOOP_INSTALL=/usr/local/hadoop export PATH=$PATH:$HADOOP_INSTALL/bin > export PATH=$PATH:$HADOOP_INSTALL/sbin export > HADOOP_MAPRED_HOME=$HADOOP_INSTALL export > HADOOP_COMMON_HOME=$HADOOP_INSTALL export HADOOP_HDFS_HOME=$HADOOP_INSTALL > export YARN_HOME=$HADOOP_INSTALL export > HADOOP_COMMON_LIB_NATIVE_DIR=$HADOOP_INSTALL/lib/native export > HADOOP_OPTS="-Djava.library.path=$HADOOP_INSTALL/lib" export > HADOOP_CONF_DIR=$HADOOP_INSTALL/etc/hadoop export > SLIDER_CLASSPATH_EXTRA=$HADOOP_CONF_DIR/*:/usr/local/hadoop/etc/hadoop/*:/usr/local/hadoop/share/hadoop/common/*:/usr/local/hadoop/share/hadoop/common/lib/*:/usr/local/hadoop/share/hadoop/hdfs/*:/usr/local/hadoop/share/hadoop/hdfs/lib/*:/usr/local/hadoop/share/hadoop/yarn/*:/usr/local/hadoop/share/hadoop/yarn/lib/*:/usr/local/hadoop/share/hadoop/mapreduce/*:/usr/local/hadoop/share/hadoop/mapreduce/lib/* > export YARN_CONF_DIR=$HADOOP_INSTALL/etc/hadoop > > > > 3. Output when I run 'python slider.py version' slider_home = > "/usr/local/slider/slider-0.40" slider_jvm_opts = > "-Djava.net.preferIPv4Stack=true -Djava.awt.headless=true -Xmx256m > -Djava.confdir=/usr/local/slider/slider-0.40/conf" slider_classpath = > "/usr/local/slider/slider-0.40/lib/*:/usr/local/slider/slider-0.40/conf:/usr/local/hadoop/etc/hadoop/*:/usr/local/hadoop/etc/hadoop/*:/usr/local/hadoop/share/hadoop/common/*:/usr/local/hadoop/share/hadoop/common/lib/*:/usr/local/hadoop/share/hadoop/hdfs/*:/usr/local/hadoop/share/hadoop/hdfs/lib/*:/usr/local/hadoop/share/hadoop/yarn/*:/usr/local/hadoop/share/hadoop/yarn/lib/*:/usr/local/hadoop/share/hadoop/mapreduce/*:/usr/local/hadoop/share/hadoop/mapreduce/lib/*" > ready to exec : ['java', '-Djava.net.preferIPv4Stack=true', > '-Djava.awt.headless=true', '-Xmx256m', > '-Djava.confdir=/usr/local/slider/slider-0.40/conf', '-classpath', > '/usr/local/slider/slider-0.40/lib/*:/usr/local/slider/slider-0.40/conf:/usr/local/hadoop/etc/hadoop/*:/usr/local/hadoop/etc/hadoop/*:/usr/local/hadoop/share/hadoop/common/*:/usr/local/hadoop/share/hadoop/common/lib/*:/usr/local/hadoop/share/hadoop/hdfs/*:/usr/local/hadoop/share/hadoop/hdfs/lib/*:/usr/local/hadoop/share/hadoop/yarn/*:/usr/local/hadoop/share/hadoop/yarn/lib/*:/usr/local/hadoop/share/hadoop/mapreduce/*:/usr/local/hadoop/share/hadoop/mapreduce/lib/*', > 'org.apache.slider.Slider', 'version'] SLF4J: Class path contains multiple > SLF4J bindings. 2014-10-27 14:52:17,995 [main] INFO client.RMProxy - > Connecting to ResourceManager at localhost/127.0.0.1:8032 SLF4J: Found > binding in > [jar:file:/usr/local/slider/slider-0.40/lib/slf4j-log4j12-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class] > 2014-10-27 14:52:18,121 [main] INFO client.SliderClient - Slider Core-0.40 > Built against commit# ddf7338759 on Java 1.7.0_67 by praste SLF4J: Found > binding in > [jar:file:/usr/local/hadoop/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class] > 2014-10-27 14:52:18,125 [main] INFO client.SliderClient - Compiled against > Hadoop 2.4.0 SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings > for an explanation. SLF4J: Actual binding is of type > [org.slf4j.impl.Log4jLoggerFactory] 2014-10-27 14:52:18,129 [main] INFO > client.SliderClient - Hadoop runtime version branch-2.4.0 with source > checksum 375b2832a6641759c6eaf6e3e998147 and build date 2014-03-31T08:31Z > 2014-10-27 14:52:18,133 [main] INFO util.ExitUtil - Exiting with status 0 -- CONFIDENTIALITY NOTICE NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You.
