Run "slider registry --name solr --listexp" first to see the list of available exports.
Also, seems like you are running the slider app as user hdfs. If it is a non-secure cluster you should run it as user yarn. -Gour On 8/28/15, 6:35 AM, "Vijaya Narayana Reddy Bhoomi Reddy" <[email protected]> wrote: >Thanks Gour for correcting me. I was wrongly referring RM at port 8032 >instead of 8050. I now completed the step for creating a slider package >and >I am able to see the application listed on the RM web UI. > >However, when I run the slider registry command slider registry --name >solr >--getexp servers , I am getting a 44 error with the following log trail. >Any help on how to know the Solr Web UI address apart from the slider >registry command or how to fix the below error? > >2015-08-28 08:27:51,010 [main] INFO impl.TimelineClientImpl - >Timeline service address: http://myhdpcluster.com:8188/ws/v1/timeline/ >2015-08-28 08:27:52,564 [main] WARN shortcircuit.DomainSocketFactory >- The short-circuit local reads feature cannot be used because >libhadoop cannot be loaded. >2015-08-28 08:27:52,580 [main] INFO client.RMProxy - Connecting to >ResourceManager at myhdpcluster.com/10.0.2.15:8050 >2015-08-28 08:27:52,949 [main] INFO imps.CuratorFrameworkImpl - Starting >2015-08-28 08:27:53,188 [main-EventThread] INFO >state.ConnectionStateManager - State change: CONNECTED >2015-08-28 08:27:53,189 [ConnectionStateManager-0] WARN >state.ConnectionStateManager - There are no ConnectionStateListeners >registered. >2015-08-28 08:27:54,225 [main] ERROR main.ServiceLauncher - >/registry/users/hdfs/services/org-apache-slider/solr >2015-08-28 08:27:54,229 [main] INFO util.ExitUtil - Exiting with status >44 > >Thanks & Regards >Vijay > > > > >On 28 August 2015 at 08:47, Gour Saha <[email protected]> wrote: > >> Did you get rid of the entries in slider-client.xml? I am surprised that >> your RM is running at port 8032. The typical default port is 8050. Can >>you >> check /etc/hadoop/conf/yarn-site.xml and see what is >> yarn.resourcemanager.address set to? >> >> -Gour >> >> On 8/28/15, 3:51 AM, "Vijaya Narayana Reddy Bhoomi Reddy" >> <[email protected]> wrote: >> >> >Hi Gour, >> > >> >I tried modifying the Hadoop conf entry in slider-env.sh file.I have >> >updated it as below: >> > >> >export HADOOP_CONF_DIR=/etc/hadoop/conf >> > >> >But this also didnt yield any favourable results. >> > >> >As Tim mentioned, I shall try setting some other application probably >> >HBase >> >to see if the problem is Solr specific or Slider in general. In the >> >meantime, do you have any other suggestions? >> > >> >When I run the command slider install-package command, it completed >>with >> >status 0 and I could see the files under .slider folder on HDFS. The >>issue >> >is with slider create command where its not able to connect to the >> >resource >> >manager, though RM deamon is running fine. >> > >> > >> >Thanks & Regards >> >Vijay >> > >> > >> > >> > >> > >> >On 27 August 2015 at 18:41, Gour Saha <[email protected]> wrote: >> > >> >> Since you have HDP, instead of setting the props in >>slider-client.xml, I >> >> would suggest setting HADOOP_CONF_DIR in slider-env.sh (available in >>the >> >> same folder) to /etc/hadoop/conf and see if that helps. >> >> >> >> -Gour >> >> >> >> On 8/27/15, 2:48 PM, "Timothy Potter" <[email protected]> wrote: >> >> >> >> >Hi Vijay, >> >> > >> >> >Are you able to create any other apps using slider create in your >>env? >> >> >If so, that rules out any general issues and points to something >> >> >specific to the Slider packaging for Solr. >> >> > >> >> >Tim >> >> > >> >> >On Thu, Aug 27, 2015 at 3:30 PM, Vijay Bhoomireddy >> >> ><[email protected]> wrote: >> >> >> Hi, >> >> >> >> >> >> >> >> >> >> >> >> I am facing some issue while setting up Solr on Hadoop using >>Slider. >> >>I >> >> >>am >> >> >> using HDP 2.3which has got Slider 0.80. I am following LucidWorks >> >>blog >> >> >>at >> >> >> https://github.com/LucidWorks/solr-slider for the same. I already >> >>have >> >> a >> >> >> single node Hortonworks HDP cluster. When I try to setup Solr on >>my >> >>HDP >> >> >> cluster using Slider, I am facing some issues. >> >> >> >> >> >> >> >> >> >> >> >> As per the blog, I have performed the below steps: >> >> >> >> >> >> >> >> >> >> >> >> 1. I have setup a single node HDP cluster for which the >> >>hostname >> >> >>is >> >> >> myhdpcluster.com with all the essential services including >>ZooKeeper >> >> and >> >> >> Slider running on it. >> >> >> >> >> >> 2. Updated the resource manager address and port in >> >> >>slider-client.xml >> >> >> present under /usr/hdp/current/slider-client/conf >> >> >> >> >> >> <property> >> >> >> >> >> >> <name>yarn.resourcemanager.address</name> >> >> >> >> >> >> <value> myhdpcluster.com:8032</value> >> >> >> >> >> >> </property> >> >> >> >> >> >> 3. Cloned the LucidWorks git and moved it under >> >> >>/home/hdfs/solr-slider >> >> >> >> >> >> 4. Downloaded solr latest stable distribution and renamed >>it as >> >> >> solr.tgz and placed it under >> >> >>/home/hdfs/solr-slider/package/files/solr.tgz >> >> >> >> >> >> 5. Next ran the following command from within the >> >> >> /home/hdfs/solr-slider folder >> >> >> >> >> >> zip -r solr-on-yarn.zip metainfo.xml package/ >> >> >> >> >> >> 6. Next ran the following command as hdfs user >> >> >> >> >> >> slider install-package --replacepkg --name solr --package >> >> >> /home/hdfs/solr-slider/solr-on-yarn.zip >> >> >> >> >> >> 7. Modified the following settings in the >> >> >> /home/hdfs/solr-slider/appConfig-default.json file >> >> >> >> >> >> "java_home": MY_JAVA_HOME_LOCATION >> >> >> >> >> >> "site.global.app_root": >> >>"${AGENT_WORK_ROOT}/app/install/solr-5.2.1", >> >> >> (Should this be changed to any other value?) >> >> >> >> >> >> "site.global.zk_host": " myhdpcluster.com:2181", >> >> >> >> >> >> 8. Set yarn.component.instances to 1 in >>resources-default.json >> >> >>file >> >> >> >> >> >> 9. Next ran the following command >> >> >> >> >> >> slider create solr --template >> >> >>/home/hdfs/solr-slider/appConfig-default.json >> >> >> --resources /home/hdfs/solr-slider/resources-default.json >> >> >> >> >> >> >> >> >> >> >> >> During this step, I am seeing an message INFO client.RMProxy - >> >> >>Connecting to >> >> >> ResourceManager at myhdpcluster.com/10.0.2.15:8032 >> >> >> >> >> >> >> >> >> INFO ipc.Client - Retrying connect to server: >> >> >> myhdpcluster.com/10.0.2.15:8032. Already tried 0 time(s); >> >> >> >> >> >> >> >> >> >> >> >> This message keeps repeating for 50 times and then pauses for a >> >>couple >> >> >>of >> >> >> seconds and then prints the same message in a loop eternally. Not >> >>sure >> >> >>on >> >> >> where the problem is. I verified the Resource Manager URL and its >> >> >>pointing >> >> >> correctly. In my case, it's myhdpcluster.com:8032 I even tried >> >>passing >> >> >> --manager param to the slider create solr command, but without any >> >>luck. >> >> >> >> >> >> I am able to login to Ambari console and see all the services >>running >> >> >>fine , >> >> >> including YARN related and ZooKeeper. Also, I could login to >>Resource >> >> >> Manager's web UI as well and its working fine. >> >> >> >> >> >> >> >> >> >> >> >> Here is the complete content of the appConfig-default.json file. I >> >> >>haven't >> >> >> worked with Slider so far, so not very sure if some mistake has >>crept >> >> >>into >> >> >> this file while modifying it as per the changes mentioned by >> >>Lucidworks >> >> >>on >> >> >> the Github page. However, I tried to simulate the steps mentioned >>on >> >>the >> >> >> Github Solr-Slider page. As you can see from below file, I am >>using >> >> >>Java 7. >> >> >> >> >> >> >> >> >> >> >> >> { >> >> >> >> >> >> "schema": "http://example.org/specification/v2.0.0";, >> >> >> >> >> >> "metadata": { >> >> >> >> >> >> }, >> >> >> >> >> >> "global": { >> >> >> >> >> >> "application.def": "/home/hdfs/solr-slider/solr-on-yarn.zip", >> >> >> >> >> >> "java_home": "/usr/lib/jvm/jre-1.7.0-openjdk.x86_64", >> >> >> >> >> >> "site.global.app_root": >> >> >> "${AGENT_WORK_ROOT}/app/install/solr-5.2.1-SNAPSHOT", >> >> >> >> >> >> "site.global.zk_host": "myhdpcluster.com:2181", >> >> >> >> >> >> "site.global.solr_host": "${SOLR_HOST}", >> >> >> >> >> >> "site.global.listen_port": "${SOLR.ALLOCATED_PORT}", >> >> >> >> >> >> "site.global.xmx_val": "1g", >> >> >> >> >> >> "site.global.xms_val": "1g", >> >> >> >> >> >> "site.global.gc_tune": "-XX:NewRatio=3 -XX:SurvivorRatio=4 >> >> >> -XX:TargetSurvivorRatio=90 -XX:MaxTenuringThreshold=8 >> >> >> -XX:+UseConcMarkSweepGC -XX:+UseParNewGC -XX:ConcGCThreads=4 >> >> >> -XX:ParallelGCThreads=4 -XX:+CMSScavengeBeforeRemark >> >> >> -XX:PretenureSizeThreshold=64m -XX:+UseCMSInitiatingOccupancyOnly >> >> >> -XX:CMSInitiatingOccupancyFraction=50 >> >> >>-XX:CMSMaxAbortablePrecleanTime=6000 >> >> >> -XX:+CMSParallelRemarkEnabled -XX:+ParallelRefProcEnabled >>-verbose:gc >> >> >> -XX:+PrintHeapAtGC -XX:+PrintGCDetails -XX:+PrintGCDateStamps >> >> >> -XX:+PrintTenuringDistribution >>-XX:+PrintGCApplicationStoppedTime", >> >> >> >> >> >> "site.global.zk_timeout": "15000", >> >> >> >> >> >> "site.global.server_module": "--module=http", >> >> >> >> >> >> "site.global.stop_key": "solrrocks", >> >> >> >> >> >> "site.global.solr_opts": "" >> >> >> >> >> >> }, >> >> >> >> >> >> "components": { >> >> >> >> >> >> "slider-appmaster": { >> >> >> >> >> >> "jvm.heapsize": "512M" >> >> >> >> >> >> }, >> >> >> >> >> >> "SOLR": { >> >> >> >> >> >> } >> >> >> >> >> >> } >> >> >> >> >> >> } >> >> >> >> >> >> >> >> >> >> >> >> Can anyone please let me know what could have gone wrong with my >> >> >> configuration and what changes need to be made to get it working? >> >>Many >> >> >> thanks in advance. >> >> >> >> >> >> >> >> >> >> >> >> Thanks & Regards >> >> >> >> >> >> Vijay >> >> >> >> >> >> >> >> >> -- >> >> >> The contents of this e-mail are confidential and for the exclusive >> >>use >> >> >>of >> >> >> the intended recipient. If you receive this e-mail in error please >> >> >>delete >> >> >> it from your system immediately and notify us either by e-mail or >> >> >> telephone. You should not copy, forward or otherwise disclose the >> >> >>content >> >> >> of the e-mail. The views expressed in this communication may not >> >> >> necessarily be the view held by WHISHWORKS. >> >> > >> >> >> >> >> > >> >-- >> >The contents of this e-mail are confidential and for the exclusive use >>of >> >the intended recipient. If you receive this e-mail in error please >>delete >> >it from your system immediately and notify us either by e-mail or >> >telephone. You should not copy, forward or otherwise disclose the >>content >> >of the e-mail. The views expressed in this communication may not >> >necessarily be the view held by WHISHWORKS. >> >> > >-- >The contents of this e-mail are confidential and for the exclusive use of >the intended recipient. If you receive this e-mail in error please delete >it from your system immediately and notify us either by e-mail or >telephone. You should not copy, forward or otherwise disclose the content >of the e-mail. The views expressed in this communication may not >necessarily be the view held by WHISHWORKS.
