Hi Vijay, Are you able to create any other apps using slider create in your env? If so, that rules out any general issues and points to something specific to the Slider packaging for Solr.
Tim On Thu, Aug 27, 2015 at 3:30 PM, Vijay Bhoomireddy <[email protected]> wrote: > Hi, > > > > I am facing some issue while setting up Solr on Hadoop using Slider. I am > using HDP 2.3which has got Slider 0.80. I am following LucidWorks blog at > https://github.com/LucidWorks/solr-slider for the same. I already have a > single node Hortonworks HDP cluster. When I try to setup Solr on my HDP > cluster using Slider, I am facing some issues. > > > > As per the blog, I have performed the below steps: > > > > 1. I have setup a single node HDP cluster for which the hostname is > myhdpcluster.com with all the essential services including ZooKeeper and > Slider running on it. > > 2. Updated the resource manager address and port in slider-client.xml > present under /usr/hdp/current/slider-client/conf > > <property> > > <name>yarn.resourcemanager.address</name> > > <value> myhdpcluster.com:8032</value> > > </property> > > 3. Cloned the LucidWorks git and moved it under /home/hdfs/solr-slider > > 4. Downloaded solr latest stable distribution and renamed it as > solr.tgz and placed it under /home/hdfs/solr-slider/package/files/solr.tgz > > 5. Next ran the following command from within the > /home/hdfs/solr-slider folder > > zip -r solr-on-yarn.zip metainfo.xml package/ > > 6. Next ran the following command as hdfs user > > slider install-package --replacepkg --name solr --package > /home/hdfs/solr-slider/solr-on-yarn.zip > > 7. Modified the following settings in the > /home/hdfs/solr-slider/appConfig-default.json file > > "java_home": MY_JAVA_HOME_LOCATION > > "site.global.app_root": "${AGENT_WORK_ROOT}/app/install/solr-5.2.1", > (Should this be changed to any other value?) > > "site.global.zk_host": " myhdpcluster.com:2181", > > 8. Set yarn.component.instances to 1 in resources-default.json file > > 9. Next ran the following command > > slider create solr --template /home/hdfs/solr-slider/appConfig-default.json > --resources /home/hdfs/solr-slider/resources-default.json > > > > During this step, I am seeing an message INFO client.RMProxy - Connecting to > ResourceManager at myhdpcluster.com/10.0.2.15:8032 > > > INFO ipc.Client - Retrying connect to server: > myhdpcluster.com/10.0.2.15:8032. Already tried 0 time(s); > > > > This message keeps repeating for 50 times and then pauses for a couple of > seconds and then prints the same message in a loop eternally. Not sure on > where the problem is. I verified the Resource Manager URL and its pointing > correctly. In my case, it's myhdpcluster.com:8032 I even tried passing > --manager param to the slider create solr command, but without any luck. > > I am able to login to Ambari console and see all the services running fine , > including YARN related and ZooKeeper. Also, I could login to Resource > Manager's web UI as well and its working fine. > > > > Here is the complete content of the appConfig-default.json file. I haven't > worked with Slider so far, so not very sure if some mistake has crept into > this file while modifying it as per the changes mentioned by Lucidworks on > the Github page. However, I tried to simulate the steps mentioned on the > Github Solr-Slider page. As you can see from below file, I am using Java 7. > > > > { > > "schema": "http://example.org/specification/v2.0.0";, > > "metadata": { > > }, > > "global": { > > "application.def": "/home/hdfs/solr-slider/solr-on-yarn.zip", > > "java_home": "/usr/lib/jvm/jre-1.7.0-openjdk.x86_64", > > "site.global.app_root": > "${AGENT_WORK_ROOT}/app/install/solr-5.2.1-SNAPSHOT", > > "site.global.zk_host": "myhdpcluster.com:2181", > > "site.global.solr_host": "${SOLR_HOST}", > > "site.global.listen_port": "${SOLR.ALLOCATED_PORT}", > > "site.global.xmx_val": "1g", > > "site.global.xms_val": "1g", > > "site.global.gc_tune": "-XX:NewRatio=3 -XX:SurvivorRatio=4 > -XX:TargetSurvivorRatio=90 -XX:MaxTenuringThreshold=8 > -XX:+UseConcMarkSweepGC -XX:+UseParNewGC -XX:ConcGCThreads=4 > -XX:ParallelGCThreads=4 -XX:+CMSScavengeBeforeRemark > -XX:PretenureSizeThreshold=64m -XX:+UseCMSInitiatingOccupancyOnly > -XX:CMSInitiatingOccupancyFraction=50 -XX:CMSMaxAbortablePrecleanTime=6000 > -XX:+CMSParallelRemarkEnabled -XX:+ParallelRefProcEnabled -verbose:gc > -XX:+PrintHeapAtGC -XX:+PrintGCDetails -XX:+PrintGCDateStamps > -XX:+PrintTenuringDistribution -XX:+PrintGCApplicationStoppedTime", > > "site.global.zk_timeout": "15000", > > "site.global.server_module": "--module=http", > > "site.global.stop_key": "solrrocks", > > "site.global.solr_opts": "" > > }, > > "components": { > > "slider-appmaster": { > > "jvm.heapsize": "512M" > > }, > > "SOLR": { > > } > > } > > } > > > > Can anyone please let me know what could have gone wrong with my > configuration and what changes need to be made to get it working? Many > thanks in advance. > > > > Thanks & Regards > > Vijay > > > -- > The contents of this e-mail are confidential and for the exclusive use of > the intended recipient. If you receive this e-mail in error please delete > it from your system immediately and notify us either by e-mail or > telephone. You should not copy, forward or otherwise disclose the content > of the e-mail. The views expressed in this communication may not > necessarily be the view held by WHISHWORKS.
