Hi,
I am facing some issue while setting up Solr on Hadoop using Slider. I am using HDP 2.3which has got Slider 0.80. I am following LucidWorks blog at https://github.com/LucidWorks/solr-slider for the same. I already have a single node Hortonworks HDP cluster. When I try to setup Solr on my HDP cluster using Slider, I am facing some issues. As per the blog, I have performed the below steps: 1. I have setup a single node HDP cluster for which the hostname is myhdpcluster.com with all the essential services including ZooKeeper and Slider running on it. 2. Updated the resource manager address and port in slider-client.xml present under /usr/hdp/current/slider-client/conf <property> <name>yarn.resourcemanager.address</name> <value> myhdpcluster.com:8032</value> </property> 3. Cloned the LucidWorks git and moved it under /home/hdfs/solr-slider 4. Downloaded solr latest stable distribution and renamed it as solr.tgz and placed it under /home/hdfs/solr-slider/package/files/solr.tgz 5. Next ran the following command from within the /home/hdfs/solr-slider folder zip -r solr-on-yarn.zip metainfo.xml package/ 6. Next ran the following command as hdfs user slider install-package --replacepkg --name solr --package /home/hdfs/solr-slider/solr-on-yarn.zip 7. Modified the following settings in the /home/hdfs/solr-slider/appConfig-default.json file "java_home": MY_JAVA_HOME_LOCATION "site.global.app_root": "${AGENT_WORK_ROOT}/app/install/solr-5.2.1", (Should this be changed to any other value?) "site.global.zk_host": " myhdpcluster.com:2181", 8. Set yarn.component.instances to 1 in resources-default.json file 9. Next ran the following command slider create solr --template /home/hdfs/solr-slider/appConfig-default.json --resources /home/hdfs/solr-slider/resources-default.json During this step, I am seeing an message INFO client.RMProxy - Connecting to ResourceManager at myhdpcluster.com/10.0.2.15:8032 INFO ipc.Client - Retrying connect to server: myhdpcluster.com/10.0.2.15:8032. Already tried 0 time(s); This message keeps repeating for 50 times and then pauses for a couple of seconds and then prints the same message in a loop eternally. Not sure on where the problem is. I verified the Resource Manager URL and its pointing correctly. In my case, it's myhdpcluster.com:8032 I even tried passing --manager param to the slider create solr command, but without any luck. I am able to login to Ambari console and see all the services running fine , including YARN related and ZooKeeper. Also, I could login to Resource Manager's web UI as well and its working fine. Here is the complete content of the appConfig-default.json file. I haven't worked with Slider so far, so not very sure if some mistake has crept into this file while modifying it as per the changes mentioned by Lucidworks on the Github page. However, I tried to simulate the steps mentioned on the Github Solr-Slider page. As you can see from below file, I am using Java 7. { "schema": "http://example.org/specification/v2.0.0";, "metadata": { }, "global": { "application.def": "/home/hdfs/solr-slider/solr-on-yarn.zip", "java_home": "/usr/lib/jvm/jre-1.7.0-openjdk.x86_64", "site.global.app_root": "${AGENT_WORK_ROOT}/app/install/solr-5.2.1-SNAPSHOT", "site.global.zk_host": "myhdpcluster.com:2181", "site.global.solr_host": "${SOLR_HOST}", "site.global.listen_port": "${SOLR.ALLOCATED_PORT}", "site.global.xmx_val": "1g", "site.global.xms_val": "1g", "site.global.gc_tune": "-XX:NewRatio=3 -XX:SurvivorRatio=4 -XX:TargetSurvivorRatio=90 -XX:MaxTenuringThreshold=8 -XX:+UseConcMarkSweepGC -XX:+UseParNewGC -XX:ConcGCThreads=4 -XX:ParallelGCThreads=4 -XX:+CMSScavengeBeforeRemark -XX:PretenureSizeThreshold=64m -XX:+UseCMSInitiatingOccupancyOnly -XX:CMSInitiatingOccupancyFraction=50 -XX:CMSMaxAbortablePrecleanTime=6000 -XX:+CMSParallelRemarkEnabled -XX:+ParallelRefProcEnabled -verbose:gc -XX:+PrintHeapAtGC -XX:+PrintGCDetails -XX:+PrintGCDateStamps -XX:+PrintTenuringDistribution -XX:+PrintGCApplicationStoppedTime", "site.global.zk_timeout": "15000", "site.global.server_module": "--module=http", "site.global.stop_key": "solrrocks", "site.global.solr_opts": "" }, "components": { "slider-appmaster": { "jvm.heapsize": "512M" }, "SOLR": { } } } Can anyone please let me know what could have gone wrong with my configuration and what changes need to be made to get it working? Many thanks in advance. Thanks & Regards Vijay -- The contents of this e-mail are confidential and for the exclusive use of the intended recipient. If you receive this e-mail in error please delete it from your system immediately and notify us either by e-mail or telephone. You should not copy, forward or otherwise disclose the content of the e-mail. The views expressed in this communication may not necessarily be the view held by WHISHWORKS.
