Tom Beerbower created AMBARI-17274: -------------------------------------- Summary: As part of atlas startup,"/usr/lib/ambari-logsearch-solr-client/solrCloudCli.sh" script is executed by ambari, which fails with "java.io.FileNotFoundException" Key: AMBARI-17274 URL: https://issues.apache.org/jira/browse/AMBARI-17274 Project: Ambari Issue Type: Bug Reporter: Tom Beerbower Assignee: Tom Beerbower
Below is the error log. {noformat} Traceback (most recent call last): File "/var/lib/ambari-agent/cache/common-services/ATLAS/0.1.0.2.3/package/scripts/metadata_server.py", line 173, in <module> MetadataServer().execute() File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 257, in execute method(env) File "/var/lib/ambari-agent/cache/common-services/ATLAS/0.1.0.2.3/package/scripts/metadata_server.py", line 69, in start self.configure(env) File "/var/lib/ambari-agent/cache/common-services/ATLAS/0.1.0.2.3/package/scripts/metadata_server.py", line 53, in configure metadata() File "/var/lib/ambari-agent/cache/common-services/ATLAS/0.1.0.2.3/package/scripts/metadata.py", line 101, in metadata upload_conf_set('basic_configs', random_num) File "/var/lib/ambari-agent/cache/common-services/ATLAS/0.1.0.2.3/package/scripts/metadata.py", line 122, in upload_conf_set user=params.metadata_user) File "/usr/lib/python2.6/site-packages/resource_management/libraries/functions/solr_cloud_util.py", line 49, in upload_configuration_to_zk user=user File "/usr/lib/python2.6/site-packages/resource_management/core/base.py", line 155, in __init__ self.env.run() File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 160, in run self.run_action(resource, action) File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 124, in run_action provider_action() File "/usr/lib/python2.6/site-packages/resource_management/core/providers/system.py", line 273, in action_run tries=self.resource.tries, try_sleep=self.resource.try_sleep) File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 70, in inner result = function(command, **kwargs) File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 92, in checked_call tries=tries, try_sleep=try_sleep) File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 140, in _call_wrapper result = _call(command, **kwargs_copy) File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 293, in _call raise Fail(err_msg) resource_management.core.exceptions.Fail: Execution of 'export JAVA_HOME=/usr/jdk64/jdk1.8.0_77 ; /usr/lib/ambari-logsearch-solr-client/solrCloudCli.sh -z os-d7-unsecure-atlas-3.openstacklocal:2181,os-d7-unsecure-atlas-1.openstacklocal:2181/ambari-solr --upload-config -d /usr/lib/ambari-logsearch-solr/server/solr/configsets/basic_configs/conf -cs basic_configs -rt 5 -i 10' returned 1. log4j:ERROR setFile(null,true) call failed. java.io.FileNotFoundException: (No such file or directory) at java.io.FileOutputStream.open0(Native Method) at java.io.FileOutputStream.open(FileOutputStream.java:270) at java.io.FileOutputStream.<init>(FileOutputStream.java:213) at java.io.FileOutputStream.<init>(FileOutputStream.java:133) at org.apache.log4j.FileAppender.setFile(FileAppender.java:294) at org.apache.log4j.RollingFileAppender.setFile(RollingFileAppender.java:207) at org.apache.log4j.FileAppender.activateOptions(FileAppender.java:165) at org.apache.log4j.config.PropertySetter.activate(PropertySetter.java:307) at org.apache.log4j.config.PropertySetter.setProperties(PropertySetter.java:172) at org.apache.log4j.config.PropertySetter.setProperties(PropertySetter.java:104) at org.apache.log4j.PropertyConfigurator.parseAppender(PropertyConfigurator.java:842) at org.apache.log4j.PropertyConfigurator.parseCategory(PropertyConfigurator.java:768) at org.apache.log4j.PropertyConfigurator.configureRootCategory(PropertyConfigurator.java:648) at org.apache.log4j.PropertyConfigurator.doConfigure(PropertyConfigurator.java:514) at org.apache.log4j.PropertyConfigurator.doConfigure(PropertyConfigurator.java:580) at org.apache.log4j.helpers.OptionConverter.selectAndConfigure(OptionConverter.java:526) at org.apache.log4j.LogManager.<clinit>(LogManager.java:127) at org.slf4j.impl.Log4jLoggerFactory.getLogger(Log4jLoggerFactory.java:64) at org.slf4j.LoggerFactory.getLogger(LoggerFactory.java:270) at org.slf4j.LoggerFactory.getLogger(LoggerFactory.java:281) at org.apache.ambari.logsearch.solr.AmbariSolrCloudCLI.<clinit>(AmbariSolrCloudCLI.java:38) Using default ZkCredentialsProvider Client environment:zookeeper.version=3.4.6-1569965, built on 02/20/2014 09:09 GMT Client environment:host.name=os-d7-unsecure-atlas-3.openstacklocal Client environment:java.version=1.8.0_77 Client environment:java.vendor=Oracle Corporation Client environment:java.home=/usr/jdk64/jdk1.8.0_77/jre Client environment:java.class.path=/usr/lib/ambari-logsearch-solr-client:/usr/lib/ambari-logsearch-solr-client/libs/junit-4.10.jar:/usr/lib/ambari-logsearch-solr-client/libs/httpcore-4.4.1.jar:/usr/lib/ambari-logsearch-solr-client/libs/commons-cli-1.3.1.jar:/usr/lib/ambari-logsearch-solr-client/libs/jcl-over-slf4j-1.7.7.jar:/usr/lib/ambari-logsearch-solr-client/libs/ambari-logsearch-solr-client-2.4.0.0.664.jar:/usr/lib/ambari-logsearch-solr-client/libs/log4j-1.2.17.jar:/usr/lib/ambari-logsearch-solr-client/libs/commons-lang-2.5.jar:/usr/lib/ambari-logsearch-solr-client/libs/httpmime-4.4.1.jar:/usr/lib/ambari-logsearch-solr-client/libs/slf4j-log4j12-1.7.2.jar:/usr/lib/ambari-logsearch-solr-client/libs/stax2-api-3.1.4.jar:/usr/lib/ambari-logsearch-solr-client/libs/woodstox-core-asl-4.4.1.jar:/usr/lib/ambari-logsearch-solr-client/libs/noggit-0.6.jar:/usr/lib/ambari-logsearch-solr-client/libs/zookeeper-3.4.6.jar:/usr/lib/ambari-logsearch-solr-client/libs/hamcrest-core-1.1.jar:/usr/lib/ambari-logsearch-solr-client/libs/easymock-3.4.jar:/usr/lib/ambari-logsearch-solr-client/libs/objenesis-2.2.jar:/usr/lib/ambari-logsearch-solr-client/libs/commons-io-2.1.jar:/usr/lib/ambari-logsearch-solr-client/libs/httpclient-4.4.1.jar:/usr/lib/ambari-logsearch-solr-client/libs/slf4j-api-1.7.2.jar:/usr/lib/ambari-logsearch-solr-client/libs/solr-solrj-5.5.1.jar Client environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib Client environment:java.io.tmpdir=/tmp Client environment:java.compiler=<NA> Client environment:os.name=Linux Client environment:os.arch=amd64 Client environment:os.version=3.2.0-4-amd64 Client environment:user.name=atlas Client environment:user.home=/home/atlas Client environment:user.dir=/home/atlas Initiating client connection, connectString=os-d7-unsecure-atlas-3.openstacklocal:2181,os-d7-unsecure-atlas-1.openstacklocal:2181/ambari-solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.SolrZkClient$3@4c98385c Waiting for client to connect to ZooKeeper Opening socket connection to server os-d7-unsecure-atlas-1.openstacklocal/172.22.115.2:2181. Will not attempt to authenticate using SASL (unknown error) Socket connection established to os-d7-unsecure-atlas-1.openstacklocal/172.22.115.2:2181, initiating session Session establishment complete on server os-d7-unsecure-atlas-1.openstacklocal/172.22.115.2:2181, sessionid = 0x1555240e3270026, negotiated timeout = 10000 Watcher org.apache.solr.common.cloud.ConnectionManager@51691955 name:ZooKeeperConnection Watcher:os-d7-unsecure-atlas-3.openstacklocal:2181,os-d7-unsecure-atlas-1.openstacklocal:2181/ambari-solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None Client is connected to ZooKeeper Using default ZkACLProvider Path /usr/lib/ambari-logsearch-solr/server/solr/configsets/basic_configs/conf does not exist java.io.IOException: Path /usr/lib/ambari-logsearch-solr/server/solr/configsets/basic_configs/conf does not exist at org.apache.solr.common.cloud.ZkConfigManager.uploadToZK(ZkConfigManager.java:57) at org.apache.solr.common.cloud.ZkConfigManager.uploadConfigDir(ZkConfigManager.java:121) at org.apache.ambari.logsearch.solr.commands.UploadConfigZkCommand.executeZkCommand(UploadConfigZkCommand.java:37) at org.apache.ambari.logsearch.solr.commands.UploadConfigZkCommand.executeZkCommand(UploadConfigZkCommand.java:27) at org.apache.ambari.logsearch.solr.commands.AbstractZookeeperRetryCommand.createAndProcessRequest(AbstractZookeeperRetryCommand.java:38) at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.retry(AbstractRetryCommand.java:45) at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.run(AbstractRetryCommand.java:40) at org.apache.ambari.logsearch.solr.AmbariSolrCloudClient.uploadConfiguration(AmbariSolrCloudClient.java:106) at org.apache.ambari.logsearch.solr.AmbariSolrCloudCLI.main(AmbariSolrCloudCLI.java:276) Path /usr/lib/ambari-logsearch-solr/server/solr/configsets/basic_configs/conf does not exist java.io.IOException: Path /usr/lib/ambari-logsearch-solr/server/solr/configsets/basic_configs/conf does not exist at org.apache.solr.common.cloud.ZkConfigManager.uploadToZK(ZkConfigManager.java:57) at org.apache.solr.common.cloud.ZkConfigManager.uploadConfigDir(ZkConfigManager.java:121) at org.apache.ambari.logsearch.solr.commands.UploadConfigZkCommand.executeZkCommand(UploadConfigZkCommand.java:37) at org.apache.ambari.logsearch.solr.commands.UploadConfigZkCommand.executeZkCommand(UploadConfigZkCommand.java:27) at org.apache.ambari.logsearch.solr.commands.AbstractZookeeperRetryCommand.createAndProcessRequest(AbstractZookeeperRetryCommand.java:38) at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.retry(AbstractRetryCommand.java:45) at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.run(AbstractRetryCommand.java:40) at org.apache.ambari.logsearch.solr.AmbariSolrCloudClient.uploadConfiguration(AmbariSolrCloudClient.java:106) at org.apache.ambari.logsearch.solr.AmbariSolrCloudCLI.main(AmbariSolrCloudCLI.java:276) Command failed, tries again (tries: 1) Path /usr/lib/ambari-logsearch-solr/server/solr/configsets/basic_configs/conf does not exist java.io.IOException: Path /usr/lib/ambari-logsearch-solr/server/solr/configsets/basic_configs/conf does not exist at org.apache.solr.common.cloud.ZkConfigManager.uploadToZK(ZkConfigManager.java:57) at org.apache.solr.common.cloud.ZkConfigManager.uploadConfigDir(ZkConfigManager.java:121) at org.apache.ambari.logsearch.solr.commands.UploadConfigZkCommand.executeZkCommand(UploadConfigZkCommand.java:37) at org.apache.ambari.logsearch.solr.commands.UploadConfigZkCommand.executeZkCommand(UploadConfigZkCommand.java:27) at org.apache.ambari.logsearch.solr.commands.AbstractZookeeperRetryCommand.createAndProcessRequest(AbstractZookeeperRetryCommand.java:38) at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.retry(AbstractRetryCommand.java:45) at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.retry(AbstractRetryCommand.java:54) at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.run(AbstractRetryCommand.java:40) at org.apache.ambari.logsearch.solr.AmbariSolrCloudClient.uploadConfiguration(AmbariSolrCloudClient.java:106) at org.apache.ambari.logsearch.solr.AmbariSolrCloudCLI.main(AmbariSolrCloudCLI.java:276) Path /usr/lib/ambari-logsearch-solr/server/solr/configsets/basic_configs/conf does not exist java.io.IOException: Path /usr/lib/ambari-logsearch-solr/server/solr/configsets/basic_configs/conf does not exist at org.apache.solr.common.cloud.ZkConfigManager.uploadToZK(ZkConfigManager.java:57) at org.apache.solr.common.cloud.ZkConfigManager.uploadConfigDir(ZkConfigManager.java:121) at org.apache.ambari.logsearch.solr.commands.UploadConfigZkCommand.executeZkCommand(UploadConfigZkCommand.java:37) at org.apache.ambari.logsearch.solr.commands.UploadConfigZkCommand.executeZkCommand(UploadConfigZkCommand.java:27) at org.apache.ambari.logsearch.solr.commands.AbstractZookeeperRetryCommand.createAndProcessRequest(AbstractZookeeperRetryCommand.java:38) at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.retry(AbstractRetryCommand.java:45) at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.retry(AbstractRetryCommand.java:54) at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.run(AbstractRetryCommand.java:40) at org.apache.ambari.logsearch.solr.AmbariSolrCloudClient.uploadConfiguration(AmbariSolrCloudClient.java:106) at org.apache.ambari.logsearch.solr.AmbariSolrCloudCLI.main(AmbariSolrCloudCLI.java:276) Command failed, tries again (tries: 2) Path /usr/lib/ambari-logsearch-solr/server/solr/configsets/basic_configs/conf does not exist java.io.IOException: Path /usr/lib/ambari-logsearch-solr/server/solr/configsets/basic_configs/conf does not exist at org.apache.solr.common.cloud.ZkConfigManager.uploadToZK(ZkConfigManager.java:57) at org.apache.solr.common.cloud.ZkConfigManager.uploadConfigDir(ZkConfigManager.java:121) at org.apache.ambari.logsearch.solr.commands.UploadConfigZkCommand.executeZkCommand(UploadConfigZkCommand.java:37) at org.apache.ambari.logsearch.solr.commands.UploadConfigZkCommand.executeZkCommand(UploadConfigZkCommand.java:27) at org.apache.ambari.logsearch.solr.commands.AbstractZookeeperRetryCommand.createAndProcessRequest(AbstractZookeeperRetryCommand.java:38) at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.retry(AbstractRetryCommand.java:45) at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.retry(AbstractRetryCommand.java:54) at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.retry(AbstractRetryCommand.java:54) at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.run(AbstractRetryCommand.java:40) at org.apache.ambari.logsearch.solr.AmbariSolrCloudClient.uploadConfiguration(AmbariSolrCloudClient.java:106) at org.apache.ambari.logsearch.solr.AmbariSolrCloudCLI.main(AmbariSolrCloudCLI.java:276) Path /usr/lib/ambari-logsearch-solr/server/solr/configsets/basic_configs/conf does not exist java.io.IOException: Path /usr/lib/ambari-logsearch-solr/server/solr/configsets/basic_configs/conf does not exist at org.apache.solr.common.cloud.ZkConfigManager.uploadToZK(ZkConfigManager.java:57) at org.apache.solr.common.cloud.ZkConfigManager.uploadConfigDir(ZkConfigManager.java:121) at org.apache.ambari.logsearch.solr.commands.UploadConfigZkCommand.executeZkCommand(UploadConfigZkCommand.java:37) at org.apache.ambari.logsearch.solr.commands.UploadConfigZkCommand.executeZkCommand(UploadConfigZkCommand.java:27) at org.apache.ambari.logsearch.solr.commands.AbstractZookeeperRetryCommand.createAndProcessRequest(AbstractZookeeperRetryCommand.java:38) at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.retry(AbstractRetryCommand.java:45) at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.retry(AbstractRetryCommand.java:54) at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.retry(AbstractRetryCommand.java:54) at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.run(AbstractRetryCommand.java:40) at org.apache.ambari.logsearch.solr.AmbariSolrCloudClient.uploadConfiguration(AmbariSolrCloudClient.java:106) at org.apache.ambari.logsearch.solr.AmbariSolrCloudCLI.main(AmbariSolrCloudCLI.java:276) Command failed, tries again (tries: 3) Path /usr/lib/ambari-logsearch-solr/server/solr/configsets/basic_configs/conf does not exist java.io.IOException: Path /usr/lib/ambari-logsearch-solr/server/solr/configsets/basic_configs/conf does not exist at org.apache.solr.common.cloud.ZkConfigManager.uploadToZK(ZkConfigManager.java:57) at org.apache.solr.common.cloud.ZkConfigManager.uploadConfigDir(ZkConfigManager.java:121) at org.apache.ambari.logsearch.solr.commands.UploadConfigZkCommand.executeZkCommand(UploadConfigZkCommand.java:37) at org.apache.ambari.logsearch.solr.commands.UploadConfigZkCommand.executeZkCommand(UploadConfigZkCommand.java:27) at org.apache.ambari.logsearch.solr.commands.AbstractZookeeperRetryCommand.createAndProcessRequest(AbstractZookeeperRetryCommand.java:38) at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.retry(AbstractRetryCommand.java:45) at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.retry(AbstractRetryCommand.java:54) at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.retry(AbstractRetryCommand.java:54) at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.retry(AbstractRetryCommand.java:54) at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.run(AbstractRetryCommand.java:40) at org.apache.ambari.logsearch.solr.AmbariSolrCloudClient.uploadConfiguration(AmbariSolrCloudClient.java:106) at org.apache.ambari.logsearch.solr.AmbariSolrCloudCLI.main(AmbariSolrCloudCLI.java:276) Path /usr/lib/ambari-logsearch-solr/server/solr/configsets/basic_configs/conf does not exist java.io.IOException: Path /usr/lib/ambari-logsearch-solr/server/solr/configsets/basic_configs/conf does not exist at org.apache.solr.common.cloud.ZkConfigManager.uploadToZK(ZkConfigManager.java:57) at org.apache.solr.common.cloud.ZkConfigManager.uploadConfigDir(ZkConfigManager.java:121) at org.apache.ambari.logsearch.solr.commands.UploadConfigZkCommand.executeZkCommand(UploadConfigZkCommand.java:37) at org.apache.ambari.logsearch.solr.commands.UploadConfigZkCommand.executeZkCommand(UploadConfigZkCommand.java:27) at org.apache.ambari.logsearch.solr.commands.AbstractZookeeperRetryCommand.createAndProcessRequest(AbstractZookeeperRetryCommand.java:38) at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.retry(AbstractRetryCommand.java:45) at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.retry(AbstractRetryCommand.java:54) at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.retry(AbstractRetryCommand.java:54) at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.retry(AbstractRetryCommand.java:54) at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.run(AbstractRetryCommand.java:40) at org.apache.ambari.logsearch.solr.AmbariSolrCloudClient.uploadConfiguration(AmbariSolrCloudClient.java:106) at org.apache.ambari.logsearch.solr.AmbariSolrCloudCLI.main(AmbariSolrCloudCLI.java:276) Command failed, tries again (tries: 4) Path /usr/lib/ambari-logsearch-solr/server/solr/configsets/basic_configs/conf does not exist java.io.IOException: Path /usr/lib/ambari-logsearch-solr/server/solr/configsets/basic_configs/conf does not exist at org.apache.solr.common.cloud.ZkConfigManager.uploadToZK(ZkConfigManager.java:57) at org.apache.solr.common.cloud.ZkConfigManager.uploadConfigDir(ZkConfigManager.java:121) at org.apache.ambari.logsearch.solr.commands.UploadConfigZkCommand.executeZkCommand(UploadConfigZkCommand.java:37) at org.apache.ambari.logsearch.solr.commands.UploadConfigZkCommand.executeZkCommand(UploadConfigZkCommand.java:27) at org.apache.ambari.logsearch.solr.commands.AbstractZookeeperRetryCommand.createAndProcessRequest(AbstractZookeeperRetryCommand.java:38) at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.retry(AbstractRetryCommand.java:45) at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.retry(AbstractRetryCommand.java:54) at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.retry(AbstractRetryCommand.java:54) at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.retry(AbstractRetryCommand.java:54) at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.retry(AbstractRetryCommand.java:54) at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.run(AbstractRetryCommand.java:40) at org.apache.ambari.logsearch.solr.AmbariSolrCloudClient.uploadConfiguration(AmbariSolrCloudClient.java:106) at org.apache.ambari.logsearch.solr.AmbariSolrCloudCLI.main(AmbariSolrCloudCLI.java:276) Path /usr/lib/ambari-logsearch-solr/server/solr/configsets/basic_configs/conf does not exist java.io.IOException: Path /usr/lib/ambari-logsearch-solr/server/solr/configsets/basic_configs/conf does not exist at org.apache.solr.common.cloud.ZkConfigManager.uploadToZK(ZkConfigManager.java:57) at org.apache.solr.common.cloud.ZkConfigManager.uploadConfigDir(ZkConfigManager.java:121) at org.apache.ambari.logsearch.solr.commands.UploadConfigZkCommand.executeZkCommand(UploadConfigZkCommand.java:37) at org.apache.ambari.logsearch.solr.commands.UploadConfigZkCommand.executeZkCommand(UploadConfigZkCommand.java:27) at org.apache.ambari.logsearch.solr.commands.AbstractZookeeperRetryCommand.createAndProcessRequest(AbstractZookeeperRetryCommand.java:38) at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.retry(AbstractRetryCommand.java:45) at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.retry(AbstractRetryCommand.java:54) at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.retry(AbstractRetryCommand.java:54) at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.retry(AbstractRetryCommand.java:54) at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.retry(AbstractRetryCommand.java:54) at org.apache.ambari.logsearch.solr.commands.AbstractRetryCommand.run(AbstractRetryCommand.java:40) at org.apache.ambari.logsearch.solr.AmbariSolrCloudClient.uploadConfiguration(AmbariSolrCloudClient.java:106) at org.apache.ambari.logsearch.solr.AmbariSolrCloudCLI.main(AmbariSolrCloudCLI.java:276) Command failed, tries again (tries: 5) usage: ./solrCloudCli.sh --create-collection -z host1:2181,host2:2181/ambari-solr -c collection -cs conf_set ./solrCloudCli.sh --upload-config -z host1:2181,host2:2181/ambari-solr -d /tmp/myonfig_dir -cs config_set ./solrCloudCli.sh --download-config -z host1:2181,host2:2181/ambari-solr -cs config_set -d /tmp/myonfig_dir ./solrCloudCli.sh --check-config -z host1:2181,host2:2181/ambari-solr -cs config_set ./solrCloudCli.sh --create-shard -z host1:2181,host2:2181/ambari-solr -c collection -sn myshard -c,--collection <collection name> Collection name -cc,--create-collection Create collection in Solr (command) -chc,--check-config Check configuration exists in Zookeeper (command) -cs,--config-set <config_set> Configuration set -csh,--create-shard Create shard in Solr (command) -d,--config-dir <config_dir> Configuration directory -dc,--download-config Download configuration set from Zookeeper (command) -h,--help Print commands -i,--interval <interval> Interval for retry logic in sec [default:5] -m,--max-shards <max number of shards> Max number of shards per node (default: replication * shards) -ns,--no-sharding Sharding not used when creating collection -r,--replication <replication factor> Replication factor -rf,--router-field <router_field> Router field for collection [default:_router_field_] -rn,--router-name <router_name> Router name for collection [default:implicit] -rt,--retry <number of retries> Number of retries for access Solr [default:10] -s,--shards <shard number> Number of shards -sn,--shard-name <my_new_shard> Name of the shard for create-shard command -uc,--upload-config Upload configuration set to Zookeeper (command) -z,--zookeeper-host <host:port,host:port../ambari-solr> Zookeeper quorum and Znode Maximum retries exceeded: 5 Maximum retries exceeded: 5 {noformat} *As a result of the above issue, Atlas is failing to comeup and all the nightlies are affected. So, marking this as a blocker for Atlas.* Live cluster info: http://172.22.115.199:8080/#/main/dashboard/metrics OS: Debian7 HDP: http://s3.amazonaws.com/dev.hortonworks.com/HDP/debian7/2.x/BUILDS/2.5.0.0-733 Ambari: 2.4.0.0-664 {noformat} root@os-d7-unsecure-atlas-3:/grid/0/log/atlas# dpkg-query -l | grep ambari-server ii ambari-server 2.4.0.0-664 amd64 Ambari Server root@os-d7-unsecure-atlas-3:/grid/0/log/atlas# {noformat} -- This message was sent by Atlassian JIRA (v6.3.4#6332)