It is actually pretty handy. You can get those type of logs right in the Ambari web interface. If you click on "Ops" near the top of the Ambari screen, it will open a window where you can dig-into all the previous operations that were run. From there you can find the operation that failed and click through to get specific log messages from any host.
Ambari user documentation is pretty good. No comment on Mpack programming documentation. :) On Wed, Apr 26, 2017 at 5:06 PM, Otto Fowler <ottobackwa...@gmail.com> wrote: > Thanks Nick. I don’t think we catch exceptions at all from the execute > calls. I wonder what the best practice is? > I can’t seem to find the ambari mpack programming documentation ;) > > > On April 26, 2017 at 16:50:18, Nick Allen (n...@nickallen.org) wrote: > > I can create the JIRA. I capture the logs. > > On Wed, Apr 26, 2017 at 4:48 PM, Nick Allen <n...@nickallen.org> wrote: > >> Yes, Otto. I just experienced that myself. It is a bug that we should >> create a JIRA for. >> >> I was able to work around it by just using "start" instead of "restart". >> >> On Wed, Apr 26, 2017 at 3:41 PM, Otto Fowler <ottobackwa...@gmail.com> >> wrote: >> >>> Ok, I did ifconfig, i mean ip a and got the right values >>> that and the brackets and it looks like es is up. >>> >>> Now my next problem is prob. a bug. >>> >>> Ambari thinks it needs to restart ‘metron’. >>> the enrichment restart crashes because we don’t catch the storm >>> exception that you are stopping a topology that was not running. >>> >>> The question is - is the state wrong _and_ the exception catch or not. >>> >>> I am guessing I should start a Jira for that one? >>> >>> >>> >>> On April 26, 2017 at 15:31:05, Otto Fowler (ottobackwa...@gmail.com) >>> wrote: >>> >>> So now I’m getting errors for ETH0 >>> I think that is one of the things that has to change on centos7? >>> Can you check what you have? >>> >>> >>> >>> On April 26, 2017 at 15:20:18, Nick Allen (n...@nickallen.org) wrote: >>> >>> Yes, I am also running on CentOS 7. >>> >>> On Wed, Apr 26, 2017 at 3:19 PM, Otto Fowler <ottobackwa...@gmail.com> >>> wrote: >>> >>>> Would i have to change that on Centos 7? >>>> >>>> >>>> On April 26, 2017 at 15:12:38, Nick Allen (n...@nickallen.org) wrote: >>>> >>>> Check on the `network_hosts` setting. I just ran into the same issue. I >>>> had to add brackets around it otherwise the file was not valid YAML and >>>> it >>>> would crash trying to load the config file. >>>> >>>> network.host: ["_lo:ipv4_","_eth0:ipv4_"] >>>> >>>> On Wed, Apr 26, 2017 at 3:09 PM, Otto Fowler <ottobackwa...@gmail.com> >>>> wrote: >>>> >>>> > I think it is literally crashing trying to load the config file >>>> > >>>> > >>>> > >>>> > On April 26, 2017 at 15:00:25, Michael Miklavcic ( >>>> > michael.miklav...@gmail.com) wrote: >>>> > >>>> > A couple more things you should check, given this setup: >>>> > >>>> > - 1 master node (not as data node) >>>> > - 2 data nodes >>>> > >>>> > I'd use something like this: >>>> > >>>> > - gateway_recover_after_data_nodes=1 or 2 >>>> > - index_number_of_replicas=0 or 1 (2 data nodes, with 2 total copies >>>> of >>>> > the index - if you set this value to 2, it would need 1 more data node >>>> > to >>>> > attain 1 orig index + 2 replicas) >>>> > >>>> > >>>> > >>>> > On Wed, Apr 26, 2017 at 12:02 PM, Otto Fowler < >>>> ottobackwa...@gmail.com> >>>> > wrote: >>>> > >>>> > > Actually never mind. I am not sure how to read the exception. Is it >>>> > > failing to read the configuration? >>>> > > >>>> > > >>>> > > On April 26, 2017 at 14:01:26, Otto Fowler (ottobackwa...@gmail.com >>>> ) >>>> > > wrote: >>>> > > >>>> > > So the elasticsearch service is disabled. That is the issue. When ES >>>> > > calls get status ( service elasticsearch status ) it fails. >>>> > > I don’t know systemd too well, but does that mean we didn’t do the >>>> equiv >>>> > > of chkconfig on? >>>> > > >>>> > > >>>> > > >>>> > > On April 26, 2017 at 13:54:10, Otto Fowler (ottobackwa...@gmail.com >>>> ) >>>> > > wrote: >>>> > > >>>> > > Getting the same error in ES as before from what I can see >>>> > > >>>> > > >>>> > > On April 26, 2017 at 13:47:09, Otto Fowler (ottobackwa...@gmail.com >>>> ) >>>> > > wrote: >>>> > > >>>> > > I still can’t keep ES running, it dies. >>>> > > Also, I’m getting exceptions from enrichment trying to restart when >>>> the >>>> > > topology wasn’t running. >>>> > > >>>> > > Is there some coordination in this work? Should I just log jiras? >>>> > > If someone is already sussing out ES, we can sync up >>>> > > >>>> > > >>>> > > >>>> > > On April 26, 2017 at 11:35:03, zeo...@gmail.com (zeo...@gmail.com) >>>> > wrote: >>>> > > >>>> > > I'm also interested to know why that's important at such a small >>>> scale. >>>> > > >>>> > > Jon >>>> > > >>>> > > On Wed, Apr 26, 2017, 10:51 AM Otto Fowler <ottobackwa...@gmail.com >>>> > >>>> > > wrote: >>>> > > >>>> > > > I am following >>>> > > > >>>> > > > https://community.hortonworks.com/articles/60805/deploying- >>>> > > a-fresh-metron-cluster-using-ambari-serv.html >>>> > > > I DO have master and data node together. >>>> > > > Why is that a problem? >>>> > > > >>>> > > > I will try again with master and data node separate. >>>> > > > >>>> > > > >>>> > > > On April 26, 2017 at 10:41:59, Michael Miklavcic ( >>>> > > > michael.miklav...@gmail.com) wrote: >>>> > > > >>>> > > > Hey Otto, >>>> > > > >>>> > > > How do you have the ES nodes configured? For a base install I >>>> would >>>> > > setup 1 >>>> > > > master (NOT as data node) and 2 data nodes (NOT on the same node >>>> as the >>>> > > > master). This is the install configuration I got working. You can >>>> also >>>> > > > modify some configuration properties around master node as data >>>> node, >>>> > > index >>>> > > > replicas, and gateway recovery to get it working differently, but >>>> this >>>> > is >>>> > > > what will work OOTB with the default config settings from the >>>> mpack. If >>>> > > > you've already setup a master node and a data node on the same >>>> host, >>>> > > we'll >>>> > > > need to re-install. >>>> > > > >>>> > > > Mike >>>> > > > >>>> > > > >>>> > > > On Wed, Apr 26, 2017 at 7:02 AM, Otto Fowler < >>>> ottobackwa...@gmail.com> >>>> > > > wrote: >>>> > > > >>>> > > > > File >>>> > > > > "/usr/lib/python2.6/site-packages/resource_management/ >>>> > core/shell.py", >>>> > > > line >>>> > > > > 293, in _call >>>> > > > > >>>> > > > > raise ExecutionFailed(err_msg, code, out, err) >>>> > > > > >>>> > > > > ExecutionFailed: Execution of 'service elasticsearch status' >>>> returned >>>> > > 3. >>>> > > > ● >>>> > > > > elasticsearch.service - Elasticsearch >>>> > > > > >>>> > > > > Loaded: loaded (/usr/lib/systemd/system/elasticsearch.service; >>>> > > > > disabled; >>>> > > > > vendor preset: disabled) >>>> > > > > >>>> > > > > Active: failed (Result: exit-code) since Tue 2017-04-25 >>>> 22:14:58 EDT >>>> > > > > <http://airmail.calendar/2017-04-25%2022:14:58%20EDT>; 10h ago >>>> > > > > >>>> > > > > Docs: http://www.elastic.co >>>> > > > > >>>> > > > > Process: 16821 ExecStart=/usr/share/elasticse >>>> arch/bin/elasticsearch >>>> > > > > -Des.pidfile=${PID_DIR}/elasticsearch.pid >>>> > -Des.default.path.home=${ES_ >>>> > > > > HOME} >>>> > > > > -Des.default.path.logs=${LOG_DIR} >>>> -Des.default.path.data=${DATA_DIR} >>>> > > > > -Des.default.path.conf=${CONF_DIR} (code=exited, >>>> status=1/FAILURE) >>>> > > > > >>>> > > > > Process: 16819 >>>> > > > > ExecStartPre=/usr/share/elasticsearch/bin/ >>>> > > elasticsearch-systemd-pre-exec >>>> > > > > (code=exited, status=0/SUCCESS) >>>> > > > > >>>> > > > > Main PID: 16821 (code=exited, status=1/FAILURE) >>>> > > > > >>>> > > > > >>>> > > > > >>>> > > > > Apr 25 22:14:58 <http://airmail.calendar/2017- >>>> 04-25%2022:14:58%20EDT >>>> > > >>>> > > > > ccs-fx-met-poc-86.dev.industrialdefender.com >>>> elasticsearch[16821]: >>>> > at >>>> > > > > org.elasticsearch.common.settings.Settings$Builder. >>>> > > > > loadFromStream(Settings.java:1080) >>>> > > > > >>>> > > > > Apr 25 22:14:58 <http://airmail.calendar/2017- >>>> 04-25%2022:14:58%20EDT >>>> > > >>>> > > > > ccs-fx-met-poc-86.dev.industrialdefender.com >>>> elasticsearch[16821]: >>>> > at >>>> > > > > org.elasticsearch.common.settings.Settings$Builder. >>>> > > > > loadFromPath(Settings.java:1067) >>>> > > > > >>>> > > > > Apr 25 22:14:58 <http://airmail.calendar/2017- >>>> 04-25%2022:14:58%20EDT >>>> > > >>>> > > > > ccs-fx-met-poc-86.dev.industrialdefender.com >>>> elasticsearch[16821]: >>>> > at >>>> > > > > org.elasticsearch.node.internal.InternalSettingsPreparer. >>>> > > > > prepareEnvironment(InternalSettingsPreparer.java:88) >>>> > > > > >>>> > > > > Apr 25 22:14:58 <http://airmail.calendar/2017- >>>> 04-25%2022:14:58%20EDT >>>> > > >>>> > > > > ccs-fx-met-poc-86.dev.industrialdefender.com >>>> elasticsearch[16821]: >>>> > at >>>> > > > > org.elasticsearch.bootstrap.Bootstrap.initialSettings( >>>> > > Bootstrap.java:202) >>>> > > > > >>>> > > > > Apr 25 22:14:58 <http://airmail.calendar/2017- >>>> 04-25%2022:14:58%20EDT >>>> > > >>>> > > > > ccs-fx-met-poc-86.dev.industrialdefender.com >>>> elasticsearch[16821]: >>>> > at >>>> > > > > org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:241) >>>> > > > > >>>> > > > > Apr 25 22:14:58 <http://airmail.calendar/2017- >>>> 04-25%2022:14:58%20EDT >>>> > > >>>> > > > > ccs-fx-met-poc-86.dev.industrialdefender.com >>>> elasticsearch[16821]: >>>> > at >>>> > > > > org.elasticsearch.bootstrap.Elasticsearch.main( >>>> > Elasticsearch.java:35) >>>> > > > > >>>> > > > > Apr 25 22:14:58 <http://airmail.calendar/2017- >>>> 04-25%2022:14:58%20EDT >>>> > > >>>> > > > > ccs-fx-met-poc-86.dev.industrialdefender.com >>>> elasticsearch[16821]: >>>> > > Refer >>>> > > > > to >>>> > > > > the log for complete error details. >>>> > > > > >>>> > > > > Apr 25 22:14:58 <http://airmail.calendar/2017- >>>> 04-25%2022:14:58%20EDT >>>> > > >>>> > > > > ccs-fx-met-poc-86.dev.industrialdefender.com systemd[1]: >>>> > > > > elasticsearch.service: main process exited, code=exited, >>>> > > status=1/FAILURE >>>> > > > > >>>> > > > > Apr 25 22:14:58 <http://airmail.calendar/2017- >>>> 04-25%2022:14:58%20EDT >>>> > > >>>> > > > > ccs-fx-met-poc-86.dev.industrialdefender.com systemd[1]: Unit >>>> > > > > elasticsearch.service entered failed state. >>>> > > > > >>>> > > > > Apr 25 22:14:58 <http://airmail.calendar/2017- >>>> 04-25%2022:14:58%20EDT >>>> > > >>>> > > > > ccs-fx-met-poc-86.dev.industrialdefender.com systemd[1]: >>>> > > > > elasticsearch.service failed. >>>> > > > > >>>> > > > > INFO 2017-04-26 08:55:19,962 >>>> > > > > <http://airmail.calendar/2017-04-26%2008:55:19%20EDT> Contr >>>> > > > > >>>> > > > > >>>> > > > > On April 26, 2017 at 08:27:27, Otto Fowler ( >>>> ottobackwa...@gmail.com) >>>> > > > > wrote: >>>> > > > > >>>> > > > > Can you describe what ES issues you are working on? >>>> > > > > Fixing the repos got everything installed, but my ES components >>>> don’t >>>> > > > stay >>>> > > > > running. >>>> > > > > I need to harvest the errors. >>>> > > > > >>>> > > > > >>>> > > > > >>>> > > > > On April 25, 2017 at 16:46:00, Otto Fowler ( >>>> ottobackwa...@gmail.com) >>>> > > > > wrote: >>>> > > > > >>>> > > > > Nm. sorry. I fixed it. >>>> > > > > >>>> > > > > >>>> > > > > >>>> > > > > On April 25, 2017 at 16:42:05, Otto Fowler ( >>>> ottobackwa...@gmail.com) >>>> > > > > wrote: >>>> > > > > >>>> > > > > Ok, now I see the repos in the ‘pick version’ screen, but it is >>>> > erring >>>> > > on >>>> > > > > the f://localrepo >>>> > > > > even though the folder exists, there is no repodata/repomd.xml. >>>> > > > > >>>> > > > > What is the command to create a local repo? >>>> > > > > >>>> > > > > >>>> > > > > >>>> > > > > On April 25, 2017 at 16:05:17, Otto Fowler ( >>>> ottobackwa...@gmail.com) >>>> > > > > wrote: >>>> > > > > >>>> > > > > I was going by the HW community page. >>>> > > > > >>>> > > > > Ok, Let me try it >>>> > > > > >>>> > > > > >>>> > > > > >>>> > > > > On April 25, 2017 at 16:04:07, David Lyle (dlyle65...@gmail.com >>>> ) >>>> > > wrote: >>>> > > > > >>>> > > > > That would do it. It requires 2.4.2+. I would have sworn I put >>>> that >>>> > in >>>> > > > the >>>> > > > > README, but I must have only annotated the PR. :( >>>> > > > > >>>> > > > > I'll get that in asap. >>>> > > > > >>>> > > > > -D... >>>> > > > > >>>> > > > > >>>> > > > > On Tue, Apr 25, 2017 at 3:44 PM, Otto Fowler < >>>> > ottobackwa...@gmail.com> >>>> > > > > wrote: >>>> > > > > >>>> > > > > > 2.4.1 as a matter of fact >>>> > > > > > >>>> > > > > > >>>> > > > > > On April 25, 2017 at 15:29:43, David Lyle ( >>>> dlyle65...@gmail.com) >>>> > > > wrote: >>>> > > > > > >>>> > > > > > Any chance they're running Ambari < 2.4.2? >>>> > > > > > >>>> > > > > > -D... >>>> > > > > > >>>> > > > > > >>>> > > > > > On Tue, Apr 25, 2017 at 3:23 PM, Michael Miklavcic < >>>> > > > > > michael.miklav...@gmail.com> wrote: >>>> > > > > > >>>> > > > > > > Hey Otto, I don't have wizard screenshots in front of me >>>> right >>>> > now >>>> > > to >>>> > > > > > say >>>> > > > > > > for sure, but I do see a repoinfo.xml in the mpack. I >>>> haven't run >>>> > > > into >>>> > > > > > > anything like that, but next time I run through the install >>>> I can >>>> > > > take >>>> > > > > > > another look. >>>> > > > > > > >>>> > > > > > > https://github.com/apache/incubator-metron/blob/master/ >>>> > > > > > > metron-deployment/packaging/ambari/metron-mpack/src/main/ >>>> > > > > > > resources/addon-services/ELAST >>>> ICSEARCH/2.3.3/repos/repoinfo.xml >>>> > > > > > > >>>> > > > > > > >>>> > > > > > > On Tue, Apr 25, 2017 at 12:16 PM, Otto Fowler < >>>> > > > ottobackwa...@gmail.com >>>> > > > > > >>>> > > > > > > wrote: >>>> > > > > > > >>>> > > > > > > > stderr: >>>> > > > > > > > >>>> > > > > > > > Traceback (most recent call last): >>>> > > > > > > > >>>> > > > > > > > File "/var/lib/ambari-agent/cache/ >>>> > common-services/ELASTICSEARCH/ >>>> > > > > > > > 2.3.3/package/scripts/elastic_slave.py", line 71, in >>>> <module> >>>> > > > > > > > >>>> > > > > > > > Elasticsearch().execute() >>>> > > > > > > > >>>> > > > > > > > File "/usr/lib/python2.6/site-packa >>>> ges/resource_management/ >>>> > > > > > > libraries/script/script.py", >>>> > > > > > > > line 280, in execute >>>> > > > > > > > >>>> > > > > > > > method(env) >>>> > > > > > > > >>>> > > > > > > > File "/var/lib/ambari-agent/cache/ >>>> > common-services/ELASTICSEARCH/ >>>> > > > > > > > 2.3.3/package/scripts/elastic_slave.py", line 32, in >>>> install >>>> > > > > > > > >>>> > > > > > > > self.install_packages(env) >>>> > > > > > > > >>>> > > > > > > > File "/usr/lib/python2.6/site-packa >>>> ges/resource_management/ >>>> > > > > > > libraries/script/script.py", >>>> > > > > > > > line 567, in install_packages >>>> > > > > > > > >>>> > > > > > > > retry_count=agent_stack_retry_count) >>>> > > > > > > > >>>> > > > > > > > File "/usr/lib/python2.6/site-packa >>>> ges/resource_management/ >>>> > > > > > > core/base.py", >>>> > > > > > > > line 155, in __init__ >>>> > > > > > > > >>>> > > > > > > > self.env.run() >>>> > > > > > > > >>>> > > > > > > > File "/usr/lib/python2.6/site-packa >>>> ges/resource_management/ >>>> > > > > > > core/environment.py", >>>> > > > > > > > line 160, in run >>>> > > > > > > > >>>> > > > > > > > self.run_action(resource, action) >>>> > > > > > > > >>>> > > > > > > > File "/usr/lib/python2.6/site-packa >>>> ges/resource_management/ >>>> > > > > > > core/environment.py", >>>> > > > > > > > line 124, in run_action >>>> > > > > > > > >>>> > > > > > > > provider_action() >>>> > > > > > > > >>>> > > > > > > > File "/usr/lib/python2.6/site-packa >>>> ges/resource_management/ >>>> > > > > > > > core/providers/package/__init__.py", line 54, in >>>> > action_install >>>> > > > > > > > >>>> > > > > > > > self.install_package(package_name, >>>> self.resource.use_repos, >>>> > > > > > > > self.resource.skip_repos) >>>> > > > > > > > >>>> > > > > > > > File "/usr/lib/python2.6/site-packa >>>> ges/resource_management/ >>>> > > > > > > > core/providers/package/yumrpm.py", line 49, in >>>> install_package >>>> > > > > > > > >>>> > > > > > > > self.checked_call_with_retries(cmd, sudo=True, >>>> > > > > > > > logoutput=self.get_logoutput()) >>>> > > > > > > > >>>> > > > > > > > File "/usr/lib/python2.6/site-packa >>>> ges/resource_management/ >>>> > > > > > > > core/providers/package/__init__.py", line 83, in >>>> > > > > > > checked_call_with_retries >>>> > > > > > > > >>>> > > > > > > > return self._call_with_retries(cmd, is_checked=True, >>>> **kwargs) >>>> > > > > > > > >>>> > > > > > > > File "/usr/lib/python2.6/site-packa >>>> ges/resource_management/ >>>> > > > > > > > core/providers/package/__init__.py", line 91, in >>>> > > _call_with_retries >>>> > > > > > > > >>>> > > > > > > > code, out = func(cmd, **kwargs) >>>> > > > > > > > >>>> > > > > > > > File "/usr/lib/python2.6/site-packa >>>> ges/resource_management/ >>>> > > > > > > core/shell.py", >>>> > > > > > > > line 71, in inner >>>> > > > > > > > >>>> > > > > > > > result = function(command, **kwargs) >>>> > > > > > > > >>>> > > > > > > > File "/usr/lib/python2.6/site-packa >>>> ges/resource_management/ >>>> > > > > > > core/shell.py", >>>> > > > > > > > line 93, in checked_call >>>> > > > > > > > >>>> > > > > > > > tries=tries, try_sleep=try_sleep) >>>> > > > > > > > >>>> > > > > > > > File "/usr/lib/python2.6/site-packa >>>> ges/resource_management/ >>>> > > > > > > core/shell.py", >>>> > > > > > > > line 141, in _call_wrapper >>>> > > > > > > > >>>> > > > > > > > result = _call(command, **kwargs_copy) >>>> > > > > > > > >>>> > > > > > > > File "/usr/lib/python2.6/site-packa >>>> ges/resource_management/ >>>> > > > > > > core/shell.py", >>>> > > > > > > > line 294, in _call >>>> > > > > > > > >>>> > > > > > > > raise Fail(err_msg) >>>> > > > > > > > >>>> > > > > > > > resource_management.core.exceptions.Fail: Execution of >>>> > > > '/usr/bin/yum >>>> > > > > > -d >>>> > > > > > > 0 >>>> > > > > > > > -e 0 -y install elasticsearch-2.3.3' returned 1. Error: >>>> Nothing >>>> > > to >>>> > > > do >>>> > > > > > > > >>>> > > > > > > > stdout: >>>> > > > > > > > >>>> > > > > > > > 2017-04-25 14:12:48,669 >>>> > > > > > > > <http://airmail.calendar/2017-04-25%2014:12:48%20EDT> - >>>> Using >>>> > > > hadoop >>>> > > > > > > conf >>>> > > > > > > > dir: /usr/hdp/current/hadoop-client/conf >>>> > > > > > > > >>>> > > > > > > > 2017-04-25 14:12:48,671 >>>> > > > > > > > <http://airmail.calendar/2017-04-25%2014:12:48%20EDT> - >>>> > > > > > Group['metron'] >>>> > > > > > > {} >>>> > > > > > > > >>>> > > > > > > > 2017-04-25 14:12:48,673 >>>> > > > > > > > <http://airmail.calendar/2017-04-25%2014:12:48%20EDT> - >>>> Adding >>>> > > > group >>>> > > > > > > > Group['metron'] >>>> > > > > > > > >>>> > > > > > > > 2017-04-25 14:12:48,740 >>>> > > > > > > > <http://airmail.calendar/2017-04-25%2014:12:48%20EDT> - >>>> > > > > Group['livy'] >>>> > > > > > {} >>>> > > > > > > > >>>> > > > > > > > 2017-04-25 14:12:48,741 >>>> > > > > > > > <http://airmail.calendar/2017-04-25%2014:12:48%20EDT> - >>>> Adding >>>> > > > group >>>> > > > > > > > Group['livy'] >>>> > > > > > > > >>>> > > > > > > > 2017-04-25 14:12:48,774 >>>> > > > > > > > <http://airmail.calendar/2017-04-25%2014:12:48%20EDT> - >>>> > > > > > > > Group['elasticsearch'] {} >>>> > > > > > > > >>>> > > > > > > > 2017-04-25 14:12:48,775 >>>> > > > > > > > <http://airmail.calendar/2017-04-25%2014:12:48%20EDT> - >>>> Adding >>>> > > > group >>>> > > > > > > > Group['elasticsearch'] >>>> > > > > > > > >>>> > > > > > > > 2017-04-25 14:12:48,812 >>>> > > > > > > > <http://airmail.calendar/2017-04-25%2014:12:48%20EDT> - >>>> > > > > > Group['spark'] >>>> > > > > > > {} >>>> > > > > > > > >>>> > > > > > > > 2017-04-25 14:12:48,812 >>>> > > > > > > > <http://airmail.calendar/2017-04-25%2014:12:48%20EDT> - >>>> Adding >>>> > > > group >>>> > > > > > > > Group['spark'] >>>> > > > > > > > >>>> > > > > > > > 2017-04-25 14:12:48,848 >>>> > > > > > > > <http://airmail.calendar/2017-04-25%2014:12:48%20EDT> - >>>> > > > > > > Group['zeppelin'] >>>> > > > > > > > {} >>>> > > > > > > > >>>> > > > > > > > 2017-04-25 14:12:48,849 >>>> > > > > > > > <http://airmail.calendar/2017-04-25%2014:12:48%20EDT> - >>>> Adding >>>> > > > group >>>> > > > > > > > Group['zeppelin'] >>>> > > > > > > > >>>> > > > > > > > 2017-04-25 14:12:48,884 >>>> > > > > > > > <http://airmail.calendar/2017-04-25%2014:12:48%20EDT> - >>>> > > > > > Group['hadoop'] >>>> > > > > > > {} >>>> > > > > > > > >>>> > > > > > > > 2017-04-25 14:12:48,885 >>>> > > > > > > > <http://airmail.calendar/2017-04-25%2014:12:48%20EDT> - >>>> Adding >>>> > > > group >>>> > > > > > > > Group['hadoop'] >>>> > > > > > > > >>>> > > > > > > > 2017-04-25 14:12:48,921 >>>> > > > > > > > <http://airmail.calendar/2017-04-25%2014:12:48%20EDT> - >>>> > > > > > Group['kibana'] >>>> > > > > > > {} >>>> > > > > > > > >>>> > > > > > > > 2017-04-25 14:12:48,922 >>>> > > > > > > > <http://airmail.calendar/2017-04-25%2014:12:48%20EDT> - >>>> Adding >>>> > > > group >>>> > > > > > > > Group['kibana'] >>>> > > > > > > > >>>> > > > > > > > 2017-04-25 14:12:48,959 >>>> > > > > > > > <http://airmail.calendar/2017-04-25%2014:12:48%20EDT> - >>>> > > > > > Group['users'] >>>> > > > > > > {} >>>> > > > > > > > >>>> > > > > > > > 2017-04-25 14:12:48,960 >>>> > > > > > > > <http://airmail.calendar/2017-04-25%2014:12:48%20EDT> - >>>> > > > User['hive'] >>>> > > > > > > > {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': >>>> > > > > > [u'hadoop']} >>>> > > > > > > > >>>> > > > > > > > 2017-04-25 14:12:48,961 >>>> > > > > > > > <http://airmail.calendar/2017-04-25%2014:12:48%20EDT> - >>>> Adding >>>> > > > user >>>> > > > > > > > User['hive'] >>>> > > > > > > > >>>> > > > > > > > 2017-04-25 14:12:49,227 >>>> > > > > > > > <http://airmail.calendar/2017-04-25%2014:12:49%20EDT> - >>>> > > > > User['storm'] >>>> > > > > > > > {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': >>>> > > > > > [u'hadoop']} >>>> > > > > > > > >>>> > > > > > > > 2017-04-25 14:12:49,227 >>>> > > > > > > > <http://airmail.calendar/2017-04-25%2014:12:49%20EDT> - >>>> Adding >>>> > > > user >>>> > > > > > > > User['storm'] >>>> > > > > > > > >>>> > > > > > > > 2017-04-25 14:12:49,388 >>>> > > > > > > > <http://airmail.calendar/2017-04-25%2014:12:49%20EDT> - >>>> > > > > > > User['zookeeper'] >>>> > > > > > > > {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': >>>> > > > > > [u'hadoop']} >>>> > > > > > > > >>>> > > > > > > > 2017-04-25 14:12:49,388 >>>> > > > > > > > <http://airmail.calendar/2017-04-25%2014:12:49%20EDT> - >>>> Adding >>>> > > > user >>>> > > > > > > > User['zookeeper'] >>>> > > > > > > > >>>> > > > > > > > 2017-04-25 14:12:49,518 >>>> > > > > > > > <http://airmail.calendar/2017-04-25%2014:12:49%20EDT> - >>>> > > > > > > > User['infra-solr'] {'gid': 'hadoop', >>>> 'fetch_nonlocal_groups': >>>> > > True, >>>> > > > > > > > 'groups': [u'hadoop']} >>>> > > > > > > > >>>> > > > > > > > 2017-04-25 14:12:49,518 >>>> > > > > > > > <http://airmail.calendar/2017-04-25%2014:12:49%20EDT> - >>>> Adding >>>> > > > user >>>> > > > > > > > User['infra-solr'] >>>> > > > > > > > >>>> > > > > > > > 2017-04-25 14:12:49,578 >>>> > > > > > > > <http://airmail.calendar/2017-04-25%2014:12:49%20EDT> - >>>> > > > User['ams'] >>>> > > > > > > > {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': >>>> > > > > > [u'hadoop']} >>>> > > > > > > > >>>> > > > > > > > 2017-04-25 14:12:49,578 >>>> > > > > > > > <http://airmail.calendar/2017-04-25%2014:12:49%20EDT> - >>>> Adding >>>> > > > user >>>> > > > > > > > User['ams'] >>>> > > > > > > > >>>> > > > > > > > 2017-04-25 14:12:49,625 >>>> > > > > > > > <http://airmail.calendar/2017-04-25%2014:12:49%20EDT> - >>>> > > > User['tez'] >>>> > > > > > > > {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': >>>> > > > > [u'users']} >>>> > > > > > > > >>>> > > > > > > > 2017-04-25 14:12:49,626 >>>> > > > > > > > <http://airmail.calendar/2017-04-25%2014:12:49%20EDT> - >>>> Adding >>>> > > > user >>>> > > > > > > > User['tez'] >>>> > > > > > > > >>>> > > > > > > > 2017-04-25 14:12:49,660 >>>> > > > > > > > <http://airmail.calendar/2017-04-25%2014:12:49%20EDT> - >>>> > > > > > User['zeppelin'] >>>> > > > > > > > {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': >>>> > > > > > [u'hadoop']} >>>> > > > > > > > >>>> > > > > > > > 2017-04-25 14:12:49,660 >>>> > > > > > > > <http://airmail.calendar/2017-04-25%2014:12:49%20EDT> - >>>> Adding >>>> > > > user >>>> > > > > > > > User['zeppelin'] >>>> > > > > > > > >>>> > > > > > > > 2017-04-25 14:12:49,705 >>>> > > > > > > > <http://airmail.calendar/2017-04-25%2014:12:49%20EDT> - >>>> > > > > > User['metron'] >>>> > > > > > > > {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': >>>> > > > > > [u'hadoop']} >>>> > > > > > > > >>>> > > > > > > > 2017-04-25 14:12:49,705 >>>> > > > > > > > <http://airmail.calendar/2017-04-25%2014:12:49%20EDT> - >>>> Adding >>>> > > > user >>>> > > > > > > > User['metron'] >>>> > > > > > > > >>>> > > > > > > > 2017-04-25 14:12:49,760 >>>> > > > > > > > <http://airmail.calendar/2017-04-25%2014:12:49%20EDT> - >>>> > > > User['livy'] >>>> > > > > > > > {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': >>>> > > > > > [u'hadoop']} >>>> > > > > > > > >>>> > > > > > > > 2017-04-25 14:12:49,760 >>>> > > > > > > > <http://airmail.calendar/2017-04-25%2014:12:49%20EDT> - >>>> Adding >>>> > > > user >>>> > > > > > > > User['livy'] >>>> > > > > > > > >>>> > > > > > > > 2017-04-25 14:12:49,803 >>>> > > > > > > > <http://airmail.calendar/2017-04-25%2014:12:49%20EDT> - >>>> > > > > > > > User['elasticsearch'] {'gid': 'hadoop', >>>> > 'fetch_nonlocal_groups': >>>> > > > > True, >>>> > > > > > > > 'groups': [u'hadoop']} >>>> > > > > > > > >>>> > > > > > > > 2017-04-25 14:12:49,804 >>>> > > > > > > > <http://airmail.calendar/2017-04-25%2014:12:49%20EDT> - >>>> Adding >>>> > > > user >>>> > > > > > > > User['elasticsearch'] >>>> > > > > > > > >>>> > > > > > > > 2017-04-25 14:12:49,837 >>>> > > > > > > > <http://airmail.calendar/2017-04-25%2014:12:49%20EDT> - >>>> > > > > User['spark'] >>>> > > > > > > > {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': >>>> > > > > > [u'hadoop']} >>>> > > > > > > > >>>> > > > > > > > 2017-04-25 14:12:49,837 >>>> > > > > > > > <http://airmail.calendar/2017-04-25%2014:12:49%20EDT> - >>>> Adding >>>> > > > user >>>> > > > > > > > User['spark'] >>>> > > > > > > > >>>> > > > > > > > 2017-04-25 14:12:49,885 >>>> > > > > > > > <http://airmail.calendar/2017-04-25%2014:12:49%20EDT> - >>>> > > > > > > User['ambari-qa'] >>>> > > > > > > > {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': >>>> > > > > [u'users']} >>>> > > > > > > > >>>> > > > > > > > 2017-04-25 14:12:49,885 >>>> > > > > > > > <http://airmail.calendar/2017-04-25%2014:12:49%20EDT> - >>>> Adding >>>> > > > user >>>> > > > > > > > User['ambari-qa'] >>>> > > > > > > > >>>> > > > > > > > 2017-04-25 14:12:49,928 >>>> > > > > > > > <http://airmail.calendar/2017-04-25%2014:12:49%20EDT> - >>>> > > > > User['flume'] >>>> > > > > > > > {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': >>>> > > > > > [u'hadoop']} >>>> > > > > > > > >>>> > > > > > > > 2017-04-25 14:12:49,928 >>>> > > > > > > > <http://airmail.calendar/2017-04-25%2014:12:49%20EDT> - >>>> Adding >>>> > > > user >>>> > > > > > > > User['flume'] >>>> > > > > > > > >>>> > > > > > > > 2017-04-25 14:12:49,972 >>>> > > > > > > > <http://airmail.calendar/2017-04-25%2014:12:49%20EDT> - >>>> > > > > User['kafka'] >>>> > > > > > > > {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': >>>> > > > > > [u'hadoop']} >>>> > > > > > > > >>>> > > > > > > > 2017-04-25 14:12:49,973 >>>> > > > > > > > <http://airmail.calendar/2017-04-25%2014:12:49%20EDT> - >>>> Adding >>>> > > > user >>>> > > > > > > > User['kafka'] >>>> > > > > > > > >>>> > > > > > > > 2017-04-25 14:12:50,025 >>>> > > > > > > > <http://airmail.calendar/2017-04-25%2014:12:50%20EDT> - >>>> > > > User['hdfs'] >>>> > > > > > > > {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': >>>> > > > > > [u'hadoop']} >>>> > > > > > > > >>>> > > > > > > > 2017-04-25 14:12:50,026 >>>> > > > > > > > <http://airmail.calendar/2017-04-25%2014:12:50%20EDT> - >>>> Adding >>>> > > > user >>>> > > > > > > > User['hdfs'] >>>> > > > > > > > >>>> > > > > > > > 2017-04-25 14:12:50,075 >>>> > > > > > > > <http://airmail.calendar/2017-04-25%2014:12:50%20EDT> - >>>> > > > User['yarn'] >>>> > > > > > > > {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': >>>> > > > > > [u'hadoop']} >>>> > > > > > > > >>>> > > > > > > > 2017-04-25 14:12:50,075 >>>> > > > > > > > <http://airmail.calendar/2017-04-25%2014:12:50%20EDT> - >>>> Adding >>>> > > > user >>>> > > > > > > > User['yarn'] >>>> > > > > > > > >>>> > > > > > > > 2017-04-25 14:12:50,125 >>>> > > > > > > > <http://airmail.calendar/2017-04-25%2014:12:50%20EDT> - >>>> > > > > > User['kibana'] >>>> > > > > > > > {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': >>>> > > > > > [u'hadoop']} >>>> > > > > > > > >>>> > > > > > > > 2017-04-25 14:12:50,126 >>>> > > > > > > > <http://airmail.calendar/2017-04-25%2014:12:50%20EDT> - >>>> Adding >>>> > > > user >>>> > > > > > > > User['kibana'] >>>> > > > > > > > >>>> > > > > > > > 2017-04-25 14:12:50,175 >>>> > > > > > > > <http://airmail.calendar/2017-04-25%2014:12:50%20EDT> - >>>> > > > > > User['mapred'] >>>> > > > > > > > {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': >>>> > > > > > [u'hadoop']} >>>> > > > > > > > >>>> > > > > > > > 2017-04-25 14:12:50,176 >>>> > > > > > > > <http://airmail.calendar/2017-04-25%2014:12:50%20EDT> - >>>> Adding >>>> > > > user >>>> > > > > > > > User['mapred'] >>>> > > > > > > > >>>> > > > > > > > 2017-04-25 14:12:50,223 >>>> > > > > > > > <http://airmail.calendar/2017-04-25%2014:12:50%20EDT> - >>>> > > > > User['hbase'] >>>> > > > > > > > {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': >>>> > > > > > [u'hadoop']} >>>> > > > > > > > >>>> > > > > > > > 2017-04-25 14:12:50,224 >>>> > > > > > > > <http://airmail.calendar/2017-04-25%2014:12:50%20EDT> - >>>> Adding >>>> > > > user >>>> > > > > > > > User['hbase'] >>>> > > > > > > > >>>> > > > > > > > 2017-04-25 14:12:50,271 >>>> > > > > > > > <http://airmail.calendar/2017-04-25%2014:12:50%20EDT> - >>>> > > > User['hcat'] >>>> > > > > > > > {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': >>>> > > > > > [u'hadoop']} >>>> > > > > > > > >>>> > > > > > > > 2017-04-25 14:12:50,272 >>>> > > > > > > > <http://airmail.calendar/2017-04-25%2014:12:50%20EDT> - >>>> Adding >>>> > > > user >>>> > > > > > > > User['hcat'] >>>> > > > > > > > >>>> > > > > > > > 2017-04-25 14:12:50,320 >>>> > > > > > > > <http://airmail.calendar/2017-04-25%2014:12:50%20EDT> - >>>> > > > > > > > File['/var/lib/ambari-agent/tmp/changeUid.sh'] >>>> {'content': >>>> > > > > > > > StaticFile('changeToSecureUid.sh'), 'mode': 0555} >>>> > > > > > > > >>>> > > > > > > > 2017-04-25 14:12:50,333 >>>> > > > > > > > <http://airmail.calendar/2017-04-25%2014:12:50%20EDT> - >>>> > Writing >>>> > > > > > > > File['/var/lib/ambari-agent/tmp/changeUid.sh'] because it >>>> > > doesn't >>>> > > > > > exist >>>> > > > > > > > >>>> > > > > > > > 2017-04-25 14:12:50,334 >>>> > > > > > > > <http://airmail.calendar/2017-04-25%2014:12:50%20EDT> - >>>> > Changing >>>> > > > > > > > permission for /var/lib/ambari-agent/tmp/changeUid.sh >>>> from 644 >>>> > > to >>>> > > > > 555 >>>> > > > > > > > >>>> > > > > > > > 2017-04-25 14:12:50,335 >>>> > > > > > > > <http://airmail.calendar/2017-04-25%2014:12:50%20EDT> - >>>> > > > > > > > Execute['/var/lib/ambari-agent/tmp/changeUid.sh ambari-qa >>>> > > > > > > > /tmp/hadoop-ambari-qa,/tmp/hsperfdata_ambari-qa,/home/ >>>> > > > > > > > ambari-qa,/tmp/ambari-qa,/tmp/sqoop-ambari-qa'] >>>> {'not_if': >>>> > > '(test >>>> > > > > > $(id >>>> > > > > > > -u >>>> > > > > > > > ambari-qa) -gt 1000) || (false)'} >>>> > > > > > > > >>>> > > > > > > > 2017-04-25 14:12:50,364 >>>> > > > > > > > <http://airmail.calendar/2017-04-25%2014:12:50%20EDT> - >>>> > Skipping >>>> > > > > > > > Execute['/var/lib/ambari-agent/tmp/changeUid.sh ambari-qa >>>> > > > > > > > /tmp/hadoop-ambari-qa,/tmp/hsperfdata_ambari-qa,/home/ >>>> > > > > > > > ambari-qa,/tmp/ambari-qa,/tmp/sqoop-ambari-qa'] due to >>>> not_if >>>> > > > > > > > >>>> > > > > > > > 2017-04-25 14:12:50,365 >>>> > > > > > > > <http://airmail.calendar/2017-04-25%2014:12:50%20EDT> - >>>> > > > > > > > Directory['/tmp/hbase-hbase'] {'owner': 'hbase', >>>> > > 'create_parents': >>>> > > > > > True, >>>> > > > > > > > 'mode': 0775, 'cd_access': 'a'} >>>> > > > > > > > >>>> > > > > > > > 2017-04-25 14:12:50,366 >>>> > > > > > > > <http://airmail.calendar/2017-04-25%2014:12:50%20EDT> - >>>> > Creating >>>> > > > > > > > directory Directory['/tmp/hbase-hbase'] since it doesn't >>>> exist. >>>> > > > > > > > >>>> > > > > > > > 2017-04-25 14:12:50,366 >>>> > > > > > > > <http://airmail.calendar/2017-04-25%2014:12:50%20EDT> - >>>> > Changing >>>> > > > > > owner >>>> > > > > > > > for /tmp/hbase-hbase from 0 to hbase >>>> > > > > > > > >>>> > > > > > > > 2017-04-25 14:12:50,366 >>>> > > > > > > > <http://airmail.calendar/2017-04-25%2014:12:50%20EDT> - >>>> > Changing >>>> > > > > > > > permission for /tmp/hbase-hbase from 755 to 775 >>>> > > > > > > > >>>> > > > > > > > 2017-04-25 14:12:50,368 >>>> > > > > > > > <http://airmail.calendar/2017-04-25%2014:12:50%20EDT> - >>>> > > > > > > > File['/var/lib/ambari-agent/tmp/changeUid.sh'] >>>> {'content': >>>> > > > > > > > StaticFile('changeToSecureUid.sh'), 'mode': 0555} >>>> > > > > > > > >>>> > > > > > > > 2017-04-25 14:12:50,369 >>>> > > > > > > > <http://airmail.calendar/2017-04-25%2014:12:50%20EDT> - >>>> > > > > > > > Execute['/var/lib/ambari-agent/tmp/changeUid.sh hbase >>>> > > > > > > > >>>> > > > > /home/hbase,/tmp/hbase,/usr/bin/hbase,/var/log/hbase,/tmp/ >>>> > > hbase-hbase'] >>>> > > > > > >>>> > > > > > > > {'not_if': '(test $(id -u hbase) -gt 1000) || (false)'} >>>> > > > > > > > >>>> > > > > > > > 2017-04-25 14:12:50,393 >>>> > > > > > > > <http://airmail.calendar/2017-04-25%2014:12:50%20EDT> - >>>> > Skipping >>>> > > > > > > > Execute['/var/lib/ambari-agent/tmp/changeUid.sh hbase >>>> > > > > > > > >>>> > > > > /home/hbase,/tmp/hbase,/usr/bin/hbase,/var/log/hbase,/tmp/ >>>> > > hbase-hbase'] >>>> > > > > > >>>> > > > > > > > due to not_if >>>> > > > > > > > >>>> > > > > > > > 2017-04-25 14:12:50,394 >>>> > > > > > > > <http://airmail.calendar/2017-04-25%2014:12:50%20EDT> - >>>> > > > > Group['hdfs'] >>>> > > > > > {} >>>> > > > > > > > >>>> > > > > > > > 2017-04-25 14:12:50,395 >>>> > > > > > > > <http://airmail.calendar/2017-04-25%2014:12:50%20EDT> - >>>> Adding >>>> > > > group >>>> > > > > > > > Group['hdfs'] >>>> > > > > > > > >>>> > > > > > > > 2017-04-25 14:12:50,430 >>>> > > > > > > > <http://airmail.calendar/2017-04-25%2014:12:50%20EDT> - >>>> > > > User['hdfs'] >>>> > > > > > > > {'fetch_nonlocal_groups': True, 'groups': [u'hadoop', >>>> u'hdfs']} >>>> > > > > > > > >>>> > > > > > > > 2017-04-25 14:12:50,431 >>>> > > > > > > > <http://airmail.calendar/2017-04-25%2014:12:50%20EDT> - >>>> > > Modifying >>>> > > > > > user >>>> > > > > > > > hdfs >>>> > > > > > > > >>>> > > > > > > > 2017-04-25 14:12:50,474 >>>> > > > > > > > <http://airmail.calendar/2017-04-25%2014:12:50%20EDT> - >>>> FS >>>> > Type: >>>> > > > > > > > >>>> > > > > > > > 2017-04-25 14:12:50,474 >>>> > > > > > > > <http://airmail.calendar/2017-04-25%2014:12:50%20EDT> - >>>> > > > > > > > Directory['/etc/hadoop'] {'mode': 0755} >>>> > > > > > > > >>>> > > > > > > > 2017-04-25 14:12:50,474 >>>> > > > > > > > <http://airmail.calendar/2017-04-25%2014:12:50%20EDT> - >>>> > Creating >>>> > > > > > > > directory Directory['/etc/hadoop'] since it doesn't exist. >>>> > > > > > > > >>>> > > > > > > > 2017-04-25 14:12:50,475 >>>> > > > > > > > <http://airmail.calendar/2017-04-25%2014:12:50%20EDT> - >>>> > > > > > > > Directory['/var/lib/ambari-age >>>> nt/tmp/hadoop_java_io_tmpdir'] >>>> > > > > > {'owner': >>>> > > > > > > > 'hdfs', 'group': 'hadoop', 'mode': 01777} >>>> > > > > > > > >>>> > > > > > > > 2017-04-25 14:12:50,476 >>>> > > > > > > > <http://airmail.calendar/2017-04-25%2014:12:50%20EDT> - >>>> > Creating >>>> > > > > > > > directory Directory['/var/lib/ambari-age >>>> nt/tmp/hadoop_java_io_ >>>> > > > > tmpdir'] >>>> > > > > > >>>> > > > > > > > since it doesn't exist. >>>> > > > > > > > >>>> > > > > > > > 2017-04-25 14:12:50,476 >>>> > > > > > > > <http://airmail.calendar/2017-04-25%2014:12:50%20EDT> - >>>> > Changing >>>> > > > > > owner >>>> > > > > > > > for /var/lib/ambari-agent/tmp/hadoop_java_io_tmpdir from >>>> 0 to >>>> > > hdfs >>>> > > > > > > > >>>> > > > > > > > 2017-04-25 14:12:50,476 >>>> > > > > > > > <http://airmail.calendar/2017-04-25%2014:12:50%20EDT> - >>>> > Changing >>>> > > > > > group >>>> > > > > > > > for /var/lib/ambari-agent/tmp/hadoop_java_io_tmpdir from >>>> 0 to >>>> > > > hadoop >>>> > > > > > > > >>>> > > > > > > > 2017-04-25 14:12:50,477 >>>> > > > > > > > <http://airmail.calendar/2017-04-25%2014:12:50%20EDT> - >>>> > Changing >>>> > > > > > > > permission for /var/lib/ambari-agent/tmp/hado >>>> op_java_io_tmpdir >>>> > > from >>>> > > > > > 755 >>>> > > > > > > > to 1777 >>>> > > > > > > > >>>> > > > > > > > 2017-04-25 14:12:50,477 >>>> > > > > > > > <http://airmail.calendar/2017-04-25%2014:12:50%20EDT> - >>>> > > > > > > > Directory['/var/lib/ambari-agent/tmp/AMBARI-artifacts/'] >>>> > > > > > > > {'create_parents': True} >>>> > > > > > > > >>>> > > > > > > > 2017-04-25 14:12:50,478 >>>> > > > > > > > <http://airmail.calendar/2017-04-25%2014:12:50%20EDT> - >>>> > Creating >>>> > > > > > > > directory Directory['/var/lib/ambari- >>>> > > agent/tmp/AMBARI-artifacts/'] >>>> > > > > > since >>>> > > > > > > > it doesn't exist. >>>> > > > > > > > >>>> > > > > > > > 2017-04-25 14:12:50,479 >>>> > > > > > > > <http://airmail.calendar/2017-04-25%2014:12:50%20EDT> - >>>> > > > > > > > File['/var/lib/ambari-agent/tm >>>> p/jdk-8u77-linux-x64.tar.gz'] >>>> > > > > > {'content': >>>> > > > > > > > DownloadSource('http://css-fx-met-poc-82:8080/resources// >>>> > > > > > > > jdk-8u77-linux-x64.tar.gz'), 'not_if': 'test -f >>>> > > > > > > > /var/lib/ambari-agent/tmp/jdk-8u77-linux-x64.tar.gz'} >>>> > > > > > > > >>>> > > > > > > > 2017-04-25 14:12:50,504 >>>> > > > > > > > <http://airmail.calendar/2017-04-25%2014:12:50%20EDT> - >>>> > > > Downloading >>>> > > > > > the >>>> > > > > > > > file from http://css-fx-met-poc-82:8080/ >>>> resources//jdk-8u77- >>>> > > > > > > > linux-x64.tar.gz >>>> > > > > > > > >>>> > > > > > > > 2017-04-25 14:12:53,793 >>>> > > > > > > > <http://airmail.calendar/2017-04-25%2014:12:53%20EDT> - >>>> > > > > > > > Directory['/usr/jdk64'] {} >>>> > > > > > > > >>>> > > > > > > > 2017-04-25 14:12:53,793 >>>> > > > > > > > <http://airmail.calendar/2017-04-25%2014:12:53%20EDT> - >>>> > Creating >>>> > > > > > > > directory Directory['/usr/jdk64'] since it doesn't exist. >>>> > > > > > > > >>>> > > > > > > > 2017-04-25 14:12:53,794 >>>> > > > > > > > <http://airmail.calendar/2017-04-25%2014:12:53%20EDT> - >>>> > > > > > > Execute[('chmod', >>>> > > > > > > > 'a+x', u'/usr/jdk64')] {'sudo': True} >>>> > > > > > > > >>>> > > > > > > > 2017-04-25 14:12:53,824 >>>> > > > > > > > <http://airmail.calendar/2017-04-25%2014:12:53%20EDT> - >>>> > > > Execute['cd >>>> > > > > > > > /var/lib/ambari-agent/tmp/jdk_tmp_1BRMsS && tar -xf >>>> > > > > > > > /var/lib/ambari-agent/tmp/jdk-8u77-linux-x64.tar.gz && >>>> > > > > ambari-sudo.sh >>>> > > > > > cp >>>> > > > > > > > -rp /var/lib/ambari-agent/tmp/jdk_tmp_1BRMsS/* >>>> /usr/jdk64'] {} >>>> > > > > > > > >>>> > > > > > > > 2017-04-25 14:13:00,439 >>>> > > > > > > > <http://airmail.calendar/2017-04-25%2014:13:00%20EDT> - >>>> > > > > > > > Directory['/var/lib/ambari-agent/tmp/jdk_tmp_1BRMsS'] >>>> > {'action': >>>> > > > > > > > ['delete']} >>>> > > > > > > > >>>> > > > > > > > 2017-04-25 14:13:00,440 >>>> > > > > > > > <http://airmail.calendar/2017-04-25%2014:13:00%20EDT> - >>>> > Removing >>>> > > > > > > > directory Directory['/var/lib/ambari- >>>> > agent/tmp/jdk_tmp_1BRMsS'] >>>> > > and >>>> > > > > > all >>>> > > > > > > > its content >>>> > > > > > > > >>>> > > > > > > > 2017-04-25 14:13:00,620 >>>> > > > > > > > <http://airmail.calendar/2017-04-25%2014:13:00%20EDT> - >>>> > > > > > > > File['/usr/jdk64/jdk1.8.0_77/bin/java'] {'mode': 0755, >>>> > > 'cd_access': >>>> > > > > > 'a'} >>>> > > > > > > > >>>> > > > > > > > 2017-04-25 14:13:00,621 >>>> > > > > > > > <http://airmail.calendar/2017-04-25%2014:13:00%20EDT> - >>>> > > > > > > Execute[('chmod', >>>> > > > > > > > '-R', '755', u'/usr/jdk64/jdk1.8.0_77')] {'sudo': True} >>>> > > > > > > > >>>> > > > > > > > 2017-04-25 14:13:00,682 >>>> > > > > > > > <http://airmail.calendar/2017-04-25%2014:13:00%20EDT> - >>>> > > > Initializing >>>> > > > > > 2 >>>> > > > > > > > repositories >>>> > > > > > > > >>>> > > > > > > > 2017-04-25 14:13:00,683 >>>> > > > > > > > <http://airmail.calendar/2017-04-25%2014:13:00%20EDT> - >>>> > > > > > > > Repository['HDP-2.5'] {'base_url': 'http://public-repo-1. >>>> > > > > > > > hortonworks.com/HDP/centos7/2.x/updates/2.5.5.0', >>>> 'action': >>>> > > > > > ['create'], >>>> > > > > > > > 'components': [u'HDP', 'main'], 'repo_template': >>>> > > > > > > > '[{{repo_id}}]\nname={{repo_id}}\n{% if mirror_list >>>> > > > > > > > %}mirrorlist={{mirror_list}}{% else >>>> %}baseurl={{base_url}}{% >>>> > > endif >>>> > > > > > > > %}\n\npath=/\nenabled=1\ngpgcheck=0', 'repo_file_name': >>>> 'HDP', >>>> > > > > > > > 'mirror_list': None} >>>> > > > > > > > >>>> > > > > > > > 2017-04-25 14:13:00,709 >>>> > > > > > > > <http://airmail.calendar/2017-04-25%2014:13:00%20EDT> - >>>> > > > > > > > File['/etc/yum.repos.d/HDP.repo'] {'content': >>>> > > InlineTemplate(...)} >>>> > > > > > > > >>>> > > > > > > > 2017-04-25 14:13:00,711 >>>> > > > > > > > <http://airmail.calendar/2017-04-25%2014:13:00%20EDT> - >>>> > Writing >>>> > > > > > > > File['/etc/yum.repos.d/HDP.repo'] because it doesn't >>>> exist >>>> > > > > > > > >>>> > > > > > > > 2017-04-25 14:13:00,711 >>>> > > > > > > > <http://airmail.calendar/2017-04-25%2014:13:00%20EDT> - >>>> > > > > > > > Repository['HDP-UTILS-1.1.0.21'] {'base_url': ' >>>> > > > http://public-repo-1. >>>> > > > >>>> > > > > > > > hortonworks.com/HDP-UTILS-1.1.0.21/repos/centos7', >>>> 'action': >>>> > > > > > ['create'], >>>> > > > > > > > 'components': [u'HDP-UTILS', 'main'], 'repo_template': >>>> > > > > > > > '[{{repo_id}}]\nname={{repo_id}}\n{% if mirror_list >>>> > > > > > > > %}mirrorlist={{mirror_list}}{% else >>>> %}baseurl={{base_url}}{% >>>> > > endif >>>> > > > > > > > %}\n\npath=/\nenabled=1\ngpgcheck=0', 'repo_file_name': >>>> > > > 'HDP-UTILS', >>>> > > > > > > > 'mirror_list': None} >>>> > > > > > > > >>>> > > > > > > > 2017-04-25 14:13:00,717 >>>> > > > > > > > <http://airmail.calendar/2017-04-25%2014:13:00%20EDT> - >>>> > > > > > > > File['/etc/yum.repos.d/HDP-UTILS.repo'] {'content': >>>> > > > > > InlineTemplate(...)} >>>> > > > > > > > >>>> > > > > > > > 2017-04-25 14:13:00,717 >>>> > > > > > > > <http://airmail.calendar/2017-04-25%2014:13:00%20EDT> - >>>> > Writing >>>> > > > > > > > File['/etc/yum.repos.d/HDP-UTILS.repo'] because it >>>> doesn't >>>> > exist >>>> > > > > > > > >>>> > > > > > > > 2017-04-25 14:13:00,718 >>>> > > > > > > > <http://airmail.calendar/2017-04-25%2014:13:00%20EDT> - >>>> > > > > > Package['unzip'] >>>> > > > > > > > {'retry_on_repo_unavailability': False, 'retry_count': 5} >>>> > > > > > > > >>>> > > > > > > > 2017-04-25 14:13:00,846 >>>> > > > > > > > <http://airmail.calendar/2017-04-25%2014:13:00%20EDT> - >>>> > > Installing >>>> > > > > > > > package unzip ('/usr/bin/yum -d 0 -e 0 -y install unzip') >>>> > > > > > > > >>>> > > > > > > > 2017-04-25 14:13:03,413 >>>> > > > > > > > <http://airmail.calendar/2017-04-25%2014:13:03%20EDT> - >>>> > > > > > Package['curl'] >>>> > > > > > > > {'retry_on_repo_unavailability': False, 'retry_count': 5} >>>> > > > > > > > >>>> > > > > > > > 2017-04-25 14:13:03,429 >>>> > > > > > > > <http://airmail.calendar/2017-04-25%2014:13:03%20EDT> - >>>> > Skipping >>>> > > > > > > > installation of existing package curl >>>> > > > > > > > >>>> > > > > > > > 2017-04-25 14:13:03,430 >>>> > > > > > > > <http://airmail.calendar/2017-04-25%2014:13:03%20EDT> - >>>> > > > > > > > Package['hdp-select'] {'retry_on_repo_unavailability': >>>> False, >>>> > > > > > > > 'retry_count': 5} >>>> > > > > > > > >>>> > > > > > > > 2017-04-25 14:13:03,451 >>>> > > > > > > > <http://airmail.calendar/2017-04-25%2014:13:03%20EDT> - >>>> > > Installing >>>> > > > > > > > package hdp-select ('/usr/bin/yum -d 0 -e 0 -y install >>>> > > hdp-select') >>>> > > > > > > > >>>> > > > > > > > 2017-04-25 14:13:04,948 >>>> > > > > > > > <http://airmail.calendar/2017-04-25%2014:13:04%20EDT> - >>>> > Install >>>> > > ES >>>> > > > > > Data >>>> > > > > > > > Node >>>> > > > > > > > >>>> > > > > > > > 2017-04-25 14:13:04,952 >>>> > > > > > > > <http://airmail.calendar/2017-04-25%2014:13:04%20EDT> - >>>> > > > > > > > Package['elasticsearch-2.3.3'] {'retry_on_repo_ >>>> > unavailability': >>>> > > > > > False, >>>> > > > > > > > 'retry_count': 5} >>>> > > > > > > > >>>> > > > > > > > 2017-04-25 14:13:05,086 >>>> > > > > > > > <http://airmail.calendar/2017-04-25%2014:13:05%20EDT> - >>>> > > Installing >>>> > > > > > > > package elasticsearch-2.3.3 ('/usr/bin/yum -d 0 -e 0 -y >>>> install >>>> > > > > > > > elasticsearch-2.3.3') >>>> > > > > > > > >>>> > > > > > > > >>>> > > > > > > > >>>> > > > > > > > Command failed after 1 tries >>>> > > > > > > > >>>> > > > > > > > >>>> > > > > > > > >>>> > > > > > > > >>>> > > > > > > > >>>> > > > > > > > On April 25, 2017 at 13:47:17, Otto Fowler ( >>>> > > > ottobackwa...@gmail.com) >>>> > > > >>>> > > > > > > > wrote: >>>> > > > > > > > >>>> > > > > > > > Yes, I’m going to run through again and get the logs. The >>>> basic >>>> > > > issue >>>> > > > > > > is, >>>> > > > > > > > no repo tab -> if I should have one, >>>> > > > > > > > and the ES yum command failing with nothing to do, which >>>> stops >>>> > > > > > deployment >>>> > > > > > > > on all the nodes. >>>> > > > > > > > >>>> > > > > > > > >>>> > > > > > > > >>>> > > > > > > > On April 25, 2017 at 13:36:25, Michael Miklavcic ( >>>> > > > > > > > michael.miklav...@gmail.com) wrote: >>>> > > > > > > > >>>> > > > > > > > I've been doing an internal hwx deployment (HCP) recently >>>> for >>>> > > > testing >>>> > > > > > > > purposes. I have some ES tweaks to work out, but other >>>> than >>>> > that >>>> > > it >>>> > > > > > has >>>> > > > > > > > been running smoothly. Can you share any log info or >>>> > screenshots? >>>> > > > > > > > >>>> > > > > > > > Mike >>>> > > > > > > > >>>> > > > > > > > On Apr 25, 2017 11:30 AM, "Otto Fowler" < >>>> > ottobackwa...@gmail.com >>>> > > > >>>> > > > > > wrote: >>>> > > > > > > > >>>> > > > > > > > > Hi, >>>> > > > > > > > > Should I see the repo tab in the ambari wizard for >>>> metron at >>>> > > this >>>> > > > > > > point? >>>> > > > > > > > > Asking for a friend who can’t get the wizard to work :) >>>> > > > > > > > > >>>> > > > > > > > >>>> > > > > > > > >>>> > > > > > > >>>> > > > > > >>>> > > > > > >>>> > > > > >>>> > > > >>>> > > -- >>>> > > >>>> > > Jon >>>> > > >>>> > > >>>> > >>>> >>>> >>> >> >
