how to get the task-id in the install method of the service
i am writing a custom service, where in i need to get the command-taskid.json file path in the install: method of my custom service. This file is being generated during install f the service at /var/lib/ambari-agent/data/ So, i need the path of this file /var/lib/ambari-agent/data/command-TASKID.json or, it would be great if i can get the taskid of the running service in the install method. Thanks, Satya.
Adding install priority to custom services
I have created some custom services, and in my case the service2 needs service1 to be installed first as it is needed for service2 to function properly. How can I specify the dependency or order in which the services should be installed. Thanks, Satya.
Check the service by default
I have created some custom services, and I would like to some of my services to be checked by default for installation(choose services screen) and the user should not be in a position to un-check it as they are must to install. Please let me know if there is any such possibility. Thanks, Satya.
RE: Check the service by default
Thanks Jayush, This did the trick. :) Is there a way to remove the existing services from the choose services screen, which are not of my interest ex: TEZ, sqoop? From: Jayush Luniya [mailto:jlun...@hortonworks.com] Sent: 05 March 2015 15:57 To: user@ambari.apache.org Subject: Re: Check the service by default RE: I would like to some of my services to be checked by default for installation(choose services screen) I haven't tried with a custom service, but I believe by default all services are checked in the Choose Services screen. RE: The user should not be in a position to un-check it as they are must to install. Not exactly the solution you are looking for, but you could add your service as requiredService in other services, so that the Choose Service wouldn't proceed to the next step without your service being selected. https://github.com/apache/ambari/blob/trunk/ambari-server/src/main/resources/common-services/HDFS/2.1.0.2.0/metainfo.xml requiredServices serviceZOOKEEPER/service /requiredServices Hope this helps! Thanks, Jayush From: Satyanarayana Jampa sja...@innominds.commailto:sja...@innominds.com Reply-To: user@ambari.apache.orgmailto:user@ambari.apache.org user@ambari.apache.orgmailto:user@ambari.apache.org Date: Thursday, March 5, 2015 at 1:42 AM To: user@ambari.apache.orgmailto:user@ambari.apache.org user@ambari.apache.orgmailto:user@ambari.apache.org Subject: Check the service by default I have created some custom services, and I would like to some of my services to be checked by default for installation(choose services screen) and the user should not be in a position to un-check it as they are must to install. Please let me know if there is any such possibility. Thanks, Satya.
Amabri - with custom java - version
Hi, I am configuring java-1.8 to be used with Ambari during the ambari-server setup option. Also, I added the java-1.8 on all the nodes manually and have set the class path and JAVA_HOME. While installing Hadoop components, the Ambari is installing its default java-version, instead of using the existing java-1.8. How can we say Ambari not to install pre-packaged java and use the one which was manually setup on all the datanodes. Thanks, Satya.
custom service - client unique_id property
Just wondering, if there is a way to generate a unique_id in the property file for each node, for an custom client service. I mean: I have a custom client service component. I am looking for a way to generate a unique_id in the client property file, for each node it gets installed. Thanks, Satya.
Do we have API for change password
Hi, Just wondering if we have an API to change the Ambari password, instead of logging in and changing the password. Actually I have a custom script which will take username and password as argument which I have to use it for configuration before installing Ambari. Thanks, Satya.
RE: Do we have API for change password
Got it working
curl -w "%{http_code}" -o /dev/null --user admin:admin ....
From: Satyanarayana Jampa [mailto:sja...@innominds.com]
Sent: 22 March 2016 09:55
To: user@ambari.apache.org
Subject: RE: Do we have API for change password
Can we get the HTTP response code in this?
From: Dmitry Sen [mailto:d...@hortonworks.com]
Sent: 21 March 2016 20:02
To: user@ambari.apache.org
Subject: Re: Do we have API for change password
It works for me:
curl -i -u admin:admin 'http://192.168.120.6:1081/api/v1/users/admin' -X PUT
-H 'X-Requested-By: ambari' --data-binary
'{"Users/password":"newpasswd","Users/old_password":"admin"}'
BR,
Dmytro Sen
____
From: Satyanarayana Jampa <sja...@innominds.com<mailto:sja...@innominds.com>>
Sent: Monday, March 21, 2016 7:59 AM
To: user@ambari.apache.org<mailto:user@ambari.apache.org>
Subject: Do we have API for change password
Hi,
Just wondering if we have an API to change the Ambari password, instead of
logging in and changing the password.
Actually I have a custom script which will take username and password as
argument which I have to use it for configuration before installing Ambari.
Thanks,
Satya.
Ambari Java Version
Hi, What is the property that needs to be set, so that Ambari installs JDK1.8 on all the cluster hosts and not java 1.7 Thanks, Satya.
RE: Ambari Java Version
Hi Loïc, I did the same, but it is installing java on ambari server node alone. I want java to be installed on all other ambari-agent nodes also. Should we do that manually on all the agent nodes or will ambary take care of it during host registration? Thanks, Satya. From: Loïc Chanel [mailto:loic.cha...@telecomnancy.net] Sent: 31 August 2016 15:12 To: user@ambari.apache.org Subject: Re: Ambari Java Version Hi Satya, You can do ambari-server setup –j or simply do ambari-server setup and follow the options, as there is a prompt asking you what Java version you want to use. Hope this helps, Loïc Loïc CHANEL System & virtualization engineer TO - XaaS Ind - Worldline (Villeurbanne, France) 2016-08-31 11:13 GMT+02:00 Satyanarayana Jampa <sja...@innominds.com<mailto:sja...@innominds.com>>: Hi, What is the property that needs to be set, so that Ambari installs JDK1.8 on all the cluster hosts and not java 1.7 Thanks, Satya.
hostname param for slave
Hi, I have written a Ambari service which is a slave component. In this service, I have a template which is my configuration file. This file needs the "hostname" as one of its field. Example template below: host = '' accesslog = '/opt/purple/accesslog.out' errorlog = '/opt/purple/gunicorn.out' How can I get the HOSTNAME of the specific hosts on which the slave component is being installed in to the template file. Thanks, Satya.
How to get Hive host,user and password into my custom service
Hi, I have written a custom service in which I need the information of Hive_host, hive_user and hive_password. Instead of asking the end-user to enter these values during installation as config parameters for the custom service, is there a way that I can use some env parameters that use to hold these values. Similarly, I need the env. Parameters for sqoop host etc. Thanks, Satya.
custom metrics - tomcat
Hi, I have a custom service in Ambari which contains tomcat server. I would like to create metrics for the tomcat server like number of requests coming in and memory usage. Could someone point me to the right doc or steps. Thanks, Satya.
custom service config with radio button options
Hi, I have a custom service which needs some configuration values to be selected for a configuration property which has radio buttons. I am using the below my_config.xml, but these properties are not being showed up during the installation of this service. I only see "Custom my-config" tab. Can some one let me know, what is wrong here method_type option1 Authentication Method value-list 1 option1 2 option2 3 option3 1 BASE_URL URL ldap://hostname:389
RE: custom config property
Hi Sumit, Thank you for your inputs. But looks like theme is for the first tab. I am looking for an option something like in the attached screenshot. Thanks, Satya. From: Sumit Mohanty [mailto:smoha...@hortonworks.com] Sent: 16 December 2016 11:20 To: user@ambari.apache.org Subject: Re: custom config property Look at the combination of https://github.com/apache/ambari/blob/trunk/ambari-server/src/main/resources/stacks/HDP/2.2/services/HIVE/configuration/hive-env.xml#L92-L115 https://github.com/apache/ambari/blob/trunk/ambari-server/src/main/resources/stacks/HDP/2.2/services/HIVE/themes/theme.json#L322-L327 Wiki is at - https://cwiki.apache.org/confluence/display/AMBARI/Enhanced+Configs From: Satyanarayana Jampa <sja...@innominds.com<mailto:sja...@innominds.com>> Sent: Thursday, December 15, 2016 9:20 PM To: user@ambari.apache.org<mailto:user@ambari.apache.org> Subject: custom config property Can someone help me out in pointing the steps for creating a configuration property with radio button options. Something similar to what we have it for “hive database” selection under hive config tab. Example: custom_database: o Mysql o Postgres o Mssql Thanks, Satya.
RE: custom config property
Hi Alexander, Created the jira ticket, please modify it as needed: https://issues.apache.org/jira/browse/AMBARI-19249 Thanks, Satya. From: Alexander Antonenko [mailto:alexantone...@apache.org] Sent: 19 December 2016 19:53 To: user@ambari.apache.org Subject: Re: custom config property This is something that has to be done in different files, and different places, this is a whole bunch of work. I can suggest you file a ticket in https://issues.apache.org/jira/browse/AMBARI regarding this. Or as Sumit said : In order to define customized configuration property, user should use theme for enhanced configs (https://cwiki.apache.org/confluence/display/AMBARI/Enhanced+Configs) - This is already implemented in trunk for configs that you are interested in. On Mon, Dec 19, 2016 at 11:02 AM, Satyanarayana Jampa <sja...@innominds.com<mailto:sja...@innominds.com>> wrote: What part of the UI code, needs to be hard coded. So far I found one file with references to the fields under Advanced Tab: “/opt/apache-ambari-2.2.2-src/ambari-web/public/javascripts/app.js” Can someone point me to the correct UI code. From: Alexander Antonenko [mailto:alexantone...@apache.org<mailto:alexantone...@apache.org>] Sent: 16 December 2016 23:58 To: user@ambari.apache.org<mailto:user@ambari.apache.org> Subject: Re: custom config property In order to define customized configuration property, user should use theme for enhanced configs (https://cwiki.apache.org/confluence/display/AMBARI/Enhanced+Configs). Making the property appear outside enhanced configs tab (i.e., inside Advanced tab) is only possible after hardcoding inside UI code. On Fri, Dec 16, 2016 at 6:46 PM, Sumit Mohanty <smoha...@hortonworks.com<mailto:smoha...@hortonworks.com>> wrote: Ah! that may be custom UI code. Can some one familiar with the UI code respond? thanks Sumit ________ From: Satyanarayana Jampa <sja...@innominds.com<mailto:sja...@innominds.com>> Sent: Thursday, December 15, 2016 11:02 PM To: user@ambari.apache.org<mailto:user@ambari.apache.org> Subject: RE: custom config property Hi Sumit, Thank you for your inputs. But looks like theme is for the first tab. I am looking for an option something like in the attached screenshot. Thanks, Satya. From: Sumit Mohanty [mailto:smoha...@hortonworks.com<mailto:smoha...@hortonworks.com>] Sent: 16 December 2016 11:20 To: user@ambari.apache.org<mailto:user@ambari.apache.org> Subject: Re: custom config property Look at the combination of https://github.com/apache/ambari/blob/trunk/ambari-server/src/main/resources/stacks/HDP/2.2/services/HIVE/configuration/hive-env.xml#L92-L115 https://github.com/apache/ambari/blob/trunk/ambari-server/src/main/resources/stacks/HDP/2.2/services/HIVE/themes/theme.json#L322-L327 Wiki is at - https://cwiki.apache.org/confluence/display/AMBARI/Enhanced+Configs From: Satyanarayana Jampa <sja...@innominds.com<mailto:sja...@innominds.com>> Sent: Thursday, December 15, 2016 9:20 PM To: user@ambari.apache.org<mailto:user@ambari.apache.org> Subject: custom config property Can someone help me out in pointing the steps for creating a configuration property with radio button options. Something similar to what we have it for “hive database” selection under hive config tab. Example: custom_database: o Mysql o Postgres o Mssql Thanks, Satya.
Enabling SNMP alerts
Hi, I am using Ambari 2.2 and I would like to enable the SNMP alerts. For enabling the alerts I followed the below link: https://community.hortonworks.com/articles/74370/snmp-alert.html The "snmp_mib_script.sh" has snmptrap command, which take localhost as the "HOST" parameter as below: Can this "Host" parameter be taken from the Ambari "Edit Notification" screen, just like the alert state, alertname etc? HOST=localhost COMMUNITY=public STATE=0 if [ $4 == "OK" ]; then STATE=0 elif [ $4 == "UNKNOWN" ]; then STATE=1 elif [ $4 == "WARNING" ]; then STATE=2 elif [ $4 == "CRITICAL" ]; then STATE=3 fi /usr/bin/snmptrap -v 2c -c $COMMUNITY $HOST '' APACHE-AMBARI-MIB::apacheAmbariAlert alertDefinitionName s "$1" alertName s "$2" alertText s "$5" alertState i $STATE alertService s "$3" Thanks, Satya.
unselect slave component by default
Hi, I have a custom slave component, during installation in the "Assign slaves and clients" screen, it is being checked by default. How can I make it unchecked by default. I have set the cardinality if the slave component in metainfo.xml to 0+ Thanks, Satya.
default HDP stack selection
Hi, I am using "apache-ambari-2.2.2" and during install at Step1 shows list of HDP versions and the stack Repositories: The stack versions show: ? HDP 2.2 ? HDP 2.3 ? HDP 2.4 And 2.3 is selected by default. How can I change the default selection to 2.4. Also, in the Repository section: I would like to uncheck all others except Redhat6 and change its URL. Please let me know the right place to change these values. So that I can change the code and rebuild. Thanks, Satya.
Adding custom config properties programatically
Hi, I would like to add "custom core-site" properties during installation programmatically. Can you please help me out with the necessary info. Say for ex: Under HDFS TAB --> Custom core-site hadoop.proxyuser.root.hosts=* hadoop.proxyuser.root.groups=* Thanks, Satya.
upgrade custom component
Hi, Can you please let me know, how to upgrade the config information for the custom component. I have developed a custom component and installed with Ambari. Now that I have some new configuration fields added and also the scripts(params.py, *.py) were updated, how can I upgrade the custom component on the installed machine? Please suggest. Thanks, Satya.
RE: unexpected version error - for custom components
Thanks for the info Hurley. Yes, I mean mpack, not mstack ☺ From: Jonathan Hurley [mailto:jhur...@hortonworks.com] Sent: 07 June 2018 21:05 To: user@ambari.apache.org Subject: Re: unexpected version error - for custom components I’m not sure if you meant mpack instead of mstack, but the alert below indicates that there are components installed which are not reporting the correct versions. It should tell you which components are wrong. Normally, this happens with an mpack that has installed services which indicate they advertise a version when they really don’t. The fix here is to find the service’s metainfo.xml which was installed and look for true and set this to false. From: Satyanarayana Jampa mailto:sja...@innominds.com>> Reply-To: "user@ambari.apache.org<mailto:user@ambari.apache.org>" mailto:user@ambari.apache.org>> Date: Thursday, June 7, 2018 at 11:28 AM To: "user@ambari.apache.org<mailto:user@ambari.apache.org>" mailto:user@ambari.apache.org>> Subject: unexpected version error - for custom components Hi Team, I have installed custom services using mstack and the below alert is observed: “This alert is triggered if the server detects that there is a problem with the expected and reported version of a component. The alert is suppressed automatically during an upgrade.” What needs to be fixed to disable this alert. Thanks in advance. Thanks, Satya.
unexpected version error - for custom components
Hi Team, I have installed custom services using mstack and the below alert is observed: "This alert is triggered if the server detects that there is a problem with the expected and reported version of a component. The alert is suppressed automatically during an upgrade." What needs to be fixed to disable this alert. Thanks in advance. Thanks, Satya.
RE: Hive Error on restart when public IP is changed
Yes, changing the public DNS to local hostname/IP works. I would like to know if this can be configured to local hostname(FQDN) during installation itself, so that it need not be changed manually on every restart of the AWS server or whenever the public IP is changed. Thanks, Satya. From: Benoit Perroud [mailto:ben...@noisette.ch] Sent: 09 February 2018 15:32 To: user@ambari.apache.org Subject: Re: Hive Error on restart when public IP is changed The ip listed in the exception is the instance private ip. I would change > hadoop.proxyuser.hive.hosts: > ec2-54-197-36-23.compute-1.amazonaws.com<http://ec2-54-197-36-23.compute-1.amazonaws.com/> to > hadoop.proxyuser.hive.hosts: 172.31.55.219 If this still doesn’t work, remove the IP and put * instead. Small warning here, I would not open Hive to the whole world and rely only on host filtering thinking it’s secure. On 09 Feb 2018, at 09:59, Satyanarayana Jampa <sja...@innominds.com<mailto:sja...@innominds.com>> wrote: Hi, The below error is observed after restarting the single node AWS machine. Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.security.authorize.AuthorizationException): Unauthorized connection for super-user: hive from IP 172.31.55.219 at org.apache.hadoop.ipc.Client.call(Client.java:1427) at org.apache.hadoop.ipc.Client.call(Client.java:1358) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:229) at com.sun.proxy.$Proxy15.getFileInfo(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getFileInfo(ClientNamenodeProtocolTranslatorPB.java:771) Scenario: 1. Install the HDP on a single node AWS box. 2. We can see the below configuration after installation: a.services->HDFS->configs->advanced->custom core-site i. hadoop.proxyuser.hive.hosts: ec2-54-197-36-23.compute-1.amazonaws.com<http://ec2-54-197-36-23.compute-1.amazonaws.com/> ii. hadoop.proxyuser.hive.groups: * 3. Once we restart the AWS machine, the public IP of the machine changes and as such the public DNS name which was picked up automatically during installation for “hadoop.proxyuser.hive.hosts” property becomes invalid and hence the error. Can someone please let me know how to overcome this situation. Thanks, Satya.
Hive Error on restart when public IP is changed
Hi, The below error is observed after restarting the single node AWS machine. Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.security.authorize.AuthorizationException): Unauthorized connection for super-user: hive from IP 172.31.55.219 at org.apache.hadoop.ipc.Client.call(Client.java:1427) at org.apache.hadoop.ipc.Client.call(Client.java:1358) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:229) at com.sun.proxy.$Proxy15.getFileInfo(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getFileInfo(ClientNamenodeProtocolTranslatorPB.java:771) Scenario: 1. Install the HDP on a single node AWS box. 2. We can see the below configuration after installation: a.services->HDFS->configs->advanced->custom core-site i. hadoop.proxyuser.hive.hosts: ec2-54-197-36-23.compute-1.amazonaws.com ii. hadoop.proxyuser.hive.groups: * 3. Once we restart the AWS machine, the public IP of the machine changes and as such the public DNS name which was picked up automatically during installation for "hadoop.proxyuser.hive.hosts" property becomes invalid and hence the error. Can someone please let me know how to overcome this situation. Thanks, Satya.
