But this ticket for HDP 2.5, then how can I verify it in blueprint ?


Best Regard,
Jeff Zhang


From: Sean Roberts <srobe...@hortonworks.com<mailto:srobe...@hortonworks.com>>
Date: Wednesday, May 25, 2016 at 3:42 PM
To: Jianfeng Zhang <jzh...@hortonworks.com<mailto:jzh...@hortonworks.com>>
Cc: Jayush Luniya <jlun...@hortonworks.com<mailto:jlun...@hortonworks.com>>, 
Sumit Mohanty <smoha...@hortonworks.com<mailto:smoha...@hortonworks.com>>, 
Alejandro Fernandez 
<afernan...@hortonworks.com<mailto:afernan...@hortonworks.com>>, Jeff Zhang 
<zjf...@apache.org<mailto:zjf...@apache.org>>, Ambari 
<reviews@ambari.apache.org<mailto:reviews@ambari.apache.org>>
Subject: Re: Review Request 46727: [AMBARI-15612] Add Livy to HDP 2.5 as slave 
component of Spark

Did you switch to 2.4? 2.5 is not ready yet and should not be used.

--
Hortonworks - We do Hadoop

Sean Roberts
... blame the phone for offensive typos

On 25 May 2016, at 04:08, Jianfeng (Jeff) Zhang 
<jzh...@hortonworks.com<mailto:jzh...@hortonworks.com>> wrote:


+ Sean Roberts who may able to help

Hi Jayush & Sean,

I also ask the question on ambari mail list, but still could not make progress, 
not sure how to verify that, do you have any suggestion on that ? Very 
appreciated.

http://mail-archives.apache.org/mod_mbox/ambari-user/201605.mbox/%3CCAADy7x7ha6amOjmNFCQN2bKpMACGbLJr3uDxKjPCn=jph_7...@mail.gmail.com%3E



Best Regard,
Jeff Zhang


From: Jianfeng Zhang <jzh...@hortonworks.com<mailto:jzh...@hortonworks.com>>
Date: Friday, May 20, 2016 at 7:28 AM
To: Jayush Luniya <jlun...@hortonworks.com<mailto:jlun...@hortonworks.com>>, 
Sumit Mohanty <smoha...@hortonworks.com<mailto:smoha...@hortonworks.com>>, 
Alejandro Fernandez 
<afernan...@hortonworks.com<mailto:afernan...@hortonworks.com>>
Cc: Jeff Zhang <zjf...@apache.org<mailto:zjf...@apache.org>>, Ambari 
<reviews@ambari.apache.org<mailto:reviews@ambari.apache.org>>
Subject: Re: Review Request 46727: [AMBARI-15612] Add Livy to HDP 2.5 as slave 
component of Spark


Hi Jayush,

Could you help take a look at it ? Thanks.


Best Regard,
Jeff Zhang


From: Jianfeng Zhang <jzh...@hortonworks.com<mailto:jzh...@hortonworks.com>>
Date: Thursday, May 19, 2016 at 10:22 AM
To: Jayush Luniya <jlun...@hortonworks.com<mailto:jlun...@hortonworks.com>>, 
Sumit Mohanty <smoha...@hortonworks.com<mailto:smoha...@hortonworks.com>>, 
Alejandro Fernandez 
<afernan...@hortonworks.com<mailto:afernan...@hortonworks.com>>
Cc: Jeff Zhang <zjf...@apache.org<mailto:zjf...@apache.org>>, Ambari 
<reviews@ambari.apache.org<mailto:reviews@ambari.apache.org>>
Subject: Re: Review Request 46727: [AMBARI-15612] Add Livy to HDP 2.5 as slave 
component of Spark


Hi Jayush,

I try to verify it on blueprints,  but fails with 2 problems.
One is when setup hw repo, another is when registering blueprint. Here’s the 
errors I get, could you guide me what steps I miss here ? Thanks

Setup hw repo.


curl -X PUT  -u admin:admin -d @repo.json -H 'X-Requested-By: ambari' 
http://jzhang-test3-1.openstacklocal:8080/api/v1/stacks/HDP/versions/2.5/operating_systems/centos6/repositories/hw_repo


Error I get:

{

  "status" : 404,

  "message" : "org.apache.ambari.server.controller.spi.NoSuchResourceException: 
The specified resource doesn't exist: Stack data, stackName=HDP, 
stackVersion=2.5, osType=centos6, repoId=hw_repo”

}


Register blueprint


curl -X POST -u admin:admin -d @dev_cluster.json -H 'X-Requested-By: ambari' 
http://jzhang-test3-1.openstacklocal:8080/api/v1/blueprints/dev_cluster


Error I get


{

  "status" : 400,

  "message" : "Blueprint configuration validation failed: Missing required 
properties.  Specify a value for these properties in the blueprint 
configuration. {host_group_1={kerberos-env=[kdc_type, kdc_hosts, 
encryption_types, realm, ldap_url, container_dn]}}”

}



Attach are the request body file for these 2 cases.




Best Regard,
Jeff Zhang


From: Jayush Luniya 
<nore...@reviews.apache.org<mailto:nore...@reviews.apache.org>> on behalf of 
Jayush Luniya <jlun...@hortonworks.com<mailto:jlun...@hortonworks.com>>
Reply-To: Jayush Luniya 
<jlun...@hortonworks.com<mailto:jlun...@hortonworks.com>>
Date: Thursday, May 19, 2016 at 7:53 AM
To: Jayush Luniya <jlun...@hortonworks.com<mailto:jlun...@hortonworks.com>>, 
Sumit Mohanty <smoha...@hortonworks.com<mailto:smoha...@hortonworks.com>>, 
Alejandro Fernandez 
<afernan...@hortonworks.com<mailto:afernan...@hortonworks.com>>
Cc: Jeff Zhang <zjf...@apache.org<mailto:zjf...@apache.org>>, Ambari 
<reviews@ambari.apache.org<mailto:reviews@ambari.apache.org>>
Subject: Re: Review Request 46727: [AMBARI-15612] Add Livy to HDP 2.5 as slave 
component of Spark

This is an automatically generated e-mail. To reply, visit: 
https://reviews.apache.org/r/46727/


@Jeff
Can you verify that blueprint deployment of the cluster without Livy Server 
works?

Guide on Blueprints
https://cwiki.apache.org/confluence/display/AMBARI/Blueprints


- Jayush Luniya


On May 18th, 2016, 11:10 a.m. UTC, Jeff Zhang wrote:

Review request for Ambari, Alejandro Fernandez, Jayush Luniya, and Sumit 
Mohanty.
By Jeff Zhang.

Updated May 18, 2016, 11:10 a.m.

Bugs: AMBARI-15612<https://issues.apache.org/jira/browse/AMBARI-15612>
Repository: ambari
Description

Add Livy to HDP 2.5 as slave component of Spark.

Move the spark stack definiation to commoon-services and then


Testing

Manully verify it. Livy is installed correctly in non-secure and secure cluster.


Diffs

  *   
ambari-common/src/main/python/resource_management/libraries/functions/constants.py
 (2e18443)
  *   
ambari-common/src/main/python/resource_management/libraries/functions/stack_features.py
 (9e9cadc)
  *   
ambari-server/src/main/resources/common-services/SPARK/1.2.1/package/scripts/livy_server.py
 (PRE-CREATION)
  *   
ambari-server/src/main/resources/common-services/SPARK/1.2.1/package/scripts/livy_service.py
 (PRE-CREATION)
  *   
ambari-server/src/main/resources/common-services/SPARK/1.2.1/package/scripts/params.py
 (c5f3eb6)
  *   
ambari-server/src/main/resources/common-services/SPARK/1.2.1/package/scripts/service_check.py
 (694f046)
  *   
ambari-server/src/main/resources/common-services/SPARK/1.2.1/package/scripts/setup_livy.py
 (PRE-CREATION)
  *   
ambari-server/src/main/resources/common-services/SPARK/1.2.1/package/scripts/status_params.py
 (86e7f7d)
  *   
ambari-server/src/main/resources/stacks/HDP/2.0.6/properties/stack_features.json
 (3ec5d05)
  *   
ambari-server/src/main/resources/stacks/HDP/2.0.6/services/stack_advisor.py 
(6e506a0)
  *   ambari-server/src/main/resources/stacks/HDP/2.5/role_command_order.json 
(f7e15aa)
  *   
ambari-server/src/main/resources/stacks/HDP/2.5/services/SPARK/configuration/livy-conf.xml
 (PRE-CREATION)
  *   
ambari-server/src/main/resources/stacks/HDP/2.5/services/SPARK/configuration/livy-env.xml
 (PRE-CREATION)
  *   
ambari-server/src/main/resources/stacks/HDP/2.5/services/SPARK/configuration/livy-log4j-properties.xml
 (PRE-CREATION)
  *   
ambari-server/src/main/resources/stacks/HDP/2.5/services/SPARK/configuration/livy-spark-blacklist.xml
 (PRE-CREATION)
  *   
ambari-server/src/main/resources/stacks/HDP/2.5/services/SPARK/kerberos.json 
(PRE-CREATION)
  *   
ambari-server/src/main/resources/stacks/HDP/2.5/services/SPARK/metainfo.xml 
(d1129cd)

View Diff<https://reviews.apache.org/r/46727/diff/>

Reply via email to