+ Sean Roberts who may able to help Hi Jayush & Sean,
I also ask the question on ambari mail list, but still could not make progress, not sure how to verify that, do you have any suggestion on that ? Very appreciated. http://mail-archives.apache.org/mod_mbox/ambari-user/201605.mbox/%3CCAADy7x7ha6amOjmNFCQN2bKpMACGbLJr3uDxKjPCn=jph_7...@mail.gmail.com%3E Best Regard, Jeff Zhang From: Jianfeng Zhang <jzh...@hortonworks.com<mailto:jzh...@hortonworks.com>> Date: Friday, May 20, 2016 at 7:28 AM To: Jayush Luniya <jlun...@hortonworks.com<mailto:jlun...@hortonworks.com>>, Sumit Mohanty <smoha...@hortonworks.com<mailto:smoha...@hortonworks.com>>, Alejandro Fernandez <afernan...@hortonworks.com<mailto:afernan...@hortonworks.com>> Cc: Jeff Zhang <zjf...@apache.org<mailto:zjf...@apache.org>>, Ambari <reviews@ambari.apache.org<mailto:reviews@ambari.apache.org>> Subject: Re: Review Request 46727: [AMBARI-15612] Add Livy to HDP 2.5 as slave component of Spark Hi Jayush, Could you help take a look at it ? Thanks. Best Regard, Jeff Zhang From: Jianfeng Zhang <jzh...@hortonworks.com<mailto:jzh...@hortonworks.com>> Date: Thursday, May 19, 2016 at 10:22 AM To: Jayush Luniya <jlun...@hortonworks.com<mailto:jlun...@hortonworks.com>>, Sumit Mohanty <smoha...@hortonworks.com<mailto:smoha...@hortonworks.com>>, Alejandro Fernandez <afernan...@hortonworks.com<mailto:afernan...@hortonworks.com>> Cc: Jeff Zhang <zjf...@apache.org<mailto:zjf...@apache.org>>, Ambari <reviews@ambari.apache.org<mailto:reviews@ambari.apache.org>> Subject: Re: Review Request 46727: [AMBARI-15612] Add Livy to HDP 2.5 as slave component of Spark Hi Jayush, I try to verify it on blueprints, but fails with 2 problems. One is when setup hw repo, another is when registering blueprint. Here’s the errors I get, could you guide me what steps I miss here ? Thanks Setup hw repo. curl -X PUT -u admin:admin -d @repo.json -H 'X-Requested-By: ambari' http://jzhang-test3-1.openstacklocal:8080/api/v1/stacks/HDP/versions/2.5/operating_systems/centos6/repositories/hw_repo Error I get: { "status" : 404, "message" : "org.apache.ambari.server.controller.spi.NoSuchResourceException: The specified resource doesn't exist: Stack data, stackName=HDP, stackVersion=2.5, osType=centos6, repoId=hw_repo” } Register blueprint curl -X POST -u admin:admin -d @dev_cluster.json -H 'X-Requested-By: ambari' http://jzhang-test3-1.openstacklocal:8080/api/v1/blueprints/dev_cluster Error I get { "status" : 400, "message" : "Blueprint configuration validation failed: Missing required properties. Specify a value for these properties in the blueprint configuration. {host_group_1={kerberos-env=[kdc_type, kdc_hosts, encryption_types, realm, ldap_url, container_dn]}}” } Attach are the request body file for these 2 cases. Best Regard, Jeff Zhang From: Jayush Luniya <nore...@reviews.apache.org<mailto:nore...@reviews.apache.org>> on behalf of Jayush Luniya <jlun...@hortonworks.com<mailto:jlun...@hortonworks.com>> Reply-To: Jayush Luniya <jlun...@hortonworks.com<mailto:jlun...@hortonworks.com>> Date: Thursday, May 19, 2016 at 7:53 AM To: Jayush Luniya <jlun...@hortonworks.com<mailto:jlun...@hortonworks.com>>, Sumit Mohanty <smoha...@hortonworks.com<mailto:smoha...@hortonworks.com>>, Alejandro Fernandez <afernan...@hortonworks.com<mailto:afernan...@hortonworks.com>> Cc: Jeff Zhang <zjf...@apache.org<mailto:zjf...@apache.org>>, Ambari <reviews@ambari.apache.org<mailto:reviews@ambari.apache.org>> Subject: Re: Review Request 46727: [AMBARI-15612] Add Livy to HDP 2.5 as slave component of Spark This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/46727/ @Jeff Can you verify that blueprint deployment of the cluster without Livy Server works? Guide on Blueprints https://cwiki.apache.org/confluence/display/AMBARI/Blueprints - Jayush Luniya On May 18th, 2016, 11:10 a.m. UTC, Jeff Zhang wrote: Review request for Ambari, Alejandro Fernandez, Jayush Luniya, and Sumit Mohanty. By Jeff Zhang. Updated May 18, 2016, 11:10 a.m. Bugs: AMBARI-15612<https://issues.apache.org/jira/browse/AMBARI-15612> Repository: ambari Description Add Livy to HDP 2.5 as slave component of Spark. Move the spark stack definiation to commoon-services and then Testing Manully verify it. Livy is installed correctly in non-secure and secure cluster. Diffs * ambari-common/src/main/python/resource_management/libraries/functions/constants.py (2e18443) * ambari-common/src/main/python/resource_management/libraries/functions/stack_features.py (9e9cadc) * ambari-server/src/main/resources/common-services/SPARK/1.2.1/package/scripts/livy_server.py (PRE-CREATION) * ambari-server/src/main/resources/common-services/SPARK/1.2.1/package/scripts/livy_service.py (PRE-CREATION) * ambari-server/src/main/resources/common-services/SPARK/1.2.1/package/scripts/params.py (c5f3eb6) * ambari-server/src/main/resources/common-services/SPARK/1.2.1/package/scripts/service_check.py (694f046) * ambari-server/src/main/resources/common-services/SPARK/1.2.1/package/scripts/setup_livy.py (PRE-CREATION) * ambari-server/src/main/resources/common-services/SPARK/1.2.1/package/scripts/status_params.py (86e7f7d) * ambari-server/src/main/resources/stacks/HDP/2.0.6/properties/stack_features.json (3ec5d05) * ambari-server/src/main/resources/stacks/HDP/2.0.6/services/stack_advisor.py (6e506a0) * ambari-server/src/main/resources/stacks/HDP/2.5/role_command_order.json (f7e15aa) * ambari-server/src/main/resources/stacks/HDP/2.5/services/SPARK/configuration/livy-conf.xml (PRE-CREATION) * ambari-server/src/main/resources/stacks/HDP/2.5/services/SPARK/configuration/livy-env.xml (PRE-CREATION) * ambari-server/src/main/resources/stacks/HDP/2.5/services/SPARK/configuration/livy-log4j-properties.xml (PRE-CREATION) * ambari-server/src/main/resources/stacks/HDP/2.5/services/SPARK/configuration/livy-spark-blacklist.xml (PRE-CREATION) * ambari-server/src/main/resources/stacks/HDP/2.5/services/SPARK/kerberos.json (PRE-CREATION) * ambari-server/src/main/resources/stacks/HDP/2.5/services/SPARK/metainfo.xml (d1129cd) View Diff<https://reviews.apache.org/r/46727/diff/>