-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/52136/
-----------------------------------------------------------

Review request for Ambari.


Bugs: AMBARI-18438
    https://issues.apache.org/jira/browse/AMBARI-18438


Repository: ambari


Description
-------

In order to support sysprepped clusters using Docker containers, we need more 
granular flags about what steps must be done, e.g.,

* Copy tarballs to HDFS
* Copy Oozie share lib to HDFS
* Copy fast jar (fast-hdfs-resource.jar) to /var/lib/ambari-agent/lib/
* Create users and groups

These properties will be stored in cluster-env instead of ambari.properties so 
they can be changed without requiring a restart of Ambari Server.

sysprep_skip_copy_tarballs_hdfs=true|false (default is false)
sysprep_skip_copy_oozie_share_lib_to_hdfs=true|false (default is false)
sysprep_skip_copy_fast_jar_hdfs=true|false (default is false) 
sysprep_create_users_and_groups=true|false (default is true)

For existing users that have automated everything on a sysprepped cluster, they 
should set these flags as true, true, true, false, respectively.

These flags are only valid if ambari.properties knows the cluster is 
sysprepped, i.e.,
packages.pre.installed=true


Diffs
-----

  
ambari-common/src/main/python/resource_management/libraries/functions/copy_tarball.py
 2626990 
  
ambari-common/src/main/python/resource_management/libraries/functions/setup_atlas_hook.py
 591c064 
  
ambari-server/src/main/resources/common-services/ACCUMULO/1.6.1.2.2.0/package/scripts/params.py
 4c111f1 
  
ambari-server/src/main/resources/common-services/AMBARI_METRICS/0.1.0/package/scripts/params.py
 6934924 
  
ambari-server/src/main/resources/common-services/FLUME/1.4.0.2.0/package/scripts/params.py
 d3a9294 
  
ambari-server/src/main/resources/common-services/HBASE/0.96.0.2.0/package/scripts/params.py
 f3208ce 
  
ambari-server/src/main/resources/common-services/HDFS/2.1.0.2.0/package/scripts/params.py
 7514918 
  
ambari-server/src/main/resources/common-services/HIVE/0.12.0.2.0/package/scripts/hive.py
 3249dd4 
  
ambari-server/src/main/resources/common-services/HIVE/0.12.0.2.0/package/scripts/hive_interactive.py
 6511d0e 
  
ambari-server/src/main/resources/common-services/HIVE/0.12.0.2.0/package/scripts/hive_server.py
 7c886b2 
  
ambari-server/src/main/resources/common-services/HIVE/0.12.0.2.0/package/scripts/hive_server_interactive.py
 da05913 
  
ambari-server/src/main/resources/common-services/HIVE/0.12.0.2.0/package/scripts/params.py
 f10a3f3 
  
ambari-server/src/main/resources/common-services/KAFKA/0.8.1/package/scripts/params.py
 f631ac9 
  
ambari-server/src/main/resources/common-services/KERBEROS/1.10.3-10/package/scripts/params.py
 fe367b6 
  
ambari-server/src/main/resources/common-services/KNOX/0.5.0.2.2/package/scripts/params.py
 14e021d 
  
ambari-server/src/main/resources/common-services/MAHOUT/1.0.0.2.3/package/scripts/params.py
 8ef3ba8 
  
ambari-server/src/main/resources/common-services/OOZIE/4.0.0.2.0/package/scripts/oozie_service.py
 4740131 
  
ambari-server/src/main/resources/common-services/OOZIE/4.0.0.2.0/package/scripts/params.py
 28d654e 
  
ambari-server/src/main/resources/common-services/PIG/0.12.0.2.0/package/scripts/params.py
 36541e7 
  
ambari-server/src/main/resources/common-services/PIG/0.12.0.2.0/package/scripts/service_check.py
 e029092 
  
ambari-server/src/main/resources/common-services/RANGER/0.4.0/package/scripts/params.py
 e63627d 
  
ambari-server/src/main/resources/common-services/SLIDER/0.60.0.2.2/package/scripts/params.py
 842e5ed 
  
ambari-server/src/main/resources/common-services/SLIDER/0.60.0.2.2/package/scripts/params_linux.py
 6bf41b4 
  
ambari-server/src/main/resources/common-services/SLIDER/0.60.0.2.2/package/scripts/service_check.py
 468dfb1 
  
ambari-server/src/main/resources/common-services/SPARK/1.2.1/package/scripts/job_history_server.py
 2825f35 
  
ambari-server/src/main/resources/common-services/SPARK/1.2.1/package/scripts/params.py
 4e525db 
  
ambari-server/src/main/resources/common-services/SPARK/1.2.1/package/scripts/spark_service.py
 82a010a 
  
ambari-server/src/main/resources/common-services/SPARK2/2.0.0/package/scripts/job_history_server.py
 3a0cff5 
  
ambari-server/src/main/resources/common-services/SPARK2/2.0.0/package/scripts/params.py
 e461186 
  
ambari-server/src/main/resources/common-services/SPARK2/2.0.0/package/scripts/spark_service.py
 590b299 
  
ambari-server/src/main/resources/common-services/SQOOP/1.4.4.2.0/package/scripts/params.py
 ec71506 
  
ambari-server/src/main/resources/common-services/STORM/0.9.1/package/scripts/params.py
 f10a3f3 
  
ambari-server/src/main/resources/common-services/TEZ/0.4.0.2.1/package/scripts/params.py
 1e591f4 
  
ambari-server/src/main/resources/common-services/TEZ/0.4.0.2.1/package/scripts/pre_upgrade.py
 04d8be1 
  
ambari-server/src/main/resources/common-services/TEZ/0.4.0.2.1/package/scripts/service_check.py
 af429f6 
  
ambari-server/src/main/resources/common-services/YARN/2.1.0.2.0/package/scripts/historyserver.py
 d5bdc6b 
  
ambari-server/src/main/resources/common-services/YARN/2.1.0.2.0/package/scripts/params.py
 073e84f 
  
ambari-server/src/main/resources/stacks/HDP/2.0.6/configuration/cluster-env.xml 
81cb175 
  
ambari-server/src/main/resources/stacks/HDP/2.0.6/hooks/before-ANY/scripts/params.py
 8b52ca1 
  
ambari-server/src/main/resources/stacks/HDP/2.0.6/hooks/before-ANY/scripts/shared_initialization.py
 1a7d21a 
  
ambari-server/src/main/resources/stacks/HDP/2.0.6/hooks/before-START/scripts/params.py
 45eab2f 
  
ambari-server/src/main/resources/stacks/HDP/2.0.6/hooks/before-START/scripts/shared_initialization.py
 8f845d2 
  ambari-server/src/test/python/stacks/2.0.6/HIVE/test_hive_server.py 3e5dc7e 
  ambari-server/src/test/python/stacks/2.0.6/YARN/test_historyserver.py 9ce5530 
  ambari-server/src/test/python/stacks/2.2/PIG/test_pig_service_check.py 
3abc601 

Diff: https://reviews.apache.org/r/52136/diff/


Testing
-------

To test this, I prepared 3 CentOS 6.4 VMs with the following.

* Ambari Server on c6401 host (set ambari.properties file with 
packages.pre.installed=true)
* Ambari Agent on all 3 hosts with manual registration (c6401, c6402, c6403)
* Setup repo files,
/etc/yum.repos.d/HDP.repo
/etc/yum.repos.d/HDP-UTILS.repo
* Installed bits by running install_packages.sh on each host
* Used blueprint blueprint_fast_install_more_services.json and topology.json 
(from Jira) to install HDP 2.5


Thanks,

Alejandro Fernandez

Reply via email to