-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/52136/#review149902
-----------------------------------------------------------




ambari-common/src/main/python/resource_management/libraries/functions/copy_tarball.py
 (line 68)
<https://reviews.apache.org/r/52136/#comment217668>

    This is called by a lot of the service params.py files



ambari-common/src/main/python/resource_management/libraries/functions/copy_tarball.py
 (line 202)
<https://reviews.apache.org/r/52136/#comment217669>

    Renamed the variable to keep it generic



ambari-server/src/main/resources/common-services/OOZIE/4.0.0.2.0/package/scripts/params.py
 (line 39)
<https://reviews.apache.org/r/52136/#comment217670>

    Oozie has different logic for its share lib.



ambari-server/src/main/resources/common-services/RANGER/0.4.0/package/scripts/params.py
 
<https://reviews.apache.org/r/52136/#comment217671>

    Ranger, Flume, Accumulo, AMS, Storm, and a couple of others don't need this.



ambari-server/src/main/resources/stacks/HDP/2.0.6/configuration/cluster-env.xml 
(line 84)
<https://reviews.apache.org/r/52136/#comment217674>

    These are the 4 new configs.



ambari-server/src/main/resources/stacks/HDP/2.0.6/hooks/before-ANY/scripts/shared_initialization.py
 (line 34)
<https://reviews.apache.org/r/52136/#comment217673>

    Creating users groups uses its own flag.



ambari-server/src/main/resources/stacks/HDP/2.0.6/hooks/before-START/scripts/shared_initialization.py
 (line 65)
<https://reviews.apache.org/r/52136/#comment217672>

    Copying the fast jar uses its own flag.


- Alejandro Fernandez


On Sept. 21, 2016, 9:49 p.m., Alejandro Fernandez wrote:
> 
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/52136/
> -----------------------------------------------------------
> 
> (Updated Sept. 21, 2016, 9:49 p.m.)
> 
> 
> Review request for Ambari.
> 
> 
> Bugs: AMBARI-18438
>     https://issues.apache.org/jira/browse/AMBARI-18438
> 
> 
> Repository: ambari
> 
> 
> Description
> -------
> 
> In order to support sysprepped clusters using Docker containers, we need more 
> granular flags about what steps must be done, e.g.,
> 
> * Copy tarballs to HDFS
> * Copy Oozie share lib to HDFS
> * Copy fast jar (fast-hdfs-resource.jar) to /var/lib/ambari-agent/lib/
> * Create users and groups
> 
> These properties will be stored in cluster-env instead of ambari.properties 
> so they can be changed without requiring a restart of Ambari Server.
> 
> sysprep_skip_copy_tarballs_hdfs=true|false (default is false)
> sysprep_skip_copy_oozie_share_lib_to_hdfs=true|false (default is false)
> sysprep_skip_copy_fast_jar_hdfs=true|false (default is false) 
> sysprep_create_users_and_groups=true|false (default is true)
> 
> For existing users that have automated everything on a sysprepped cluster, 
> they should set these flags as true, true, true, false, respectively.
> 
> These flags are only valid if ambari.properties knows the cluster is 
> sysprepped, i.e.,
> packages.pre.installed=true
> 
> 
> Diffs
> -----
> 
>   
> ambari-common/src/main/python/resource_management/libraries/functions/copy_tarball.py
>  2626990 
>   
> ambari-common/src/main/python/resource_management/libraries/functions/setup_atlas_hook.py
>  591c064 
>   
> ambari-server/src/main/resources/common-services/ACCUMULO/1.6.1.2.2.0/package/scripts/params.py
>  4c111f1 
>   
> ambari-server/src/main/resources/common-services/AMBARI_METRICS/0.1.0/package/scripts/params.py
>  6934924 
>   
> ambari-server/src/main/resources/common-services/FLUME/1.4.0.2.0/package/scripts/params.py
>  d3a9294 
>   
> ambari-server/src/main/resources/common-services/HBASE/0.96.0.2.0/package/scripts/params.py
>  f3208ce 
>   
> ambari-server/src/main/resources/common-services/HDFS/2.1.0.2.0/package/scripts/params.py
>  7514918 
>   
> ambari-server/src/main/resources/common-services/HIVE/0.12.0.2.0/package/scripts/hive.py
>  3249dd4 
>   
> ambari-server/src/main/resources/common-services/HIVE/0.12.0.2.0/package/scripts/hive_interactive.py
>  6511d0e 
>   
> ambari-server/src/main/resources/common-services/HIVE/0.12.0.2.0/package/scripts/hive_server.py
>  7c886b2 
>   
> ambari-server/src/main/resources/common-services/HIVE/0.12.0.2.0/package/scripts/hive_server_interactive.py
>  da05913 
>   
> ambari-server/src/main/resources/common-services/HIVE/0.12.0.2.0/package/scripts/params.py
>  f10a3f3 
>   
> ambari-server/src/main/resources/common-services/KAFKA/0.8.1/package/scripts/params.py
>  f631ac9 
>   
> ambari-server/src/main/resources/common-services/KERBEROS/1.10.3-10/package/scripts/params.py
>  fe367b6 
>   
> ambari-server/src/main/resources/common-services/KNOX/0.5.0.2.2/package/scripts/params.py
>  14e021d 
>   
> ambari-server/src/main/resources/common-services/MAHOUT/1.0.0.2.3/package/scripts/params.py
>  8ef3ba8 
>   
> ambari-server/src/main/resources/common-services/OOZIE/4.0.0.2.0/package/scripts/oozie_service.py
>  4740131 
>   
> ambari-server/src/main/resources/common-services/OOZIE/4.0.0.2.0/package/scripts/params.py
>  28d654e 
>   
> ambari-server/src/main/resources/common-services/PIG/0.12.0.2.0/package/scripts/params.py
>  36541e7 
>   
> ambari-server/src/main/resources/common-services/PIG/0.12.0.2.0/package/scripts/service_check.py
>  e029092 
>   
> ambari-server/src/main/resources/common-services/RANGER/0.4.0/package/scripts/params.py
>  e63627d 
>   
> ambari-server/src/main/resources/common-services/SLIDER/0.60.0.2.2/package/scripts/params.py
>  842e5ed 
>   
> ambari-server/src/main/resources/common-services/SLIDER/0.60.0.2.2/package/scripts/params_linux.py
>  6bf41b4 
>   
> ambari-server/src/main/resources/common-services/SLIDER/0.60.0.2.2/package/scripts/service_check.py
>  468dfb1 
>   
> ambari-server/src/main/resources/common-services/SPARK/1.2.1/package/scripts/job_history_server.py
>  2825f35 
>   
> ambari-server/src/main/resources/common-services/SPARK/1.2.1/package/scripts/params.py
>  4e525db 
>   
> ambari-server/src/main/resources/common-services/SPARK/1.2.1/package/scripts/spark_service.py
>  82a010a 
>   
> ambari-server/src/main/resources/common-services/SPARK2/2.0.0/package/scripts/job_history_server.py
>  3a0cff5 
>   
> ambari-server/src/main/resources/common-services/SPARK2/2.0.0/package/scripts/params.py
>  e461186 
>   
> ambari-server/src/main/resources/common-services/SPARK2/2.0.0/package/scripts/spark_service.py
>  590b299 
>   
> ambari-server/src/main/resources/common-services/SQOOP/1.4.4.2.0/package/scripts/params.py
>  ec71506 
>   
> ambari-server/src/main/resources/common-services/STORM/0.9.1/package/scripts/params.py
>  f10a3f3 
>   
> ambari-server/src/main/resources/common-services/TEZ/0.4.0.2.1/package/scripts/params.py
>  1e591f4 
>   
> ambari-server/src/main/resources/common-services/TEZ/0.4.0.2.1/package/scripts/pre_upgrade.py
>  04d8be1 
>   
> ambari-server/src/main/resources/common-services/TEZ/0.4.0.2.1/package/scripts/service_check.py
>  af429f6 
>   
> ambari-server/src/main/resources/common-services/YARN/2.1.0.2.0/package/scripts/historyserver.py
>  d5bdc6b 
>   
> ambari-server/src/main/resources/common-services/YARN/2.1.0.2.0/package/scripts/params.py
>  073e84f 
>   
> ambari-server/src/main/resources/stacks/HDP/2.0.6/configuration/cluster-env.xml
>  81cb175 
>   
> ambari-server/src/main/resources/stacks/HDP/2.0.6/hooks/before-ANY/scripts/params.py
>  8b52ca1 
>   
> ambari-server/src/main/resources/stacks/HDP/2.0.6/hooks/before-ANY/scripts/shared_initialization.py
>  1a7d21a 
>   
> ambari-server/src/main/resources/stacks/HDP/2.0.6/hooks/before-START/scripts/params.py
>  45eab2f 
>   
> ambari-server/src/main/resources/stacks/HDP/2.0.6/hooks/before-START/scripts/shared_initialization.py
>  8f845d2 
>   ambari-server/src/test/python/stacks/2.0.6/HIVE/test_hive_server.py 3e5dc7e 
>   ambari-server/src/test/python/stacks/2.0.6/YARN/test_historyserver.py 
> 9ce5530 
>   ambari-server/src/test/python/stacks/2.2/PIG/test_pig_service_check.py 
> 3abc601 
> 
> Diff: https://reviews.apache.org/r/52136/diff/
> 
> 
> Testing
> -------
> 
> To test this, I prepared 3 CentOS 6.4 VMs with the following.
> 
> * Ambari Server on c6401 host (set ambari.properties file with 
> packages.pre.installed=true)
> * Ambari Agent on all 3 hosts with manual registration (c6401, c6402, c6403)
> * Setup repo files,
> /etc/yum.repos.d/HDP.repo
> /etc/yum.repos.d/HDP-UTILS.repo
> * Installed bits by running install_packages.sh on each host
> * Used blueprint blueprint_fast_install_more_services.json and topology.json 
> (from Jira) to install HDP 2.5
> 
> 
> Thanks,
> 
> Alejandro Fernandez
> 
>

Reply via email to