----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/57792/#review169707 -----------------------------------------------------------
ambari-common/src/main/python/resource_management/libraries/functions/stack_select.py Lines 296 (patched) <https://reviews.apache.org/r/57792/#comment242227> be -> by ambari-server/src/main/java/org/apache/ambari/server/controller/internal/UpgradeResourceProvider.java Line 1357 (original), 1357 (patched) <https://reviews.apache.org/r/57792/#comment242228> Why do you want to include the host name on the command - the command is scoped to a host already. ambari-server/src/main/java/org/apache/ambari/server/state/UpgradeHelper.java Lines 511 (patched) <https://reviews.apache.org/r/57792/#comment242229> isBlank instead? ambari-server/src/main/java/org/apache/ambari/server/state/stack/upgrade/ClusterGrouping.java Lines 296 (patched) <https://reviews.apache.org/r/57792/#comment242231> Doesn't this mean split the original set into subsets of 1 each? When `numHostsPerBatch` is 0, then you should have a single set of all hosts, right? Why not just use a Collections.singleontList(hostNames) ambari-server/src/main/resources/alerts.json Lines 184 (patched) <https://reviews.apache.org/r/57792/#comment242233> prefix with ambari_agent to be consistent ambari-server/src/main/resources/stacks/HDP/2.3/upgrades/nonrolling-upgrade-2.3.xml Lines 307 (patched) <https://reviews.apache.org/r/57792/#comment242234> You're changing the behavior here to batch this by 100's ... is this what we want in an express upgrade? - Jonathan Hurley On March 20, 2017, 8:49 p.m., Alejandro Fernandez wrote: > > ----------------------------------------------------------- > This is an automatically generated e-mail. To reply, visit: > https://reviews.apache.org/r/57792/ > ----------------------------------------------------------- > > (Updated March 20, 2017, 8:49 p.m.) > > > Review request for Ambari, Jonathan Hurley, Nate Cole, Sumit Mohanty, and Sid > Wagle. > > > Bugs: AMBARI-20490 > https://issues.apache.org/jira/browse/AMBARI-20490 > > > Repository: ambari > > > Description > ------- > > On large-scale clusters over 1000 nodes, performance during Express Upgrade > can be very slow and it takes more time to fix potential errors. > We can remedy these with the following fixes: > > * "hdp-select set all" is currently ran in the ClusterGroup with a single > stage instead of batching. This can cause Ambari Server to be the bottleneck > when processing 1000+ requests. Allow the execute-stage inside a ClusterGroup > to use batching. > > * If some hosts have symlinks or dirs that don't belong in /usr/hdp/ then it > will prevent the hosts from running "hdp-select versions". We can find these > problematic hosts with an alert. > > * There is currently no upgrade path from HDP 2.2 directly to 2.5. Doing a > 2-step upgrade is very time consuming (only for branch 2.4 since HDP 2.2 no > longer supported in Ambari 2.5). > > > Diffs > ----- > > > ambari-common/src/main/python/resource_management/libraries/functions/stack_select.py > 20b4cbd > > ambari-server/src/main/java/org/apache/ambari/server/checks/AtlasPresenceCheck.java > 8556436 > > ambari-server/src/main/java/org/apache/ambari/server/controller/internal/UpgradeResourceProvider.java > ca9ce07 > > ambari-server/src/main/java/org/apache/ambari/server/state/UpgradeHelper.java > ee5451f > > ambari-server/src/main/java/org/apache/ambari/server/state/stack/upgrade/ClusterGrouping.java > c45ec24 > > ambari-server/src/main/java/org/apache/ambari/server/state/stack/upgrade/Grouping.java > 8003223 > > ambari-server/src/main/java/org/apache/ambari/server/state/stack/upgrade/StageWrapper.java > 669d50f > > ambari-server/src/main/java/org/apache/ambari/server/state/stack/upgrade/StageWrapperBuilder.java > 3cf3f8b > ambari-server/src/main/resources/alerts.json 2559b3a > ambari-server/src/main/resources/host_scripts/alert_version_select.py > PRE-CREATION > > ambari-server/src/main/resources/stacks/HDP/2.3/upgrades/nonrolling-upgrade-2.3.xml > 28ca939 > > ambari-server/src/main/resources/stacks/HDP/2.3/upgrades/nonrolling-upgrade-2.4.xml > 9aff1a9 > > ambari-server/src/main/resources/stacks/HDP/2.3/upgrades/nonrolling-upgrade-2.5.xml > adccac0 > > ambari-server/src/main/resources/stacks/HDP/2.4/upgrades/nonrolling-upgrade-2.4.xml > 3c0104b > > ambari-server/src/main/resources/stacks/HDP/2.4/upgrades/nonrolling-upgrade-2.5.xml > cd63651 > > ambari-server/src/main/resources/stacks/HDP/2.5/upgrades/nonrolling-upgrade-2.5.xml > 39cb0dc > > ambari-server/src/main/resources/stacks/HDP/2.5/upgrades/nonrolling-upgrade-2.6.xml > 57a5203 > > ambari-server/src/main/resources/stacks/HDP/2.6/upgrades/nonrolling-upgrade-2.6.xml > 035cb59 > ambari-server/src/main/resources/upgrade-pack.xsd 1f11aa1 > > ambari-server/src/test/java/org/apache/ambari/server/api/services/AmbariMetaInfoTest.java > f1af66f > > ambari-server/src/test/java/org/apache/ambari/server/controller/AmbariManagementControllerTest.java > bf6c41a > > ambari-server/src/test/java/org/apache/ambari/server/metadata/AgentAlertDefinitionsTest.java > cbc5e69 > > ambari-server/src/test/java/org/apache/ambari/server/state/UpgradeHelperTest.java > 8e5ad0a > > ambari-server/src/test/resources/stacks/HDP/2.1.1/upgrades/upgrade_test_batch.xml > PRE-CREATION > > ambari-server/src/test/resources/stacks/HDP/2.1.1/upgrades/upgrade_to_new_stack.xml > fe387f3 > > > Diff: https://reviews.apache.org/r/57792/diff/2/ > > > Testing > ------- > > mvn clean test > > > Thanks, > > Alejandro Fernandez > >
