-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/41987/
-----------------------------------------------------------
Review request for Ambari, Alejandro Fernandez, Dmytro Grinenko, Jonathan
Hurley, Jayush Luniya, and Nate Cole.
Bugs: AMBARI-14570
https://issues.apache.org/jira/browse/AMBARI-14570
Repository: ambari
Description
-------
*Steps*
# Setup HDP 2.3.4.0 (Dal M20) cluster with Ambari 2.2.1.0 (including spark
service)
# Perform EU to Dal M21 (HDP-2.4.0.0-42)
EU reports failure at Finalize Upgrade pre-check with below error for
SPARK_THRIFTSERVER :
{code}
The following components were found to have version mismatches. Finalize will
not complete successfully:
host-ora12-6.novalocal: SPARK/SPARK_THRIFTSERVER reports 2.3.4.0-3485
host-ora12-4.novalocal: SPARK/SPARK_THRIFTSERVER reports 2.3.4.0-3485
host-ora12-1.novalocal: SPARK/SPARK_THRIFTSERVER reports 2.3.4.0-3485
host-ora12-2.novalocal: SPARK/SPARK_THRIFTSERVER reports 2.3.4.0-3485
host-ora12-5.novalocal: SPARK/SPARK_THRIFTSERVER reports 2.3.4.0-3485
{code}
>From DB found below:
{code}
select * from hostcomponentstate where component_name = 'SPARK_THRIFTSERVER'
53.00 1.00 SPARK_THRIFTSERVER 2.3.4.0-3485 5.00 STARTED 3.00
SPARK NONE UNKNOWN
54.00 1.00 SPARK_THRIFTSERVER 2.3.4.0-3485 5.00 STARTED 5.00
SPARK NONE UNKNOWN
55.00 1.00 SPARK_THRIFTSERVER 2.3.4.0-3485 5.00 STARTED 4.00
SPARK NONE UNKNOWN
56.00 1.00 SPARK_THRIFTSERVER 2.3.4.0-3485 5.00 STARTED 1.00
SPARK NONE UNKNOWN
57.00 1.00 SPARK_THRIFTSERVER 2.3.4.0-3485 5.00 STARTED 2.00
SPARK NONE UNKNOWN
select * from hostcomponentdesiredstate where component_name =
'SPARK_THRIFTSERVER'
1.00 SPARK_THRIFTSERVER 3.00 STARTED 1.00 SPARK INSERVICE
OFF UNSECURED 0.00
1.00 SPARK_THRIFTSERVER 3.00 STARTED 2.00 SPARK INSERVICE
OFF UNSECURED 0.00
1.00 SPARK_THRIFTSERVER 3.00 STARTED 3.00 SPARK INSERVICE
OFF UNSECURED 0.00
1.00 SPARK_THRIFTSERVER 3.00 STARTED 4.00 SPARK INSERVICE
OFF UNSECURED 0.00
1.00 SPARK_THRIFTSERVER 3.00 STARTED 5.00 SPARK INSERVICE
OFF UNSECURED 0.00
select * from stack where stack_id in (3,5)
3.00 HDP 2.4
5.00 HDP 2.3
{code}
EU reports failure at Finalize Upgrade pre-check with below error:
{code}
The following components were found to have version mismatches. Finalize will
not complete successfully:
host21unsecnr-6.novalocal: MAHOUT/MAHOUT reports 2.3.2.0-2950
host21unsecnr-3.novalocal: MAHOUT/MAHOUT reports 2.3.2.0-2950
host21unsecnr-1.novalocal: MAHOUT/MAHOUT reports 2.3.2.0-2950
host21unsecnr-5.novalocal: MAHOUT/MAHOUT reports 2.3.2.0-2950
host21unsecnr-2.novalocal: MAHOUT/MAHOUT reports 2.3.2.0-2950
{code}
>From DB found below:
{code}
select * from hostcomponentstate where component_name = 'MAHOUT'
id cluster_id component_name version current_stack_id
current_state host_id service_name upgrade_state security_state
116 2 MAHOUT 2.3.2.0-2950 2 INSTALLED 5 MAHOUT
NONE UNKNOWN
117 2 MAHOUT 2.3.2.0-2950 2 INSTALLED 3 MAHOUT
NONE UNKNOWN
118 2 MAHOUT 2.3.2.0-2950 2 INSTALLED 4 MAHOUT
NONE UNKNOWN
119 2 MAHOUT 2.3.2.0-2950 2 INSTALLED 1 MAHOUT
NONE UNKNOWN
120 2 MAHOUT 2.3.2.0-2950 2 INSTALLED 2 MAHOUT
NONE UNKNOWN
select * from hostcomponentdesiredstate where component_name = 'MAHOUT'
cluster_id component_name desired_stack_id desired_state host_id
service_name admin_state maintenance_state security_state
restart_required
2 MAHOUT 1 INSTALLED 1 MAHOUT NULL OFF
UNSECURED 0
2 MAHOUT 1 INSTALLED 2 MAHOUT NULL OFF
UNSECURED 0
2 MAHOUT 1 INSTALLED 3 MAHOUT NULL OFF
UNSECURED 0
2 MAHOUT 1 INSTALLED 4 MAHOUT NULL OFF
UNSECURED 0
2 MAHOUT 1 INSTALLED 5 MAHOUT NULL OFF
UNSECURED 0
select * from stack where stack_id in (1,2)
stack_id stack_name stack_version
1 HDP 2.4
2 HDP 2.3
{code}
Diffs
-----
ambari-agent/src/main/python/ambari_agent/HostCleanup.py 1655fbd
ambari-agent/src/main/python/ambari_agent/HostInfo.py 9892b0c
ambari-agent/src/test/python/ambari_agent/TestActionQueue.py 35d048a
ambari-agent/src/test/python/ambari_agent/TestHostCleanup.py 165c5f0
ambari-common/src/main/python/resource_management/libraries/functions/hdp_select.py
7cae627
ambari-server/src/main/java/org/apache/ambari/server/alerts/StaleAlertRunnable.java
83abc8e
ambari-server/src/main/resources/common-services/HAWQ/2.0.0/package/scripts/master_helper.py
95c4eba
ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/package/scripts/service_check.py
c004654
ambari-server/src/main/resources/stacks/HDP/2.0.6/hooks/after-INSTALL/scripts/hook.py
73412e0
ambari-server/src/main/resources/stacks/HDP/2.0.6/hooks/after-INSTALL/scripts/shared_initialization.py
1b7b57a
ambari-server/src/main/resources/stacks/HDP/2.0.6/services/stack_advisor.py
a4c602e
ambari-server/src/main/resources/stacks/HDP/2.3/upgrades/nonrolling-upgrade-2.4.xml
ab91379
ambari-server/src/main/resources/stacks/HDP/2.4/services/SPARK/metainfo.xml
adcf59e
ambari-server/src/main/resources/stacks/HDP/2.4/upgrades/nonrolling-upgrade-2.4.xml
57be7b2
ambari-server/src/main/resources/stacks/HDP/2.4/upgrades/upgrade-2.4.xml
c534257
ambari-server/src/test/python/stacks/2.0.6/hooks/after-INSTALL/test_after_install.py
be35a99
ambari-web/app/controllers/main/admin/highAvailability/nameNode/rollback_controller.js
4aa2d73
ambari-web/app/controllers/main/admin/highAvailability/nameNode/step9_controller.js
7745c6b
ambari-web/app/controllers/main/admin/stack_and_upgrade_controller.js 29b996f
ambari-web/app/controllers/wizard/step8_controller.js a843f65
ambari-web/app/messages.js 214b214
ambari-web/app/templates/wizard/step8/step8_log_popup.hbs 6d3e5c2
ambari-web/app/views/common/chart/linear_time.js 4fbbef9
Diff: https://reviews.apache.org/r/41987/diff/
Testing
-------
For now, patch verification is blocked by rel eng issue (hdp-select-2.4.0.0-6
has no support for spark-thriftserver)
Thanks,
Dmitro Lisnichenko
