This is an automated email from the ASF dual-hosted git repository. jonathanhurley pushed a change to branch branch-feature-AMBARI-14714 in repository https://gitbox.apache.org/repos/asf/ambari.git.
from 9224d91 [AMBARI-24468] Add ClusterSettings and StackSettings module in execution_command library add c37b7ff AMBARI-23811. TimelineMetricsFilterTest fails if dir name contains @ due to AMBARI-24066 (#2031) add 73719b5 AMBARI-24459. Log Search / Log Feeder - support to use ZK only for storing filters (without manage input configs) (#2040) add 121ea17 AMBARI-24462. ambari-server upgrade stuck with NPE (amagyar) (#2043) add c5b67de Update team page. (yusaku) add d15a7bd [AMBARI-24425] [Log Search UI] Create visible time histogram selection area (#2025) add ad0f358 [AMBARI-24424] [Log Search UI] Align the time histogram chart axis (#2033) add 2ccf01b [AMBARI-24445] [Log Search UI] exclude mock data from production build (#2008) add a4d1d48 [AMBARI-24440] [Log Search UI] Default logs list length per page should be 100 instead of 10 (#2053) add 6d8c53b [AMBARI-24465] Warnings during ambari-agent, ambari-server upgrade (dgrinenko) add 04b738e [AMBARI-24441] [Log Search UI] The graphs are not always resized on window resize event. (#2051) add 2e64484 [AMBARI-24439] [Log Search UI] center the log tabs so they're aligned with the buttons (#2056) add a148741 AMBARI-24474. Data in Install Wizard is restored even after logout (akovalenko) add df5845a [AMBARI-24471] URL rewrite rules in gateway cannot be applied when thee response content from ambari server is compressed. (#2050) add ca17890 AMBARI-24477. ambari-agent floods data directory with files created for status commands (aonishuk) add 271e63b [AMBARI-24451] ambari.ldap.advanced.group_mapping_rules does not work, LDAP sync does not add admin roles for configured group(s) add 7f91e82 [AMBARI-24438] [Log Search UI] App Loader Page - add initial progress state (#2061) add 47aa256 AMBARI-21158. Eliminate Maven warning in Log Feeder Container Registry (#2075) add ad6d3eb AMBARI-24476. Disable autostart during blueprint deploy. (#2060) add 55351b8 AMBARI-24482 Overlapping text in Recommendations in Configurations page while UI installer. (ababiichuk) add 312f617 Merge branch 'trunk' of https://gitbox.apache.org/repos/asf/ambari into trunk add ee1076d Merge branch 'trunk' of https://gitbox.apache.org/repos/asf/ambari into trunk add 89514bd AMBARI-24475. Cover Ranger step 4 controller with tests add db2c3c7 Merge pull request #2058 from hiveww/AMBARI-24475-trunk add b73f84c AMBARI-24473. Ambari upgrade fails due to NPE when processing Ambari Infra kerberos descriptor changes (#2069) add 3f9d414 AMBARI-24484. HDP-GPL repo's shouldn't be pushed to hosts when GPL license was not applied. (#2080) add 49e8ee3 AMBARI-24480. Upgrade Infra Solr (from Solr 7.3.1 to Solr 7.4.0 (#2088) add a7cfe50 AMBARI-24486. Yarn Timeline Service V2 Reader is found down after EU (Atlantic to AtlanticM05) With error - Address already in use (amagyar) (#2085) add 0daa5f1 AMBARI-24488. Ambari Server Upgrade is failing with IndexError: tuple index out of range while running ambari-server upgrade command. (aonishuk) add 96335ba [AMBARI-24437] [Log Search UI] App Loader Page - add more space above the loader animations (#2063) add 60d4951 [AMBARI-24436] [Log Search UI] App Loader Page - Align the logo left (#2065) add 7ccfd1e AMBARI-24489. Cover activate standby step 3 controller with tests add 93c5f8e Merge pull request #2089 from hiveww/AMBARI-24489-trunk add 56441eb [AMBARI-24433] [Log Search UI] Reset to default selection in the dropdowns (#2091) add 99c9070 Fixed Spelling. (#1918) add 9d525af [AMBARI-24452] [UI Deploy] LLAP queue is not created/set in YARN configs while enabling HSI. add bff6d0e [AMBARI-24485] HDP-3.0 Hive Interactive server fails to start. (#2098) add 0d3cf9c AMBARI-24495. ambari-server setup fails with postgresql >= 9.3 (aonishuk) add ba20a59 AMBARI-24496. Ambari updates lates_url info for HDF stacks with HDP link (amagyar) (#2107) add 6f60dc2 [AMBARI-24490] [Log Search UI] Time Histogram Chart keep invert grey selection area when no selection happened (#2095) add e7a37c6 AMBARI-24500 Stack and Versions page style fixes. (ababiichuk) add 9070ae9 [AMBARI-24494] Ambari API does not return AssignmentManager HBase point in time metrics through API. (#2113) add 154b36f AMBARI-24505 host component out of sync error message on version screen add 005e50f [AMBARI-24503] LLAP application on Yarn fails with CNF exception on sysprepped cluster. (#2118) add 4c8f6f8 AMBARI-24506. Upgrade: Infra Solr service is not renamed in Upgrade History table. (#2119) add dfaaf33 AMBARI-23903: Add jdeb support (#1642) add 9491f1f AMBARI-24514. conf-select/stack-select operations can yield incorrect result with parallel_execution=1 (aonishuk) add 17f6792 [AMBARI-24507] Remove dependency on org.bouncycastle bcprov-jdk15on before version 1.6.0 for Ambari Server add 7195954 AMBARI-24515 Remove dependency on JQuery 1.8.0 for Ambari Server UI add 93818f3 [AMBARI-24513] Using current timestamp as created_time in case there is no value in users table in this column upon upgrading to 2.7 (#2130) add 539d8ee AMBARI-24506 - ADDENDUM - Upgrade: Infra Solr service is not renamed in Upgrade History table (#2139) add 5a2d63e AMBARI-24499 blueprint support for multiple TIMELINE_READER components (benyoka) (#2136) add 7c73d98 Update KEYS file add bff429c [AMBARI-24520] Fix set KDC admin credentials section in enable Kerberos doc add 31ebcd2 AMBARI-23817 : Visualizing the Encrypted zones and Erasure coded zones in HDFS (nitirajrathore) (#2094) add d497004 AMBARI-24521. CLONE - Requests STOMP topic sent updates for host check request. (#2143) add a8e9022 [AMBARI-24522] Cannot connect to MIT KDC admin server when port is specified in kerberos-env/admin_server_host add 500a00b AMBARI-24526. Status of components does not become RED if their deamon goes down immediately after successful start (aonishuk) add 431b399 AMBARI-24517. Cover add standby step 4 controller add 64cf74a Merge pull request #2134 from hiveww/AMBARI-24517-trunk add dda8b50 AMBARI-24524 Unable to validate password complexity for properties rangertagsync_user_password, rangerusersync_user_password add 74a5360 Merge branch 'trunk' into branch-feature-AMBARI-14714 new 2825adf Merge branch 'trunk' into branch-feature-AMBARI-14714 The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: KEYS | 35 ++ ambari-agent/conf/unix/install-helper.sh | 271 ++++++----- ambari-agent/pom.xml | 4 + ambari-agent/src/main/package/deb/control/postrm | 16 +- ambari-agent/src/main/package/deb/control/preinst | 61 ++- ambari-agent/src/main/package/deb/control/prerm | 1 + .../package/rpm/{preremove.sh => postremove.sh} | 9 +- .../src/main/package/rpm/posttrans_agent.sh | 4 +- ambari-agent/src/main/package/rpm/preinstall.sh | 55 ++- ambari-agent/src/main/package/rpm/preremove.sh | 1 - .../ambari_agent/CustomServiceOrchestrator.py | 7 +- .../main/python/ambari_agent/RecoveryManager.py | 14 + .../test/python/ambari_agent/TestActionQueue.py | 29 +- .../src/test/python/ambari_agent/TestAlerts.py | 4 +- .../python/ambari_agent/TestRecoveryManager.py | 16 +- .../resource_management/libraries/script/script.py | 9 + ambari-common/src/test/python/coilmq/scheduler.py | 2 +- ambari-funtest/pom.xml | 21 + .../ambari-infra-manager/docker/docker-compose.yml | 2 +- .../docker/infra-manager-docker-compose.sh | 2 +- ambari-infra/ambari-infra-solr-client/README.md | 8 +- .../src/main/python/migrationHelper.py | 2 +- .../src/main/resources/solrIndexHelper.sh | 8 +- .../docker/infra-solr-docker-compose.sh | 2 +- ambari-infra/pom.xml | 23 +- .../config/zookeeper/LogLevelFilterManagerZK.java | 27 ++ .../zookeeper/LogSearchConfigLogFeederZK.java | 34 +- .../config/zookeeper/LogSearchConfigServerZK.java | 5 +- .../config/zookeeper/LogSearchConfigZK.java | 148 +----- ...hConfigZK.java => LogSearchConfigZKHelper.java} | 187 +++++--- .../pom.xml | 1 + .../logfeeder/common/LogFeederConstants.java | 3 + .../ambari/logfeeder/conf/ApplicationConfig.java | 10 +- .../ambari/logfeeder/conf/LogFeederProps.java | 18 + .../loglevelfilter/LogLevelFilterHandler.java | 23 +- .../main/configsets/audit_logs/conf/solrconfig.xml | 2 +- .../configsets/hadoop_logs/conf/solrconfig.xml | 2 +- .../main/configsets/history/conf/solrconfig.xml | 2 +- .../logsearch/common/ACLPropertiesSplitter.java | 29 +- .../logsearch/conf/LogSearchConfigApiConfig.java | 25 ++ .../ambari/logsearch/conf/SecurityConfig.java | 15 +- .../apache/ambari/logsearch/conf/SolrConfig.java | 7 +- ...rState.java => LogLevelFilterManagerState.java} | 2 +- .../LogLevelManagerFilterConfigurer.java | 123 +++++ .../configurer/SolrLogLevelFilterConfigurer.java | 92 ---- .../logsearch/manager/ShipperConfigManager.java | 12 +- .../LogSearchLogLevelFilterManagerFilter.java | 10 +- ambari-logsearch/ambari-logsearch-web/README.md | 9 +- .../ambari-logsearch-web/src/app/app.module.ts | 23 - .../classes/components/graph/graph.component.ts | 30 +- .../components/graph/time-graph.component.less | 4 +- .../components/graph/time-graph.component.ts | 5 +- .../action-menu/action-menu.component.less | 1 - .../src/app/components/app.component.html | 2 +- .../src/app/components/app.component.less | 1 - .../src/app/components/app.component.ts | 2 +- .../log-message/log-message.component.ts | 50 ++- .../logs-container/logs-container.component.html | 4 +- .../logs-container/logs-container.component.less | 7 + .../logs-container/logs-container.component.ts | 7 +- .../service-logs-table.component.html | 6 +- .../time-histogram/time-histogram.component.ts | 2 +- .../data-loading-indicator.component.html | 2 +- .../data-loading-indicator.component.less | 4 +- .../data-loading-indicator.component.ts | 6 +- .../dropdown-button/dropdown-button.component.html | 7 +- .../dropdown-button/dropdown-button.component.ts | 27 +- .../dropdown-list/dropdown-list.component.html | 9 +- .../dropdown-list/dropdown-list.component.less | 23 +- .../dropdown-list/dropdown-list.component.ts | 61 ++- .../src/app/modules/shared/variables.less | 1 + .../app/services/logs-filtering-utils.service.ts | 4 +- .../ambari-logsearch-web/src/assets/i18n/en.json | 1 + .../ambari-logsearch-web/src/index.html | 3 + ambari-logsearch/docker/Dockerfile | 2 +- ambari-logsearch/docker/docker-compose.yml | 2 +- ambari-logsearch/docker/logsearch-docker.sh | 2 +- ambari-logsearch/docker/solr.yml | 2 +- ambari-logsearch/docker/sso.yml | 2 +- .../test-config/logfeeder/logfeeder.properties | 3 +- .../test-config/logsearch/logsearch.properties | 1 + ambari-logsearch/pom.xml | 23 +- ambari-metrics/ambari-metrics-grafana/pom.xml | 21 + .../ambari-metrics-host-aggregator/pom.xml | 21 + .../conf/unix/amshbase_metrics_whitelist | 6 +- .../conf/unix/metrics_whitelist | 6 +- .../conf/windows/amshbase_metrics_whitelist | 6 +- .../conf/windows/metrics_whitelist | 6 +- .../src/main/resources/metrics_def/AMS-HBASE.dat | 38 +- .../main/resources/metrics_def/HBASE_MASTER.dat | 54 +-- .../core/timeline/TimelineMetricsFilterTest.java | 12 +- .../test/resources/test_data/full_whitelist.dat | 114 ++--- .../test/resources/ui_metrics_def/AMS-HBASE.dat | 2 +- .../src/test/resources/ui_metrics_def/HBASE.dat | 2 +- .../src/test/resources/ui_metrics_def/NAMENODE.dat | 2 +- .../src/test/resources/ui_metrics_def/NIMBUS.dat | 2 +- ambari-server/conf/unix/install-helper.sh | 329 ++++++++------ ambari-server/docs/configuration/index.md | 9 +- .../docs/security/kerberos/enabling_kerberos.md | 2 +- ambari-server/pom.xml | 16 +- .../server/actionmanager/ActionDBAccessorImpl.java | 14 +- .../ambari/server/agent/CommandRepository.java | 1 + .../ambari/server/agent/ExecutionCommand.java | 1 + .../ambari/server/configuration/Configuration.java | 16 + .../controller/AmbariManagementController.java | 3 + .../controller/AmbariManagementControllerImpl.java | 229 ++++++++++ .../ambari/server/controller/AmbariServer.java | 15 +- .../server/controller/KerberosHelperImpl.java | 4 +- .../internal/BlueprintConfigurationProcessor.java | 6 +- .../apache/ambari/server/events/AmbariEvent.java | 5 + ...vent.java => ClusterProvisionStartedEvent.java} | 8 +- .../events/listeners/tasks/TaskStatusListener.java | 46 +- .../ads/DefaultLdapConfigurationService.java | 2 +- .../ambari/server/orm/entities/ClusterEntity.java | 14 + .../server/security/authorization/Users.java | 18 +- .../kerberos/IPAKerberosOperationHandler.java | 4 +- .../kerberos/KDCKerberosOperationHandler.java | 35 +- .../kerberos/MITKerberosOperationHandler.java | 4 +- .../upgrades/FixTimelineReaderAddress.java | 25 +- ...nState.java => BlueprintProvisioningState.java} | 14 +- .../org/apache/ambari/server/state/Cluster.java | 4 + .../ambari/server/state/cluster/ClusterImpl.java | 35 ++ .../ambari/server/topology/TopologyManager.java | 2 + .../ambari/server/upgrade/UpgradeCatalog271.java | 133 +++++- ambari-server/src/main/package/deb/control/postrm | 14 + ambari-server/src/main/package/deb/control/preinst | 190 ++++---- ambari-server/src/main/package/deb/control/prerm | 5 +- ambari-server/src/main/package/rpm/postinstall.sh | 4 +- .../{deb/control/postinst => rpm/postremove.sh} | 14 +- ambari-server/src/main/package/rpm/preinstall.sh | 205 ++++----- ambari-server/src/main/package/rpm/preremove.sh | 5 +- .../python/ambari_server/dbConfiguration_linux.py | 17 +- .../python/ambari_server/serverConfiguration.py | 2 +- .../src/main/python/ambari_server/serverSetup.py | 4 +- .../src/main/python/ambari_server/serverUpgrade.py | 4 +- .../src/main/python/ambari_server/utils.py | 11 +- .../src/main/resources/Ambari-DDL-Derby-CREATE.sql | 1 + .../src/main/resources/Ambari-DDL-MySQL-CREATE.sql | 1 + .../main/resources/Ambari-DDL-Oracle-CREATE.sql | 1 + .../main/resources/Ambari-DDL-Postgres-CREATE.sql | 1 + .../resources/Ambari-DDL-SQLAnywhere-CREATE.sql | 1 + .../main/resources/Ambari-DDL-SQLServer-CREATE.sql | 1 + .../src/main/resources/scripts/Ambaripreupload.py | 7 +- .../ads/detectors/GroupMemberAttrDetectorTest.java | 4 +- .../AmbariLdapAuthenticationProviderBaseTest.java | 58 --- ...apAuthenticationProviderForDNWithSpaceTest.java | 185 -------- ...AuthenticationProviderForDuplicateUserTest.java | 143 ------ .../AmbariLdapAuthenticationProviderTest.java | 309 ++++--------- .../server/security/authorization/TestUsers.java | 79 +++- .../kerberos/IPAKerberosOperationHandlerTest.java | 45 ++ .../kerberos/MITKerberosOperationHandlerTest.java | 46 ++ .../upgrades/FixTimelineReaderAddressTest.java | 4 +- .../topology/ClusterDeployWithStartOnlyTest.java | 6 + ...terInstallWithoutStartOnComponentLevelTest.java | 7 + .../topology/ClusterInstallWithoutStartTest.java | 6 + .../server/topology/TopologyManagerTest.java | 20 +- .../server/upgrade/UpgradeCatalog271Test.java | 101 ++++- .../src/test/python/TestUpgradeSummary.py | 8 +- .../test/resources/hbase_hbasemaster_jmx_2.json | 4 +- ambari-web/api-docs/index.html | 2 +- ambari-web/api-docs/lib/jquery-1.8.0.min.js | 2 - ambari-web/api-docs/lib/jquery-1.8.3.min.js | 2 + ambari-web/app/assets/test/tests.js | 3 + .../app/controllers/global/update_controller.js | 2 +- ambari-web/app/mappers/service_metrics_mapper.js | 4 +- ambari-web/app/messages.js | 2 +- .../common/configs/config_recommendation_parser.js | 47 +- ambari-web/app/mixins/common/serverValidator.js | 7 +- ambari-web/app/routes/installer.js | 3 - ambari-web/app/styles/application.less | 9 +- ambari-web/app/styles/bootstrap_overrides.less | 16 +- ambari-web/app/styles/common.less | 5 + ambari-web/app/styles/stack_versions.less | 494 +++++++++++---------- ambari-web/app/utils/ajax/ajax.js | 2 +- ambari-web/app/utils/config.js | 2 +- .../controllers/global/update_controller_test.js | 2 +- .../hawq/activateStandby/step3_controller_test.js | 173 ++++++++ .../hawq/addStandby/step4_controller_test.js | 108 +++++ .../rangerAdmin/step4_controller_test.js | 128 ++++++ ambari-web/test/mappers/service_mapper_test.js | 8 +- contrib/views/ambari-views-package/pom.xml | 2 +- contrib/views/commons/pom.xml | 6 + contrib/views/files/pom.xml | 1 - .../main/resources/ui/app/config/files-columns.js | 20 +- .../main/resources/ui/app/helpers/shorten-text.js | 4 + .../files/src/main/resources/ui/app/models/file.js | 3 + .../ui/app/templates/components/file-row.hbs | 10 + contrib/views/pig/pom.xml | 21 +- .../org/apache/ambari/view/pig/test/JobTest.java | 26 +- .../ambari/view/pig/test/ScriptTestUnmanaged.java | 3 +- contrib/views/pom.xml | 66 ++- contrib/views/utils/pom.xml | 11 +- .../org/apache/ambari/view/utils/hdfs/HdfsApi.java | 14 +- .../ambari/view/utils/hdfs/DummyFileStatus.java | 76 ++++ .../view/utils/hdfs/DummyNonHdfsFileStatus.java | 16 +- .../apache/ambari/view/utils/hdfs/HdfsApiTest.java | 63 +++ docs/pom.xml | 16 +- 197 files changed, 3626 insertions(+), 2273 deletions(-) copy ambari-agent/src/main/package/rpm/{preremove.sh => postremove.sh} (75%) copy ambari-logsearch/ambari-logsearch-config-zookeeper/src/main/java/org/apache/ambari/logsearch/config/zookeeper/{LogSearchConfigZK.java => LogSearchConfigZKHelper.java} (57%) rename ambari-logsearch/ambari-logsearch-server/src/main/java/org/apache/ambari/logsearch/conf/global/{SolrLogLevelFilterManagerState.java => LogLevelFilterManagerState.java} (96%) create mode 100644 ambari-logsearch/ambari-logsearch-server/src/main/java/org/apache/ambari/logsearch/configurer/LogLevelManagerFilterConfigurer.java delete mode 100644 ambari-logsearch/ambari-logsearch-server/src/main/java/org/apache/ambari/logsearch/configurer/SolrLogLevelFilterConfigurer.java copy ambari-server/src/main/java/org/apache/ambari/server/events/{ClusterProvisionedEvent.java => ClusterProvisionStartedEvent.java} (80%) copy ambari-server/src/main/java/org/apache/ambari/server/state/{HostComponentAdminState.java => BlueprintProvisioningState.java} (81%) copy ambari-server/src/main/package/{deb/control/postinst => rpm/postremove.sh} (78%) delete mode 100644 ambari-server/src/test/java/org/apache/ambari/server/security/authorization/AmbariLdapAuthenticationProviderBaseTest.java delete mode 100644 ambari-server/src/test/java/org/apache/ambari/server/security/authorization/AmbariLdapAuthenticationProviderForDNWithSpaceTest.java delete mode 100644 ambari-server/src/test/java/org/apache/ambari/server/security/authorization/AmbariLdapAuthenticationProviderForDuplicateUserTest.java delete mode 100644 ambari-web/api-docs/lib/jquery-1.8.0.min.js create mode 100644 ambari-web/api-docs/lib/jquery-1.8.3.min.js create mode 100644 ambari-web/test/controllers/main/admin/highAvailability/hawq/activateStandby/step3_controller_test.js create mode 100644 ambari-web/test/controllers/main/admin/highAvailability/hawq/addStandby/step4_controller_test.js create mode 100644 ambari-web/test/controllers/main/admin/highAvailability/rangerAdmin/step4_controller_test.js create mode 100644 contrib/views/utils/src/test/java/org/apache/ambari/view/utils/hdfs/DummyFileStatus.java copy ambari-server/src/main/java/org/apache/ambari/server/hooks/HookContext.java => contrib/views/utils/src/test/java/org/apache/ambari/view/utils/hdfs/DummyNonHdfsFileStatus.java (82%)