This is an automated email from the ASF dual-hosted git repository.
madhan pushed a change to branch RANGER-3923
in repository https://gitbox.apache.org/repos/asf/ranger.git
from 01ced14fc RANGER-3923: added support for MariaDB
add 2d9af0015 RANGER-4163: Upgrade spring framework to 5.3.26 and jettison
to 1.5.4
add 932bc3404 RANGER-4152: Create common module for metrics and add
metrics in Admin
add 79e786fe3 RANGER-4176: fix the javax.el dependency issue
add ce7191f3c RANGER-4180: fixed log location for gc-worker.log
add 00d2241a6 RANGER-4181: Docker setup updated to support JDK 8/11/17 to
build Ranger and run Ranger Admin
add b4f087d49 RANGER-4169: Add pull_request_template.md (#240)
add 9c523c204 RANGER-4177: fail policy create/update when it references
non-existing users/groups/roles
add fb63f21cf RANGER-4136: Incorrect processing of tag-deltas by
RangerTagEnricher - Part 2
add 2734df910 RANGER-3739: Add JWT filter in Ranger Admin -- follow-up
patch
add 6d88806d1 RANGER-4088 While editing policy All permissions & and other
resource fields are getting disappered
add 42b8c973e RANGER-4193: ServiceTagsProcessor fails to handle update of
an existing Service-Resource
add a378f285a RANGER-4192: A higher priority Data-masking policy is not
considered when computing Datamask type
add 774d159e2 RANGER-4185: Improve debugging messages when policy-deltas
are enabled
add e8a6125ba RANGER-4130: Improve performance of event processing in
agsync by optimizing number of commits to Kafka broker
add 021ff3758 RANGER-4182: Ranger Admin - Enable isRecursive option to
additional default policies while service creation
add 0056aea4a RANGER-4173: relative path delimiter should not be included
at beginning of key path (#242)
add 7a5afd53a RANGER-4142: added docs update for 2.4.0 release in
ranger.apache.org site
add 506cee394 RANGER-4198: fixed build issue
add 5019931d2 RANGER-4149 : Create common module for HA support
add 225526931 RANGER-4199: fixed incorrect log in RangerPluginClassLoader
add 87c9f3b0d RANGER-4204: RANGER-4205: RANGER-4206: RANGER-4212: Upgrade
woodstox, commons-net, kerby and json-smart libraries versions
add aed940123 RANGER-4197 Encryption Tab's key manager table show blank
data.
add de49d7e16 RANGER-4194 For Hive service def resources not supporting
exclude and recursive are showing this option in service view detail
add 67b49a6be RANGER-4183 Updating service fetch call in Zone Display
component
add db97c44fa RANGER-4047: KMS health metrics
add d64f578c1 RANGER-4214: added dependecies for javax.annotation package
add 2ad0f7aca RANGER-4209: blog: adventures in abac - part-1
add 67db8af60 RANGER-4209: added Apache License header on the blog html
file
add afb8fe95c RANGER-4175: REST API to find security-zone for a given
resource
add 18c53d5d1 RANGER-4101: REST API to find security-zone for a given
resource - #2
new 1713b11cc Merge branch 'master' into RANGER-3923
The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.github/pull_request_template.md | 11 +
.gitignore | 1 +
.../plugin/contextenricher/RangerTagEnricher.java | 64 ++-
.../ranger/plugin/model/RangerPolicyDelta.java | 2 +-
.../ranger/plugin/policyengine/PolicyEngine.java | 14 +-
.../RangerDefaultDataMaskPolicyItemEvaluator.java | 6 -
.../RangerDefaultPolicyEvaluator.java | 4 +-
.../RangerDefaultRowFilterPolicyItemEvaluator.java | 19 +-
.../ranger/plugin/service/RangerBaseService.java | 14 +-
.../ranger/plugin/util/RangerPolicyDeltaUtil.java | 2 +-
.../org/apache/ranger/plugin/util/ServiceTags.java | 3 +
credentialbuilder/pom.xml | 10 +
dev-support/ranger-docker/.env | 13 +
dev-support/ranger-docker/Dockerfile.ranger | 5 +
dev-support/ranger-docker/Dockerfile.ranger-base | 6 +-
dev-support/ranger-docker/Dockerfile.ranger-build | 5 +
.../ranger-docker/docker-compose.ranger-base.yml | 1 +
.../ranger-docker/docker-compose.ranger-build.yml | 2 +
.../ranger-docker/docker-compose.ranger.yml | 1 +
distro/src/main/assembly/kms.xml | 7 +
docs/pom.xml | 217 +++++-----
.../fig01-policy_ussales_rib.jpg | Bin 0 -> 285015 bytes
.../fig02-policy_globalsales_highly_sensitive.jpg | Bin 0 -> 271338 bytes
.../fig03-policy_globalsales_sensitive.jpg | Bin 0 -> 260322 bytes
.../fig04-policy_globalsales_non_sensitive.jpg | Bin 0 -> 278120 bytes
...-policy_globalsales_row_filter_sales_region.jpg | Bin 0 -> 294414 bytes
.../fig06-roles_capturing_sl_sr.jpg | Bin 0 -> 232289 bytes
.../fig07-policy_ussales_tag_attribute_based.jpg | Bin 0 -> 273108 bytes
.../fig08-policy_tag_based_sl.jpg | Bin 0 -> 278600 bytes
...ig09-policy_globalsales_row_filter_sr_roles.jpg | Bin 0 -> 277497 bytes
.../fig10-roles_capturing_sl_sr_sp.jpg | Bin 0 -> 261623 bytes
...policy_globalsalespartners_row_filter_sr_sp.jpg | Bin 0 -> 461403 bytes
.../table_globalsales.jpg | Bin 0 -> 196162 bytes
.../table_globalsalespartners.jpg | Bin 0 -> 213507 bytes
.../adventures_in_abac_1.files/table_ussales.jpg | Bin 0 -> 125498 bytes
.../site/resources/blogs/adventures_in_abac_1.html | 437 +++++++++++++++++++++
docs/src/site/site.xml | 2 +
docs/src/site/xdoc/blogs.xml | 34 ++
docs/src/site/xdoc/download.xml | 30 +-
docs/src/site/xdoc/quick_start_guide.xml | 14 +-
embeddedwebserver/scripts/ranger-admin-services.sh | 6 +-
hbase-agent/pom.xml | 13 +
hive-agent/pom.xml | 15 +
.../main/java/org/apache/ranger/RangerClient.java | 6 +
.../python/apache_ranger/client/ranger_client.py | 35 +-
intg/src/main/python/apache_ranger/utils.py | 13 +-
.../java/org/apache/ranger/TestRangerClient.java | 29 ++
kms/pom.xml | 5 +
.../apache/hadoop/crypto/key/kms/server/KMS.java | 76 +++-
.../key/kms/server/KMSAuthenticationFilter.java | 3 +
.../hadoop/crypto/key/kms/server/KMSWebApp.java | 29 +-
.../hadoop/crypto/key/kms/server/MetricREST.java | 81 ++++
.../ranger/kms/metrics/KMSMetricWrapper.java | 115 ++++++
.../org/apache/ranger/kms/metrics/KMSMetrics.java | 100 +++++
.../kms/metrics/collector/KMSMetricsCollector.java | 95 +++++
.../ranger/kms/metrics/source/KMSMetricSource.java | 112 ++++++
kms/src/main/resources/hadoop-metrics2.properties | 54 +++
.../ranger/kms/metrics/TestKMSMetricsWrapper.java | 89 +++++
kms/src/test/resources/hadoop-metrics2.properties | 54 +++
pom.xml | 28 +-
ranger-common-ha/pom.xml | 124 ++++++
.../org/apache/ranger/RangerHAInitializer.java | 62 +++
.../ranger/ha/ActiveInstanceElectorService.java | 187 +++++++++
.../org/apache/ranger/ha/ActiveInstanceState.java | 124 ++++++
.../apache/ranger/ha/ActiveStateChangeHandler.java | 53 +++
.../java/org/apache/ranger/ha/CuratorFactory.java | 211 ++++++++++
.../java/org/apache/ranger/ha/HAConfiguration.java | 269 +++++++++++++
.../ranger/ha/RangerServiceServerIdSelector.java | 91 +++++
.../java/org/apache/ranger/ha/ServiceState.java | 113 ++++++
.../ranger/ha/ZookeeperSecurityProperties.java | 80 ++++
.../org/apache/ranger/ha/annotation/HAService.java | 22 +-
.../apache/ranger/ha/service/HARangerService.java | 19 +-
.../apache/ranger/ha/service/ServiceManager.java | 71 ++++
.../service/TestRangerServiceServerIdSelector.java | 54 +++
ranger-common-ha/src/test/resources/log4j.xml | 70 ++++
.../src/test/resources/ranger-tagsync-site.xml | 199 ++++++++++
ranger-hbase-plugin-shim/pom.xml | 9 +
ranger-hive-plugin-shim/pom.xml | 21 +
{docs => ranger-metrics}/.gitignore | 0
ranger-metrics/pom.xml | 55 +++
.../apache/ranger/metrics/RangerMetricsInfo.java | 28 +-
.../ranger/metrics/RangerMetricsSystemWrapper.java | 99 +++++
.../ranger/metrics/sink/RangerMetricsJsonSink.java | 85 ++++
.../metrics/sink/RangerMetricsPrometheusSink.java | 114 ++++++
.../metrics/source/RangerMetricsJvmSource.java | 125 ++++++
.../ranger/metrics/source/RangerMetricsSource.java | 30 +-
.../metrics/wrapper/RangerMetricsSinkWrapper.java | 32 +-
.../wrapper/RangerMetricsSourceWrapper.java | 53 +++
.../classloader/RangerPluginClassLoader.java | 2 +-
security-admin/pom.xml | 5 +
.../org/apache/ranger/biz/PolicyRefUpdater.java | 14 +-
.../java/org/apache/ranger/biz/RangerBizUtil.java | 7 +
.../org/apache/ranger/biz/RangerPolicyAdmin.java | 3 +
.../apache/ranger/biz/RangerPolicyAdminImpl.java | 25 ++
.../java/org/apache/ranger/biz/ServiceDBStore.java | 65 ++-
.../java/org/apache/ranger/biz/TagDBStore.java | 3 +
.../main/java/org/apache/ranger/biz/XUserMgr.java | 4 +
.../ranger/common/RangerServicePoliciesCache.java | 2 +-
.../RangerTransactionSynchronizationAdapter.java | 15 +-
.../java/org/apache/ranger/db/XXPortalUserDao.java | 19 +
.../java/org/apache/ranger/db/XXServiceDao.java | 1 -
.../java/org/apache/ranger/db/XXServiceDefDao.java | 71 ++++
.../main/java/org/apache/ranger/db/XXUserDao.java | 1 -
.../ranger/metrics/RangerAdminMetricsWrapper.java | 109 +++++
.../ranger/metrics/RangerMetricsFetcher.java | 124 ++++++
.../source/RangerAdminMetricsSourceBase.java | 72 ++++
.../RangerAdminMetricsSourceContextEnricher.java} | 29 +-
.../RangerAdminMetricsSourceDenyConditions.java} | 29 +-
.../RangerAdminMetricsSourcePolicyMasking.java} | 30 +-
...gerAdminMetricsSourcePolicyResourceAccess.java} | 31 +-
...angerAdminMetricsSourcePolicyRowFiltering.java} | 30 +-
.../source/RangerAdminMetricsSourceService.java} | 29 +-
.../source/RangerAdminMetricsSourceUserGroup.java} | 30 +-
.../java/org/apache/ranger/rest/MetricsREST.java | 46 +++
.../java/org/apache/ranger/rest/PublicAPIsv2.java | 9 +
.../org/apache/ranger/rest/SecurityZoneREST.java | 33 ++
.../java/org/apache/ranger/rest/ServiceREST.java | 2 +-
.../apache/ranger/rest/ServiceTagsProcessor.java | 4 +-
.../security/context/RangerAdminOpContext.java | 8 +
.../RangerSecurityContextFormationFilter.java | 20 +
.../org/apache/ranger/service/XGroupService.java | 4 +
.../main/resources/META-INF/jpa_named_queries.xml | 24 +-
.../conf.dist/security-applicationContext.xml | 7 +-
.../src/main/resources/hadoop-metrics2.properties | 54 +++
.../webapp/react-webapp/src/utils/XAMessages.js | 13 +-
.../AuditEvent/AdminLogs/PolicyViewDetails.jsx | 29 +-
.../react-webapp/src/views/CustomBreadcrumb.jsx | 4 +-
.../src/views/Encryption/KeyCreate.jsx | 35 +-
.../src/views/Encryption/KeyManager.jsx | 22 +-
.../main/webapp/react-webapp/src/views/Header.jsx | 50 ++-
.../main/webapp/react-webapp/src/views/Layout.jsx | 2 +-
.../views/PolicyListing/AddUpdatePolicyForm.jsx | 65 ++-
.../views/PolicyListing/PolicyConditionsComp.jsx | 2 -
.../src/views/PolicyListing/PolicyListing.jsx | 72 ++--
.../PolicyListing/PolicyValidityPeriodComp.jsx | 1 -
.../src/views/Resources/ResourceComp.jsx | 49 ++-
.../src/views/SecurityZone/SecurityZoneForm.jsx | 37 +-
.../src/views/SecurityZone/ZoneDisplay.jsx | 35 +-
.../src/views/SecurityZone/ZoneListing.jsx | 27 +-
.../views/ServiceManager/ServiceAuditFilter.jsx | 89 ++---
.../src/views/ServiceManager/ServiceDefinition.jsx | 9 +-
.../views/ServiceManager/ServiceDefinitions.jsx | 35 +-
.../src/views/ServiceManager/ServiceForm.jsx | 125 +++---
.../groups_details/GroupForm.jsx | 2 +-
.../UserGroupRoleListing/role_details/RoleForm.jsx | 6 +-
.../users_details/UserFormComp.jsx | 2 +-
.../webapp/react-webapp/src/views/UserProfile.jsx | 3 +-
.../source/atlas/AtlasOzoneResourceMapper.java | 2 +-
.../tagsync/source/atlas/AtlasTagSource.java | 68 ++--
.../tagsync/process/TestOzoneResourceMapper.java | 4 +-
150 files changed, 5291 insertions(+), 740 deletions(-)
create mode 100644 .github/pull_request_template.md
create mode 100644
docs/src/site/resources/blogs/adventures_in_abac_1.files/fig01-policy_ussales_rib.jpg
create mode 100644
docs/src/site/resources/blogs/adventures_in_abac_1.files/fig02-policy_globalsales_highly_sensitive.jpg
create mode 100644
docs/src/site/resources/blogs/adventures_in_abac_1.files/fig03-policy_globalsales_sensitive.jpg
create mode 100644
docs/src/site/resources/blogs/adventures_in_abac_1.files/fig04-policy_globalsales_non_sensitive.jpg
create mode 100644
docs/src/site/resources/blogs/adventures_in_abac_1.files/fig05-policy_globalsales_row_filter_sales_region.jpg
create mode 100644
docs/src/site/resources/blogs/adventures_in_abac_1.files/fig06-roles_capturing_sl_sr.jpg
create mode 100644
docs/src/site/resources/blogs/adventures_in_abac_1.files/fig07-policy_ussales_tag_attribute_based.jpg
create mode 100644
docs/src/site/resources/blogs/adventures_in_abac_1.files/fig08-policy_tag_based_sl.jpg
create mode 100644
docs/src/site/resources/blogs/adventures_in_abac_1.files/fig09-policy_globalsales_row_filter_sr_roles.jpg
create mode 100644
docs/src/site/resources/blogs/adventures_in_abac_1.files/fig10-roles_capturing_sl_sr_sp.jpg
create mode 100644
docs/src/site/resources/blogs/adventures_in_abac_1.files/fig11-policy_globalsalespartners_row_filter_sr_sp.jpg
create mode 100644
docs/src/site/resources/blogs/adventures_in_abac_1.files/table_globalsales.jpg
create mode 100644
docs/src/site/resources/blogs/adventures_in_abac_1.files/table_globalsalespartners.jpg
create mode 100644
docs/src/site/resources/blogs/adventures_in_abac_1.files/table_ussales.jpg
create mode 100644 docs/src/site/resources/blogs/adventures_in_abac_1.html
create mode 100644 docs/src/site/xdoc/blogs.xml
create mode 100644
kms/src/main/java/org/apache/hadoop/crypto/key/kms/server/MetricREST.java
create mode 100644
kms/src/main/java/org/apache/ranger/kms/metrics/KMSMetricWrapper.java
create mode 100644
kms/src/main/java/org/apache/ranger/kms/metrics/KMSMetrics.java
create mode 100644
kms/src/main/java/org/apache/ranger/kms/metrics/collector/KMSMetricsCollector.java
create mode 100644
kms/src/main/java/org/apache/ranger/kms/metrics/source/KMSMetricSource.java
create mode 100644 kms/src/main/resources/hadoop-metrics2.properties
create mode 100644
kms/src/test/java/org/apache/ranger/kms/metrics/TestKMSMetricsWrapper.java
create mode 100644 kms/src/test/resources/hadoop-metrics2.properties
create mode 100644 ranger-common-ha/pom.xml
create mode 100644
ranger-common-ha/src/main/java/org/apache/ranger/RangerHAInitializer.java
create mode 100644
ranger-common-ha/src/main/java/org/apache/ranger/ha/ActiveInstanceElectorService.java
create mode 100644
ranger-common-ha/src/main/java/org/apache/ranger/ha/ActiveInstanceState.java
create mode 100644
ranger-common-ha/src/main/java/org/apache/ranger/ha/ActiveStateChangeHandler.java
create mode 100644
ranger-common-ha/src/main/java/org/apache/ranger/ha/CuratorFactory.java
create mode 100644
ranger-common-ha/src/main/java/org/apache/ranger/ha/HAConfiguration.java
create mode 100644
ranger-common-ha/src/main/java/org/apache/ranger/ha/RangerServiceServerIdSelector.java
create mode 100644
ranger-common-ha/src/main/java/org/apache/ranger/ha/ServiceState.java
create mode 100644
ranger-common-ha/src/main/java/org/apache/ranger/ha/ZookeeperSecurityProperties.java
copy
security-admin/src/main/java/org/apache/ranger/security/context/RangerAdminOpContext.java
=>
ranger-common-ha/src/main/java/org/apache/ranger/ha/annotation/HAService.java
(67%)
copy
security-admin/src/main/java/org/apache/ranger/security/context/RangerAdminOpContext.java
=>
ranger-common-ha/src/main/java/org/apache/ranger/ha/service/HARangerService.java
(67%)
create mode 100644
ranger-common-ha/src/main/java/org/apache/ranger/ha/service/ServiceManager.java
create mode 100644
ranger-common-ha/src/test/java/org/apache/ranger/ha/service/TestRangerServiceServerIdSelector.java
create mode 100644 ranger-common-ha/src/test/resources/log4j.xml
create mode 100644 ranger-common-ha/src/test/resources/ranger-tagsync-site.xml
copy {docs => ranger-metrics}/.gitignore (100%)
create mode 100644 ranger-metrics/pom.xml
copy
security-admin/src/main/java/org/apache/ranger/security/context/RangerAdminOpContext.java
=>
ranger-metrics/src/main/java/org/apache/ranger/metrics/RangerMetricsInfo.java
(61%)
create mode 100644
ranger-metrics/src/main/java/org/apache/ranger/metrics/RangerMetricsSystemWrapper.java
create mode 100644
ranger-metrics/src/main/java/org/apache/ranger/metrics/sink/RangerMetricsJsonSink.java
create mode 100644
ranger-metrics/src/main/java/org/apache/ranger/metrics/sink/RangerMetricsPrometheusSink.java
create mode 100644
ranger-metrics/src/main/java/org/apache/ranger/metrics/source/RangerMetricsJvmSource.java
copy
security-admin/src/main/java/org/apache/ranger/security/context/RangerAdminOpContext.java
=>
ranger-metrics/src/main/java/org/apache/ranger/metrics/source/RangerMetricsSource.java
(52%)
copy
security-admin/src/main/java/org/apache/ranger/security/context/RangerAdminOpContext.java
=>
ranger-metrics/src/main/java/org/apache/ranger/metrics/wrapper/RangerMetricsSinkWrapper.java
(57%)
create mode 100644
ranger-metrics/src/main/java/org/apache/ranger/metrics/wrapper/RangerMetricsSourceWrapper.java
create mode 100644
security-admin/src/main/java/org/apache/ranger/metrics/RangerAdminMetricsWrapper.java
create mode 100644
security-admin/src/main/java/org/apache/ranger/metrics/RangerMetricsFetcher.java
create mode 100644
security-admin/src/main/java/org/apache/ranger/metrics/source/RangerAdminMetricsSourceBase.java
copy
security-admin/src/main/java/org/apache/ranger/{security/context/RangerAdminOpContext.java
=> metrics/source/RangerAdminMetricsSourceContextEnricher.java} (52%)
copy
security-admin/src/main/java/org/apache/ranger/{security/context/RangerAdminOpContext.java
=> metrics/source/RangerAdminMetricsSourceDenyConditions.java} (52%)
copy
security-admin/src/main/java/org/apache/ranger/{security/context/RangerAdminOpContext.java
=> metrics/source/RangerAdminMetricsSourcePolicyMasking.java} (50%)
copy
security-admin/src/main/java/org/apache/ranger/{security/context/RangerAdminOpContext.java
=> metrics/source/RangerAdminMetricsSourcePolicyResourceAccess.java} (50%)
copy
security-admin/src/main/java/org/apache/ranger/{security/context/RangerAdminOpContext.java
=> metrics/source/RangerAdminMetricsSourcePolicyRowFiltering.java} (50%)
copy
security-admin/src/main/java/org/apache/ranger/{security/context/RangerAdminOpContext.java
=> metrics/source/RangerAdminMetricsSourceService.java} (54%)
copy
security-admin/src/main/java/org/apache/ranger/{security/context/RangerAdminOpContext.java
=> metrics/source/RangerAdminMetricsSourceUserGroup.java} (51%)
create mode 100644 security-admin/src/main/resources/hadoop-metrics2.properties
