-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/70462/
-----------------------------------------------------------
(Updated April 23, 2019, 9:37 p.m.)
Review request for atlas, Ashutosh Mestry, Sridhar K, Le Ma, Madhan Neethiraj,
and Sarath Subramanian.
Changes
-------
Tested these changes on a VM and it works now.
Bugs: ATLAS-3133
https://issues.apache.org/jira/browse/ATLAS-3133
Repository: atlas
Description
-------
Adding support for Process Executions in Atlas
Diffs (updated)
-----
addons/hive-bridge/src/main/java/org/apache/atlas/hive/hook/AtlasHiveHookContext.java
52da7106282bc9ab0c8a99bccd47d7227867ec70
addons/hive-bridge/src/main/java/org/apache/atlas/hive/hook/HiveHook.java
6109297e30895f9329b82295e520f577aaa6954b
addons/hive-bridge/src/main/java/org/apache/atlas/hive/hook/events/BaseHiveEvent.java
4127c611a271bf3cbfc747cf1ac23ecd120d8a50
addons/hive-bridge/src/main/java/org/apache/atlas/hive/hook/events/CreateHiveProcess.java
019deb73c9c875033c1bc1117fb3188fd9749af2
addons/hive-bridge/src/main/java/org/apache/atlas/hive/hook/events/CreateTable.java
b6ec5c330bed988e9f66298a68881f5fadb079f8
addons/hive-bridge/src/main/java/org/apache/atlas/hive/model/HiveDataTypes.java
94010d0cb1a7a5c48b71f6d77c5e1a8f5cfcf013
addons/hive-bridge/src/test/java/org/apache/atlas/hive/HiveITBase.java
c8c53c473db02bdb523b91f71d3c3d10ceb57c5a
addons/hive-bridge/src/test/java/org/apache/atlas/hive/hook/HiveHookIT.java
677043a01bbebf0fe998feae49e6af6915685fad
addons/models/0000-Area0/0010-base_model.json
8b41ee89f3a7288bb4cdad3df6887242b40b68d2
addons/models/1000-Hadoop/1030-hive_model.json
e96443382a587411d1207d6e1157ea65350cbdba
webapp/src/main/java/org/apache/atlas/examples/QuickStartV2.java
6fcea9ed43f7e3d93742c7de4bc4db4386ecdb2d
Diff: https://reviews.apache.org/r/70462/diff/8/
Changes: https://reviews.apache.org/r/70462/diff/7-8/
Testing
-------
We want to add support for Process Executions in Atlas. With the help of
process executions attributes specific to each execution(like startTime,
endTime, queryText) will be captured in the execution object. With the current
model of Atlas this is lost since each execution overrides the previous one. To
solve this problem. We are creating 2 new entity definitions and one relations
definition. We create an entity definition called a process execution and
another one called hive process execution. The hive process execution has all
the attributes which are specific to each execution. We also create a
relationship defintion between a hive process and a hive process execution as a
many to one relation. The lineage does not get affected in this since the
inputs and outputs are still attached to the hive process. Hive Process can now
be thought of as a grouping of multiple executions. There is no lineage shown
for a hive process execution. The criteria for grouping is based on the qualifie
dName of a Hive Process. As long as the qualified Name of a hive process
remains the same, each execution gets mapped to the same hive process.
Thanks,
Aadarsh Jajodia
