----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/70462/#review214870 -----------------------------------------------------------
Ship it! Ship It! - Sarath Subramanian On April 24, 2019, 12:37 p.m., Aadarsh Jajodia wrote: > > ----------------------------------------------------------- > This is an automatically generated e-mail. To reply, visit: > https://reviews.apache.org/r/70462/ > ----------------------------------------------------------- > > (Updated April 24, 2019, 12:37 p.m.) > > > Review request for atlas, Ashutosh Mestry, Sridhar K, Le Ma, Madhan > Neethiraj, and Sarath Subramanian. > > > Bugs: ATLAS-3133 > https://issues.apache.org/jira/browse/ATLAS-3133 > > > Repository: atlas > > > Description > ------- > > Adding support for Process Executions in Atlas > > > Diffs > ----- > > > addons/hive-bridge/src/main/java/org/apache/atlas/hive/hook/AtlasHiveHookContext.java > 52da7106282bc9ab0c8a99bccd47d7227867ec70 > addons/hive-bridge/src/main/java/org/apache/atlas/hive/hook/HiveHook.java > 6109297e30895f9329b82295e520f577aaa6954b > > addons/hive-bridge/src/main/java/org/apache/atlas/hive/hook/events/BaseHiveEvent.java > 4127c611a271bf3cbfc747cf1ac23ecd120d8a50 > > addons/hive-bridge/src/main/java/org/apache/atlas/hive/hook/events/CreateHiveProcess.java > 019deb73c9c875033c1bc1117fb3188fd9749af2 > > addons/hive-bridge/src/main/java/org/apache/atlas/hive/hook/events/CreateTable.java > b6ec5c330bed988e9f66298a68881f5fadb079f8 > > addons/hive-bridge/src/main/java/org/apache/atlas/hive/model/HiveDataTypes.java > 94010d0cb1a7a5c48b71f6d77c5e1a8f5cfcf013 > addons/hive-bridge/src/test/java/org/apache/atlas/hive/HiveITBase.java > c8c53c473db02bdb523b91f71d3c3d10ceb57c5a > addons/hive-bridge/src/test/java/org/apache/atlas/hive/hook/HiveHookIT.java > 677043a01bbebf0fe998feae49e6af6915685fad > addons/models/0000-Area0/0010-base_model.json > 8b41ee89f3a7288bb4cdad3df6887242b40b68d2 > addons/models/1000-Hadoop/1030-hive_model.json > e96443382a587411d1207d6e1157ea65350cbdba > webapp/src/main/java/org/apache/atlas/examples/QuickStartV2.java > 6fcea9ed43f7e3d93742c7de4bc4db4386ecdb2d > > > Diff: https://reviews.apache.org/r/70462/diff/9/ > > > Testing > ------- > > We want to add support for Process Executions in Atlas. With the help of > process executions attributes specific to each execution(like startTime, > endTime, queryText) will be captured in the execution object. With the > current model of Atlas this is lost since each execution overrides the > previous one. To solve this problem. We are creating 2 new entity definitions > and one relations definition. We create an entity definition called a process > execution and another one called hive process execution. The hive process > execution has all the attributes which are specific to each execution. We > also create a relationship defintion between a hive process and a hive > process execution as a many to one relation. The lineage does not get > affected in this since the inputs and outputs are still attached to the hive > process. Hive Process can now be thought of as a grouping of multiple > executions. There is no lineage shown for a hive process execution. The > criteria for grouping is based on the qualif iedName of a Hive Process. As long as the qualified Name of a hive process remains the same, each execution gets mapped to the same hive process. > > > Thanks, > > Aadarsh Jajodia > >
