-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/45784/
-----------------------------------------------------------

(Updated April 5, 2016, 11:54 p.m.)


Review request for atlas.


Bugs: ATLAS-527
    https://issues.apache.org/jira/browse/ATLAS-527


Repository: atlas


Description
-------

Added support to track lineage between HDFS Paths and hive tables  in 

a. LOAD( at table, partition level) - input is a HDFS path and output is table( 
even though we dont create partition entities, we are still tracking the 
lineage at table level for partitions. This could be an issue if there are 
large number of partition queries which is not being addressed in this jira - 
https://issues.apache.org/jira/browse/ATLAS-619) . refer 
https://cwiki.apache.org/confluence/display/Hive/LanguageManual+DML
b. IMPORT, EXPORT to and from hdfs paths - Refer 
https://cwiki.apache.org/confluence/display/Hive/LanguageManual+DML
c. CREATE EXTERNAL TABLE - input is hdfs path and o/p is table
d. ALTER TABLE LOCATION for an external table - input is the new hdfs path and 
o/p is the table.


Diffs
-----

  
addons/hdfs-model/src/main/java/org/apache/atlas/fs/model/FSDataModelGenerator.java
 555d565 
  addons/hdfs-model/src/main/scala/org/apache/atlas/fs/model/FSDataModel.scala 
c964f73 
  addons/hive-bridge/pom.xml e125f18 
  
addons/hive-bridge/src/main/java/org/apache/atlas/hive/bridge/HiveMetaStoreBridge.java
 3a802d7 
  addons/hive-bridge/src/main/java/org/apache/atlas/hive/hook/HiveHook.java 
68e32ff 
  addons/hive-bridge/src/test/java/org/apache/atlas/hive/hook/HiveHookIT.java 
e17afb8 
  
addons/storm-bridge/src/main/java/org/apache/atlas/storm/hook/StormAtlasHook.java
 5665856 
  
repository/src/main/java/org/apache/atlas/services/DefaultMetadataService.java 
0a04c5f 
  
repository/src/main/java/org/apache/atlas/services/ReservedTypesRegistrar.java 
430bb6b 

Diff: https://reviews.apache.org/r/45784/diff/


Testing (updated)
-------

Added tests in HiveHookIT


Thanks,

Suma Shivaprasad

Reply via email to