-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/69006/
-----------------------------------------------------------
Review request for atlas, Apoorv Naik, Ashutosh Mestry, keval bhatt, Nixon
Rodrigues, and Sarath Subramanian.
Bugs: ATLAS-2891
https://issues.apache.org/jira/browse/ATLAS-2891
Repository: atlas
Description
-------
Updated the workaround to skip incorrect column-lineage (due to HIVE-20633) to
use a threshold on average # of inputs across all column-lineage. If average is
greater than 15, column-lineages will be skipped. This workaroud is necessary
due to HIVE-20633, which ended up generating incorrect column-lineage with
large number of inputs. The workaround can be turned off via configuration once
Hive issue is addressed.
Diffs
-----
addons/hive-bridge/src/main/java/org/apache/atlas/hive/hook/HiveHook.java
4bb3b6506
addons/hive-bridge/src/main/java/org/apache/atlas/hive/hook/events/CreateHiveProcess.java
7dd5f1d0e
webapp/src/main/java/org/apache/atlas/notification/NotificationHookConsumer.java
76fbef0ac
Diff: https://reviews.apache.org/r/69006/diff/1/
Testing
-------
Precommit test run:
https://builds.apache.org/view/A/view/Atlas/job/PreCommit-ATLAS-Build-Test/756/
Thanks,
Madhan Neethiraj
