MK created ATLAS-4724:
-------------------------
Summary: column lineage in where clause and join condition are not
collected
Key: ATLAS-4724
URL: https://issues.apache.org/jira/browse/ATLAS-4724
Project: Atlas
Issue Type: Improvement
Components: hive-integration
Affects Versions: 2.2.0
Environment: hive 3.1.2 / atlas 2.2.0
Reporter: MK
we are using atlas to collect hivesql column lineage. when there's data issue
in a column, we will rerun etl script follow this lineage .
now we found columns in where clause and join condition are not collected in
lineage.
sample :
insert into tableA( a, b, c ) select x, y , z from tableB where d = '123';
if there is data issue in tableB.d , tableA will be impacted and we will
rerun tableA ， but the lineage didn't show relation between column d and tableA
.
the same as columns in join condition .
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
