Mandar Ambawane created ATLAS-5157:
--------------------------------------

             Summary: Add functionality to process Lineage relationship 
entities which got generated for the same table in the parellel mode.
                 Key: ATLAS-5157
                 URL: https://issues.apache.org/jira/browse/ATLAS-5157
             Project: Atlas
          Issue Type: Improvement
          Components:  atlas-core
            Reporter: Mandar Ambawane
            Assignee: Mandar Ambawane


For following query,
{code:java}
insert into table_tgt select * from table_src;{code}
When above query gets executed, the number of hive_column_lineage entities get 
created is equal to the number of columns present in the table.

Atlas process these entities in linear way which may cause performance issue 
when the number of columns in the table is very large.

Attaching the "create table" command for source and target tables. 
"insert into" command for source table.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to