Umesh Padashetty created ATLAS-4747:
---------------------------------------
Summary: ddlQueries and ALTERTABLE_* lineage missing for spark
tables created via spark3-shell
Key: ATLAS-4747
URL: https://issues.apache.org/jira/browse/ATLAS-4747
Project: Atlas
Issue Type: Bug
Components: atlas-core
Affects Versions: 2.3.0
Reporter: Umesh Padashetty
Attachments: Screenshot 2023-04-26 at 1.00.11 AM.png, Screenshot
2023-04-26 at 1.00.17 AM.png, Screenshot 2023-04-26 at 1.00.45 AM.png,
Screenshot 2023-04-26 at 1.00.50 AM.png
Ran the below queries via spark3-shell
{code:java}
spark.sql("create table testing_iceberg_spark_alters_1(name string, address
string)");
spark.sql("alter table testing_iceberg_spark_alters_1 add column(address2
string)");{code}
ddlQueries and outputFromProcesses (lineage) is missing for the alter queries
!Screenshot 2023-04-26 at 1.00.11 AM.png!
!Screenshot 2023-04-26 at 1.00.17 AM.png!
Running similar queries via beeline, it generates ddlQueries and
outputFromProcesses (lineage) for the alter queries
!Screenshot 2023-04-26 at 1.00.45 AM.png!
!Screenshot 2023-04-26 at 1.00.50 AM.png!
--
This message was sent by Atlassian Jira
(v8.20.10#820010)