Zihan Li created GOBBLIN-1515:
---------------------------------

             Summary: Fix hive schema not updated issue in streaming and GMIP
                 Key: GOBBLIN-1515
                 URL: https://issues.apache.org/jira/browse/GOBBLIN-1515
             Project: Apache Gobblin
          Issue Type: Bug
            Reporter: Zihan Li


There are two issues need to be fixed:

1. Fix the issue that Hive schema is using avro schema even for orc table: Now, 
since we directly use avro schema literal to calculate the column and column 
types for orc table, it sometimes is not correct, so we need to change avro 
schema to orc schema and compute column types accordingly

2. Change the behavior that we only evolve avro schema literal but not the hive 
schema when schema evolution happen: In Streaming, when we do hive 
registration, we compare the current schema with schema registry and when there 
is schema evolution, we only update avro schema literal and leave hive schema 
to be lag. 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to