Arpit Varshney created GOBBLIN-2058:
---------------------------------------
Summary: Allowing additional hive tables schema to be evolved when
hourly table schema is evolved
Key: GOBBLIN-2058
URL: https://issues.apache.org/jira/browse/GOBBLIN-2058
Project: Apache Gobblin
Issue Type: Wish
Components: hive-registration
Reporter: Arpit Varshney
Assignee: Abhishek Tiwari
Hive table registration takes care of registering new partitions and evolve the
hive table schema if the schema has been updated in the Kafka schema registry.
As a user, these partitions are registered for hourly tables. These hourly
table data are then compacted via a separate run, creating a new daily table.
To get the full data, users should do a union of this hourly and daily table.
During schema evolution, this hourly table schema gets evolved while the daily
table schema is not evolved until the run which can take around a day till the
user won't be able to fetch the data.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
