Original write of File:
Schema: custom_metadata: {"value":1}
Message
Message
Footer
Schema: custom_metadata: {"value":1}
Process appends messages (new data in bold):
Schema: custom_metadata: {"value":1}
Message
Message
*Message*
*Footer*
* Schema: custom_metadata: {"value":2}*
Re-writing the entire file may not be practical due to the size, so after
this operation custom_metadata at the Schema level is out of sync... the
two Schema copies are no longer the same.
In order to address this I would like to propose adding custom_metadata to
Footer as well. Any objections?
-John
