Columns have support for key/value pairs in the metadata: https://github.com/apache/parquet-format/blob/master/src/main/thrift/parquet.thrift#L489
Let me know if that works for you. On Thu, Jun 30, 2016 at 10:44 AM, Mohammad Islam <[email protected] > wrote: > Hi All, > What is the best way of tagging any field schema with metadata? Does > Parquet support it? I think Avro has "doc" attribute. Also Hive schema has > "comments". > I need to tag each field whether it is PII or not. I think someone may > want to add description of a field as well. > Regards,Mohammad > >
