[
https://issues.apache.org/jira/browse/PARQUET-235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14483738#comment-14483738
]
Ryan Blue commented on PARQUET-235:
-----------------------------------
I'm currently testing a fix where parquet-common defines
parquet.common.internal.ColumnPath, and both ColumnPath and Canonicalizer are
added back to parquet.hadoop.metadata for compatibility. I agree that we want
to limit what we're going to expose in this package after the next breaking API
change, but for now I think we should go with the compatibility guarantee.
> Fix compatibility of parquet.metadata with 1.5.0
> ------------------------------------------------
>
> Key: PARQUET-235
> URL: https://issues.apache.org/jira/browse/PARQUET-235
> Project: Parquet
> Issue Type: Bug
> Components: parquet-mr
> Affects Versions: 1.6.0
> Reporter: Ryan Blue
> Priority: Blocker
> Fix For: 1.6.0
>
>
> There are quite a few incompatible changes to {{parquet.metadata}} (see
> below). It seems like it is part of the API because the metadata is exposed.
> Fixing it will be annoying because {{ColumnPath}} was removed entirely.
> If this is public, then we need to fix compatibility.
> {code:title=parquet.metadata changes}
> Class parquet.hadoop.metadata.Canonicalizer
> Removed Class , access public super synchronized
> Class parquet.hadoop.metadata.ColumnChunkMetaData
> Added Method getPath, desc ()Lparquet/common/schema/ColumnPath;, access
> public
> Removed Method get, sig
> (Lparquet/hadoop/metadata/ColumnPath;Lparquet/schema/PrimitiveType$PrimitiveTypeName;Lparquet/hadoop/metadata/CompressionCodecName;Ljava/util/Set<Lparquet/column/Encoding;>;Lparquet/column/statistics/Statistics;JJJJJ)Lparquet/hadoop/metadata/ColumnChunkMetaData;,
> desc
> (Lparquet/hadoop/metadata/ColumnPath;Lparquet/schema/PrimitiveType$PrimitiveTypeName;Lparquet/hadoop/metadata/CompressionCodecName;Ljava/util/Set;Lparquet/column/statistics/Statistics;JJJJJ)Lparquet/hadoop/metadata/ColumnChunkMetaData;,
> access public static
> Added Method get, sig
> (Lparquet/common/schema/ColumnPath;Lparquet/schema/PrimitiveType$PrimitiveTypeName;Lparquet/hadoop/metadata/CompressionCodecName;Ljava/util/Set<Lparquet/column/Encoding;>;JJJJJ)Lparquet/hadoop/metadata/ColumnChunkMetaData;,
> desc
> (Lparquet/common/schema/ColumnPath;Lparquet/schema/PrimitiveType$PrimitiveTypeName;Lparquet/hadoop/metadata/CompressionCodecName;Ljava/util/Set;JJJJJ)Lparquet/hadoop/metadata/ColumnChunkMetaData;,
> access public static
> Added Method get, sig
> (Lparquet/common/schema/ColumnPath;Lparquet/schema/PrimitiveType$PrimitiveTypeName;Lparquet/hadoop/metadata/CompressionCodecName;Ljava/util/Set<Lparquet/column/Encoding;>;Lparquet/column/statistics/Statistics;JJJJJ)Lparquet/hadoop/metadata/ColumnChunkMetaData;,
> desc
> (Lparquet/common/schema/ColumnPath;Lparquet/schema/PrimitiveType$PrimitiveTypeName;Lparquet/hadoop/metadata/CompressionCodecName;Ljava/util/Set;Lparquet/column/statistics/Statistics;JJJJJ)Lparquet/hadoop/metadata/ColumnChunkMetaData;,
> access public static
> Removed Method getPath, desc ()Lparquet/hadoop/metadata/ColumnPath;, access
> public
> Removed Method get, sig
> (Lparquet/hadoop/metadata/ColumnPath;Lparquet/schema/PrimitiveType$PrimitiveTypeName;Lparquet/hadoop/metadata/CompressionCodecName;Ljava/util/Set<Lparquet/column/Encoding;>;JJJJJ)Lparquet/hadoop/metadata/ColumnChunkMetaData;,
> desc
> (Lparquet/hadoop/metadata/ColumnPath;Lparquet/schema/PrimitiveType$PrimitiveTypeName;Lparquet/hadoop/metadata/CompressionCodecName;Ljava/util/Set;JJJJJ)Lparquet/hadoop/metadata/ColumnChunkMetaData;,
> access public static
> Class parquet.hadoop.metadata.ColumnChunkProperties
> Added Method getPath, desc ()Lparquet/common/schema/ColumnPath;, access
> public
> Removed Method getPath, desc ()Lparquet/hadoop/metadata/ColumnPath;, access
> public
> Removed Method get, sig
> (Lparquet/hadoop/metadata/ColumnPath;Lparquet/schema/PrimitiveType$PrimitiveTypeName;Lparquet/hadoop/metadata/CompressionCodecName;Ljava/util/Set<Lparquet/column/Encoding;>;)Lparquet/hadoop/metadata/ColumnChunkProperties;,
> desc
> (Lparquet/hadoop/metadata/ColumnPath;Lparquet/schema/PrimitiveType$PrimitiveTypeName;Lparquet/hadoop/metadata/CompressionCodecName;Ljava/util/Set;)Lparquet/hadoop/metadata/ColumnChunkProperties;,
> access public static
> Added Method get, sig
> (Lparquet/common/schema/ColumnPath;Lparquet/schema/PrimitiveType$PrimitiveTypeName;Lparquet/hadoop/metadata/CompressionCodecName;Ljava/util/Set<Lparquet/column/Encoding;>;)Lparquet/hadoop/metadata/ColumnChunkProperties;,
> desc
> (Lparquet/common/schema/ColumnPath;Lparquet/schema/PrimitiveType$PrimitiveTypeName;Lparquet/hadoop/metadata/CompressionCodecName;Ljava/util/Set;)Lparquet/hadoop/metadata/ColumnChunkProperties;,
> access public static
> Class parquet.hadoop.metadata.ColumnPath
> Removed Class , access final public super synchronized
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
