This looks like a bug in parquet-tools when printing the schema to the console. Possibly adding a @JsonValue annotation to intValue() [1] in Type would fix it. [1] https://github.com/apache/parquet-mr/blob/89e0607cf6470dda1a6a47b46abf37468df4e50f/parquet-column/src/main/java/org/apache/parquet/schema/Type.java#L48 <https://github.com/apache/parquet-mr/blob/89e0607cf6470dda1a6a47b46abf37468df4e50f/parquet-column/src/main/java/org/apache/parquet/schema/Type.java#L48>
> On Jan 12, 2017, at 5:28 PM, James Pirz <[email protected]> wrote: > > Hi, > > I am trying to use a sample parquet file (generated via an existing example > [1] in parquet-cpp) against parquet-tools [2] (in local mode) from > parquet-mr project to check its content. However, parquet-tools can not > read the schema and footer of the generated file successfully showing the > following error. > I am just wondering if it is happening because of a mis-match in the > jackson library between parquet-cpp and parquet-mr or if it is more > fundamental. My understanding is that no matter how the parquet file is > generated (via parquet-cpp or some other library) it should be usable by > all standard readers including parquet-tools. > > Here is the error: > >> java -jar ./parquet-tools-1.9.1-SNAPSHOT.jar cat -j > /home/user/Downloads/parquet_cpp_example.parquet > > Could not read footer: java.lang.RuntimeException: > shaded.parquet.org.codehaus.jackson.map.JsonMappingException: > No serializer found for class > org.apache.parquet.schema.Type$ID and no properties > discovered to create BeanSerializer (to avoid exception, > disable SerializationConfig.Feature.FAIL_ON_EMPTY_BEANS) ) > (through reference chain: > org.apache.parquet.hadoop.metadata.ParquetMetadata["fileMetaData"]->org.apache.parquet.hadoop.metadata.FileMetaData["schema"]->org.apache.parquet.schema.MessageType["fields"]->java.util.ArrayList[0]->org.apache.parquet.schema.PrimitiveType["id"]) > > James > [1] > https://github.com/apache/parquet-cpp/blob/master/examples/reader-writer.cc > [2] https://github.com/apache/parquet-mr/tree/master/parquet-tools
signature.asc
Description: Message signed with OpenPGP using GPGMail
