[ 
https://issues.apache.org/jira/browse/PARQUET-1541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16780293#comment-16780293
 ] 

Qinghui Xu commented on PARQUET-1541:
-------------------------------------

Hello, [~theCoder]

Could you provide your protobuf schema? Also, what version of parquet-mr are 
you using?

> ClassCastException
> ------------------
>
>                 Key: PARQUET-1541
>                 URL: https://issues.apache.org/jira/browse/PARQUET-1541
>             Project: Parquet
>          Issue Type: Bug
>          Components: parquet-mr
>    Affects Versions: 1.10.1
>            Reporter: the coder
>            Priority: Major
>              Labels: parquetWriter
>
> Hi
> I'm writing protobuf to Parquet using ProtoParquetWriter, i'm also writing to 
> local HDFS and write only  one file.
> my code running in a bit data environment.
> the problem is that after about 30 min of run i'm starting to get exception 
> like this:
>  
> java.lang.ClassCastException: org.apache.parquet.io.MessageColumnIO cannot be 
> cast to org.apache.parquet.io.PrimitiveColumnIO
>  at 
> org.apache.parquet.io.MessageColumnIO$MessageColumnIORecordConsumer.getColumnWriter(MessageColumnIO.java:432)
>  at 
> org.apache.parquet.io.MessageColumnIO$MessageColumnIORecordConsumer.addLong(MessageColumnIO.java:449)
>  at 
> org.apache.parquet.proto.ProtoWriteSupport$LongWriter.writeRawValue(ProtoWriteSupport.java:294)
>  at 
> org.apache.parquet.proto.ProtoWriteSupport$FieldWriter.writeField(ProtoWriteSupport.java:145)
>  at 
> org.apache.parquet.proto.ProtoWriteSupport$MessageWriter.writeAllFields(ProtoWriteSupport.java:229)
>  at 
> org.apache.parquet.proto.ProtoWriteSupport$MessageWriter.writeTopLevelMessage(ProtoWriteSupport.java:194)
>  
> I printed the message that cause to this error and I can't see any problem 
> with it.
> any idea?
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to