Michiel de Jong created AVRO-3266:
-------------------------------------
Summary: Output stream incompatible with MagicS3GuardCommitter
Key: AVRO-3266
URL: https://issues.apache.org/jira/browse/AVRO-3266
Project: Apache Avro
Issue Type: Bug
Components: java
Reporter: Michiel de Jong
Avro's output stream can not be used in combination with the
MagicS3GuardCommitter
{code:java}
Error: java.lang.ClassCastException: class
org.apache.hadoop.fs.s3a.commit.magic.MagicS3GuardCommitter cannot be cast to
class org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter{code}
The reason for this problem is that
AvroOutputFormatBase.getAvroFileOutputStream tries to cast the outputcommiter
to a FileOutputCommitter.
It can be solved by casting to a PathOutputCommitter instead (which is a
superclass of both the FileOutputCommitter and the MagicS3GuardCommitter)
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
