[
https://issues.apache.org/jira/browse/AVRO-3266?focusedWorklogId=782472&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-782472
]
ASF GitHub Bot logged work on AVRO-3266:
----------------------------------------
Author: ASF GitHub Bot
Created on: 17/Jun/22 16:52
Start Date: 17/Jun/22 16:52
Worklog Time Spent: 10m
Work Description: RyanSkraba commented on PR #1618:
URL: https://github.com/apache/avro/pull/1618#issuecomment-1159062760
I'll just pass this by the mailing list to give anyone a change to object
strongly! But I think your argument is convincing.
If we stop supporting Hadoop 2, then the other PR is the one to pick! But
thanks so much for doing the work for this implementation...
Issue Time Tracking
-------------------
Worklog Id: (was: 782472)
Time Spent: 3h 40m (was: 3.5h)
> Output stream incompatible with MagicS3GuardCommitter
> -----------------------------------------------------
>
> Key: AVRO-3266
> URL: https://issues.apache.org/jira/browse/AVRO-3266
> Project: Apache Avro
> Issue Type: Bug
> Components: java
> Reporter: Michiel de Jong
> Assignee: Emil Ejbyfeldt
> Priority: Minor
> Labels: pull-request-available
> Fix For: 1.11.1
>
> Time Spent: 3h 40m
> Remaining Estimate: 0h
>
> Avro's output stream can not be used in combination with the
> MagicS3GuardCommitter
> {code:java}
> Error: java.lang.ClassCastException: class
> org.apache.hadoop.fs.s3a.commit.magic.MagicS3GuardCommitter cannot be cast to
> class org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter{code}
> The reason for this problem is that
> AvroOutputFormatBase.getAvroFileOutputStream tries to cast the outputcommiter
> to a FileOutputCommitter.
> It can be solved by casting to a PathOutputCommitter instead (which is a
> superclass of both the FileOutputCommitter and the MagicS3GuardCommitter)
--
This message was sent by Atlassian Jira
(v8.20.7#820007)
