[
https://issues.apache.org/jira/browse/AVRO-3266?focusedWorklogId=781056&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-781056
]
ASF GitHub Bot logged work on AVRO-3266:
----------------------------------------
Author: ASF GitHub Bot
Created on: 14/Jun/22 09:27
Start Date: 14/Jun/22 09:27
Worklog Time Spent: 10m
Work Description: martin-g commented on PR #1431:
URL: https://github.com/apache/avro/pull/1431#issuecomment-1154941190
> avro has just upgraded its hadoop dependency to 3.3.3
@steveloughran Do you mean https://github.com/apache/avro/pull/1697 ?
This is just a bump from 3.3.2 to 3.3.3. I hope Hadoop didn't introduce
anything concerning in a minor version.
Avro uses Hadoop 3.2.0 since at least 2020 (Avro 1.9.x, I believe).
But there is also `hadoop-2` profile -
https://github.com/apache/avro/blob/79976977feba9a1e77ca1d96137295bc0ab96e8a/lang/java/pom.xml#L469
I guess this one could be bumped to 2.10.2 before releasing 1.11.1.
Issue Time Tracking
-------------------
Worklog Id: (was: 781056)
Time Spent: 3h 20m (was: 3h 10m)
> Output stream incompatible with MagicS3GuardCommitter
> -----------------------------------------------------
>
> Key: AVRO-3266
> URL: https://issues.apache.org/jira/browse/AVRO-3266
> Project: Apache Avro
> Issue Type: Bug
> Components: java
> Reporter: Michiel de Jong
> Assignee: Emil Ejbyfeldt
> Priority: Minor
> Labels: pull-request-available
> Fix For: 1.11.1
>
> Time Spent: 3h 20m
> Remaining Estimate: 0h
>
> Avro's output stream can not be used in combination with the
> MagicS3GuardCommitter
> {code:java}
> Error: java.lang.ClassCastException: class
> org.apache.hadoop.fs.s3a.commit.magic.MagicS3GuardCommitter cannot be cast to
> class org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter{code}
> The reason for this problem is that
> AvroOutputFormatBase.getAvroFileOutputStream tries to cast the outputcommiter
> to a FileOutputCommitter.
> It can be solved by casting to a PathOutputCommitter instead (which is a
> superclass of both the FileOutputCommitter and the MagicS3GuardCommitter)
--
This message was sent by Atlassian Jira
(v8.20.7#820007)
