[
https://issues.apache.org/jira/browse/AVRO-3266?focusedWorklogId=778037&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-778037
]
ASF GitHub Bot logged work on AVRO-3266:
----------------------------------------
Author: ASF GitHub Bot
Created on: 03/Jun/22 11:17
Start Date: 03/Jun/22 11:17
Worklog Time Spent: 10m
Work Description: steveloughran commented on PR #1618:
URL: https://github.com/apache/avro/pull/1618#issuecomment-1145861090
> hadoop 2 is still not EOL
it pretty much is actually. that is just a CVE fix. it is otherwise frozen
for all bug reports, and we don't do anything about transient CVEs from
dependent libraries we can't upgrade. as it is required to be java7 compatible,
all its dependencies need to be java7, which means they are all pretty frozen.
doesn't work on java > 8 either. whereas hadoop 3 is java 8 guaranteed and
on branch 3.3.x, java 11 compatible. trunk we are moving to java 11 *only*,
first in builds, then source.
please, give up on hadoop 2.
Issue Time Tracking
-------------------
Worklog Id: (was: 778037)
Time Spent: 3h (was: 2h 50m)
> Output stream incompatible with MagicS3GuardCommitter
> -----------------------------------------------------
>
> Key: AVRO-3266
> URL: https://issues.apache.org/jira/browse/AVRO-3266
> Project: Apache Avro
> Issue Type: Bug
> Components: java
> Reporter: Michiel de Jong
> Assignee: Emil Ejbyfeldt
> Priority: Minor
> Labels: pull-request-available
> Fix For: 1.11.1
>
> Time Spent: 3h
> Remaining Estimate: 0h
>
> Avro's output stream can not be used in combination with the
> MagicS3GuardCommitter
> {code:java}
> Error: java.lang.ClassCastException: class
> org.apache.hadoop.fs.s3a.commit.magic.MagicS3GuardCommitter cannot be cast to
> class org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter{code}
> The reason for this problem is that
> AvroOutputFormatBase.getAvroFileOutputStream tries to cast the outputcommiter
> to a FileOutputCommitter.
> It can be solved by casting to a PathOutputCommitter instead (which is a
> superclass of both the FileOutputCommitter and the MagicS3GuardCommitter)
--
This message was sent by Atlassian Jira
(v8.20.7#820007)
