[ 
https://issues.apache.org/jira/browse/BEAM-9144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Tomo Suzuki updated BEAM-9144:
------------------------------
    Description: 
>From Aaron's comment in 
>https://issues.apache.org/jira/browse/BEAM-8388?focusedCommentId=17016476&page=com.atlassian.jira.plugin.system.issuetabpanels%3Acomment-tabpanel#comment-17016476
> .
{quote}My org must use Avro 1.9.x (due to some Avro schema resolution issues 
resolved in 1.9.x) so downgrading Avro is not possible for us.
 Beam 2.16.0 is compatible with our usage of Avro 1.9.x – but upgrading to 
2.17.0 we are broken as 2.17.0 links to Java classes in Avro 1.8.x that are not 
available in 1.9.x.
{quote}
The Java class is {{org.apache.avro.data.TimeConversions.TimestampConversion}} 
in Avro 1.8.
 It's renamed to {{org.apache.avro.data.JodaTimeConversions}} in Avro 1.9.

# Beam Java SDK cannot upgrade Avro to 1.9

Beam has Spark runners and Spark has not yet upgraded to Avro 1.9.

Illustration of the dependecy

!avro-beam-dependency-graph.png|width=799,height=385!

  was:
>From Aaron's comment in 
>https://issues.apache.org/jira/browse/BEAM-8388?focusedCommentId=17016476&page=com.atlassian.jira.plugin.system.issuetabpanels%3Acomment-tabpanel#comment-17016476
> .
{quote}My org must use Avro 1.9.x (due to some Avro schema resolution issues 
resolved in 1.9.x) so downgrading Avro is not possible for us.
 Beam 2.16.0 is compatible with our usage of Avro 1.9.x – but upgrading to 
2.17.0 we are broken as 2.17.0 links to Java classes in Avro 1.8.x that are not 
available in 1.9.x.
{quote}
The Java class is {{org.apache.avro.data.TimeConversions.TimestampConversion}} 
in Avro 1.8.
 It's renamed to {{org.apache.avro.data.JodaTimeConversions}} in Avro 1.9.

!avro-beam-dependency-graph.png|width=799,height=385!


> Beam's own Avro TimeConversion class in beam-sdk-java-core 
> -----------------------------------------------------------
>
>                 Key: BEAM-9144
>                 URL: https://issues.apache.org/jira/browse/BEAM-9144
>             Project: Beam
>          Issue Type: Bug
>          Components: sdk-java-core
>            Reporter: Tomo Suzuki
>            Assignee: Tomo Suzuki
>            Priority: Major
>         Attachments: avro-beam-dependency-graph.png
>
>
> From Aaron's comment in 
> https://issues.apache.org/jira/browse/BEAM-8388?focusedCommentId=17016476&page=com.atlassian.jira.plugin.system.issuetabpanels%3Acomment-tabpanel#comment-17016476
>  .
> {quote}My org must use Avro 1.9.x (due to some Avro schema resolution issues 
> resolved in 1.9.x) so downgrading Avro is not possible for us.
>  Beam 2.16.0 is compatible with our usage of Avro 1.9.x – but upgrading to 
> 2.17.0 we are broken as 2.17.0 links to Java classes in Avro 1.8.x that are 
> not available in 1.9.x.
> {quote}
> The Java class is 
> {{org.apache.avro.data.TimeConversions.TimestampConversion}} in Avro 1.8.
>  It's renamed to {{org.apache.avro.data.JodaTimeConversions}} in Avro 1.9.
> # Beam Java SDK cannot upgrade Avro to 1.9
> Beam has Spark runners and Spark has not yet upgraded to Avro 1.9.
> Illustration of the dependecy
> !avro-beam-dependency-graph.png|width=799,height=385!



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to