[
https://issues.apache.org/jira/browse/FLINK-18478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17163347#comment-17163347
]
Georg Heiler commented on FLINK-18478:
--------------------------------------
Great! I can confirm that the initial reflection-based error is solved now.
However `{color:#008080}GenericData{color}` cannot be cast to type
`scala.Product` for an now updated reproducible example of {color:#000000}
[https://gist.github.com/geoHeil/5a5a4ae0ca2a8049617afa91acf40f89]{color}:
```
{color:#000000}java.lang.{color}{color:#008080}ClassCastException{color}{color:#000000}:
org.apache.avro.generic.{color}{color:#008080}GenericData$Record{color}{color:#000000}
cannot be {color}{color:#0000ff}cast{color}{color:#000000} to
scala.{color}{color:#008080}Product{color}
{color:#000000}ava.lang.{color}{color:#008080}ClassCastException{color}{color:#000000}:
org.apache.avro.generic.{color}{color:#008080}GenericData$Record{color}{color:#000000}
cannot be {color}{color:#0000ff}cast{color}{color:#000000} to
scala.{color}{color:#008080}Product{color}
{color:#000000} at
org.apache.flink.api.scala.typeutils.{color}{color:#008080}CaseClassSerializer{color}{color:#000000}.copy({color}{color:#008080}CaseClassSerializer{color}{color:#000000}.scala:{color}{color:#09885a}32{color}{color:#000000})
~[flink-dist_2.{color}{color:#09885a}11{color}{color:#000000}-{color}{color:#09885a}1.11{color}{color:#000000}.{color}{color:#09885a}1{color}{color:#000000}.jar:{color}{color:#09885a}1.11{color}{color:#000000}.{color}{color:#09885a}1{color}{color:#000000}]{color}
{color:#000000} at
org.apache.flink.streaming.runtime.tasks.{color}{color:#008080}OperatorChain$CopyingChainingOutput{color}{color:#000000}.pushToOperator({color}{color:#008080}OperatorChain{color}{color:#000000}.java:{color}{color:#09885a}715{color}{color:#000000})
~[flink-dist_2.{color}{color:#09885a}11{color}{color:#000000}-{color}{color:#09885a}1.11{color}{color:#000000}.{color}{color:#09885a}1{color}{color:#000000}.jar:{color}{color:#09885a}1.11{color}{color:#000000}.{color}{color:#09885a}1{color}{color:#000000}]{color}
{color:#000000} at
org.apache.flink.streaming.runtime.tasks.{color}{color:#008080}OperatorChain$CopyingChainingOutput{color}{color:#000000}.{color}{color:#0000ff}collect{color}{color:#000000}({color}{color:#008080}OperatorChain{color}{color:#000000}.java:{color}{color:#09885a}692{color}{color:#000000})
~[flink-dist_2.{color}{color:#09885a}11{color}{color:#000000}-{color}{color:#09885a}1.11{color}{color:#000000}.{color}{color:#09885a}1{color}{color:#000000}.jar:{color}{color:#09885a}1.11{color}{color:#000000}.{color}{color:#09885a}1{color}{color:#000000}]{color}
{color:#000000} at
org.apache.flink.streaming.runtime.tasks.{color}{color:#008080}OperatorChain$CopyingChainingOutput{color}{color:#000000}.{color}{color:#0000ff}collect{color}{color:#000000}({color}{color:#008080}OperatorChain{color}{color:#000000}.java:{color}{color:#09885a}672{color}{color:#000000})
~[flink-dist_2.{color}{color:#09885a}11{color}{color:#000000}-{color}{color:#09885a}1.11{color}{color:#000000}.{color}{color:#09885a}1{color}{color:#000000}.jar:{color}{color:#09885a}1.11{color}{color:#000000}.{color}{color:#09885a}1{color}{color:#000000}]{color}
{color:#000000} at
org.apache.flink.streaming.api.operators.{color}{color:#008080}CountingOutput{color}{color:#000000}.{color}{color:#0000ff}collect{color}{color:#000000}({color}{color:#008080}CountingOutput{color}{color:#000000}.java:{color}{color:#09885a}52{color}{color:#000000})
~[flink-dist_2.{color}{color:#09885a}11{color}{color:#000000}-{color}{color:#09885a}1.11{color}{color:#000000}.{color}{color:#09885a}1{color}{color:#000000}.jar:{color}{color:#09885a}1.11{color}{color:#000000}.{color}{color:#09885a}1{color}{color:#000000}]{color}
{color:#000000} at
org.apache.flink.streaming.api.operators.{color}{color:#008080}CountingOutput{color}{color:#000000}.{color}{color:#0000ff}collect{color}{color:#000000}({color}{color:#008080}CountingOutput{color}{color:#000000}.java:{color}{color:#09885a}30{color}{color:#000000})
~[flink-dist_2.{color}{color:#09885a}11{color}{color:#000000}-{color}{color:#09885a}1.11{color}{color:#000000}.{color}{color:#09885a}1{color}{color:#000000}.jar:{color}{color:#09885a}1.11{color}{color:#000000}.{color}{color:#09885a}1{color}{color:#000000}]{color}
{color:#000000} at
org.apache.flink.streaming.api.operators.{color}{color:#008080}StreamSourceContexts$NonTimestampContext{color}{color:#000000}.{color}{color:#0000ff}collect{color}{color:#000000}({color}{color:#008080}StreamSourceContexts{color}{color:#000000}.java:{color}{color:#09885a}104{color}{color:#000000})
~[flink-dist_2.{color}{color:#09885a}11{color}{color:#000000}-{color}{color:#09885a}1.11{color}{color:#000000}.{color}{color:#09885a}1{color}{color:#000000}.jar:{color}{color:#09885a}1.11{color}{color:#000000}.{color}{color:#09885a}1{color}{color:#000000}]{color}
{color:#000000} at
org.apache.flink.streaming.api.operators.{color}{color:#008080}StreamSourceContexts$NonTimestampContext{color}{color:#000000}.collectWithTimestamp({color}{color:#008080}StreamSourceContexts{color}{color:#000000}.java:{color}{color:#09885a}111{color}{color:#000000})
~[flink-dist_2.{color}{color:#09885a}11{color}{color:#000000}-{color}{color:#09885a}1.11{color}{color:#000000}.{color}{color:#09885a}1{color}{color:#000000}.jar:{color}{color:#09885a}1.11{color}{color:#000000}.{color}{color:#09885a}1{color}{color:#000000}]{color}
{color:#000000} at
org.apache.flink.streaming.connectors.kafka.internals.{color}{color:#008080}AbstractFetcher{color}{color:#000000}.emitRecordsWithTimestamps({color}{color:#008080}AbstractFetcher{color}{color:#000000}.java:{color}{color:#09885a}352{color}{color:#000000})
~[flink-connector-kafka-base_2.{color}{color:#09885a}11{color}{color:#000000}-{color}{color:#09885a}1.11{color}{color:#000000}.{color}{color:#09885a}1{color}{color:#000000}.jar:{color}{color:#09885a}1.11{color}{color:#000000}.{color}{color:#09885a}1{color}{color:#000000}]{color}
{color:#000000} at
org.apache.flink.streaming.connectors.kafka.internal.{color}{color:#008080}KafkaFetcher{color}{color:#000000}.partitionConsumerRecordsHandler({color}{color:#008080}KafkaFetcher{color}{color:#000000}.java:{color}{color:#09885a}185{color}{color:#000000})
~[flink-connector-kafka_2.{color}{color:#09885a}11{color}{color:#000000}-{color}{color:#09885a}1.11{color}{color:#000000}.{color}{color:#09885a}1{color}{color:#000000}.jar:{color}{color:#09885a}1.11{color}{color:#000000}.{color}{color:#09885a}1{color}{color:#000000}]{color}
{color:#000000} at
org.apache.flink.streaming.connectors.kafka.internal.{color}{color:#008080}KafkaFetcher{color}{color:#000000}.runFetchLoop({color}{color:#008080}KafkaFetcher{color}{color:#000000}.java:{color}{color:#09885a}141{color}{color:#000000})
~[flink-connector-kafka_2.{color}{color:#09885a}11{color}{color:#000000}-{color}{color:#09885a}1.11{color}{color:#000000}.{color}{color:#09885a}1{color}{color:#000000}.jar:{color}{color:#09885a}1.11{color}{color:#000000}.{color}{color:#09885a}1{color}{color:#000000}]{color}
{color:#000000} at
org.apache.flink.streaming.connectors.kafka.{color}{color:#008080}FlinkKafkaConsumerBase{color}{color:#000000}.run({color}{color:#008080}FlinkKafkaConsumerBase{color}{color:#000000}.java:{color}{color:#09885a}755{color}{color:#000000})
~[flink-connector-kafka-base_2.{color}{color:#09885a}11{color}{color:#000000}-{color}{color:#09885a}1.11{color}{color:#000000}.{color}{color:#09885a}1{color}{color:#000000}.jar:{color}{color:#09885a}1.11{color}{color:#000000}.{color}{color:#09885a}1{color}{color:#000000}]{color}
{color:#000000} at
org.apache.flink.streaming.api.operators.{color}{color:#008080}StreamSource{color}{color:#000000}.run({color}{color:#008080}StreamSource{color}{color:#000000}.java:{color}{color:#09885a}100{color}{color:#000000})
~[flink-dist_2.{color}{color:#09885a}11{color}{color:#000000}-{color}{color:#09885a}1.11{color}{color:#000000}.{color}{color:#09885a}1{color}{color:#000000}.jar:{color}{color:#09885a}1.11{color}{color:#000000}.{color}{color:#09885a}1{color}{color:#000000}]{color}
{color:#000000} at
org.apache.flink.streaming.api.operators.{color}{color:#008080}StreamSource{color}{color:#000000}.run({color}{color:#008080}StreamSource{color}{color:#000000}.java:{color}{color:#09885a}63{color}{color:#000000})
~[flink-dist_2.{color}{color:#09885a}11{color}{color:#000000}-{color}{color:#09885a}1.11{color}{color:#000000}.{color}{color:#09885a}1{color}{color:#000000}.jar:{color}{color:#09885a}1.11{color}{color:#000000}.{color}{color:#09885a}1{color}{color:#000000}]{color}
{color:#000000} at
org.apache.flink.streaming.runtime.tasks.{color}{color:#008080}SourceStreamTask$LegacySourceFunctionThread{color}{color:#000000}.run({color}{color:#008080}SourceStreamTask{color}{color:#000000}.java:{color}{color:#09885a}201{color}{color:#000000})
~[flink-dist_2.{color}{color:#09885a}11{color}{color:#000000}-{color}{color:#09885a}1.11{color}{color:#000000}.{color}{color:#09885a}1{color}{color:#000000}.jar:{color}{color:#09885a}1.11{color}{color:#000000}.{color}{color:#09885a}1{color}{color:#000000}]{color}
```
> AvroDeserializationSchema does not work with types generated by avrohugger
> --------------------------------------------------------------------------
>
> Key: FLINK-18478
> URL: https://issues.apache.org/jira/browse/FLINK-18478
> Project: Flink
> Issue Type: Bug
> Components: Formats (JSON, Avro, Parquet, ORC, SequenceFile)
> Reporter: Aljoscha Krettek
> Assignee: Aljoscha Krettek
> Priority: Major
> Labels: pull-request-available
> Fix For: 1.10.2, 1.12.0, 1.11.1
>
>
> The main problem is that the code in {{SpecificData.createSchema()}} tries to
> reflectively read the {{SCHEMA$}} field, that is normally there in Avro
> generated classes. However, avrohugger generates this field in a companion
> object, which the reflective Java code will therefore not find.
> This is also described in these ML threads:
> *
> [https://lists.apache.org/thread.html/5db58c7d15e4e9aaa515f935be3b342fe036e97d32e1fb0f0d1797ee@%3Cuser.flink.apache.org%3E]
> *
> [https://lists.apache.org/thread.html/cf1c5b8fa7f095739438807de9f2497e04ffe55237c5dea83355112d@%3Cuser.flink.apache.org%3E]
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
