[
https://issues.apache.org/jira/browse/FLINK-12410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17043610#comment-17043610
]
Theo Diefenthal edited comment on FLINK-12410 at 2/24/20 3:46 PM:
------------------------------------------------------------------
It is indeed very annoying. I think, Kafka is the most used source in Flink and
I can't set
```
env.getConfig().disableGenericTypes();
```
when using kafka as [~alexeyt820] already pointed out.
This way, every time somebody changes our streaming jobs, he could by accident
create/change POJOs to become GenericTypes and don't work with Schema-Evolution
any more. => If we could enable the `disableGenericTypes` option, the pipeline
won't start and every developer would immediately realize that he made some bad
changes.
was (Author: theod):
It is indeed very annoying. I think, Kafka is the most used Source in Flink and
I can't set
```
env.getConfig().disableGenericTypes();
```
when using kafka as [~alexeyt820] already pointed out.
This way, every time somebody changes our streaming jobs, he could by accident
create/change POJOs to become GenericTypes and don't work with Schema-Evolution
any more. => If we could enable the `disableGenericTypes` option, the pipeline
won't start and every developer would immediately realize that he made some bad
changes.
> KafkaTopicPartition cannot be used as a POJO type because not all fields are
> valid POJO fields
> ----------------------------------------------------------------------------------------------
>
> Key: FLINK-12410
> URL: https://issues.apache.org/jira/browse/FLINK-12410
> Project: Flink
> Issue Type: Bug
> Components: Connectors / Kafka
> Affects Versions: 1.8.0
> Reporter: Chethan UK
> Priority: Minor
>
> While Pushing data to Kafka Topic using Pojo, there is an error: "INFO
> org.apache.flink.api.java.typeutils.TypeExtractor - Class class
> org.apache.flink.streaming.connectors.kafka.internals.KafkaTopicPartition
> cannot be used as a POJO type because not all fields are valid POJO fields,
> and must be processed as GenericType"
> {code:java}
> // code placeholder
> 09:18:27,633 INFO org.apache.flink.api.java.typeutils.TypeExtractor - class
> org.apache.flink.streaming.connectors.kafka.internals.KafkaTopicPartition
> does not contain a setter for field topic
> 09:18:27,634 INFO org.apache.flink.api.java.typeutils.TypeExtractor - Class
> class
> org.apache.flink.streaming.connectors.kafka.internals.KafkaTopicPartition
> cannot be used as a POJO type because not all fields are valid POJO fields,
> and must be processed as GenericType. Please read the Flink documentation on
> "Data Types & Serialization" for details of the effect on performance.
> 09:18:27,633 INFO org.apache.flink.api.java.typeutils.TypeExtractor - class
> org.apache.flink.streaming.connectors.kafka.internals.KafkaTopicPartition
> does not contain a setter for field topic
> 09:18:27,635 INFO org.apache.flink.api.java.typeutils.TypeExtractor - Class
> class
> org.apache.flink.streaming.connectors.kafka.internals.KafkaTopicPartition
> cannot be used as a POJO type because not all fields are valid POJO fields,
> and must be processed as GenericType. Please read the Flink documentation on
> "Data Types & Serialization" for details of the effect on performance.
> 09:18:27,635 INFO org.apache.flink.api.java.typeutils.TypeExtractor - class
> org.apache.flink.streaming.connectors.kafka.internals.KafkaTopicPartition
> does not contain a setter for field topic
> 09:18:27,636 INFO org.apache.flink.api.java.typeutils.TypeExtractor - Class
> class
> org.apache.flink.streaming.connectors.kafka.internals.KafkaTopicPartition
> cannot be used as a POJO type because not all fields are valid POJO fields,
> and must be processed as GenericType. Please read the Flink documentation on
> "Data Types & Serialization" for details of the effect on performance.
> 09:18:27,639 INFO org.apache.flink.api.java.typeutils.TypeExtractor - class
> org.apache.flink.streaming.connectors.kafka.internals.KafkaTopicPartition
> does not contain a setter for field topic
> 09:18:27,642 INFO org.apache.flink.api.java.typeutils.TypeExtractor - Class
> class
> org.apache.flink.streaming.connectors.kafka.internals.KafkaTopicPartition
> cannot be used as a POJO type because not all fields are valid POJO fields,
> and must be processed as GenericType. Please read the Flink documentation on
> "Data Types & Serialization" for details of the effect on performance.
> 09:18:27,654 INFO
> org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase - No
> restore state for FlinkKafkaConsumer.
> 09:18:27,655 INFO
> org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase - No
> restore state for FlinkKafkaConsumer.
> 09:18:27,655 INFO
> org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase - No
> restore state for FlinkKafkaConsumer.
> 09:18:27,654 INFO
> org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase - No
> restore state for FlinkKafkaConsumer.
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
