[ 
https://issues.apache.org/jira/browse/APEXMALHAR-2283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15572849#comment-15572849
 ] 

Thomas Weise commented on APEXMALHAR-2283:
------------------------------------------

It also appears that the user has to specify the key serializer, which makes no 
sense since it is internal to the operator:
{code}
org.apache.kafka.common.config.ConfigException: Missing required configuration 
"key.serializer" which has no default value.
        at org.apache.kafka.common.config.ConfigDef.parse(ConfigDef.java:148)
        at 
org.apache.kafka.common.config.AbstractConfig.<init>(AbstractConfig.java:49)
        at 
org.apache.kafka.common.config.AbstractConfig.<init>(AbstractConfig.java:56)
        at 
org.apache.kafka.clients.producer.ProducerConfig.<init>(ProducerConfig.java:315)
        at 
org.apache.kafka.clients.producer.KafkaProducer.<init>(KafkaProducer.java:181)
        at 
org.apache.apex.malhar.kafka.AbstractKafkaOutputOperator.setup(AbstractKafkaOutputOperator.java:51)
        at 
org.apache.apex.malhar.kafka.KafkaSinglePortExactlyOnceOutputOperator.setup(KafkaSinglePortExactlyOnceOutputOperator.java:124)
        at 
org.apache.apex.malhar.kafka.KafkaSinglePortExactlyOnceOutputOperator.setup(KafkaSinglePortExactlyOnceOutputOperator.java:94)
{code}


> Issues with Kafka output operator
> ---------------------------------
>
>                 Key: APEXMALHAR-2283
>                 URL: https://issues.apache.org/jira/browse/APEXMALHAR-2283
>             Project: Apache Apex Malhar
>          Issue Type: Improvement
>            Reporter: Siyuan Hua
>            Assignee: Siyuan Hua
>
> The abstract kafka output operator needs to be refactored
> 1. Needs to set some mandatory properties on operator level instead of kafka 
> property level.
> 2. More document and examples
> 3. Find a standard way to achieve exactly once in both 0.8 and 0.9
> More will be added when working on the ticket



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to