Thomas Weise commented on APEXMALHAR-2283:

The operator recovery assumes that messages are strings. That isn't the case 
when using a custom serializer and that's what the type parameter T was for. 
There also is no access to the consumer properties. Please consider the cost of 
deserializing every object just to determine equality. It can be done by 
comparing the byte arrays also and there should be some control given to the 

> Refactor kafka output operator
> ------------------------------
>                 Key: APEXMALHAR-2283
>                 URL: https://issues.apache.org/jira/browse/APEXMALHAR-2283
>             Project: Apache Apex Malhar
>          Issue Type: Improvement
>            Reporter: Siyuan Hua
>            Assignee: Siyuan Hua
> The abstract kafka output operator needs to be refactored
> 1. Needs to set some mandatory properties on operator level instead of kafka 
> property level.
> 2. More document and examples
> 3. Find a standard way to achieve exactly once in both 0.8 and 0.9
> More will be added when working on the ticket

This message was sent by Atlassian JIRA

Reply via email to