[
https://issues.apache.org/jira/browse/SAMZA-2176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Shanthoosh Venkataraman updated SAMZA-2176:
-------------------------------------------
Description:
Samza stores the metadata of the job into a log-compacted kafka topic called
coordinator stream.
Due to some operational issue, we converted serialized null value into bytes
and stored them as values for some keys in the coordinator stream. These keys
will not be log-compacted by kafka, since they're not actually null messages.
As a part of JIRA, we propose to ignore these configurations with
serialized-null values and hold keys only with non-null values from
coordinator-stream in ApplicationMaster.
was:
Samza stores the metadata of the job into a log-compacted kafka topic called
coordinator stream.
Due to some operational issue, we converted the serialized null value into
bytes and stored them as messages in the coordinator stream. These keys will
not be log-compacted by kafka, since they're not actually null messages.
As a part of JIRA, we propose to ignore these configurations with
serialized-null values and hold keys only with non-null values from
coordinator-stream in ApplicationMaster.
> Ignore the configurations with serialized null values from coordinator stream.
> ------------------------------------------------------------------------------
>
> Key: SAMZA-2176
> URL: https://issues.apache.org/jira/browse/SAMZA-2176
> Project: Samza
> Issue Type: Bug
> Reporter: Shanthoosh Venkataraman
> Assignee: Shanthoosh Venkataraman
> Priority: Major
>
> Samza stores the metadata of the job into a log-compacted kafka topic called
> coordinator stream.
> Due to some operational issue, we converted serialized null value into bytes
> and stored them as values for some keys in the coordinator stream. These keys
> will not be log-compacted by kafka, since they're not actually null messages.
> As a part of JIRA, we propose to ignore these configurations with
> serialized-null values and hold keys only with non-null values from
> coordinator-stream in ApplicationMaster.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
