[
https://issues.apache.org/jira/browse/CHUKWA-284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ari Rabkin updated CHUKWA-284:
------------------------------
Attachment: CHUKWA-284.patch
Should only checkpoint adaptor status once we got an ack back from collector.
This patch does that.
> division of responsibility between agent and adaptor
> ----------------------------------------------------
>
> Key: CHUKWA-284
> URL: https://issues.apache.org/jira/browse/CHUKWA-284
> Project: Hadoop Chukwa
> Issue Type: Bug
> Components: data collection
> Affects Versions: 0.1.2, 0.2.0
> Reporter: Ari Rabkin
> Assignee: Ari Rabkin
> Fix For: 0.3.0
>
> Attachments: CHUKWA-284.patch
>
>
> The division of responsibility between adaptor and agent for managing
> offsets, datatypes, and such has gotten quite squirrely. And the comments
> don't match the code.
> For instance, the adaptors track last offset. This means that checkpoint
> files include the last byte enqueued to be SENT, rather than the last byte
> ACKNOWLEDGED. This violates both the spec and the comments.
> I propose that we make the agent responsible for recording offsets and
> possibly also datatypes. Are there cases where an Adaptor decides on its own
> what the Datatype is for the chunks it outputs? Or outputs chunks of
> different Types?
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
