[
https://issues.apache.org/jira/browse/CHUKWA-368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12739091#action_12739091
]
Ari Rabkin commented on CHUKWA-368:
-----------------------------------
My proposal is as follows: modify ConstRateSender to emit, instead of random
bytes, a byte pattern that depends on the sequence number of the Chunk being
produced. (This is a small and painless change).
Second, a MapReduce job that looks for that pattern and verifies that each
chunk shows up at least once, that counts the number of duplicates, and that
verifies that Chunks aren't corrupted.
Really, I'm worried about lost or duplicate chunks; the data pattern thing is
just easy to do at the same time.
> proposed stress test
> --------------------
>
> Key: CHUKWA-368
> URL: https://issues.apache.org/jira/browse/CHUKWA-368
> Project: Hadoop Chukwa
> Issue Type: New Feature
> Components: build and test code
> Reporter: Ari Rabkin
>
> I'd like to build a stress-test for Chukwa, to verify that collectors don't
> lose or corrupt data under high load.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
