[
https://issues.apache.org/jira/browse/SAMZA-548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14332439#comment-14332439
]
Chris Riccomini commented on SAMZA-548:
---------------------------------------
On my MacbookPro, it seems to go at about ~700K msgs/sec.
Here's a 1 second snapshot, 15s in:
{noformat}
2015-02-22 16:02:56 TestPerformanceTask [INFO] Processed 8600000 messages in 15
seconds.
2015-02-22 16:02:56 TestPerformanceTask [INFO] Processed 8610000 messages in 15
seconds.
2015-02-22 16:02:56 TestPerformanceTask [INFO] Processed 8620000 messages in 15
seconds.
2015-02-22 16:02:56 TestPerformanceTask [INFO] Processed 8630000 messages in 15
seconds.
2015-02-22 16:02:56 TestPerformanceTask [INFO] Processed 8640000 messages in 15
seconds.
2015-02-22 16:02:56 TestPerformanceTask [INFO] Processed 8650000 messages in 15
seconds.
2015-02-22 16:02:56 TestPerformanceTask [INFO] Processed 8660000 messages in 15
seconds.
2015-02-22 16:02:56 TestPerformanceTask [INFO] Processed 8670000 messages in 15
seconds.
2015-02-22 16:02:56 TestPerformanceTask [INFO] Processed 8680000 messages in 15
seconds.
2015-02-22 16:02:56 TestPerformanceTask [INFO] Processed 8690000 messages in 15
seconds.
2015-02-22 16:02:56 TestPerformanceTask [INFO] Processed 8700000 messages in 15
seconds.
2015-02-22 16:02:56 TestPerformanceTask [INFO] Processed 8710000 messages in 15
seconds.
2015-02-22 16:02:56 TestPerformanceTask [INFO] Processed 8720000 messages in 15
seconds.
2015-02-22 16:02:56 TestPerformanceTask [INFO] Processed 8730000 messages in 15
seconds.
2015-02-22 16:02:56 TestPerformanceTask [INFO] Processed 8740000 messages in 15
seconds.
2015-02-22 16:02:56 TestPerformanceTask [INFO] Processed 8750000 messages in 15
seconds.
2015-02-22 16:02:56 TestPerformanceTask [INFO] Processed 8760000 messages in 15
seconds.
2015-02-22 16:02:56 TestPerformanceTask [INFO] Processed 8770000 messages in 15
seconds.
2015-02-22 16:02:56 TestPerformanceTask [INFO] Processed 8780000 messages in 15
seconds.
2015-02-22 16:02:56 TestPerformanceTask [INFO] Processed 8790000 messages in 15
seconds.
2015-02-22 16:02:56 TestPerformanceTask [INFO] Processed 8800000 messages in 15
seconds.
2015-02-22 16:02:56 TestPerformanceTask [INFO] Processed 8810000 messages in 15
seconds.
2015-02-22 16:02:56 TestPerformanceTask [INFO] Processed 8820000 messages in 15
seconds.
2015-02-22 16:02:56 TestPerformanceTask [INFO] Processed 8830000 messages in 15
seconds.
2015-02-22 16:02:56 TestPerformanceTask [INFO] Processed 8840000 messages in 15
seconds.
2015-02-22 16:02:56 TestPerformanceTask [INFO] Processed 8850000 messages in 15
seconds.
2015-02-22 16:02:56 TestPerformanceTask [INFO] Processed 8860000 messages in 15
seconds.
2015-02-22 16:02:57 TestPerformanceTask [INFO] Processed 8870000 messages in 15
seconds.
2015-02-22 16:02:57 TestPerformanceTask [INFO] Processed 8880000 messages in 15
seconds.
2015-02-22 16:02:57 TestPerformanceTask [INFO] Processed 8890000 messages in 15
seconds.
2015-02-22 16:02:57 TestPerformanceTask [INFO] Processed 8900000 messages in 15
seconds.
2015-02-22 16:02:57 TestPerformanceTask [INFO] Processed 8910000 messages in 15
seconds.
2015-02-22 16:02:57 TestPerformanceTask [INFO] Processed 8920000 messages in 15
seconds.
2015-02-22 16:02:57 TestPerformanceTask [INFO] Processed 8930000 messages in 15
seconds.
2015-02-22 16:02:57 TestPerformanceTask [INFO] Processed 8940000 messages in 15
seconds.
2015-02-22 16:02:57 TestPerformanceTask [INFO] Processed 8950000 messages in 15
seconds.
2015-02-22 16:02:57 TestPerformanceTask [INFO] Processed 8960000 messages in 15
seconds.
2015-02-22 16:02:57 TestPerformanceTask [INFO] Processed 8970000 messages in 15
seconds.
2015-02-22 16:02:57 TestPerformanceTask [INFO] Processed 8980000 messages in 15
seconds.
2015-02-22 16:02:57 TestPerformanceTask [INFO] Processed 8990000 messages in 15
seconds.
2015-02-22 16:02:57 TestPerformanceTask [INFO] Processed 9000000 messages in 15
seconds.
2015-02-22 16:02:57 TestPerformanceTask [INFO] Processed 9010000 messages in 15
seconds.
2015-02-22 16:02:57 TestPerformanceTask [INFO] Processed 9020000 messages in 15
seconds.
2015-02-22 16:02:57 TestPerformanceTask [INFO] Processed 9030000 messages in 15
seconds.
2015-02-22 16:02:57 TestPerformanceTask [INFO] Processed 9040000 messages in 15
seconds.
2015-02-22 16:02:57 TestPerformanceTask [INFO] Processed 9050000 messages in 15
seconds.
2015-02-22 16:02:57 TestPerformanceTask [INFO] Processed 9060000 messages in 15
seconds.
2015-02-22 16:02:57 TestPerformanceTask [INFO] Processed 9070000 messages in 15
seconds.
2015-02-22 16:02:57 TestPerformanceTask [INFO] Processed 9080000 messages in 15
seconds.
2015-02-22 16:02:57 TestPerformanceTask [INFO] Processed 9090000 messages in 15
seconds.
2015-02-22 16:02:57 TestPerformanceTask [INFO] Processed 9100000 messages in 15
seconds.
2015-02-22 16:02:57 TestPerformanceTask [INFO] Processed 9110000 messages in 15
seconds.
2015-02-22 16:02:57 TestPerformanceTask [INFO] Processed 9120000 messages in 15
seconds.
2015-02-22 16:02:57 TestPerformanceTask [INFO] Processed 9130000 messages in 15
seconds.
2015-02-22 16:02:57 TestPerformanceTask [INFO] Processed 9140000 messages in 15
seconds.
2015-02-22 16:02:57 TestPerformanceTask [INFO] Processed 9150000 messages in 15
seconds.
2015-02-22 16:02:57 TestPerformanceTask [INFO] Processed 9160000 messages in 15
seconds.
2015-02-22 16:02:57 TestPerformanceTask [INFO] Processed 9170000 messages in 15
seconds.
2015-02-22 16:02:57 TestPerformanceTask [INFO] Processed 9180000 messages in 15
seconds.
2015-02-22 16:02:57 TestPerformanceTask [INFO] Processed 9190000 messages in 15
seconds.
2015-02-22 16:02:57 TestPerformanceTask [INFO] Processed 9200000 messages in 15
seconds.
2015-02-22 16:02:57 TestPerformanceTask [INFO] Processed 9210000 messages in 15
seconds.
2015-02-22 16:02:57 TestPerformanceTask [INFO] Processed 9220000 messages in 15
seconds.
2015-02-22 16:02:57 TestPerformanceTask [INFO] Processed 9230000 messages in 15
seconds.
2015-02-22 16:02:57 TestPerformanceTask [INFO] Processed 9240000 messages in 15
seconds.
2015-02-22 16:02:57 TestPerformanceTask [INFO] Processed 9250000 messages in 15
seconds.
2015-02-22 16:02:57 TestPerformanceTask [INFO] Processed 9260000 messages in 15
seconds.
2015-02-22 16:02:57 TestPerformanceTask [INFO] Processed 9270000 messages in 15
seconds.
2015-02-22 16:02:57 TestPerformanceTask [INFO] Processed 9280000 messages in 15
seconds.
2015-02-22 16:02:57 TestPerformanceTask [INFO] Processed 9290000 messages in 15
seconds.
2015-02-22 16:02:57 TestPerformanceTask [INFO] Processed 9300000 messages in 16
seconds.
{noformat}
It used to go a bit more than 1 million messages/sec on the same laptop with
the same test. We've likely regressed a bit over time.
I didn't mess with tuning this test at all. It's a direct port from the JUnit
test to Zopkio, that's all. See SAMZA-544 for details.
> Add performance test for container Kafka performance
> ----------------------------------------------------
>
> Key: SAMZA-548
> URL: https://issues.apache.org/jira/browse/SAMZA-548
> Project: Samza
> Issue Type: Bug
> Components: kafka, test
> Affects Versions: 0.9.0
> Reporter: Chris Riccomini
> Assignee: Chris Riccomini
> Fix For: 0.9.0
>
> Attachments: SAMZA-548-0.patch, SAMZA-548-1.patch, SAMZA-548-2.patch
>
>
> There was [some
> discussion|http://mail-archives.apache.org/mod_mbox/samza-dev/201502.mbox/%3CCANFmfeNfdGCRsj66-76prLy%3DreK7_q3bfKLNP5iKfX7G1X2sNg%40mail.gmail.com%3E]
> on the mailing list about Samza's read/write performance with Kafka. We
> don't currently have a performance test that measures a Samza container's
> read/write performance when using Kafka. We should write one.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
