[jira] [Commented] (KAFKA-1718) "Message Size Too Large" error when only small messages produced with Snappy

2016-03-29 Thread Swapnesh Gandhi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15217246#comment-15217246 ] Swapnesh Gandhi commented on KAFKA-1718: I am seeing the same issue, is this comp

[jira] [Commented] (KAFKA-1718) "Message Size Too Large" error when only small messages produced with Snappy

2015-02-08 Thread Evan Huus (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14311387#comment-14311387 ] Evan Huus commented on KAFKA-1718: -- [~guozhang], [~jkreps] my understanding is that while

[jira] [Commented] (KAFKA-1718) "Message Size Too Large" error when only small messages produced with Snappy

2015-02-07 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14311141#comment-14311141 ] Guozhang Wang commented on KAFKA-1718: -- [~jkreps] I think the conclusion is that this

[jira] [Commented] (KAFKA-1718) "Message Size Too Large" error when only small messages produced with Snappy

2015-02-07 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14310958#comment-14310958 ] Jay Kreps commented on KAFKA-1718: -- [~junrao], [~guozhang] is this still ongoing? > "Mes

[jira] [Commented] (KAFKA-1718) "Message Size Too Large" error when only small messages produced with Snappy

2014-10-23 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14181470#comment-14181470 ] Jun Rao commented on KAFKA-1718: Evan, Thanks for updating the wiki. The MagicByte curren

[jira] [Commented] (KAFKA-1718) "Message Size Too Large" error when only small messages produced with Snappy

2014-10-23 Thread Evan Huus (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14181348#comment-14181348 ] Evan Huus commented on KAFKA-1718: -- [~junrao] I already have wiki permissions, so I made

[jira] [Commented] (KAFKA-1718) "Message Size Too Large" error when only small messages produced with Snappy

2014-10-22 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14180856#comment-14180856 ] Jun Rao commented on KAFKA-1718: [~guozhang], removing the max message size may be a bigge

[jira] [Commented] (KAFKA-1718) "Message Size Too Large" error when only small messages produced with Snappy

2014-10-22 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14180763#comment-14180763 ] Guozhang Wang commented on KAFKA-1718: -- Yes, that is what I was thinking about. > "M

[jira] [Commented] (KAFKA-1718) "Message Size Too Large" error when only small messages produced with Snappy

2014-10-22 Thread Evan Huus (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14180126#comment-14180126 ] Evan Huus commented on KAFKA-1718: -- ??when it gets a partial message from the broker it w

[jira] [Commented] (KAFKA-1718) "Message Size Too Large" error when only small messages produced with Snappy

2014-10-22 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14180033#comment-14180033 ] Guozhang Wang commented on KAFKA-1718: -- Since the reason we add the "max.message.size

[jira] [Commented] (KAFKA-1718) "Message Size Too Large" error when only small messages produced with Snappy

2014-10-21 Thread Evan Huus (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14179485#comment-14179485 ] Evan Huus commented on KAFKA-1718: -- ??I guess your go producer can send multiple compress

[jira] [Commented] (KAFKA-1718) "Message Size Too Large" error when only small messages produced with Snappy

2014-10-21 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14179472#comment-14179472 ] Jun Rao commented on KAFKA-1718: Yes, the broker does recompress all messages in the messa

[jira] [Commented] (KAFKA-1718) "Message Size Too Large" error when only small messages produced with Snappy

2014-10-21 Thread Wojciech Kuranowski (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14178796#comment-14178796 ] Wojciech Kuranowski commented on KAFKA-1718: My test is almost the same as in

[jira] [Commented] (KAFKA-1718) "Message Size Too Large" error when only small messages produced with Snappy

2014-10-21 Thread Sriharsha Chintalapani (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14178737#comment-14178737 ] Sriharsha Chintalapani commented on KAFKA-1718: --- [~noxis] can you share your

[jira] [Commented] (KAFKA-1718) "Message Size Too Large" error when only small messages produced with Snappy

2014-10-21 Thread Sriharsha Chintalapani (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14178519#comment-14178519 ] Sriharsha Chintalapani commented on KAFKA-1718: --- I ran sizeInBytes for "test

[jira] [Commented] (KAFKA-1718) "Message Size Too Large" error when only small messages produced with Snappy

2014-10-21 Thread Wojciech Kuranowski (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14178396#comment-14178396 ] Wojciech Kuranowski commented on KAFKA-1718: I have compiled kafka 0.8.2 with

[jira] [Commented] (KAFKA-1718) "Message Size Too Large" error when only small messages produced with Snappy

2014-10-20 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14177558#comment-14177558 ] Jun Rao commented on KAFKA-1718: In trunk, we actually do a size check before and after re

[jira] [Commented] (KAFKA-1718) "Message Size Too Large" error when only small messages produced with Snappy

2014-10-20 Thread Evan Huus (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14177487#comment-14177487 ] Evan Huus commented on KAFKA-1718: -- That sounds plausible. 1. How do I verify if that is

[jira] [Commented] (KAFKA-1718) "Message Size Too Large" error when only small messages produced with Snappy

2014-10-20 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14177478#comment-14177478 ] Jun Rao commented on KAFKA-1718: Another thing that we do on the broker is to assign a new

[jira] [Commented] (KAFKA-1718) "Message Size Too Large" error when only small messages produced with Snappy

2014-10-20 Thread Evan Huus (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14177351#comment-14177351 ] Evan Huus commented on KAFKA-1718: -- The numbers I put in my original report do take all o

[jira] [Commented] (KAFKA-1718) "Message Size Too Large" error when only small messages produced with Snappy

2014-10-20 Thread Sriharsha Chintalapani (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14177324#comment-14177324 ] Sriharsha Chintalapani commented on KAFKA-1718: --- [~eapache] there is additio

[jira] [Commented] (KAFKA-1718) "Message Size Too Large" error when only small messages produced with Snappy

2014-10-20 Thread Evan Huus (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14177112#comment-14177112 ] Evan Huus commented on KAFKA-1718: -- LogOverhead is only 12 bytes; none of the values I pr

[jira] [Commented] (KAFKA-1718) "Message Size Too Large" error when only small messages produced with Snappy

2014-10-20 Thread Sriharsha Chintalapani (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14177107#comment-14177107 ] Sriharsha Chintalapani commented on KAFKA-1718: --- [~eapache] kafka uses ByteB