Introducing Sachith Withana

[Sachith Withana]

Hi All,

I'm Sachith Withana, a 3rd year undergrad at University of Moratuwa, Sri
Lanka studying Computer Science and Engineering. Currently I'm working on
my internship at UITS, Indiana University on the Apache Airavata project.

I'm really interested in the Apache Kafka project and I'd love to
contribute. I'm considering to take on Distributed Computing as my area of
research for post graduate studies and I know that contributing to Apache
Kafka would help me a learn a lot.

I went through the documentation and successfully completed the examples
given. I'm getting into the code now.

How would you recommend a newbie like me should proceed in contributing to
the project while getting to know the code?

Any help is appreciated.

-- 
Thanks,
Sachith Withana

[jira] [Updated] (KAFKA-1196) java.lang.IllegalArgumentException Buffer.limit on FetchResponse.scala + 33

[Gerrit Jansen van Vuuren (JIRA)]

 [ 
https://issues.apache.org/jira/browse/KAFKA-1196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Gerrit Jansen van Vuuren updated KAFKA-1196:


   Priority: Blocker  (was: Major)
Description: 
I have 6 topics each with 8 partitions spread over 4 kafka servers.
the servers are 24 core 72 gig ram.

While consuming from the topics I get an IlegalArgumentException and all 
consumption stops, the error keeps on throwing.

I've tracked it down to FectchResponse.scala line 33

The error happens when the FetchResponsePartitionData object's readFrom method 
calls:
messageSetBuffer.limit(messageSetSize)

I put in some debug code the the messageSetSize is 671758648, while the 
buffer.capacity() gives 155733313, for some reason the buffer is smaller than 
the required message size.

I don't know the consumer code enough to debug this. It doesn't matter if 
compression is used or not.






  was:
I have 6 topics each with 8 partitions spread over 4 kafka servers.
the servers are 24 core 72 gig ram.

While consuming from the topics I get an IlegalArgumentException and all 
consumption stops, the error keeps on throwing.

I've tracked it down to FectchResponse.scala line 33

The error happens when the FetchResponsePartitionData object's readFrom method 
calls:
messageSetBuffer.limit(messageSetSize)

I put in some debug code the the messageSetSize is 671758648, while the 
buffer.capacity() gives 155733313, for some reason the buffer is smaller than 
the required message size.

I don't know the consumer code enough to debug this, but I've turned off 
compression on my producers and now I do not seem to get this message anymore.




> java.lang.IllegalArgumentException Buffer.limit on FetchResponse.scala + 33
> ---
>
> Key: KAFKA-1196
> URL: https://issues.apache.org/jira/browse/KAFKA-1196
> Project: Kafka
>  Issue Type: Bug
>  Components: consumer
>Affects Versions: 0.8.0
> Environment: running java 1.7, linux and kafka compiled against scala 
> 2.9.2
>Reporter: Gerrit Jansen van Vuuren
>Assignee: Neha Narkhede
>Priority: Blocker
>
> I have 6 topics each with 8 partitions spread over 4 kafka servers.
> the servers are 24 core 72 gig ram.
> While consuming from the topics I get an IlegalArgumentException and all 
> consumption stops, the error keeps on throwing.
> I've tracked it down to FectchResponse.scala line 33
> The error happens when the FetchResponsePartitionData object's readFrom 
> method calls:
> messageSetBuffer.limit(messageSetSize)
> I put in some debug code the the messageSetSize is 671758648, while the 
> buffer.capacity() gives 155733313, for some reason the buffer is smaller than 
> the required message size.
> I don't know the consumer code enough to debug this. It doesn't matter if 
> compression is used or not.



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)