Re: Anyone working on a Kafka book?

2013-12-13 Thread Steve Morin
Shafaq, That's pretty cool, have you already connected Kafka to spark RRD/DStream or is that something you have to figure out? -Steve On Tue, Dec 10, 2013 at 7:10 PM, Shafaq s.abdullah...@gmail.com wrote: Hi Steve, The first phase would be pretty simple, essentially hooking up the

Re: Anyone working on a Kafka book?

2013-12-13 Thread Shafaq
Thats already done. On Dec 13, 2013 9:28 AM, Steve Morin st...@stevemorin.com wrote: Shafaq, That's pretty cool, have you already connected Kafka to spark RRD/DStream or is that something you have to figure out? -Steve On Tue, Dec 10, 2013 at 7:10 PM, Shafaq s.abdullah...@gmail.com

Re: Anyone working on a Kafka book?

2013-12-13 Thread Steve Morin
Would you mind sharing your connection setup? On Dec 13, 2013, at 10:36, Shafaq s.abdullah...@gmail.com wrote: Thats already done. On Dec 13, 2013 9:28 AM, Steve Morin st...@stevemorin.com wrote: Shafaq, That's pretty cool, have you already connected Kafka to spark RRD/DStream or is

Re: Anyone working on a Kafka book?

2013-12-10 Thread S Ahmed
Is there a book or this was just an idea? On Mon, Mar 25, 2013 at 12:42 PM, Chris Curtin curtin.ch...@gmail.comwrote: Thanks Jun, I've updated the example with this information. I've also removed some of the unnecessary newlines. Thanks, Chris On Mon, Mar 25, 2013 at 12:04 PM, Jun

Re: Anyone working on a Kafka book?

2013-12-10 Thread Steve Morin
I forget but think Chetan was with oreilly On Dec 10, 2013, at 7:01, S Ahmed sahmed1...@gmail.com wrote: Is there a book or this was just an idea? On Mon, Mar 25, 2013 at 12:42 PM, Chris Curtin curtin.ch...@gmail.comwrote: Thanks Jun, I've updated the example with this information.

Re: Anyone working on a Kafka book?

2013-12-10 Thread Steve Morin
I'll let chetan comment if he's up for it. -Steve On Tue, Dec 10, 2013 at 8:40 AM, David Arthur mum...@gmail.com wrote: There was some talk a few months ago, not sure what the current status is. On 12/10/13 10:01 AM, S Ahmed wrote: Is there a book or this was just an idea? On Mon, Mar

Re: Anyone working on a Kafka book?

2013-12-10 Thread chetan conikee
Hey Guys Yes, Ben Lorica (Oreilly) and I are planning to pen a Beginning Kafka book. We only finalized this late October are hoping to start this mid-month Chetan On Tue, Dec 10, 2013 at 8:45 AM, Steve Morin st...@stevemorin.com wrote: I'll let chetan comment if he's up for it. -Steve

Re: Anyone working on a Kafka book?

2013-12-10 Thread S Ahmed
Great, so its not even at MEAP stage then :(, let me guess, it is going to take 6 months to decide on what animal to put on the cover! :) Looking forward to in though! On Tue, Dec 10, 2013 at 12:15 PM, chetan conikee coni...@gmail.com wrote: Hey Guys Yes, Ben Lorica (Oreilly) and I are

Re: Anyone working on a Kafka book?

2013-12-10 Thread Shafaq
Hey Guys, I would love to contribute to the book specially in the portion of Kafka-Spark integration or parts of kafka in general. Am building a Kafka-Spark Real-time framework here at Gree Intl Inc processing order of MBs of data per second. My profile:

Re: Anyone working on a Kafka book?

2013-12-10 Thread Steve Morin
Shafaq, What does the architecture of what your building look like? -Steve On Tue, Dec 10, 2013 at 10:19 AM, Shafaq s.abdullah...@gmail.com wrote: Hey Guys, I would love to contribute to the book specially in the portion of Kafka-Spark integration or parts of kafka in general. Am

Re: Anyone working on a Kafka book?

2013-12-10 Thread Shafaq
Hi Steve, The first phase would be pretty simple, essentially hooking up the Kafka-DStream-consumer to perform KPI aggregation over the streamed data from Kafka Broker cluster in real-time. We would like to maximize the throughput by choosing the right message payload size, correct kafka

Re: Anyone working on a Kafka book?

2013-03-25 Thread Chris Curtin
Thanks for finding those. Looks like a copy and paste issue. I've updated the document. Thanks, Chris On Sat, Mar 23, 2013 at 11:27 AM, Jonathan Hodges hodg...@gmail.com wrote: Many thanks for contributing! The docs are very helpful. I found a couple small possible typos. The

Re: Anyone working on a Kafka book?

2013-03-25 Thread Jun Rao
Chris, This looks good. One thing about partitioning. Currently, if a message doesn't have a key, we always use the random partitioner (regardless of what partitioner.class is set to). Thanks, Jun On Thu, Mar 21, 2013 at 11:42 AM, Chris Curtin curtin.ch...@gmail.comwrote: I published my

Re: Anyone working on a Kafka book?

2013-03-23 Thread Jonathan Hodges
Many thanks for contributing! The docs are very helpful. I found a couple small possible typos. The partitioning code example looks like it repeats at the bottom with duplicate import and class definition statements. Also the create topic command-line appears to have an extra '-' for the

Re: Anyone working on a Kafka book?

2013-03-20 Thread Chris Curtin
Okay, how do we do this logistically? I've take the Producer code that I wrote for testing purposes and wrote a description around it. How do I get it to you guys? Simple Consumer is going to take a little longer since my test Consumers are non-trivial and I'll need to simplify them. Thanks,

Re: Anyone working on a Kafka book?

2013-03-19 Thread Jun Rao
to make sure no one else was working on a book. No sense in producing competing texts at this point. So, anyone working on a Kafka book? Self published or otherwise? -David

Re: Anyone working on a Kafka book?

2013-03-19 Thread S Ahmed
was working on a book. No sense in producing competing texts at this point. So, anyone working on a Kafka book? Self published or otherwise? -David

Re: Anyone working on a Kafka book?

2013-03-19 Thread Chris Curtin
to do a book on Kafka - something I've actually thought about pursuing. Before I say yes (or consider saying yes), I wanted to make sure no one else was working on a book. No sense in producing competing texts at this point. So, anyone working on a Kafka book? Self published or otherwise