Re: batch processing in storm

2016-09-18 Thread Olivier Mallassi 
you may look at trident
http://storm.apache.org/releases/1.0.1/Trident-tutorial.html which, built
on storm,supports micro-batch

On Sun, Sep 18, 2016 at 3:20 PM, Shushant Arora 
wrote:

> yes, mini batch of say 15 minutes kafka data.
>
> On Sun, Sep 18, 2016 at 3:18 PM, darion.yaphet  wrote:
>
>> Storm is a stream process system and use to process message one by one .
>>
>> I'm not very sure understood which you mean . Do you want to process a
>> mini batch such as spark streaming ?
>>
>>
>> At 2016-09-15 02:06:41, "Shushant Arora" 
>> wrote:
>>
>> Hi
>>
>> Is storm a right fit for batch processing - say every 10 min data from
>> kafka source.
>> does we need to right separate code for storm stream vs batch application
>> ?
>>
>> Thanks
>>
>>
>>
>>
>>
>
>

Re: batch processing in storm

2016-09-18 Thread Shushant Arora 
yes, mini batch of say 15 minutes kafka data.

On Sun, Sep 18, 2016 at 3:18 PM, darion.yaphet  wrote:

> Storm is a stream process system and use to process message one by one .
>
> I'm not very sure understood which you mean . Do you want to process a
> mini batch such as spark streaming ?
>
>
> At 2016-09-15 02:06:41, "Shushant Arora" 
> wrote:
>
> Hi
>
> Is storm a right fit for batch processing - say every 10 min data from
> kafka source.
> does we need to right separate code for storm stream vs batch application ?
>
> Thanks
>
>
>
>
>