RE: Storm 1.0.0 Windowing by id

[Filipa Duarte]

Arun,

 

I am clarified. 

Thank you very much!


Filipa

 

From: Arun Iyer [mailto:ai...@hortonworks.com] On Behalf Of Arun Mahadevan
Sent: 4 de abril de 2016 09:30
To: user@storm.apache.org
Subject: Re: Storm 1.0.0 Windowing by id

 

Filipa,

 

You should do the grouping within the bolt execute method, which will have all 
tuples of all ids. 

 

Fields grouping is something you can do on top of this if you want to spread 
out (scale) the operation to multiple bolts and you want to receive tuples with 
same id in the same bolt.

 

- Arun

 

 

From: Filipa Duarte
Reply-To: "user@storm.apache.org <mailto:user@storm.apache.org> "
Date: Monday, April 4, 2016 at 1:53 PM
To: "user@storm.apache.org <mailto:user@storm.apache.org> "
Subject: RE: Storm 1.0.0 Windowing by id 

 

Hello,

 

Florin, Arun, thank you for your answers.

I’m afraid streams are not what I am looking for. I do not know in advance 
which ids I will have in the system. Imagine this ids as users registered in 
the system, for example.

 

Arun, by id based grouping do you mean fields grouping? Or do you mean I should 
do the grouping myself within the bolt execute method, which will have all 
tuples of all ids?

 

Thank you!


Filipa

 

From: Arun Iyer [mailto:ai...@hortonworks.com] On Behalf Of Arun Mahadevan
Sent: 2 de abril de 2016 20:33
To: user@storm.apache.org <mailto:user@storm.apache.org> 
Subject: Re: Storm 1.0.0 Windowing by id 

 

Hi Filipa,

 

Yes, you could have a separate stream per id and have a separate windowed bolt 
subscribe to the corresponding stream.

 

The other option is to do the id based grouping  within the windowed bolt each 
time its "execute" method is triggered with the tuples in the current window.

 

Thanks,

Arun

 

From: Filipa Duarte
Reply-To: "user@storm.apache.org <mailto:user@storm.apache.org> "
Date: Friday, April 1, 2016 at 10:47 PM
To: "user@storm.apache.org <mailto:user@storm.apache.org> "
Subject: Storm 1.0.0 Windowing by id 

 

Hi!

 

With regard to the new windowing features of Storm 1.0.0, is it possible to 
group the windows by  id, so that the events coming from different clients are 
processed by different windows?

Thank you.


Regards,

Filipa

 

Re: Storm 1.0.0 Windowing by id

[Arun Mahadevan]

Filipa,

You should do the grouping within the bolt execute method, which will have all 
tuples of all ids. 

Fields grouping is something you can do on top of this if you want to spread 
out (scale) the operation to multiple bolts and you want to receive tuples with 
same id in the same bolt.

- Arun


From:  Filipa Duarte
Reply-To:  "user@storm.apache.org"
Date:  Monday, April 4, 2016 at 1:53 PM
To:  "user@storm.apache.org"
Subject:  RE: Storm 1.0.0 Windowing by id 

Hello,

 

Florin, Arun, thank you for your answers.

I’m afraid streams are not what I am looking for. I do not know in advance 
which ids I will have in the system. Imagine this ids as users registered in 
the system, for example.

 

Arun, by id based grouping do you mean fields grouping? Or do you mean I should 
do the grouping myself within the bolt execute method, which will have all 
tuples of all ids?

 

Thank you!


Filipa

 

From: Arun Iyer [mailto:ai...@hortonworks.com] On Behalf Of Arun Mahadevan
Sent: 2 de abril de 2016 20:33
To: user@storm.apache.org
Subject: Re: Storm 1.0.0 Windowing by id 

 

Hi Filipa,

 

Yes, you could have a separate stream per id and have a separate windowed bolt 
subscribe to the corresponding stream.

 

The other option is to do the id based grouping  within the windowed bolt each 
time its "execute" method is triggered with the tuples in the current window.

 

Thanks,

Arun

 

From: Filipa Duarte
Reply-To: "user@storm.apache.org"
Date: Friday, April 1, 2016 at 10:47 PM
To: "user@storm.apache.org"
Subject: Storm 1.0.0 Windowing by id 

 

Hi!

 

With regard to the new windowing features of Storm 1.0.0, is it possible to 
group the windows by  id, so that the events coming from different clients are 
processed by different windows?

Thank you.


Regards,

Filipa

 

RE: Storm 1.0.0 Windowing by id

[Filipa Duarte]

Hello,

 

Florin, Arun, thank you for your answers.

I’m afraid streams are not what I am looking for. I do not know in advance 
which ids I will have in the system. Imagine this ids as users registered in 
the system, for example.

 

Arun, by id based grouping do you mean fields grouping? Or do you mean I should 
do the grouping myself within the bolt execute method, which will have all 
tuples of all ids?

 

Thank you!


Filipa

 

From: Arun Iyer [mailto:ai...@hortonworks.com] On Behalf Of Arun Mahadevan
Sent: 2 de abril de 2016 20:33
To: user@storm.apache.org
Subject: Re: Storm 1.0.0 Windowing by id 

 

Hi Filipa,

 

Yes, you could have a separate stream per id and have a separate windowed bolt 
subscribe to the corresponding stream.

 

The other option is to do the id based grouping  within the windowed bolt each 
time its "execute" method is triggered with the tuples in the current window.

 

Thanks,

Arun

 

From: Filipa Duarte
Reply-To: "user@storm.apache.org <mailto:user@storm.apache.org> "
Date: Friday, April 1, 2016 at 10:47 PM
To: "user@storm.apache.org <mailto:user@storm.apache.org> "
Subject: Storm 1.0.0 Windowing by id 

 

Hi!

 

With regard to the new windowing features of Storm 1.0.0, is it possible to 
group the windows by  id, so that the events coming from different clients are 
processed by different windows?

Thank you.


Regards,

Filipa

 

Re: Storm 1.0.0 Windowing by id

[Arun Mahadevan]

Hi Filipa,

Yes, you could have a separate stream per id and have a separate windowed bolt 
subscribe to the corresponding stream.

The other option is to do the id based grouping  within the windowed bolt each 
time its "execute" method is triggered with the tuples in the current window.

Thanks,
Arun

From:  Filipa Duarte
Reply-To:  "user@storm.apache.org"
Date:  Friday, April 1, 2016 at 10:47 PM
To:  "user@storm.apache.org"
Subject:  Storm 1.0.0 Windowing by id 

Hi!

 

With regard to the new windowing features of Storm 1.0.0, is it possible to 
group the windows by  id, so that the events coming from different clients are 
processed by different windows?

Thank you.


Regards,

Filipa

 

Re: Storm 1.0.0 Windowing by id

[Spico Florin]

Hi!
   Depending what do you mean by and if that Id is part of the tuple. If
you use for example different stream id for your clients, the answer for
this post

https://community.hortonworks.com/questions/24068/storm-window-support-for-streams.html

 gave the idea that you have different windows for each streamId.
  I hope that it helps.
  Regards,
 Florin



On Fri, Apr 1, 2016 at 8:17 PM, Filipa Duarte 
wrote:

> Hi!
>
>
>
> With regard to the new windowing features of Storm 1.0.0, is it possible
> to group the windows by  id, so that the events coming from different
> clients are processed by different windows?
>
> Thank you.
>
>
> Regards,
>
> Filipa
>
>
>

Storm 1.0.0 Windowing by id

[Filipa Duarte]

Hi!

 

With regard to the new windowing features of Storm 1.0.0, is it possible to
group the windows by  id, so that the events coming from different clients
are processed by different windows?

Thank you.


Regards,

Filipa