Re: [Gelly] Help with GSA compiler tests

2015-07-15 Thread Stephan Ewen
Lady Kalamari, The plan looks good. To test whether the data is partitioned there: If you have the optimizer plan, make sure the global properties have a partitioning property of "PATITIONED_HASH". Thanks, Stephan On Wed, Jul 15, 2015 at 2:07 PM, Vasiliki Kalavri wrote: > Hi, > > thank you S

Re: [Gelly] Help with GSA compiler tests

2015-07-15 Thread Vasiliki Kalavri
Hi, thank you Stephan! Here's the missing part of the plan: http://i.imgur.com/N861tg1.png There is one hash partition / sort. Is this what you're talking about? Regarding your second point, how can I test if the data is known to be partitioned at the end? -Vasia. On 15 July 2015 at 13:13, St

Re: [Gelly] Help with GSA compiler tests

2015-07-15 Thread Stephan Ewen
Hey Vasia! Sorry for the late response... Thanks for pinging again! The optimizer is acting a little funky here - seems an artifact of the "properties" optimization. -> The initial join needs to be partitioned and sorted. Can you check whether one partitioning and sorting happens before the it

Re: [Gelly] Help with GSA compiler tests

2015-07-15 Thread Vasiliki Kalavri
Hey, any input on this? or a hint? or where to look to figure this out by myself? Thanks! -Vasia. On 7 July 2015 at 15:20, Vasiliki Kalavri wrote: > Hello to my squirrels, > > I've started looking into FLINK-1943 > and I need some help > to un

[Gelly] Help with GSA compiler tests

2015-07-07 Thread Vasiliki Kalavri
Hello to my squirrels, I've started looking into FLINK-1943 and I need some help to understand what to test and how to do it properly. In the corresponding Spargel compiler test, the following functionality is checked: 1. sink: the ship strategy