Re: Nexmark ratelimiting not working

2021-01-07 Thread Andrew Pilloud
It looks like the 'isRateLimited' flag was used on these tests inside
google ~5 years ago, but I don't think we've ever used it in Beam. I don't
believe there are any tests so it doesn't really surprise me that it is
broken.

The configs we normally run nexmark on Flink with are here:
https://github.com/apache/beam/blob/master/.test-infra/jenkins/job_PostCommit_Java_Nexmark_Flink.groovy

On Thu, Jan 7, 2021 at 6:36 AM Teodor Spæren 
wrote:

> Hello and happy new years!
>
> I've been trying to use Nexmark for evaluating some performance
> improvements I've made to Beam. I've discovered a problem where Nexmark
> won't work if you enable the ratelimiting mode. I've filled out a bug
> report for this[1].
>
> To reproduce the problem is easy, simply run the normal nexmark suite
> with ratelimiting mode enable and see that the number of results you get
> is way lower than it should be.
>
> I've reached the limit of what I'm able to debug. Is this reproducible
> for anyone else and does anyone have a clue about why this might happen?
>
> Any help is very much appreciated!
>
> Teodor
>
> [1]: https://issues.apache.org/jira/browse/BEAM-11547
>


Nexmark ratelimiting not working

2021-01-07 Thread Teodor Spæren

Hello and happy new years!

I've been trying to use Nexmark for evaluating some performance 
improvements I've made to Beam. I've discovered a problem where Nexmark 
won't work if you enable the ratelimiting mode. I've filled out a bug 
report for this[1].


To reproduce the problem is easy, simply run the normal nexmark suite 
with ratelimiting mode enable and see that the number of results you get 
is way lower than it should be.


I've reached the limit of what I'm able to debug. Is this reproducible 
for anyone else and does anyone have a clue about why this might happen?


Any help is very much appreciated!

Teodor

[1]: https://issues.apache.org/jira/browse/BEAM-11547