[ 
https://issues.apache.org/jira/browse/FLINK-1710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14366933#comment-14366933
 ] 

Aljoscha Krettek commented on FLINK-1710:
-----------------------------------------

It is executed on the same data sets as the other tests. The problem is, that 
the expressions are compiled to byte code at runtime, this takes time.

For these short tests, where the data size is very small we notice the 
additional compilation overhead. For real jobs there is no difference in 
runtime. I ran tests for that.

> Expression API Tests take very long
> -----------------------------------
>
>                 Key: FLINK-1710
>                 URL: https://issues.apache.org/jira/browse/FLINK-1710
>             Project: Flink
>          Issue Type: Bug
>          Components: Expression API
>    Affects Versions: 0.9
>            Reporter: Stephan Ewen
>            Assignee: Aljoscha Krettek
>             Fix For: 0.9
>
>
> The tests of the Expression API take an immense amount of time, compared to 
> the other API tests.
> Is that because they execute on large (generated) data sets, because the 
> program compilation overhead is high, or because there is an inefficiency in 
> the execution still?
> Running org.apache.flink.api.scala.expressions.AggregationsITCase
> Running org.apache.flink.api.scala.expressions.SelectITCase
> Running org.apache.flink.api.scala.expressions.AsITCase
> Running org.apache.flink.api.scala.expressions.StringExpressionsITCase
> Running org.apache.flink.api.scala.expressions.CastingITCase
> Running org.apache.flink.api.scala.expressions.JoinITCase
> Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 34.652 sec - 
> in org.apache.flink.api.scala.expressions.AsITCase
> Running org.apache.flink.api.scala.expressions.GroupedAggreagationsITCase
> Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 55.797 sec - 
> in org.apache.flink.api.scala.expressions.StringExpressionsITCase
> Running org.apache.flink.api.scala.expressions.PageRankExpressionITCase
> Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 63.072 sec - 
> in org.apache.flink.api.scala.expressions.SelectITCase
> Running org.apache.flink.api.scala.expressions.ExpressionsITCase
> Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 65.628 sec - 
> in org.apache.flink.api.scala.expressions.CastingITCase
> Running org.apache.flink.api.scala.expressions.FilterITCase
> Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 74.174 sec - 
> in org.apache.flink.api.scala.expressions.AggregationsITCase
> Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 93.878 sec - 
> in org.apache.flink.api.scala.expressions.JoinITCase
> Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 63.4 sec - in 
> org.apache.flink.api.scala.expressions.GroupedAggreagationsITCase
> Tests run: 12, Failures: 0, Errors: 0, Skipped: 4, Time elapsed: 44.179 sec - 
> in org.apache.flink.api.scala.expressions.FilterITCase
> Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 53.801 sec - 
> in org.apache.flink.api.scala.expressions.ExpressionsITCase
> Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 124.365 sec - 
> in org.apache.flink.api.scala.expressions.PageRankExpressionITCase



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to