[jira] [Updated] (FLINK-22530) RuntimeException after subsequent windowed grouping in TableAPI
[
https://issues.apache.org/jira/browse/FLINK-22530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Christopher Rost updated FLINK-22530:
-
Priority: Major (was: Minor)
> RuntimeException after subsequent windowed grouping in TableAPI
> ---
>
> Key: FLINK-22530
> URL: https://issues.apache.org/jira/browse/FLINK-22530
> Project: Flink
> Issue Type: Bug
> Components: Table SQL / Planner
>Affects Versions: 1.12.0
>Reporter: Christopher Rost
>Priority: Major
>
> After applying the following using the TableAPI v 1.12.0, an error is thrown:
> {code:java}
> java.lang.RuntimeException: Error while applying rule
> StreamExecGroupWindowAggregateRule(in:LOGICAL,out:STREAM_PHYSICAL), args
> [rel#505:FlinkLogicalWindowAggregate.LOGICAL.any.None:
> 0.[NONE].[NONE](input=RelSubset#504,group={1},window=TumblingGroupWindow('w2,
> w1_rowtime, 1),properties=EXPR$1)]{code}
> The code snippet to reproduce:
> {code:java}
> Table table2 = table1
> .window(Tumble.over(lit(10).seconds()).on($(EVENT_TIME)).as("w1"))
> .groupBy($(ID), $(LABEL), $("w1"))
> .select($(ID), $(LABEL), $("w1").rowtime().as("w1_rowtime"));
> // table2.execute().print(); --> work well
> Table table3 = table2
> .window(Tumble.over(lit(10).seconds()).on($("w1_rowtime")).as("w2"))
> .groupBy($(LABEL), $("w2"))
> .select(
> $(LABEL).as("super_label"),
> lit(1).count().as("super_count"),
> $("w2").rowtime().as("w2_rowtime")
> );
> // table3.execute().print(); //--> work well
>table3.select($("super_label"), $("w2_rowtime"))
> .execute().print(); // --> throws exception
> {code}
> It seems that the alias "w1_rowtime" is no longer available for further
> usages of table3, since the cause of the exception is:
> {noformat}
> Caused by: java.lang.IllegalArgumentException: field [w1_rowtime] not found;
> input fields are: [vertex_id, vertex_label, EXPR$0
> {noformat}
> {{The complete trace:}}
> {code:java}
> java.lang.RuntimeException: Error while applying rule
> StreamExecGroupWindowAggregateRule(in:LOGICAL,out:STREAM_PHYSICAL), args
> [rel#197:FlinkLogicalWindowAggregate.LOGICAL.any.None:
> 0.[NONE].[NONE](input=RelSubset#196,group={1},window=TumblingGroupWindow('w2,
> w1_rowtime, 1),properties=EXPR$1)]at
> org.apache.calcite.plan.volcano.VolcanoRuleCall.onMatch(VolcanoRuleCall.java:256)
> at
> org.apache.calcite.plan.volcano.IterativeRuleDriver.drive(IterativeRuleDriver.java:58)
> at
> org.apache.calcite.plan.volcano.VolcanoPlanner.findBestExp(VolcanoPlanner.java:510)
> at
> org.apache.calcite.tools.Programs$RuleSetProgram.run(Programs.java:312)
> at
> org.apache.flink.table.planner.plan.optimize.program.FlinkVolcanoProgram.optimize(FlinkVolcanoProgram.scala:64)
> at
> org.apache.flink.table.planner.plan.optimize.program.FlinkChainedProgram$$anonfun$optimize$1.apply(FlinkChainedProgram.scala:62)
> at
> org.apache.flink.table.planner.plan.optimize.program.FlinkChainedProgram$$anonfun$optimize$1.apply(FlinkChainedProgram.scala:58)
> at
> scala.collection.TraversableOnce$$anonfun$foldLeft$1.apply(TraversableOnce.scala:157)
> at
> scala.collection.TraversableOnce$$anonfun$foldLeft$1.apply(TraversableOnce.scala:157)
> at scala.collection.Iterator$class.foreach(Iterator.scala:891)
> at scala.collection.AbstractIterator.foreach(Iterator.scala:1334)
> at scala.collection.IterableLike$class.foreach(IterableLike.scala:72)
> at scala.collection.AbstractIterable.foreach(Iterable.scala:54)
> at
> scala.collection.TraversableOnce$class.foldLeft(TraversableOnce.scala:157)
> at scala.collection.AbstractTraversable.foldLeft(Traversable.scala:104)
> at
> org.apache.flink.table.planner.plan.optimize.program.FlinkChainedProgram.optimize(FlinkChainedProgram.scala:57)
> at
> org.apache.flink.table.planner.plan.optimize.StreamCommonSubGraphBasedOptimizer.optimizeTree(StreamCommonSubGraphBasedOptimizer.scala:163)
> at
> org.apache.flink.table.planner.plan.optimize.StreamCommonSubGraphBasedOptimizer.doOptimize(StreamCommonSubGraphBasedOptimizer.scala:79)
> at
> org.apache.flink.table.planner.plan.optimize.CommonSubGraphBasedOptimizer.optimize(CommonSubGraphBasedOptimizer.scala:77)
> at
> org.apache.flink.table.planner.delegation.PlannerBase.optimize(PlannerBase.scala:286)
> at
> org.apache.flink.table.planner.delegation.PlannerBase.translate(PlannerBase.scala:165)
> at
> org.apache.flink.table.api.internal.TableEnvironmentImpl.translate(TableEnvironmentImpl.java:1267)
> at
> org.apache.flink.table.api.internal.TableEnvironmentImpl.executeInternal(TableEnvironmentImpl.java:703)
> at
>
[jira] [Updated] (FLINK-22530) RuntimeException after subsequent windowed grouping in TableAPI
[
https://issues.apache.org/jira/browse/FLINK-22530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Christopher Rost updated FLINK-22530:
-
Labels: (was: auto-deprioritized-major)
> RuntimeException after subsequent windowed grouping in TableAPI
> ---
>
> Key: FLINK-22530
> URL: https://issues.apache.org/jira/browse/FLINK-22530
> Project: Flink
> Issue Type: Bug
> Components: Table SQL / Planner
>Affects Versions: 1.12.0
>Reporter: Christopher Rost
>Priority: Minor
>
> After applying the following using the TableAPI v 1.12.0, an error is thrown:
> {code:java}
> java.lang.RuntimeException: Error while applying rule
> StreamExecGroupWindowAggregateRule(in:LOGICAL,out:STREAM_PHYSICAL), args
> [rel#505:FlinkLogicalWindowAggregate.LOGICAL.any.None:
> 0.[NONE].[NONE](input=RelSubset#504,group={1},window=TumblingGroupWindow('w2,
> w1_rowtime, 1),properties=EXPR$1)]{code}
> The code snippet to reproduce:
> {code:java}
> Table table2 = table1
> .window(Tumble.over(lit(10).seconds()).on($(EVENT_TIME)).as("w1"))
> .groupBy($(ID), $(LABEL), $("w1"))
> .select($(ID), $(LABEL), $("w1").rowtime().as("w1_rowtime"));
> // table2.execute().print(); --> work well
> Table table3 = table2
> .window(Tumble.over(lit(10).seconds()).on($("w1_rowtime")).as("w2"))
> .groupBy($(LABEL), $("w2"))
> .select(
> $(LABEL).as("super_label"),
> lit(1).count().as("super_count"),
> $("w2").rowtime().as("w2_rowtime")
> );
> // table3.execute().print(); //--> work well
>table3.select($("super_label"), $("w2_rowtime"))
> .execute().print(); // --> throws exception
> {code}
> It seems that the alias "w1_rowtime" is no longer available for further
> usages of table3, since the cause of the exception is:
> {noformat}
> Caused by: java.lang.IllegalArgumentException: field [w1_rowtime] not found;
> input fields are: [vertex_id, vertex_label, EXPR$0
> {noformat}
> {{The complete trace:}}
> {code:java}
> java.lang.RuntimeException: Error while applying rule
> StreamExecGroupWindowAggregateRule(in:LOGICAL,out:STREAM_PHYSICAL), args
> [rel#197:FlinkLogicalWindowAggregate.LOGICAL.any.None:
> 0.[NONE].[NONE](input=RelSubset#196,group={1},window=TumblingGroupWindow('w2,
> w1_rowtime, 1),properties=EXPR$1)]at
> org.apache.calcite.plan.volcano.VolcanoRuleCall.onMatch(VolcanoRuleCall.java:256)
> at
> org.apache.calcite.plan.volcano.IterativeRuleDriver.drive(IterativeRuleDriver.java:58)
> at
> org.apache.calcite.plan.volcano.VolcanoPlanner.findBestExp(VolcanoPlanner.java:510)
> at
> org.apache.calcite.tools.Programs$RuleSetProgram.run(Programs.java:312)
> at
> org.apache.flink.table.planner.plan.optimize.program.FlinkVolcanoProgram.optimize(FlinkVolcanoProgram.scala:64)
> at
> org.apache.flink.table.planner.plan.optimize.program.FlinkChainedProgram$$anonfun$optimize$1.apply(FlinkChainedProgram.scala:62)
> at
> org.apache.flink.table.planner.plan.optimize.program.FlinkChainedProgram$$anonfun$optimize$1.apply(FlinkChainedProgram.scala:58)
> at
> scala.collection.TraversableOnce$$anonfun$foldLeft$1.apply(TraversableOnce.scala:157)
> at
> scala.collection.TraversableOnce$$anonfun$foldLeft$1.apply(TraversableOnce.scala:157)
> at scala.collection.Iterator$class.foreach(Iterator.scala:891)
> at scala.collection.AbstractIterator.foreach(Iterator.scala:1334)
> at scala.collection.IterableLike$class.foreach(IterableLike.scala:72)
> at scala.collection.AbstractIterable.foreach(Iterable.scala:54)
> at
> scala.collection.TraversableOnce$class.foldLeft(TraversableOnce.scala:157)
> at scala.collection.AbstractTraversable.foldLeft(Traversable.scala:104)
> at
> org.apache.flink.table.planner.plan.optimize.program.FlinkChainedProgram.optimize(FlinkChainedProgram.scala:57)
> at
> org.apache.flink.table.planner.plan.optimize.StreamCommonSubGraphBasedOptimizer.optimizeTree(StreamCommonSubGraphBasedOptimizer.scala:163)
> at
> org.apache.flink.table.planner.plan.optimize.StreamCommonSubGraphBasedOptimizer.doOptimize(StreamCommonSubGraphBasedOptimizer.scala:79)
> at
> org.apache.flink.table.planner.plan.optimize.CommonSubGraphBasedOptimizer.optimize(CommonSubGraphBasedOptimizer.scala:77)
> at
> org.apache.flink.table.planner.delegation.PlannerBase.optimize(PlannerBase.scala:286)
> at
> org.apache.flink.table.planner.delegation.PlannerBase.translate(PlannerBase.scala:165)
> at
> org.apache.flink.table.api.internal.TableEnvironmentImpl.translate(TableEnvironmentImpl.java:1267)
> at
> org.apache.flink.table.api.internal.TableEnvironmentImpl.executeInternal(TableEnvironmentImpl.java:703)
> at
>
[jira] [Commented] (FLINK-22530) RuntimeException after subsequent windowed grouping in TableAPI
[
https://issues.apache.org/jira/browse/FLINK-22530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17419619#comment-17419619
]
Christopher Rost commented on FLINK-22530:
--
Hi [~twalthr] , we still have this issue. We tried the workaround you
mentioned, it doesn not solve the problem. Can you still investigate the
problem? This would be great! If I can help in some way, let me know.
> RuntimeException after subsequent windowed grouping in TableAPI
> ---
>
> Key: FLINK-22530
> URL: https://issues.apache.org/jira/browse/FLINK-22530
> Project: Flink
> Issue Type: Bug
> Components: Table SQL / Planner
>Affects Versions: 1.12.0
>Reporter: Christopher Rost
>Priority: Minor
> Labels: auto-deprioritized-major
>
> After applying the following using the TableAPI v 1.12.0, an error is thrown:
> {code:java}
> java.lang.RuntimeException: Error while applying rule
> StreamExecGroupWindowAggregateRule(in:LOGICAL,out:STREAM_PHYSICAL), args
> [rel#505:FlinkLogicalWindowAggregate.LOGICAL.any.None:
> 0.[NONE].[NONE](input=RelSubset#504,group={1},window=TumblingGroupWindow('w2,
> w1_rowtime, 1),properties=EXPR$1)]{code}
> The code snippet to reproduce:
> {code:java}
> Table table2 = table1
> .window(Tumble.over(lit(10).seconds()).on($(EVENT_TIME)).as("w1"))
> .groupBy($(ID), $(LABEL), $("w1"))
> .select($(ID), $(LABEL), $("w1").rowtime().as("w1_rowtime"));
> // table2.execute().print(); --> work well
> Table table3 = table2
> .window(Tumble.over(lit(10).seconds()).on($("w1_rowtime")).as("w2"))
> .groupBy($(LABEL), $("w2"))
> .select(
> $(LABEL).as("super_label"),
> lit(1).count().as("super_count"),
> $("w2").rowtime().as("w2_rowtime")
> );
> // table3.execute().print(); //--> work well
>table3.select($("super_label"), $("w2_rowtime"))
> .execute().print(); // --> throws exception
> {code}
> It seems that the alias "w1_rowtime" is no longer available for further
> usages of table3, since the cause of the exception is:
> {noformat}
> Caused by: java.lang.IllegalArgumentException: field [w1_rowtime] not found;
> input fields are: [vertex_id, vertex_label, EXPR$0
> {noformat}
> {{The complete trace:}}
> {code:java}
> java.lang.RuntimeException: Error while applying rule
> StreamExecGroupWindowAggregateRule(in:LOGICAL,out:STREAM_PHYSICAL), args
> [rel#197:FlinkLogicalWindowAggregate.LOGICAL.any.None:
> 0.[NONE].[NONE](input=RelSubset#196,group={1},window=TumblingGroupWindow('w2,
> w1_rowtime, 1),properties=EXPR$1)]at
> org.apache.calcite.plan.volcano.VolcanoRuleCall.onMatch(VolcanoRuleCall.java:256)
> at
> org.apache.calcite.plan.volcano.IterativeRuleDriver.drive(IterativeRuleDriver.java:58)
> at
> org.apache.calcite.plan.volcano.VolcanoPlanner.findBestExp(VolcanoPlanner.java:510)
> at
> org.apache.calcite.tools.Programs$RuleSetProgram.run(Programs.java:312)
> at
> org.apache.flink.table.planner.plan.optimize.program.FlinkVolcanoProgram.optimize(FlinkVolcanoProgram.scala:64)
> at
> org.apache.flink.table.planner.plan.optimize.program.FlinkChainedProgram$$anonfun$optimize$1.apply(FlinkChainedProgram.scala:62)
> at
> org.apache.flink.table.planner.plan.optimize.program.FlinkChainedProgram$$anonfun$optimize$1.apply(FlinkChainedProgram.scala:58)
> at
> scala.collection.TraversableOnce$$anonfun$foldLeft$1.apply(TraversableOnce.scala:157)
> at
> scala.collection.TraversableOnce$$anonfun$foldLeft$1.apply(TraversableOnce.scala:157)
> at scala.collection.Iterator$class.foreach(Iterator.scala:891)
> at scala.collection.AbstractIterator.foreach(Iterator.scala:1334)
> at scala.collection.IterableLike$class.foreach(IterableLike.scala:72)
> at scala.collection.AbstractIterable.foreach(Iterable.scala:54)
> at
> scala.collection.TraversableOnce$class.foldLeft(TraversableOnce.scala:157)
> at scala.collection.AbstractTraversable.foldLeft(Traversable.scala:104)
> at
> org.apache.flink.table.planner.plan.optimize.program.FlinkChainedProgram.optimize(FlinkChainedProgram.scala:57)
> at
> org.apache.flink.table.planner.plan.optimize.StreamCommonSubGraphBasedOptimizer.optimizeTree(StreamCommonSubGraphBasedOptimizer.scala:163)
> at
> org.apache.flink.table.planner.plan.optimize.StreamCommonSubGraphBasedOptimizer.doOptimize(StreamCommonSubGraphBasedOptimizer.scala:79)
> at
> org.apache.flink.table.planner.plan.optimize.CommonSubGraphBasedOptimizer.optimize(CommonSubGraphBasedOptimizer.scala:77)
> at
> org.apache.flink.table.planner.delegation.PlannerBase.optimize(PlannerBase.scala:286)
> at
> org.apache.flink.table.planner.delegation.PlannerBase.translate(PlannerBase.scala:165)
>
[jira] [Commented] (FLINK-22530) RuntimeException after subsequent windowed grouping in TableAPI
[
https://issues.apache.org/jira/browse/FLINK-22530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17360630#comment-17360630
]
Christopher Rost commented on FLINK-22530:
--
Hi, I still really looking forward to a fix of this Bug. Are there any new
ideas? I can also try to fix it but it is quite hard to get/debug through the
table API code. Maybe someone can help to figure out the function where the
issue occurs.
> RuntimeException after subsequent windowed grouping in TableAPI
> ---
>
> Key: FLINK-22530
> URL: https://issues.apache.org/jira/browse/FLINK-22530
> Project: Flink
> Issue Type: Bug
> Components: Table SQL / Planner
>Affects Versions: 1.12.0
>Reporter: Christopher Rost
>Priority: Major
> Labels: stale-major
>
> After applying the following using the TableAPI v 1.12.0, an error is thrown:
> {code:java}
> java.lang.RuntimeException: Error while applying rule
> StreamExecGroupWindowAggregateRule(in:LOGICAL,out:STREAM_PHYSICAL), args
> [rel#505:FlinkLogicalWindowAggregate.LOGICAL.any.None:
> 0.[NONE].[NONE](input=RelSubset#504,group={1},window=TumblingGroupWindow('w2,
> w1_rowtime, 1),properties=EXPR$1)]{code}
> The code snippet to reproduce:
> {code:java}
> Table table2 = table1
> .window(Tumble.over(lit(10).seconds()).on($(EVENT_TIME)).as("w1"))
> .groupBy($(ID), $(LABEL), $("w1"))
> .select($(ID), $(LABEL), $("w1").rowtime().as("w1_rowtime"));
> // table2.execute().print(); --> work well
> Table table3 = table2
> .window(Tumble.over(lit(10).seconds()).on($("w1_rowtime")).as("w2"))
> .groupBy($(LABEL), $("w2"))
> .select(
> $(LABEL).as("super_label"),
> lit(1).count().as("super_count"),
> $("w2").rowtime().as("w2_rowtime")
> );
> // table3.execute().print(); //--> work well
>table3.select($("super_label"), $("w2_rowtime"))
> .execute().print(); // --> throws exception
> {code}
> It seems that the alias "w1_rowtime" is no longer available for further
> usages of table3, since the cause of the exception is:
> {noformat}
> Caused by: java.lang.IllegalArgumentException: field [w1_rowtime] not found;
> input fields are: [vertex_id, vertex_label, EXPR$0
> {noformat}
> {{The complete trace:}}
> {code:java}
> java.lang.RuntimeException: Error while applying rule
> StreamExecGroupWindowAggregateRule(in:LOGICAL,out:STREAM_PHYSICAL), args
> [rel#197:FlinkLogicalWindowAggregate.LOGICAL.any.None:
> 0.[NONE].[NONE](input=RelSubset#196,group={1},window=TumblingGroupWindow('w2,
> w1_rowtime, 1),properties=EXPR$1)]at
> org.apache.calcite.plan.volcano.VolcanoRuleCall.onMatch(VolcanoRuleCall.java:256)
> at
> org.apache.calcite.plan.volcano.IterativeRuleDriver.drive(IterativeRuleDriver.java:58)
> at
> org.apache.calcite.plan.volcano.VolcanoPlanner.findBestExp(VolcanoPlanner.java:510)
> at
> org.apache.calcite.tools.Programs$RuleSetProgram.run(Programs.java:312)
> at
> org.apache.flink.table.planner.plan.optimize.program.FlinkVolcanoProgram.optimize(FlinkVolcanoProgram.scala:64)
> at
> org.apache.flink.table.planner.plan.optimize.program.FlinkChainedProgram$$anonfun$optimize$1.apply(FlinkChainedProgram.scala:62)
> at
> org.apache.flink.table.planner.plan.optimize.program.FlinkChainedProgram$$anonfun$optimize$1.apply(FlinkChainedProgram.scala:58)
> at
> scala.collection.TraversableOnce$$anonfun$foldLeft$1.apply(TraversableOnce.scala:157)
> at
> scala.collection.TraversableOnce$$anonfun$foldLeft$1.apply(TraversableOnce.scala:157)
> at scala.collection.Iterator$class.foreach(Iterator.scala:891)
> at scala.collection.AbstractIterator.foreach(Iterator.scala:1334)
> at scala.collection.IterableLike$class.foreach(IterableLike.scala:72)
> at scala.collection.AbstractIterable.foreach(Iterable.scala:54)
> at
> scala.collection.TraversableOnce$class.foldLeft(TraversableOnce.scala:157)
> at scala.collection.AbstractTraversable.foldLeft(Traversable.scala:104)
> at
> org.apache.flink.table.planner.plan.optimize.program.FlinkChainedProgram.optimize(FlinkChainedProgram.scala:57)
> at
> org.apache.flink.table.planner.plan.optimize.StreamCommonSubGraphBasedOptimizer.optimizeTree(StreamCommonSubGraphBasedOptimizer.scala:163)
> at
> org.apache.flink.table.planner.plan.optimize.StreamCommonSubGraphBasedOptimizer.doOptimize(StreamCommonSubGraphBasedOptimizer.scala:79)
> at
> org.apache.flink.table.planner.plan.optimize.CommonSubGraphBasedOptimizer.optimize(CommonSubGraphBasedOptimizer.scala:77)
> at
> org.apache.flink.table.planner.delegation.PlannerBase.optimize(PlannerBase.scala:286)
> at
>
[jira] [Commented] (FLINK-22530) RuntimeException after subsequent windowed grouping in TableAPI
[
https://issues.apache.org/jira/browse/FLINK-22530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17341717#comment-17341717
]
Christopher Rost commented on FLINK-22530:
--
Can no one help? It would help if someone can agree that this might be a bug.
I'm not sure if consecutive windowing is the best practice for my case or
should I do it in some other way. Maybe someone knows a workaround? The first
windowed grouping is just a workaround to distinct the elements because in my
use case it is possible that the same entities arrive at slightly different
times. Because I want to aggregate in the second window (e.g., sum, count, avg)
just distinct entities, I have to apply the first window.
> RuntimeException after subsequent windowed grouping in TableAPI
> ---
>
> Key: FLINK-22530
> URL: https://issues.apache.org/jira/browse/FLINK-22530
> Project: Flink
> Issue Type: Bug
> Components: Table SQL / Planner
>Affects Versions: 1.12.0
>Reporter: Christopher Rost
>Priority: Major
>
> After applying the following using the TableAPI v 1.12.0, an error is thrown:
> {code:java}
> java.lang.RuntimeException: Error while applying rule
> StreamExecGroupWindowAggregateRule(in:LOGICAL,out:STREAM_PHYSICAL), args
> [rel#505:FlinkLogicalWindowAggregate.LOGICAL.any.None:
> 0.[NONE].[NONE](input=RelSubset#504,group={1},window=TumblingGroupWindow('w2,
> w1_rowtime, 1),properties=EXPR$1)]{code}
> The code snippet to reproduce:
> {code:java}
> Table table2 = table1
> .window(Tumble.over(lit(10).seconds()).on($(EVENT_TIME)).as("w1"))
> .groupBy($(ID), $(LABEL), $("w1"))
> .select($(ID), $(LABEL), $("w1").rowtime().as("w1_rowtime"));
> // table2.execute().print(); --> work well
> Table table3 = table2
> .window(Tumble.over(lit(10).seconds()).on($("w1_rowtime")).as("w2"))
> .groupBy($(LABEL), $("w2"))
> .select(
> $(LABEL).as("super_label"),
> lit(1).count().as("super_count"),
> $("w2").rowtime().as("w2_rowtime")
> );
> // table3.execute().print(); //--> work well
>table3.select($("super_label"), $("w2_rowtime"))
> .execute().print(); // --> throws exception
> {code}
> It seems that the alias "w1_rowtime" is no longer available for further
> usages of table3, since the cause of the exception is:
> {noformat}
> Caused by: java.lang.IllegalArgumentException: field [w1_rowtime] not found;
> input fields are: [vertex_id, vertex_label, EXPR$0
> {noformat}
> {{The complete trace:}}
> {code:java}
> java.lang.RuntimeException: Error while applying rule
> StreamExecGroupWindowAggregateRule(in:LOGICAL,out:STREAM_PHYSICAL), args
> [rel#197:FlinkLogicalWindowAggregate.LOGICAL.any.None:
> 0.[NONE].[NONE](input=RelSubset#196,group={1},window=TumblingGroupWindow('w2,
> w1_rowtime, 1),properties=EXPR$1)]at
> org.apache.calcite.plan.volcano.VolcanoRuleCall.onMatch(VolcanoRuleCall.java:256)
> at
> org.apache.calcite.plan.volcano.IterativeRuleDriver.drive(IterativeRuleDriver.java:58)
> at
> org.apache.calcite.plan.volcano.VolcanoPlanner.findBestExp(VolcanoPlanner.java:510)
> at
> org.apache.calcite.tools.Programs$RuleSetProgram.run(Programs.java:312)
> at
> org.apache.flink.table.planner.plan.optimize.program.FlinkVolcanoProgram.optimize(FlinkVolcanoProgram.scala:64)
> at
> org.apache.flink.table.planner.plan.optimize.program.FlinkChainedProgram$$anonfun$optimize$1.apply(FlinkChainedProgram.scala:62)
> at
> org.apache.flink.table.planner.plan.optimize.program.FlinkChainedProgram$$anonfun$optimize$1.apply(FlinkChainedProgram.scala:58)
> at
> scala.collection.TraversableOnce$$anonfun$foldLeft$1.apply(TraversableOnce.scala:157)
> at
> scala.collection.TraversableOnce$$anonfun$foldLeft$1.apply(TraversableOnce.scala:157)
> at scala.collection.Iterator$class.foreach(Iterator.scala:891)
> at scala.collection.AbstractIterator.foreach(Iterator.scala:1334)
> at scala.collection.IterableLike$class.foreach(IterableLike.scala:72)
> at scala.collection.AbstractIterable.foreach(Iterable.scala:54)
> at
> scala.collection.TraversableOnce$class.foldLeft(TraversableOnce.scala:157)
> at scala.collection.AbstractTraversable.foldLeft(Traversable.scala:104)
> at
> org.apache.flink.table.planner.plan.optimize.program.FlinkChainedProgram.optimize(FlinkChainedProgram.scala:57)
> at
> org.apache.flink.table.planner.plan.optimize.StreamCommonSubGraphBasedOptimizer.optimizeTree(StreamCommonSubGraphBasedOptimizer.scala:163)
> at
> org.apache.flink.table.planner.plan.optimize.StreamCommonSubGraphBasedOptimizer.doOptimize(StreamCommonSubGraphBasedOptimizer.scala:79)
> at
>
[jira] [Comment Edited] (FLINK-22530) RuntimeException after subsequent windowed grouping in TableAPI
[
https://issues.apache.org/jira/browse/FLINK-22530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17338361#comment-17338361
]
Christopher Rost edited comment on FLINK-22530 at 5/3/21, 1:08 PM:
---
[~AHeise] and [~libenchao]] It Seems that you had a similar issue with two
subsequent tumbling windows in
https://issues.apache.org/jira/browse/FLINK-15494. Do you think it is the same
problem here?
was (Author: chrizzz110):
@libenchao Seems that you had a similar issue with two subsequent tumbling
windows.
> RuntimeException after subsequent windowed grouping in TableAPI
> ---
>
> Key: FLINK-22530
> URL: https://issues.apache.org/jira/browse/FLINK-22530
> Project: Flink
> Issue Type: Bug
> Components: Table SQL / Planner
>Affects Versions: 1.12.0
>Reporter: Christopher Rost
>Priority: Major
>
> After applying the following using the TableAPI v 1.12.0, an error is thrown:
> {code:java}
> java.lang.RuntimeException: Error while applying rule
> StreamExecGroupWindowAggregateRule(in:LOGICAL,out:STREAM_PHYSICAL), args
> [rel#505:FlinkLogicalWindowAggregate.LOGICAL.any.None:
> 0.[NONE].[NONE](input=RelSubset#504,group={1},window=TumblingGroupWindow('w2,
> w1_rowtime, 1),properties=EXPR$1)]{code}
> The code snippet to reproduce:
> {code:java}
> Table table2 = table1
> .window(Tumble.over(lit(10).seconds()).on($(EVENT_TIME)).as("w1"))
> .groupBy($(ID), $(LABEL), $("w1"))
> .select($(ID), $(LABEL), $("w1").rowtime().as("w1_rowtime"));
> // table2.execute().print(); --> work well
> Table table3 = table2
> .window(Tumble.over(lit(10).seconds()).on($("w1_rowtime")).as("w2"))
> .groupBy($(LABEL), $("w2"))
> .select(
> $(LABEL).as("super_label"),
> lit(1).count().as("super_count"),
> $("w2").rowtime().as("w2_rowtime")
> );
> // table3.execute().print(); //--> work well
>table3.select($("super_label"), $("w2_rowtime"))
> .execute().print(); // --> throws exception
> {code}
> It seems that the alias "w1_rowtime" is no longer available for further
> usages of table3, since the cause of the exception is:
> {noformat}
> Caused by: java.lang.IllegalArgumentException: field [w1_rowtime] not found;
> input fields are: [vertex_id, vertex_label, EXPR$0
> {noformat}
> {{The complete trace:}}
> {code:java}
> java.lang.RuntimeException: Error while applying rule
> StreamExecGroupWindowAggregateRule(in:LOGICAL,out:STREAM_PHYSICAL), args
> [rel#197:FlinkLogicalWindowAggregate.LOGICAL.any.None:
> 0.[NONE].[NONE](input=RelSubset#196,group={1},window=TumblingGroupWindow('w2,
> w1_rowtime, 1),properties=EXPR$1)]at
> org.apache.calcite.plan.volcano.VolcanoRuleCall.onMatch(VolcanoRuleCall.java:256)
> at
> org.apache.calcite.plan.volcano.IterativeRuleDriver.drive(IterativeRuleDriver.java:58)
> at
> org.apache.calcite.plan.volcano.VolcanoPlanner.findBestExp(VolcanoPlanner.java:510)
> at
> org.apache.calcite.tools.Programs$RuleSetProgram.run(Programs.java:312)
> at
> org.apache.flink.table.planner.plan.optimize.program.FlinkVolcanoProgram.optimize(FlinkVolcanoProgram.scala:64)
> at
> org.apache.flink.table.planner.plan.optimize.program.FlinkChainedProgram$$anonfun$optimize$1.apply(FlinkChainedProgram.scala:62)
> at
> org.apache.flink.table.planner.plan.optimize.program.FlinkChainedProgram$$anonfun$optimize$1.apply(FlinkChainedProgram.scala:58)
> at
> scala.collection.TraversableOnce$$anonfun$foldLeft$1.apply(TraversableOnce.scala:157)
> at
> scala.collection.TraversableOnce$$anonfun$foldLeft$1.apply(TraversableOnce.scala:157)
> at scala.collection.Iterator$class.foreach(Iterator.scala:891)
> at scala.collection.AbstractIterator.foreach(Iterator.scala:1334)
> at scala.collection.IterableLike$class.foreach(IterableLike.scala:72)
> at scala.collection.AbstractIterable.foreach(Iterable.scala:54)
> at
> scala.collection.TraversableOnce$class.foldLeft(TraversableOnce.scala:157)
> at scala.collection.AbstractTraversable.foldLeft(Traversable.scala:104)
> at
> org.apache.flink.table.planner.plan.optimize.program.FlinkChainedProgram.optimize(FlinkChainedProgram.scala:57)
> at
> org.apache.flink.table.planner.plan.optimize.StreamCommonSubGraphBasedOptimizer.optimizeTree(StreamCommonSubGraphBasedOptimizer.scala:163)
> at
> org.apache.flink.table.planner.plan.optimize.StreamCommonSubGraphBasedOptimizer.doOptimize(StreamCommonSubGraphBasedOptimizer.scala:79)
> at
> org.apache.flink.table.planner.plan.optimize.CommonSubGraphBasedOptimizer.optimize(CommonSubGraphBasedOptimizer.scala:77)
> at
> org.apache.flink.table.planner.delegation.PlannerBase.optimize(PlannerBase.scala:286)
>
[jira] [Commented] (FLINK-22530) RuntimeException after subsequent windowed grouping in TableAPI
[
https://issues.apache.org/jira/browse/FLINK-22530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17338361#comment-17338361
]
Christopher Rost commented on FLINK-22530:
--
@libenchao Seems that you had a similar issue with two subsequent tumbling
windows.
> RuntimeException after subsequent windowed grouping in TableAPI
> ---
>
> Key: FLINK-22530
> URL: https://issues.apache.org/jira/browse/FLINK-22530
> Project: Flink
> Issue Type: Bug
> Components: Table SQL / Planner
>Affects Versions: 1.12.0
>Reporter: Christopher Rost
>Priority: Major
>
> After applying the following using the TableAPI v 1.12.0, an error is thrown:
> {code:java}
> java.lang.RuntimeException: Error while applying rule
> StreamExecGroupWindowAggregateRule(in:LOGICAL,out:STREAM_PHYSICAL), args
> [rel#505:FlinkLogicalWindowAggregate.LOGICAL.any.None:
> 0.[NONE].[NONE](input=RelSubset#504,group={1},window=TumblingGroupWindow('w2,
> w1_rowtime, 1),properties=EXPR$1)]{code}
> The code snippet to reproduce:
> {code:java}
> Table table2 = table1
> .window(Tumble.over(lit(10).seconds()).on($(EVENT_TIME)).as("w1"))
> .groupBy($(ID), $(LABEL), $("w1"))
> .select($(ID), $(LABEL), $("w1").rowtime().as("w1_rowtime"));
> // table2.execute().print(); --> work well
> Table table3 = table2
> .window(Tumble.over(lit(10).seconds()).on($("w1_rowtime")).as("w2"))
> .groupBy($(LABEL), $("w2"))
> .select(
> $(LABEL).as("super_label"),
> lit(1).count().as("super_count"),
> $("w2").rowtime().as("w2_rowtime")
> );
> // table3.execute().print(); //--> work well
>table3.select($("super_label"), $("w2_rowtime"))
> .execute().print(); // --> throws exception
> {code}
> It seems that the alias "w1_rowtime" is no longer available for further
> usages of table3, since the cause of the exception is:
> {noformat}
> Caused by: java.lang.IllegalArgumentException: field [w1_rowtime] not found;
> input fields are: [vertex_id, vertex_label, EXPR$0
> {noformat}
> {{The complete trace:}}
> {code:java}
> java.lang.RuntimeException: Error while applying rule
> StreamExecGroupWindowAggregateRule(in:LOGICAL,out:STREAM_PHYSICAL), args
> [rel#197:FlinkLogicalWindowAggregate.LOGICAL.any.None:
> 0.[NONE].[NONE](input=RelSubset#196,group={1},window=TumblingGroupWindow('w2,
> w1_rowtime, 1),properties=EXPR$1)]at
> org.apache.calcite.plan.volcano.VolcanoRuleCall.onMatch(VolcanoRuleCall.java:256)
> at
> org.apache.calcite.plan.volcano.IterativeRuleDriver.drive(IterativeRuleDriver.java:58)
> at
> org.apache.calcite.plan.volcano.VolcanoPlanner.findBestExp(VolcanoPlanner.java:510)
> at
> org.apache.calcite.tools.Programs$RuleSetProgram.run(Programs.java:312)
> at
> org.apache.flink.table.planner.plan.optimize.program.FlinkVolcanoProgram.optimize(FlinkVolcanoProgram.scala:64)
> at
> org.apache.flink.table.planner.plan.optimize.program.FlinkChainedProgram$$anonfun$optimize$1.apply(FlinkChainedProgram.scala:62)
> at
> org.apache.flink.table.planner.plan.optimize.program.FlinkChainedProgram$$anonfun$optimize$1.apply(FlinkChainedProgram.scala:58)
> at
> scala.collection.TraversableOnce$$anonfun$foldLeft$1.apply(TraversableOnce.scala:157)
> at
> scala.collection.TraversableOnce$$anonfun$foldLeft$1.apply(TraversableOnce.scala:157)
> at scala.collection.Iterator$class.foreach(Iterator.scala:891)
> at scala.collection.AbstractIterator.foreach(Iterator.scala:1334)
> at scala.collection.IterableLike$class.foreach(IterableLike.scala:72)
> at scala.collection.AbstractIterable.foreach(Iterable.scala:54)
> at
> scala.collection.TraversableOnce$class.foldLeft(TraversableOnce.scala:157)
> at scala.collection.AbstractTraversable.foldLeft(Traversable.scala:104)
> at
> org.apache.flink.table.planner.plan.optimize.program.FlinkChainedProgram.optimize(FlinkChainedProgram.scala:57)
> at
> org.apache.flink.table.planner.plan.optimize.StreamCommonSubGraphBasedOptimizer.optimizeTree(StreamCommonSubGraphBasedOptimizer.scala:163)
> at
> org.apache.flink.table.planner.plan.optimize.StreamCommonSubGraphBasedOptimizer.doOptimize(StreamCommonSubGraphBasedOptimizer.scala:79)
> at
> org.apache.flink.table.planner.plan.optimize.CommonSubGraphBasedOptimizer.optimize(CommonSubGraphBasedOptimizer.scala:77)
> at
> org.apache.flink.table.planner.delegation.PlannerBase.optimize(PlannerBase.scala:286)
> at
> org.apache.flink.table.planner.delegation.PlannerBase.translate(PlannerBase.scala:165)
> at
> org.apache.flink.table.api.internal.TableEnvironmentImpl.translate(TableEnvironmentImpl.java:1267)
> at
>
[jira] [Updated] (FLINK-22530) RuntimeException after subsequent windowed grouping in TableAPI
[
https://issues.apache.org/jira/browse/FLINK-22530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Christopher Rost updated FLINK-22530:
-
Description:
After applying the following using the TableAPI v 1.12.0, an error is thrown:
{code:java}
java.lang.RuntimeException: Error while applying rule
StreamExecGroupWindowAggregateRule(in:LOGICAL,out:STREAM_PHYSICAL), args
[rel#505:FlinkLogicalWindowAggregate.LOGICAL.any.None:
0.[NONE].[NONE](input=RelSubset#504,group={1},window=TumblingGroupWindow('w2,
w1_rowtime, 1),properties=EXPR$1)]{code}
The code snippet to reproduce:
{code:java}
Table table2 = table1
.window(Tumble.over(lit(10).seconds()).on($(EVENT_TIME)).as("w1"))
.groupBy($(ID), $(LABEL), $("w1"))
.select($(ID), $(LABEL), $("w1").rowtime().as("w1_rowtime"));
// table2.execute().print(); --> work well
Table table3 = table2
.window(Tumble.over(lit(10).seconds()).on($("w1_rowtime")).as("w2"))
.groupBy($(LABEL), $("w2"))
.select(
$(LABEL).as("super_label"),
lit(1).count().as("super_count"),
$("w2").rowtime().as("w2_rowtime")
);
// table3.execute().print(); //--> work well
table3.select($("super_label"), $("w2_rowtime"))
.execute().print(); // --> throws exception
{code}
It seems that the alias "w1_rowtime" is no longer available for further usages
of table3, since the cause of the exception is:
{noformat}
Caused by: java.lang.IllegalArgumentException: field [w1_rowtime] not found;
input fields are: [vertex_id, vertex_label, EXPR$0
{noformat}
{{The complete trace:}}
{code:java}
java.lang.RuntimeException: Error while applying rule
StreamExecGroupWindowAggregateRule(in:LOGICAL,out:STREAM_PHYSICAL), args
[rel#197:FlinkLogicalWindowAggregate.LOGICAL.any.None:
0.[NONE].[NONE](input=RelSubset#196,group={1},window=TumblingGroupWindow('w2,
w1_rowtime, 1),properties=EXPR$1)] at
org.apache.calcite.plan.volcano.VolcanoRuleCall.onMatch(VolcanoRuleCall.java:256)
at
org.apache.calcite.plan.volcano.IterativeRuleDriver.drive(IterativeRuleDriver.java:58)
at
org.apache.calcite.plan.volcano.VolcanoPlanner.findBestExp(VolcanoPlanner.java:510)
at
org.apache.calcite.tools.Programs$RuleSetProgram.run(Programs.java:312)
at
org.apache.flink.table.planner.plan.optimize.program.FlinkVolcanoProgram.optimize(FlinkVolcanoProgram.scala:64)
at
org.apache.flink.table.planner.plan.optimize.program.FlinkChainedProgram$$anonfun$optimize$1.apply(FlinkChainedProgram.scala:62)
at
org.apache.flink.table.planner.plan.optimize.program.FlinkChainedProgram$$anonfun$optimize$1.apply(FlinkChainedProgram.scala:58)
at
scala.collection.TraversableOnce$$anonfun$foldLeft$1.apply(TraversableOnce.scala:157)
at
scala.collection.TraversableOnce$$anonfun$foldLeft$1.apply(TraversableOnce.scala:157)
at scala.collection.Iterator$class.foreach(Iterator.scala:891)
at scala.collection.AbstractIterator.foreach(Iterator.scala:1334)
at scala.collection.IterableLike$class.foreach(IterableLike.scala:72)
at scala.collection.AbstractIterable.foreach(Iterable.scala:54)
at
scala.collection.TraversableOnce$class.foldLeft(TraversableOnce.scala:157)
at scala.collection.AbstractTraversable.foldLeft(Traversable.scala:104)
at
org.apache.flink.table.planner.plan.optimize.program.FlinkChainedProgram.optimize(FlinkChainedProgram.scala:57)
at
org.apache.flink.table.planner.plan.optimize.StreamCommonSubGraphBasedOptimizer.optimizeTree(StreamCommonSubGraphBasedOptimizer.scala:163)
at
org.apache.flink.table.planner.plan.optimize.StreamCommonSubGraphBasedOptimizer.doOptimize(StreamCommonSubGraphBasedOptimizer.scala:79)
at
org.apache.flink.table.planner.plan.optimize.CommonSubGraphBasedOptimizer.optimize(CommonSubGraphBasedOptimizer.scala:77)
at
org.apache.flink.table.planner.delegation.PlannerBase.optimize(PlannerBase.scala:286)
at
org.apache.flink.table.planner.delegation.PlannerBase.translate(PlannerBase.scala:165)
at
org.apache.flink.table.api.internal.TableEnvironmentImpl.translate(TableEnvironmentImpl.java:1267)
at
org.apache.flink.table.api.internal.TableEnvironmentImpl.executeInternal(TableEnvironmentImpl.java:703)
at
org.apache.flink.table.api.internal.TableImpl.execute(TableImpl.java:570)
at
edu.leipzig.impl.algorithm.GraphStreamGroupingTest.testDoubleGrouping(GraphStreamGroupingTest.java:224)
at
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:566)
at
[jira] [Updated] (FLINK-22530) RuntimeException after subsequent windowed grouping in TableAPI
[
https://issues.apache.org/jira/browse/FLINK-22530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Christopher Rost updated FLINK-22530:
-
Environment: (was: May be similar to this issue:
https://issues.apache.org/jira/browse/FLINK-15494)
> RuntimeException after subsequent windowed grouping in TableAPI
> ---
>
> Key: FLINK-22530
> URL: https://issues.apache.org/jira/browse/FLINK-22530
> Project: Flink
> Issue Type: Bug
> Components: Table SQL / Ecosystem, Table SQL / Runtime
>Affects Versions: 1.12.0
>Reporter: Christopher Rost
>Priority: Major
>
> After applying the following using the TableAPI v 1.12.0, an error is thrown:
> {code:java}
> java.lang.RuntimeException: Error while applying rule
> StreamExecGroupWindowAggregateRule(in:LOGICAL,out:STREAM_PHYSICAL), args
> [rel#505:FlinkLogicalWindowAggregate.LOGICAL.any.None:
> 0.[NONE].[NONE](input=RelSubset#504,group={1},window=TumblingGroupWindow('w2,
> w1_rowtime, 1),properties=EXPR$1)]{code}
> The code snippet to reproduce:
> {code:java}
> Table table2 = table1
> .window(Tumble.over(lit(10).seconds()).on($(EVENT_TIME)).as("w1"))
> .groupBy($(ID), $(LABEL), $("w1"))
> .select($(ID), $(LABEL), $("w1").rowtime().as("w1_rowtime"));
> // table2.execute().print(); --> work well
> Table table3 = table2
> .window(Tumble.over(lit(10).seconds()).on($("w1_rowtime")).as("w2"))
> .groupBy($(LABEL), $("w2"))
> .select(
> $(LABEL).as("super_label"),
> lit(1).count().as("super_count"),
> $("w2").rowtime().as("w2_rowtime")
> );
> // table3.execute().print(); //--> work well
>table3.select($("super_label"), $("w2_rowtime"))
> .execute().print(); // --> throws exception
> {code}
> It seems that the alias "w1_rowtime" is no longer available for further
> usages of table3, since the cause of the exception is:
> {noformat}
> Caused by: java.lang.IllegalArgumentException: field [w1_rowtime] not found;
> input fields are: [vertex_id, vertex_label, EXPR$0
> {noformat}
> {{The complete trace:}}
> {code:java}
> java.lang.RuntimeException: Error while applying rule
> StreamExecGroupWindowAggregateRule(in:LOGICAL,out:STREAM_PHYSICAL), args
> [rel#197:FlinkLogicalWindowAggregate.LOGICAL.any.None:
> 0.[NONE].[NONE](input=RelSubset#196,group={1},window=TumblingGroupWindow('w2,
> w1_rowtime, 1),properties=EXPR$1)]at
> org.apache.calcite.plan.volcano.VolcanoRuleCall.onMatch(VolcanoRuleCall.java:256)
> at
> org.apache.calcite.plan.volcano.IterativeRuleDriver.drive(IterativeRuleDriver.java:58)
> at
> org.apache.calcite.plan.volcano.VolcanoPlanner.findBestExp(VolcanoPlanner.java:510)
> at
> org.apache.calcite.tools.Programs$RuleSetProgram.run(Programs.java:312)
> at
> org.apache.flink.table.planner.plan.optimize.program.FlinkVolcanoProgram.optimize(FlinkVolcanoProgram.scala:64)
> at
> org.apache.flink.table.planner.plan.optimize.program.FlinkChainedProgram$$anonfun$optimize$1.apply(FlinkChainedProgram.scala:62)
> at
> org.apache.flink.table.planner.plan.optimize.program.FlinkChainedProgram$$anonfun$optimize$1.apply(FlinkChainedProgram.scala:58)
> at
> scala.collection.TraversableOnce$$anonfun$foldLeft$1.apply(TraversableOnce.scala:157)
> at
> scala.collection.TraversableOnce$$anonfun$foldLeft$1.apply(TraversableOnce.scala:157)
> at scala.collection.Iterator$class.foreach(Iterator.scala:891)
> at scala.collection.AbstractIterator.foreach(Iterator.scala:1334)
> at scala.collection.IterableLike$class.foreach(IterableLike.scala:72)
> at scala.collection.AbstractIterable.foreach(Iterable.scala:54)
> at
> scala.collection.TraversableOnce$class.foldLeft(TraversableOnce.scala:157)
> at scala.collection.AbstractTraversable.foldLeft(Traversable.scala:104)
> at
> org.apache.flink.table.planner.plan.optimize.program.FlinkChainedProgram.optimize(FlinkChainedProgram.scala:57)
> at
> org.apache.flink.table.planner.plan.optimize.StreamCommonSubGraphBasedOptimizer.optimizeTree(StreamCommonSubGraphBasedOptimizer.scala:163)
> at
> org.apache.flink.table.planner.plan.optimize.StreamCommonSubGraphBasedOptimizer.doOptimize(StreamCommonSubGraphBasedOptimizer.scala:79)
> at
> org.apache.flink.table.planner.plan.optimize.CommonSubGraphBasedOptimizer.optimize(CommonSubGraphBasedOptimizer.scala:77)
> at
> org.apache.flink.table.planner.delegation.PlannerBase.optimize(PlannerBase.scala:286)
> at
> org.apache.flink.table.planner.delegation.PlannerBase.translate(PlannerBase.scala:165)
> at
> org.apache.flink.table.api.internal.TableEnvironmentImpl.translate(TableEnvironmentImpl.java:1267)
> at
>
[jira] [Updated] (FLINK-22530) RuntimeException after subsequent windowed grouping in TableAPI
[
https://issues.apache.org/jira/browse/FLINK-22530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Christopher Rost updated FLINK-22530:
-
Environment: May be similar to this issue:
https://issues.apache.org/jira/browse/FLINK-15494
> RuntimeException after subsequent windowed grouping in TableAPI
> ---
>
> Key: FLINK-22530
> URL: https://issues.apache.org/jira/browse/FLINK-22530
> Project: Flink
> Issue Type: Bug
> Components: Table SQL / Ecosystem, Table SQL / Runtime
>Affects Versions: 1.12.0
> Environment: May be similar to this issue:
> https://issues.apache.org/jira/browse/FLINK-15494
>Reporter: Christopher Rost
>Priority: Major
>
> After applying the following using the TableAPI v 1.12.0, an error is thrown:
> {code:java}
> java.lang.RuntimeException: Error while applying rule
> StreamExecGroupWindowAggregateRule(in:LOGICAL,out:STREAM_PHYSICAL), args
> [rel#505:FlinkLogicalWindowAggregate.LOGICAL.any.None:
> 0.[NONE].[NONE](input=RelSubset#504,group={1},window=TumblingGroupWindow('w2,
> w1_rowtime, 1),properties=EXPR$1)]{code}
> The code snippet to reproduce:
> {code:java}
> Table table2 = table1
> .window(Tumble.over(lit(10).seconds()).on($(EVENT_TIME)).as("w1"))
> .groupBy($(ID), $(LABEL), $("w1"))
> .select($(ID), $(LABEL), $("w1").rowtime().as("w1_rowtime"));
> // table2.execute().print(); --> work well
> Table table3 = table2
> .window(Tumble.over(lit(10).seconds()).on($("w1_rowtime")).as("w2"))
> .groupBy($(LABEL), $("w2"))
> .select(
> $(LABEL).as("super_label"),
> lit(1).count().as("super_count"),
> $("w2").rowtime().as("w2_rowtime")
> );
> // table3.execute().print(); //--> work well
>table3.select($("super_label"), $("w2_rowtime"))
> .execute().print(); // --> throws exception
> {code}
> It seems that the alias "w1_rowtime" is no longer available for further
> usages of table3, since the cause of the exception is:
> {noformat}
> Caused by: java.lang.IllegalArgumentException: field [w1_rowtime] not found;
> input fields are: [vertex_id, vertex_label, EXPR$0
> {noformat}
> {{The complete trace:}}
> {code:java}
> java.lang.RuntimeException: Error while applying rule
> StreamExecGroupWindowAggregateRule(in:LOGICAL,out:STREAM_PHYSICAL), args
> [rel#197:FlinkLogicalWindowAggregate.LOGICAL.any.None:
> 0.[NONE].[NONE](input=RelSubset#196,group={1},window=TumblingGroupWindow('w2,
> w1_rowtime, 1),properties=EXPR$1)]at
> org.apache.calcite.plan.volcano.VolcanoRuleCall.onMatch(VolcanoRuleCall.java:256)
> at
> org.apache.calcite.plan.volcano.IterativeRuleDriver.drive(IterativeRuleDriver.java:58)
> at
> org.apache.calcite.plan.volcano.VolcanoPlanner.findBestExp(VolcanoPlanner.java:510)
> at
> org.apache.calcite.tools.Programs$RuleSetProgram.run(Programs.java:312)
> at
> org.apache.flink.table.planner.plan.optimize.program.FlinkVolcanoProgram.optimize(FlinkVolcanoProgram.scala:64)
> at
> org.apache.flink.table.planner.plan.optimize.program.FlinkChainedProgram$$anonfun$optimize$1.apply(FlinkChainedProgram.scala:62)
> at
> org.apache.flink.table.planner.plan.optimize.program.FlinkChainedProgram$$anonfun$optimize$1.apply(FlinkChainedProgram.scala:58)
> at
> scala.collection.TraversableOnce$$anonfun$foldLeft$1.apply(TraversableOnce.scala:157)
> at
> scala.collection.TraversableOnce$$anonfun$foldLeft$1.apply(TraversableOnce.scala:157)
> at scala.collection.Iterator$class.foreach(Iterator.scala:891)
> at scala.collection.AbstractIterator.foreach(Iterator.scala:1334)
> at scala.collection.IterableLike$class.foreach(IterableLike.scala:72)
> at scala.collection.AbstractIterable.foreach(Iterable.scala:54)
> at
> scala.collection.TraversableOnce$class.foldLeft(TraversableOnce.scala:157)
> at scala.collection.AbstractTraversable.foldLeft(Traversable.scala:104)
> at
> org.apache.flink.table.planner.plan.optimize.program.FlinkChainedProgram.optimize(FlinkChainedProgram.scala:57)
> at
> org.apache.flink.table.planner.plan.optimize.StreamCommonSubGraphBasedOptimizer.optimizeTree(StreamCommonSubGraphBasedOptimizer.scala:163)
> at
> org.apache.flink.table.planner.plan.optimize.StreamCommonSubGraphBasedOptimizer.doOptimize(StreamCommonSubGraphBasedOptimizer.scala:79)
> at
> org.apache.flink.table.planner.plan.optimize.CommonSubGraphBasedOptimizer.optimize(CommonSubGraphBasedOptimizer.scala:77)
> at
> org.apache.flink.table.planner.delegation.PlannerBase.optimize(PlannerBase.scala:286)
> at
> org.apache.flink.table.planner.delegation.PlannerBase.translate(PlannerBase.scala:165)
> at
>
[jira] [Updated] (FLINK-22530) RuntimeException after subsequent windowed grouping in TableAPI
[
https://issues.apache.org/jira/browse/FLINK-22530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Christopher Rost updated FLINK-22530:
-
Description:
After applying the following using the TableAPI v 1.12.0, an error is thrown:
{code:java}
java.lang.RuntimeException: Error while applying rule
StreamExecGroupWindowAggregateRule(in:LOGICAL,out:STREAM_PHYSICAL), args
[rel#505:FlinkLogicalWindowAggregate.LOGICAL.any.None:
0.[NONE].[NONE](input=RelSubset#504,group={1},window=TumblingGroupWindow('w2,
w1_rowtime, 1),properties=EXPR$1)]{code}
The code snippet to reproduce:
{code:java}
Table table2 = table1
.window(Tumble.over(lit(10).seconds()).on($(EVENT_TIME)).as("w1"))
.groupBy($(ID), $(LABEL), $("w1"))
.select($(ID), $(LABEL), $("w1").rowtime().as("w1_rowtime"));
// table2.execute().print(); --> work well
Table table3 = table2
.window(Tumble.over(lit(10).seconds()).on($("w1_rowtime")).as("w2"))
.groupBy($(LABEL), $("w2"))
.select(
$(LABEL).as("super_label"),
lit(1).count().as("super_count"),
$("w2").rowtime().as("w2_rowtime")
);
// table3.execute().print(); //--> work well
table3.select($("super_label"), $("w2_rowtime"))
.execute().print(); // --> throws exception
{code}
It seems that the alias "w1_rowtime" is no longer available for further usages
of table3, since the cause of the exception is:
{noformat}
Caused by: java.lang.IllegalArgumentException: field [w1_rowtime] not found;
input fields are: [vertex_id, vertex_label, EXPR$0
{noformat}
{{The complete trace:}}
{code:java}
java.lang.RuntimeException: Error while applying rule
StreamExecGroupWindowAggregateRule(in:LOGICAL,out:STREAM_PHYSICAL), args
[rel#197:FlinkLogicalWindowAggregate.LOGICAL.any.None:
0.[NONE].[NONE](input=RelSubset#196,group={1},window=TumblingGroupWindow('w2,
w1_rowtime, 1),properties=EXPR$1)] at
org.apache.calcite.plan.volcano.VolcanoRuleCall.onMatch(VolcanoRuleCall.java:256)
at
org.apache.calcite.plan.volcano.IterativeRuleDriver.drive(IterativeRuleDriver.java:58)
at
org.apache.calcite.plan.volcano.VolcanoPlanner.findBestExp(VolcanoPlanner.java:510)
at
org.apache.calcite.tools.Programs$RuleSetProgram.run(Programs.java:312)
at
org.apache.flink.table.planner.plan.optimize.program.FlinkVolcanoProgram.optimize(FlinkVolcanoProgram.scala:64)
at
org.apache.flink.table.planner.plan.optimize.program.FlinkChainedProgram$$anonfun$optimize$1.apply(FlinkChainedProgram.scala:62)
at
org.apache.flink.table.planner.plan.optimize.program.FlinkChainedProgram$$anonfun$optimize$1.apply(FlinkChainedProgram.scala:58)
at
scala.collection.TraversableOnce$$anonfun$foldLeft$1.apply(TraversableOnce.scala:157)
at
scala.collection.TraversableOnce$$anonfun$foldLeft$1.apply(TraversableOnce.scala:157)
at scala.collection.Iterator$class.foreach(Iterator.scala:891)
at scala.collection.AbstractIterator.foreach(Iterator.scala:1334)
at scala.collection.IterableLike$class.foreach(IterableLike.scala:72)
at scala.collection.AbstractIterable.foreach(Iterable.scala:54)
at
scala.collection.TraversableOnce$class.foldLeft(TraversableOnce.scala:157)
at scala.collection.AbstractTraversable.foldLeft(Traversable.scala:104)
at
org.apache.flink.table.planner.plan.optimize.program.FlinkChainedProgram.optimize(FlinkChainedProgram.scala:57)
at
org.apache.flink.table.planner.plan.optimize.StreamCommonSubGraphBasedOptimizer.optimizeTree(StreamCommonSubGraphBasedOptimizer.scala:163)
at
org.apache.flink.table.planner.plan.optimize.StreamCommonSubGraphBasedOptimizer.doOptimize(StreamCommonSubGraphBasedOptimizer.scala:79)
at
org.apache.flink.table.planner.plan.optimize.CommonSubGraphBasedOptimizer.optimize(CommonSubGraphBasedOptimizer.scala:77)
at
org.apache.flink.table.planner.delegation.PlannerBase.optimize(PlannerBase.scala:286)
at
org.apache.flink.table.planner.delegation.PlannerBase.translate(PlannerBase.scala:165)
at
org.apache.flink.table.api.internal.TableEnvironmentImpl.translate(TableEnvironmentImpl.java:1267)
at
org.apache.flink.table.api.internal.TableEnvironmentImpl.executeInternal(TableEnvironmentImpl.java:703)
at
org.apache.flink.table.api.internal.TableImpl.execute(TableImpl.java:570)
at
edu.leipzig.impl.algorithm.GraphStreamGroupingTest.testDoubleGrouping(GraphStreamGroupingTest.java:224)
at
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:566)
at
[jira] [Updated] (FLINK-22530) RuntimeException after subsequent windowed grouping in TableAPI
[
https://issues.apache.org/jira/browse/FLINK-22530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Christopher Rost updated FLINK-22530:
-
Description:
After applying the following using the TableAPI v 1.12.0, an error is thrown:
{code:java}
java.lang.RuntimeException: Error while applying rule
StreamExecGroupWindowAggregateRule(in:LOGICAL,out:STREAM_PHYSICAL), args
[rel#505:FlinkLogicalWindowAggregate.LOGICAL.any.None:
0.[NONE].[NONE](input=RelSubset#504,group={1},window=TumblingGroupWindow('w2,
w1_rowtime, 1),properties=EXPR$1)]{code}
The code snippet to reproduce:
{code:java}
Table table2 = table1
.window(Tumble.over(lit(10).seconds()).on($(EVENT_TIME)).as("w1"))
.groupBy($(ID), $(LABEL), $("w1"))
.select($(ID), $(LABEL), $("w1").rowtime().as("w1_rowtime"));
// table2.execute().print(); --> work well
Table table3 = table2
.window(Tumble.over(lit(10).seconds()).on($("w1_rowtime")).as("w2"))
.groupBy($(LABEL), $("w2"))
.select(
$(LABEL).as("super_label"),
lit(1).count().as("super_count"),
$("w2").rowtime().as("w2_rowtime")
);
// table3.execute().print(); //--> work well
table3.select($("super_label"), $("w2_rowtime"))
.execute().print(); // --> throws exception
{code}
{{It seems that the alias "w1_rowtime" }}is no longer available for further
usages of table3, since the cause of the exception is:
{noformat}
Caused by: java.lang.IllegalArgumentException: field [w1_rowtime] not found;
input fields are: [vertex_id, vertex_label, EXPR$0
{noformat}
{{The complete trace:}}
{code:java}
java.lang.RuntimeException: Error while applying rule
StreamExecGroupWindowAggregateRule(in:LOGICAL,out:STREAM_PHYSICAL), args
[rel#197:FlinkLogicalWindowAggregate.LOGICAL.any.None:
0.[NONE].[NONE](input=RelSubset#196,group={1},window=TumblingGroupWindow('w2,
w1_rowtime, 1),properties=EXPR$1)] at
org.apache.calcite.plan.volcano.VolcanoRuleCall.onMatch(VolcanoRuleCall.java:256)
at
org.apache.calcite.plan.volcano.IterativeRuleDriver.drive(IterativeRuleDriver.java:58)
at
org.apache.calcite.plan.volcano.VolcanoPlanner.findBestExp(VolcanoPlanner.java:510)
at
org.apache.calcite.tools.Programs$RuleSetProgram.run(Programs.java:312)
at
org.apache.flink.table.planner.plan.optimize.program.FlinkVolcanoProgram.optimize(FlinkVolcanoProgram.scala:64)
at
org.apache.flink.table.planner.plan.optimize.program.FlinkChainedProgram$$anonfun$optimize$1.apply(FlinkChainedProgram.scala:62)
at
org.apache.flink.table.planner.plan.optimize.program.FlinkChainedProgram$$anonfun$optimize$1.apply(FlinkChainedProgram.scala:58)
at
scala.collection.TraversableOnce$$anonfun$foldLeft$1.apply(TraversableOnce.scala:157)
at
scala.collection.TraversableOnce$$anonfun$foldLeft$1.apply(TraversableOnce.scala:157)
at scala.collection.Iterator$class.foreach(Iterator.scala:891)
at scala.collection.AbstractIterator.foreach(Iterator.scala:1334)
at scala.collection.IterableLike$class.foreach(IterableLike.scala:72)
at scala.collection.AbstractIterable.foreach(Iterable.scala:54)
at
scala.collection.TraversableOnce$class.foldLeft(TraversableOnce.scala:157)
at scala.collection.AbstractTraversable.foldLeft(Traversable.scala:104)
at
org.apache.flink.table.planner.plan.optimize.program.FlinkChainedProgram.optimize(FlinkChainedProgram.scala:57)
at
org.apache.flink.table.planner.plan.optimize.StreamCommonSubGraphBasedOptimizer.optimizeTree(StreamCommonSubGraphBasedOptimizer.scala:163)
at
org.apache.flink.table.planner.plan.optimize.StreamCommonSubGraphBasedOptimizer.doOptimize(StreamCommonSubGraphBasedOptimizer.scala:79)
at
org.apache.flink.table.planner.plan.optimize.CommonSubGraphBasedOptimizer.optimize(CommonSubGraphBasedOptimizer.scala:77)
at
org.apache.flink.table.planner.delegation.PlannerBase.optimize(PlannerBase.scala:286)
at
org.apache.flink.table.planner.delegation.PlannerBase.translate(PlannerBase.scala:165)
at
org.apache.flink.table.api.internal.TableEnvironmentImpl.translate(TableEnvironmentImpl.java:1267)
at
org.apache.flink.table.api.internal.TableEnvironmentImpl.executeInternal(TableEnvironmentImpl.java:703)
at
org.apache.flink.table.api.internal.TableImpl.execute(TableImpl.java:570)
at
edu.leipzig.impl.algorithm.GraphStreamGroupingTest.testDoubleGrouping(GraphStreamGroupingTest.java:224)
at
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:566)
at
[jira] [Created] (FLINK-22530) RuntimeException after subsequent windowed grouping in TableAPI
Christopher Rost created FLINK-22530:
Summary: RuntimeException after subsequent windowed grouping in
TableAPI
Key: FLINK-22530
URL: https://issues.apache.org/jira/browse/FLINK-22530
Project: Flink
Issue Type: Bug
Components: Table SQL / Ecosystem, Table SQL / Runtime
Affects Versions: 1.12.0
Reporter: Christopher Rost
After applying the following using the TableAPI v 1.12.0, an error is thrown:
{code:java}
java.lang.RuntimeException: Error while applying rule
StreamExecGroupWindowAggregateRule(in:LOGICAL,out:STREAM_PHYSICAL), args
[rel#505:FlinkLogicalWindowAggregate.LOGICAL.any.None:
0.[NONE].[NONE](input=RelSubset#504,group={1},window=TumblingGroupWindow('w2,
w1_rowtime, 1),properties=EXPR$1)]{code}
The code snippet to reproduce:
{code:java}
Table table2 = table1
.window(Tumble.over(lit(10).seconds()).on($(EVENT_TIME)).as("w1"))
.groupBy($(ID), $(LABEL), $("w1"))
.select($(ID), $(LABEL), $("w1").rowtime().as("w1_rowtime"));
// table2.execute().print(); --> work well
Table table3 = table2
.window(Tumble.over(lit(10).seconds()).on($("w1_rowtime")).as("w2"))
.groupBy($(LABEL), $("w2"))
.select(
$(LABEL).as("super_label"),
lit(1).count().as("super_count"),
$("w2").rowtime().as("w2_rowtime")
);
// table3.execute().print(); //--> work well
table3.select($("super_label"), $("w2_rowtime"))
.execute().print(); // --> throws exception
{code}
{{It seems that the alias }}{{"w1_rowtime"}}{{ is no longer available for
further usages of table3, since the cause of the exception is: }}{{}}
{noformat}
Caused by: java.lang.IllegalArgumentException: field [w1_rowtime] not found;
input fields are: [vertex_id, vertex_label, EXPR$0
{noformat}
{{}}
{{}}{{The full exception:}}
{code:java}
java.lang.RuntimeException: Error while applying rule
StreamExecGroupWindowAggregateRule(in:LOGICAL,out:STREAM_PHYSICAL), args
[rel#197:FlinkLogicalWindowAggregate.LOGICAL.any.None:
0.[NONE].[NONE](input=RelSubset#196,group={1},window=TumblingGroupWindow('w2,
w1_rowtime, 1),properties=EXPR$1)] at
org.apache.calcite.plan.volcano.VolcanoRuleCall.onMatch(VolcanoRuleCall.java:256)
at
org.apache.calcite.plan.volcano.IterativeRuleDriver.drive(IterativeRuleDriver.java:58)
at
org.apache.calcite.plan.volcano.VolcanoPlanner.findBestExp(VolcanoPlanner.java:510)
at
org.apache.calcite.tools.Programs$RuleSetProgram.run(Programs.java:312)
at
org.apache.flink.table.planner.plan.optimize.program.FlinkVolcanoProgram.optimize(FlinkVolcanoProgram.scala:64)
at
org.apache.flink.table.planner.plan.optimize.program.FlinkChainedProgram$$anonfun$optimize$1.apply(FlinkChainedProgram.scala:62)
at
org.apache.flink.table.planner.plan.optimize.program.FlinkChainedProgram$$anonfun$optimize$1.apply(FlinkChainedProgram.scala:58)
at
scala.collection.TraversableOnce$$anonfun$foldLeft$1.apply(TraversableOnce.scala:157)
at
scala.collection.TraversableOnce$$anonfun$foldLeft$1.apply(TraversableOnce.scala:157)
at scala.collection.Iterator$class.foreach(Iterator.scala:891)
at scala.collection.AbstractIterator.foreach(Iterator.scala:1334)
at scala.collection.IterableLike$class.foreach(IterableLike.scala:72)
at scala.collection.AbstractIterable.foreach(Iterable.scala:54)
at
scala.collection.TraversableOnce$class.foldLeft(TraversableOnce.scala:157)
at scala.collection.AbstractTraversable.foldLeft(Traversable.scala:104)
at
org.apache.flink.table.planner.plan.optimize.program.FlinkChainedProgram.optimize(FlinkChainedProgram.scala:57)
at
org.apache.flink.table.planner.plan.optimize.StreamCommonSubGraphBasedOptimizer.optimizeTree(StreamCommonSubGraphBasedOptimizer.scala:163)
at
org.apache.flink.table.planner.plan.optimize.StreamCommonSubGraphBasedOptimizer.doOptimize(StreamCommonSubGraphBasedOptimizer.scala:79)
at
org.apache.flink.table.planner.plan.optimize.CommonSubGraphBasedOptimizer.optimize(CommonSubGraphBasedOptimizer.scala:77)
at
org.apache.flink.table.planner.delegation.PlannerBase.optimize(PlannerBase.scala:286)
at
org.apache.flink.table.planner.delegation.PlannerBase.translate(PlannerBase.scala:165)
at
org.apache.flink.table.api.internal.TableEnvironmentImpl.translate(TableEnvironmentImpl.java:1267)
at
org.apache.flink.table.api.internal.TableEnvironmentImpl.executeInternal(TableEnvironmentImpl.java:703)
at
org.apache.flink.table.api.internal.TableImpl.execute(TableImpl.java:570)
at
edu.leipzig.impl.algorithm.GraphStreamGroupingTest.testDoubleGrouping(GraphStreamGroupingTest.java:224)
at
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
