[jira] [Commented] (FLINK-7541) Redistribute operator state using OperatorID
[ https://issues.apache.org/jira/browse/FLINK-7541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16184254#comment-16184254 ] ASF GitHub Bot commented on FLINK-7541: --- Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/4609 > Redistribute operator state using OperatorID > > > Key: FLINK-7541 > URL: https://issues.apache.org/jira/browse/FLINK-7541 > Project: Flink > Issue Type: Improvement >Reporter: Piotr Nowojski >Assignee: Piotr Nowojski > > Currently StateAssignmentOperation relays heavily on the order of new and old > operators in the task. It should be changed and it should relay more on > OperatorID. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (FLINK-7541) Redistribute operator state using OperatorID
[ https://issues.apache.org/jira/browse/FLINK-7541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16184250#comment-16184250 ] ASF GitHub Bot commented on FLINK-7541: --- Github user StefanRRichter commented on the issue: https://github.com/apache/flink/pull/4609 Alright, second attempt to merge this. > Redistribute operator state using OperatorID > > > Key: FLINK-7541 > URL: https://issues.apache.org/jira/browse/FLINK-7541 > Project: Flink > Issue Type: Improvement >Reporter: Piotr Nowojski >Assignee: Piotr Nowojski > > Currently StateAssignmentOperation relays heavily on the order of new and old > operators in the task. It should be changed and it should relay more on > OperatorID. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (FLINK-7541) Redistribute operator state using OperatorID
[ https://issues.apache.org/jira/browse/FLINK-7541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181045#comment-16181045 ] ASF GitHub Bot commented on FLINK-7541: --- Github user pnowojski commented on the issue: https://github.com/apache/flink/pull/4609 Surprisingly even kafka tests have passed this time oO > Redistribute operator state using OperatorID > > > Key: FLINK-7541 > URL: https://issues.apache.org/jira/browse/FLINK-7541 > Project: Flink > Issue Type: Improvement >Reporter: Piotr Nowojski >Assignee: Piotr Nowojski > > Currently StateAssignmentOperation relays heavily on the order of new and old > operators in the task. It should be changed and it should relay more on > OperatorID. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (FLINK-7541) Redistribute operator state using OperatorID
[ https://issues.apache.org/jira/browse/FLINK-7541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16180771#comment-16180771 ] ASF GitHub Bot commented on FLINK-7541: --- Github user StefanRRichter commented on the issue: https://github.com/apache/flink/pull/4609 Yes, I also missed it between some unrelated Kafka test failures :-( Will do a second attempt if all is green this time. > Redistribute operator state using OperatorID > > > Key: FLINK-7541 > URL: https://issues.apache.org/jira/browse/FLINK-7541 > Project: Flink > Issue Type: Improvement >Reporter: Piotr Nowojski >Assignee: Piotr Nowojski > > Currently StateAssignmentOperation relays heavily on the order of new and old > operators in the task. It should be changed and it should relay more on > OperatorID. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (FLINK-7541) Redistribute operator state using OperatorID
[ https://issues.apache.org/jira/browse/FLINK-7541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16180769#comment-16180769 ] ASF GitHub Bot commented on FLINK-7541: --- Github user pnowojski commented on the issue: https://github.com/apache/flink/pull/4609 Sorry @tillrohrmann I have missed that :( @StefanRRichter I pushed a fixed version (but lets wait for travis to pass) > Redistribute operator state using OperatorID > > > Key: FLINK-7541 > URL: https://issues.apache.org/jira/browse/FLINK-7541 > Project: Flink > Issue Type: Improvement >Reporter: Piotr Nowojski >Assignee: Piotr Nowojski > > Currently StateAssignmentOperation relays heavily on the order of new and old > operators in the task. It should be changed and it should relay more on > OperatorID. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (FLINK-7541) Redistribute operator state using OperatorID
[ https://issues.apache.org/jira/browse/FLINK-7541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16180404#comment-16180404 ] ASF GitHub Bot commented on FLINK-7541: --- Github user tillrohrmann commented on the issue: https://github.com/apache/flink/pull/4609 Please don't close this PR, because the commit was reverted. Using `Multimap#get` in the `StateAssignmentOperation` makes the `OperatorSubtaskState` not serializable. The `WindowCheckpointingITCase` caught the problem. > Redistribute operator state using OperatorID > > > Key: FLINK-7541 > URL: https://issues.apache.org/jira/browse/FLINK-7541 > Project: Flink > Issue Type: Improvement >Reporter: Piotr Nowojski >Assignee: Piotr Nowojski > > Currently StateAssignmentOperation relays heavily on the order of new and old > operators in the task. It should be changed and it should relay more on > OperatorID. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (FLINK-7541) Redistribute operator state using OperatorID
[
https://issues.apache.org/jira/browse/FLINK-7541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16180362#comment-16180362
]
Till Rohrmann commented on FLINK-7541:
--
Please don't close this JIRA, because the commit was reverted with
142bde0e8410224de821cefe3876afb8bc6aaf1a. The reason was that the usage of
{{Multimap}} cause the {{OperatorSubtaskState}} to be no longer serializable
(more specifically {{ArrayListMultimap#get}} returns a {{Collection}} which is
not {{Serializable}}). This was visible due to the failing
{{WindowCheckpointingITCase}}.
> Redistribute operator state using OperatorID
>
>
> Key: FLINK-7541
> URL: https://issues.apache.org/jira/browse/FLINK-7541
> Project: Flink
> Issue Type: Improvement
>Reporter: Piotr Nowojski
>Assignee: Piotr Nowojski
>
> Currently StateAssignmentOperation relays heavily on the order of new and old
> operators in the task. It should be changed and it should relay more on
> OperatorID.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Commented] (FLINK-7541) Redistribute operator state using OperatorID
[ https://issues.apache.org/jira/browse/FLINK-7541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16179241#comment-16179241 ] ASF GitHub Bot commented on FLINK-7541: --- Github user StefanRRichter commented on the issue: https://github.com/apache/flink/pull/4609 Merged in f1b2b83d63. Please close the PR and the JIRA. > Redistribute operator state using OperatorID > > > Key: FLINK-7541 > URL: https://issues.apache.org/jira/browse/FLINK-7541 > Project: Flink > Issue Type: Improvement >Reporter: Piotr Nowojski >Assignee: Piotr Nowojski > > Currently StateAssignmentOperation relays heavily on the order of new and old > operators in the task. It should be changed and it should relay more on > OperatorID. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
