Hi,
I know a similar problem to this was raised earlier last month from the archive (http://mail-archives.apache.org/mod_mbox/flink-dev/201406.mbox/browser). However, I am unable to see if this was ever solved. I am encountering the same problem "In the given plan, the solution set delta does not depend on the workset.", but what I can't ascertain (having examined the PACT compiler (0.5.1)) is whether this is a bug or an intentional design constraint placed on the delta iteration operator. My algorithm sits between the Delta and Bulk iterative models as an Incremental iterative algorithm. The solution set is the union of all working sets up until the current working set is empty. The working set is broadcast to a single operator in the data-flow. This appears to be the problem, the compiler is unable to determine the dependency via this broadcast. To make things more complex my data does not suit the pseudo-relational model Flink is designed around. I am dealing with variable length sets / arrays so I can't join against the solution set, or working set between iterations because the data has no notion of keys. I can make it 'run' as a BulkIteration, but the result is the final state (the empty working set) as at least the 0.5.1 API doesn't allow all previous steps to be captured in a union - I essentially lose the answer once the algorithm converges. Your opinion as to whether this is actually a bug, or if I am doing it all completely wrong would be most appreciated. Cheers, Jack Galilee
