Hi all,

I've hit the next problem, this time something I thought I had testet on Beam 
before: A pipeline containing a "Join rows (cartesian product)" transform with 
input from two sources, loops forever when run via Beam-Direct or Dataflow. It 
works fine using the local runner.

While running it on Beam-Direct I've attached a debugger and can see that it is 
stuck in the while loop at JoinRows.java:486 
<https://github.com/apache/hop/blob/758c07c360c26c0447251f0a29df81557864ad11/plugins/transforms/joinrows/src/main/java/org/apache/hop/pipeline/transforms/joinrows/JoinRows.java#L487>.
 I've tried using a GCS temp directory and swapped the "Main transform to read 
from" but none of those helped.

Is this transform incompatible with Beam? If so, what could I use instead?

cheers

Fabian

Reply via email to