Re: [I] [Bug]: Periodic Impulse with Fixed Window Stalls When Used as a Side Input in a Session Window Pipeline [beam]

Tue, 18 Feb 2025 08:06:06 -0800 


SanjayPanda commented on issue #34010:
URL: https://github.com/apache/beam/issues/34010#issuecomment-2666142216

   Hi @liferoad 
   
   Thanks for reply :)
   
   I tried processing the data without windowing, but it still gets stalled at 
Enrich ParDo. Using triggers with a custom window seems to work but consumes 
too many resources.
   
   Here is screenshots of where it stall. 
   
![Image](https://github.com/user-attachments/assets/5898e870-faac-4d31-9081-a8354a1bdd6d)
   
   Here is the example of one periodic impulse step 
   
![Image](https://github.com/user-attachments/assets/c5af7b63-04c9-4bf0-a26a-6147c8cf9c05)
   Do you think FlatMap can cause the stall? 
   
   
   I have around few 21 sources/ each under 30MB data fairly static for 24hr. 
Do you think the enrich way will be better suite or side input? 
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to