subbu107 edited a comment on issue #5866: Flink event time based windowing 
functions not working with pulsar
URL: https://github.com/apache/pulsar/issues/5866#issuecomment-568838901
 
 
   Hi @yjshen , I did also try with default trigger, it still didn't work.
   
   Basically it can be simulated in the following way :
    - set flink env parallelism to 4 
    - set 
consumerConfigurationData.setSubscriptionType(SubscriptionType.Failover); .
    - number of partitions of source/ sink topics = 2. Now when i stream data, 
i don't see it triggering.
    - If I increase the number of partitions on  my source and sink topics to 
4, it works, ie, i see the window triggering and i see data in the sink topic. 
Basically **if I have fewer partitions than the parallelism that I have set in 
flink, it stops working.**
    
    
    - when I set 
    consumerConfigurationData.setSubscriptionType(SubscriptionType.Shared);, it 
always works.
   However, since we want to maintain processing order, we want to use 
SubscriptionType.Failover
   
   
   Also -- if i use kafka source / sink - exact same code works without any 
changes (sample code attached)
   
   I will attach the logs shortly

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
[email protected]


With regards,
Apache Git Services

Reply via email to