Re: Where to specify trust.jks

2023-05-18 Thread Pablo Estrada via user
Hi Utkarsh, you can pass a path in GCS (or a filesystem), and the workers should be able to download it onto themselves. You'd pass `gs://my-bucket-name/path/to/trust.jks`. Can you try that? Best -P. On Wed, May 10, 2023 at 1:58 PM Utkarsh Parekh wrote: > Hi, > > I'm testing a streaming app

Re: Exactly once guarantee with beam, flink and kafka

2023-05-18 Thread Cristian Constantinescu
Hi Ifat, I don't work with Beam and Flink anymore so the below is from memory. When I went through what you are going through, I spent quite some time to get EOS working. While it kinda worked, I ran into several issues which I'll describe below. The issue with EOS is that it uses Kafka

Beam SQL found limitations

2023-05-18 Thread Wiśniowski Piotr
HI, After experimenting with Beam SQL I did find some limitations. Testing on near latest main (precisely `5aad2467469fafd2ed2dd89012bc80c0cd76b168`) with Calcite, direct runner and openjdk version "11.0.19". Please let me know if some of them are known/ worked on/ have tickets or have

Re: state broadcasting in flink

2023-05-18 Thread Sigalit Eliazov
Hi, i suggest review https://beam.apache.org/blog/timely-processing/ hope this helps Sigalit On Thu, May 18, 2023 at 9:27 AM Zheng Ni wrote: > Hi There, > > Does beam support flink's state broadcasting feature mentioned in the link > below? if yes, is there any beam doc/example available? >

state broadcasting in flink

2023-05-18 Thread Zheng Ni
Hi There, Does beam support flink's state broadcasting feature mentioned in the link below? if yes, is there any beam doc/example available? https://flink.apache.org/2019/06/26/a-practical-guide-to-broadcast-state-in-apache-flink/ Thanks, Zheng