Re: Kryo EOFException: No more bytes left

2021-12-19 Thread Dan Hill
I'll retry the job to see if it's reproducible. The serialized state is bad so that run keeps failing. On Sun, Dec 19, 2021 at 4:28 PM Zhipeng Zhang wrote: > Hi Dan, > > Could you provide the code snippet such that we can reproduce the bug here? > > Dan Hill 于2021年12月20日周一 07:18写道: > >> Hi. >>

Re: Kryo EOFException: No more bytes left

2021-12-19 Thread Zhipeng Zhang
Hi Dan, Could you provide the code snippet such that we can reproduce the bug here? Dan Hill 于2021年12月20日周一 07:18写道: > Hi. > > I was curious if anyone else has hit this exception. I'm using the > IntervalJoinOperator to two streams of protos. I registered the protos > with a kryo serializer.

Kryo EOFException: No more bytes left

2021-12-19 Thread Dan Hill
Hi. I was curious if anyone else has hit this exception. I'm using the IntervalJoinOperator to two streams of protos. I registered the protos with a kryo serializer. I started hitting this issue which looks like the operator is trying to deserialize a bad set of bytes that it serialized. I'm no

Re: question on jar compatibility - log4j related

2021-12-19 Thread David Morávek
Hi Eddie, the APIs should be binary compatible across patch releases, so there is no need to re-compile your artifacts Best, D. On Sun 19. 12. 2021 at 16:42, Colletta, Edward wrote: > If have jar files built using flink version 11.2 in dependencies, and I > upgrade my cluster to 11.6, is it sa

question on jar compatibility - log4j related

2021-12-19 Thread Colletta, Edward
If have jar files built using flink version 11.2 in dependencies, and I upgrade my cluster to 11.6, is it safe to run the existing jars on the upgraded cluster or should I rebuild all jobs against 11.6? Thanks, Eddie Colletta

Re: How do I determine which hardware device and software has log4j zero-day security vulnerability?

2021-12-19 Thread Turritopsis Dohrnii Teo En Ming
I realised there is an Apache Log4j mailing list. Regards, Mr. Turritopsis Dohrnii Teo En Ming Targeted Individual in Singapore 19 Dec 2021 Sunday On Fri, 17 Dec 2021 at 00:29, Arvid Heise wrote: > > I think this is meant for the Apache log4j mailing list [1]. > > [1] https://logging.apache.or

Re: How do I determine which hardware device and software has log4j zero-day security vulnerability?

2021-12-19 Thread Turritopsis Dohrnii Teo En Ming
Hi, Please refer to this link. Article: Log4j zero-day flaw: What you need to know and how to protect yourself Link: https://www.zdnet.com/article/log4j-zero-day-flaw-what-you-need-to-know-and-how-to-protect-yourself/ The article says: [QUOTE] WHAT DEVICES AND APPLICATIONS ARE AT RISK? Basic

Re: Alternatives of KafkaDeserializationSchema.isEndOfStream()

2021-12-19 Thread Arvid Heise
Hi Dong, I see your point. The main issue with dynamic EOF is that we can't run in batch mode. That may be desired in the case of Ayush but there may be other use cases where it's not. Additionally, it's quite a bit of code if you'd implement a KafkaRecordDeserializationSchema from scratch. There