Re: Is the KafkaStreams#store() method thread-safe?

2023-12-26 Thread Sophie Blee-Goldman
Hey Kohei, Good question -- I don't think there's exactly a short answer to this seemingly simple question so bear with me for a second. My understanding is that KafkaStreams#store is very much intended to be thread-safe, and would have been back when it was first added a long time ago, and the

Re: where to capture a failed task's exception

2023-12-26 Thread Greg Harris
Hey Akash, Thanks for the question! For a direct answer, no: throwing exceptions from poll() is only one of many ways that a task can fail. If you look at the AK source, every failure ultimately uses the AbstractStatus.State.FAILED enum [1]. You can trace the usages of this enum back to see all

where to capture a failed task's exception

2023-12-26 Thread Akash Dhiman
Hello, I have a requirement where I need to detect failed tasks based on the specific errors and emit a metric only when it doesn't fail based on these specific errors (these include unknown_topic_or_partition, specific cases of ConfigException etc) I know about a similar metric accessible via