[ https://issues.apache.org/jira/browse/CAMEL-20044 ]


    Mike Barlotta deleted comment on CAMEL-20044:
    ---------------------------------------

was (Author: g1antfan):
Any tips or tricks you can share?

I am using podman 4.6.2
I have Docker socket compatibility enabled

*podman machine info*
Host:
  Arch: arm64
  CurrentMachine: ""
  DefaultMachine: ""
  EventsDir: 
/var/folders/82/qc43__sx1qg1wqrtl2csq6r80000gq/T/podman-run--1/podman
  MachineConfigDir: /Users/foo/.config/containers/podman/machine/qemu
  MachineImageDir: /Users/foo/.local/share/containers/podman/machine/qemu
  MachineState: ""
  NumberOfMachines: 1
  OS: darwin
  VMType: qemu
Version:
  APIVersion: 4.6.2
  Built: 1693234503
  BuiltTime: Mon Aug 28 10:55:03 2023
  GitCommit: 5db42e86862ef42c59304c38aa583732fd80f178
  GoVersion: go1.21.0
  Os: darwin
  OsArch: darwin/arm64
  Version: 4.6.2

*podman machine start*
Starting machine "podman-machine-default"
Waiting for VM ...
Mounting volume... /Users/foo:/Users/foo
API forwarding listening on: /var/run/docker.sock
Docker API clients default to this address. You do not need to set DOCKER_HOST.

Machine "podman-machine-default" started successfully

> camel-kafka - On rejoining consumer group Camel can set offset incorrectly 
> causing messages to be replayed
> ----------------------------------------------------------------------------------------------------------
>
>                 Key: CAMEL-20044
>                 URL: https://issues.apache.org/jira/browse/CAMEL-20044
>             Project: Camel
>          Issue Type: Bug
>          Components: camel-kafka
>    Affects Versions: 3.21.0
>         Environment: * Rocky Linux 8.7
>  * Open JDK 11.0.8
>  * Camel 3.21.0
>  * Spring Boot 2.7.14
>  * Strimzi Kafka 0.28.0/3.0.0
>            Reporter: Mike Barlotta
>            Priority: Major
>         Attachments: camel-kafka-offset.11-06-2023.log
>
>
> {*}Reproducing (intermittent){*}:
>  * Configure camel kafka consumer with following:
>  ** autoCommitEnable = false
>  ** allowManualCommit = true
>  ** autoOffsetReset = earliest
>  ** maxPollRecords = 1
>  ** breakOnFirstError = true
>  * Produce a series of records to kafka record to both partitions.
>  * Throw an exception that is unhandled
>  * commit the offset in the onException block
> *Expected behavior:*
>  * Application should consume the record 1 more time, then move on to the 
> next offset in the partition
> *Actual behavior:*
>  * Application will often work. Occasionally will use the offset from another 
> partition and assign that to the partition where the record failed. This can 
> then result in the consumer replaying messages instead of moving forward.
> I put together a sample that can recreate the error. However, given its 
> intermittent nature it may not fail on each run. I have included the logs 
> from 3 different runs on my laptop from this test. Two of them show the error 
> occurring. One of the them has a successful run. I have also provided more 
> details in the README. 
>  * [https://github.com/CodeSmell/CamelKafkaOffset]
> This seems related to other issues with how Camel processes the 
> _breakOnFirstError_ attribute. 
>  * CAMEL-14935
>  * CAMEL-17925
>  * CAMEL-18350
>  * CAMEL-19894



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to