Need more clarity in documentation for upgrade/downgrade procedures and limitations across releases

Hi Team, Referring to the upgrade documentation for apache kafka. https://kafka.apache.org/34/documentation.html#upgrade_3_4_0 There is confusion with respect to below statements from the above sectioned link of apache docs. "If you are upgrading from a version prior to 2.1.x, please see the

Re: Kafka connect Graceful stop of task failed

Hello Greg Thanks a *lot* for your help on this. Indeed the empty poll is not the issue for us. As mentioned, our setup is a poll every 24 hours. So the `stop()` being stuck due to the `poll()` is hitting us hard. I did a trace today on my dev environment, I can indeed see this waiting log entry

Re: Kafka connect Graceful stop of task failed

Hey Robson, Thanks for opening an issue on the JDBC repo, I think this is certainly relevant feedback for the connector developers. I commented on the issue with a potential regression that I saw, you can try downgrading your connector to see if the behavior improves. I also know that

RE: Sudden performance dip with acks=1

Attaching Grafana graphs for reference. Network and I/O threads are more than 60% idle. From: Prateek Kohli Sent: 21 August 2023 19:56 To: users@kafka.apache.org Subject: Sudden performance dip with acks=1 Hi, I am trying to test Kafka performance in my setup using kafka-perf scripts

Sudden performance dip with acks=1

Hi, I am trying to test Kafka performance in my setup using kafka-perf scripts provided by Kafka. I see a behavior in my Kafka cluster in case of acks=1, which I am unable to understand. My run works as expected for sometime, but after that suddenly "fetcher lag" starts to increase

Re: Kafka connect Graceful stop of task failed

How can I stop getting these updates ? On Mon, Aug 21, 2023 at 9:01 AM Robson Hermes wrote: > This email was sent from an external source so please treat with caution. > > No, it stops them also. > The problem is precisely what Greg described, now the stop signal comes > from the same thread.

Re: Kafka connect Graceful stop of task failed

No, it stops them also. The problem is precisely what Greg described, now the stop signal comes from the same thread. So any source task which is running in a blocking way will not process the stop signal until the current poll finishes. So would need to patch source jdbc connector. On Mon, 21

Re: Kafka connect Graceful stop of task failed

I think when you delete connector it removes the task and workers continues to run. When you stop it actually stops the worker. Both different things. Point to be noted is Worker has connector. So connector should be removed before stopping the worker. Though I am not expert in this. On Mon, 21

Re: Kafka connect Graceful stop of task failed

Hello Sunil I'm not calling a stop, I'm straight deleting the connectors with the DELETE. Stopping the connector is done internally during deletion. Regards Robson On Mon, 21 Aug 2023 at 15:36, sunil chaudhari wrote: > You have to remove connectors first using delete api > and then stop the

Re: Kafka connect Graceful stop of task failed

You have to remove connectors first using delete api and then stop the connector On Thu, 17 Aug 2023 at 2:51 AM, Robson Hermes wrote: > Hello > > I'm using kafka connect 7.4.0 to read data from Postgres views and write to > another Postgres tables. So using JDBC source and sink connectors. >

Re: Kafka connect Graceful stop of task failed

Hello Greg (sorry about the duplicate e-mail, forgot to cc users mailing list) Thanks a lot for your detailed reply. I'm using JDBC Source connectors from kafka-connect-jdbc . Indeed the `poll()` implementation is blocked, so it only processes a