Help with kafka broker reporting offset out of range after unclean shutdown

2023-10-09 Thread Steve Jacobs (US)
, resulting in a large amount of messages being re-synced. The odd part is if you go to the broker and ask again, it happily sends the ‘missing’ offset back. I could use some help trying to collect more information about this issue. I’ve been able to enable trace level logging for requests and I can

Help with Migrate from CentOS 7 to Ubuntu

2023-09-26 Thread Gene Robichaux
We have an existing cluster that is CentOS 7 and we need to migrate to Ubuntu in the next 8 months. We are unable to build a new cluster and deploy because of the complexities in clients (producers and consumers). We would like to either. 1. Replace individual CentOS nodes one at a time (both

Re: Help with MM2 active/passive configuration

2022-10-24 Thread Luke Chen
This is what Ryanne mentioned doc: https://github.com/apache/kafka/tree/trunk/connect/mirror Thanks. Luke On Mon, Oct 24, 2022 at 6:38 PM Chris Peart wrote: > > > Hi Ryanne, > > I cannot find what you mentioned, all i'm looking for are some example > configurations for and active/passive

Re: Help with MM2 active/passive configuration

2022-10-24 Thread Chris Peart
Hi Ryanne, I cannot find what you mentioned, all i'm looking for are some example configurations for and active/passive setup. Many Thanks, Chris On 2022-10-19 18:32, Chris Peart wrote: Thanks Ryan, can you provide a link to the readme please. Many Thanks Chris On 19 Oct 2022, at 6:15

Re: Help with MM2 active/passive configuration

2022-10-19 Thread Chris Peart
Thanks Ryan, can you provide a link to the readme please. Many Thanks Chris > On 19 Oct 2022, at 6:15 pm, Ryanne Dolan wrote: > > Hey Chris, check out the readme in connect/mirror for examples on how to > run mirror maker as a standalone process. It's similar to how Cloudera's > mirror maker

Re: Help with MM2 active/passive configuration

2022-10-19 Thread Ryanne Dolan
Hey Chris, check out the readme in connect/mirror for examples on how to run mirror maker as a standalone process. It's similar to how Cloudera's mirror maker is configured. If you've got a Connect cluster already, I recommend using that and manually configuring the MirrorSourceConnector. Ryanne

Help with MM2 active/passive configuration

2022-10-19 Thread Chris Peart
Hi All, I'm new to MirrorMaker and have a production cluster running version 2.8.1 and have a development cluster running the same version. Our prod cluster has 4 brokers and our dev cluster has 3 brokers, both have a replication factor of 3. I would like to setup an active/passive

Re: Help with log.dirs please

2022-09-23 Thread Chris Peart
t;> So all was working after all, once i removed the data/files from /data/kafka >> and changing the zookeeper.connect string to use /kafkaprod. >> >> >> >> We now have all six disk working on all 4 brokers. >> >> >> >> Thanks again f

Re: Help with log.dirs please

2022-09-23 Thread Peter Bukowinski
t; using /kafka instead of /kafkaprod MyBad :-( > > > > So all was working after all, once i removed the data/files from /data/kafka > and changing the zookeeper.connect string to use /kafkaprod. > > > > We now have all six disk working on all 4 brokers. >

Re: Help with log.dirs please

2022-09-22 Thread Chris Peart
:-( So all was working after all, once i removed the data/files from /data/kafka and changing the zookeeper.connect string to use /kafkaprod. We now have all six disk working on all 4 brokers. Thanks again for your help on this and sorry for not spotting my mistake sooner :-) Many Thanks

Re: Help with log.dirs please

2022-09-21 Thread Chris Peart
se all of >>>>> the log dirs when creating topics. Remember that kafka will not >>>>> automatically move any existing topic data when the cluster configs >>>>> change. I'd test by creating a topic with more partitions than storage >>>>>

Re: Help with log.dirs please

2022-09-21 Thread Peter Bukowinski
ic data when the cluster configs >>>> change. I'd test by creating a topic with more partitions than storage >>>> locations. >>>> If you'd rather start fresh, you have the steps correct. An alternative to >>>> changing the zk path is to use zkCli

Re: Help with log.dirs please

2022-09-21 Thread Chris Peart
gt;> zookeeper chroot, just delete everything from that chroot down from zkCli, >>> e.g. `rmr /[kafka-chroot]` >>> -- >>> Peter >>>> On Sep 20, 2022, at 11:56 AM, Chris Peart wrote: >>> Thinking about this, as this is not in production it might be easier ju

Re: Help with log.dirs please

2022-09-21 Thread Peter Bukowinski
on it might be easier just >> reset everything. >> Would it be something like: >> Stopping Kafka >> Deleting all files and folders in /Kafka/data >> Changing the zookeeper setting to point to a different path in the zookeeper >> cluster >> Start Kafka >&g

Re: Help with log.dirs please

2022-09-21 Thread Chris Peart
Some help on resetting Kafka would be great if ok please. Many Thanks Chris On 20 Sep 2022, at 3:37 pm, Chris Peart wrote: Hi Peter, I have checked the logs on all 4 brokers and could only see /data/1/data/kafka being used, log.dirs config in the logs showed all the disks but no errors. I man

Re: Help with log.dirs please

2022-09-20 Thread Chris Peart
2022, at 11:56 AM, Chris Peart wrote: >> >> Thinking about this, as this is not in production it might be easier just >> reset everything. >> >> Would it be something like: >> >> Stopping Kafka >> Deleting all files and folders in /Kafka/data >> Changin

Re: Help with log.dirs please

2022-09-20 Thread Peter Bukowinski
s in /Kafka/data > Changing the zookeeper setting to point to a different path in the zookeeper > cluster > Start Kafka > > Some help on resetting Kafka would be great if ok please. > > Many Thanks > Chris > >> On 20 Sep 2022, at 3:37 pm, Chris Peart wrote: >>

Re: Help with log.dirs please

2022-09-20 Thread Chris Peart
Thinking about this, as this is not in production it might be easier just reset everything. Would it be something like: Stopping Kafka Deleting all files and folders in /Kafka/data Changing the zookeeper setting to point to a different path in the zookeeper cluster Start Kafka Some help

Re: Help with log.dirs please

2022-09-20 Thread Chris Peart
somewhere, maybe in zookeeper? Any help here would be much appreciated :) Many Thanks, Chris On 2022-09-16 08:22, Chris Peart wrote: Thanks Peter, I'll check the logs next week and let you know my findings. Many Thanks Chris On 16 Sep 2022, at 7:45 am, Peter Bukowinski wrote: The next

Re: Help with log.dirs please

2022-09-16 Thread Chris Peart
ata/2 xfsnodev,noatime,nofail 1 2 >>>> >>>> /dev/mapper/VolGroup03-data/data/3xfsnodev,noatime,nofail 1 2 >>>> >>>> /dev/mapper/VolGroup04-data/data/4xfsnodev,noatime,nofail 1 2 >>>> >>>> /dev/mapper/Vo

Re: Help with log.dirs please

2022-09-16 Thread Peter Bukowinski
er/VolGroup06-data/data/6xfsnodev,noatime,nofail 1 2 >>> >>> We configured server.properties to be: >>> log.dirs=/data/1/kafka/data,/data/2/kafka/data,/data/3/kafka/data,/data/4/kafka/data,/data/5/kafka/data,/data/6/kafka/data >>> >>> i can see all our topics in /data/1/kafka/data but don't see anything in >>> /data/2-5 >>> >>> Any help would be appreciated as this is going to production next week? >>> >>> Many Thanks, >>> >>> Chris >> >

Re: Help with log.dirs please

2022-09-16 Thread Chris Peart
v/mapper/VolGroup05-data/data/5xfsnodev,noatime,nofail 1 2 >> >> /dev/mapper/VolGroup06-data/data/6xfsnodev,noatime,nofail 1 2 >> >> We configured server.properties to be: >> log.dirs=/data/1/kafka/data,/data/2/kafka/data,/data/3/kaf

Re: Help with log.dirs please

2022-09-15 Thread Peter Bukowinski
server.properties to be: > log.dirs=/data/1/kafka/data,/data/2/kafka/data,/data/3/kafka/data,/data/4/kafka/data,/data/5/kafka/data,/data/6/kafka/data > > i can see all our topics in /data/1/kafka/data but don't see anything in > /data/2-5 > > Any help would be appreciated as this is going to production next week? > > Many Thanks, > > Chris

Help with log.dirs please

2022-09-15 Thread Chris Peart
all our topics in /data/1/kafka/data but don't see anything in /data/2-5 Any help would be appreciated as this is going to production next week? Many Thanks, Chris

Re: Need help on upgrade kafka from 2.7.0 to 3.2.1

2022-08-26 Thread Patrick Taylor
Are you upgrading your Kafka servers or your applications' client libraries? We upgraded our client libraries and then ran into an incompatibility when the upgraded client ran with an older broker cluster. But the issue was fixed by simply adding an ACL for IdempotentWrite on the brokers. This

Re: Need help on upgrade kafka from 2.7.0 to 3.2.1

2022-08-25 Thread Fred Bai
Hi Sunil Chaudhari : Excuse me, is Kafka 3.1.0 backward compatible to 2.3.0? We also need to upgrade to Kafka3.x from 2.x. thx. sunil chaudhari 于2022年8月16日周二 23:41写道: > Hi Sowjanya, > I am not technical support from Kafka, but I can help you in this. > Recently I upgraded one of the

Re: Need help on upgrade kafka from 2.7.0 to 3.2.1

2022-08-16 Thread sunil chaudhari
Hi Sowjanya, I am not technical support from Kafka, but I can help you in this. Recently I upgraded one of the confluent version, so I will try to help you. Please let me know what exactly you need. On Tue, 16 Aug 2022 at 7:43 PM, sowjanya reddy < sowjanyabairapured...@gmail.com> wrote: &g

Need help on upgrade kafka from 2.7.0 to 3.2.1

2022-08-16 Thread sowjanya reddy
I Team, I need contact details of technical support on kafka upgrade. Thanks and regards, Sowjanya.

Re: Help on MM2 -- only copy new data

2022-06-13 Thread An, Hongguo (CORP)
3 Thanks in advance for any help This message and any attachments are intended only for the use of the addressee and may contain information that is privileged and confidential. If the reader of the message is not the intended recipient or an authorized representative of the intende

Re: Help on MM2 -- only copy new data

2022-06-13 Thread Jamie
tor= 3 offset.storage.replication.factor= 3 status.storage.replication.factor= 3 config.storage.replication.factor= 3 transaction.state.log.replication.factor= 3 Thanks in advance for any help This message and any attachments are intended only for the use of the addressee and may cont

Re: Help on MM2 -- only copy new data

2022-06-13 Thread An, Hongguo (CORP)
Correction, its 3.2.0 From: "An, Hongguo (CORP)" Date: Monday, June 13, 2022 at 4:12 PM To: "users@kafka.apache.org" Subject: Help on MM2 -- only copy new data Hi: I am trying to use MM2 ( 3.2.0) to migration Kafka to a new server, but looks like it only copys new dat

Help on MM2 -- only copy new data

2022-06-13 Thread An, Hongguo (CORP)
= 3 status.storage.replication.factor= 3 config.storage.replication.factor= 3 transaction.state.log.replication.factor= 3 Thanks in advance for any help This message and any attachments are intended only for the use of the addressee and may contain information that is privileged and confident

Re: Need Help - getting vulnerability due to Log4j- v1.2.17 jar being used in Kafka_2.11-2.4.0.

2022-03-30 Thread Bruno Cadonna
Hi Sandip, I just merged the PR https://github.com/apache/kafka/pull/11743 that replaces log4j with reload4j. Reload4j will be part of Apache Kafka 3.2.0 and 3.1.1. Best, Bruno On 30.03.22 04:26, Luke Chen wrote: Hi Sandip, We plan to replace log4j with reload4j in v3.2.0 and v3.1.1.

Re: Need Help - getting vulnerability due to Log4j- v1.2.17 jar being used in Kafka_2.11-2.4.0.

2022-03-29 Thread Luke Chen
Hi Sandip, We plan to replace log4j with reload4j in v3.2.0 and v3.1.1. (KAFKA-13660 ) And plan to upgrade to log4j2 in v4.0.0. You can check this discussion thread for more details:

Need Help - getting vulnerability due to Log4j- v1.2.17 jar being used in Kafka_2.11-2.4.0.

2022-03-29 Thread Sandip Bhunia
Dear Team, We are getting vulnerability due to Log4j- v1.2.17 jar being used in Kafka_2.11-2.4.0. We tried to upgrade the same to Kafka_2.13-3.1.0 to remediate vulnerability due to Log4j- v1.2.17 (obsolete version- Log4j 1.x has reached End of Life in 2015 and is no longer supported.) but

Re: MirrorMaker2 fails to replicate - please urgent help needed

2021-12-02 Thread Rijo Roy
, __consumer_offsets-20, __consumer_offsets-40, > __consumer_offsets-30, __consumer_offsets-9, __consumer_offsets-39, > __consumer_offsets-11, __consumer_offsets-31, __consumer_offsets-13] > (org.apache.kafka.clients.NetworkClient:1070) > > Could you help me understand the WAR

Re: MirrorMaker2 fails to replicate - please urgent help needed

2021-10-26 Thread Rijo Roy
_consumer_offsets-40, > __consumer_offsets-30, __consumer_offsets-9, __consumer_offsets-39, > __consumer_offsets-11, __consumer_offsets-31, __consumer_offsets-13] > (org.apache.kafka.clients.NetworkClient:1070) > > Could you help me understand the WARN. Now I have stopped it as this > looked confusing

Re: MirrorMaker2 fails to replicate - please urgent help needed

2021-10-25 Thread Ryanne Dolan
__consumer_offsets-39, > __consumer_offsets-11, __consumer_offsets-31, __consumer_offsets-13] > (org.apache.kafka.clients.NetworkClient:1070) > > Could you help me understand the WARN. Now I have stopped it as this > looked confusing [2021-10-25 20:13:24,515] INFO Connector B->A configured. > (org.ap

Re: MirrorMaker2 fails to replicate - please urgent help needed

2021-10-25 Thread Rijo Roy
ets-39, __consumer_offsets-11, __consumer_offsets-31, __consumer_offsets-13] (org.apache.kafka.clients.NetworkClient:1070) Could you help me understand the WARN. Now I have stopped it as this looked confusing [2021-10-25 20:13:24,515] INFO Connector B->A conf

Re: MirrorMaker2 fails to replicate - please urgent help needed

2021-10-25 Thread Ryanne Dolan
it is successfully doing is creating these 3 below topics in both A and B > clusters - > mm2-configs.n.internalmm2-offsets.n.internalmm2-status.n.internal > where n is A in source and B in target > And the kafka logs does not have anything to help me with troubleshooting > neither have any

MirrorMaker2 fails to replicate - please urgent help needed

2021-10-25 Thread Rijo Roy
et And the kafka logs does not have anything to help me with troubleshooting neither have any monitoring tools to track the sync progress if at all it is happening. Could you please help me here -  1. How to enable logging for mirrormaker 2. How can I successfully monitor it  3. How can

Re: Help needed to migrate from one infra to another without downtime

2021-10-25 Thread Rijo Roy
, 23 October, 2021, 09:01:39 am IST, Haruki Okada wrote: Hi, Rijo. This slide might help you to create a procedure to migrate the zk ensemble without downtime. https://speakerdeck.com/line_developers/split-brain-free-online-zookeeper-migration The slide is based on zookeeper 3.4 so in your

Re: Help needed to migrate from one infra to another without downtime

2021-10-22 Thread Haruki Okada
Hi, Rijo. This slide might help you to create a procedure to migrate the zk ensemble without downtime. https://speakerdeck.com/line_developers/split-brain-free-online-zookeeper-migration The slide is based on zookeeper 3.4 so in your environment (3.5), the procedure might be simplified thanks

Re: Help needed to migrate from one infra to another without downtime

2021-10-20 Thread Ran Lupovich
eper.properties helped me to resolve the failure > and run the cluster on infrastructure B. I know I failed miserably but this > was a sandbox where I could afford the downtime but cannot in a production > setup. I request your help and guidance to make it right. Please help! > > Thanks in advance. > > Regards,Rijo S Roy > > >

Help needed to migrate from one infra to another without downtime

2021-10-20 Thread Rijo Roy
on infrastructure B. I know I failed miserably but this was a sandbox where I could afford the downtime but cannot in a production setup. I request your help and guidance to make it right. Please help! Thanks in advance. Regards,Rijo S Roy

Re: Please Help with Error: org.apache.kafka.common.network.InvalidReceiveException: Invalid receive (size = ...

2021-08-06 Thread Israel Ekpo
che.kafka.common.network.KafkaChannel.read(KafkaChannel.java:385) > > > at > org.apache.kafka.common.network.Selector.attemptRead(Selector.java:651) > > > at > > > > org.apache.kafka.common.network.Selector.pollSelectionKeys(Selector.java:572) > > > at org.apache.kafka.common.network.Selector.poll(Selector.java:483) > > > at kafka.network.Processor.poll(SocketServer.scala:863) > > > at kafka.network.Processor.run(SocketServer.scala:762) > > > at java.lang.Thread.run(Thread.java:748) > > > > > > Please help to see how can this be resolved. > > > Many Thanks!! > > > > > > Roger > > > > > > > > > >

Re: Please Help with Error: org.apache.kafka.common.network.InvalidReceiveException: Invalid receive (size = ...

2021-08-06 Thread Mickael Maison
ector.java:651) > > at > > org.apache.kafka.common.network.Selector.pollSelectionKeys(Selector.java:572) > > at org.apache.kafka.common.network.Selector.poll(Selector.java:483) > > at kafka.network.Processor.poll(SocketServer.scala:863) > > at kafka.network.Processor.run(SocketServer.scala:762) > > at java.lang.Thread.run(Thread.java:748) > > > > Please help to see how can this be resolved. > > Many Thanks!! > > > > Roger > > > > > >

Re: Please Help with Error: org.apache.kafka.common.network.InvalidReceiveException: Invalid receive (size = ...

2021-08-06 Thread Malcolm McFarland
a:572) > at org.apache.kafka.common.network.Selector.poll(Selector.java:483) > at kafka.network.Processor.poll(SocketServer.scala:863) > at kafka.network.Processor.run(SocketServer.scala:762) > at java.lang.Thread.run(Thread.java:748) > > Please help to see how can this be resolved. > Many Thanks!! > > Roger > > >

Please Help with Error: org.apache.kafka.common.network.InvalidReceiveException: Invalid receive (size = ...

2021-08-06 Thread roger
(SocketServer.scala:863) at kafka.network.Processor.run(SocketServer.scala:762) at java.lang.Thread.run(Thread.java:748) Please help to see how can this be resolved. Many Thanks!! Roger

Help to stream msg with R

2021-07-23 Thread Paulo Ramos
Hi I already subscribe to the user help mail list. I have a technical question, regarding reading stream msg from kafka using R. This is what I am currently using: if (FALSE) { library <https://rdrr.io/r/base/library.html>(sparklyr <https://spark.rstudio.com/>) sc <- spark

Re: Help !! Apache-Kafka On-Premises Setup.

2021-06-18 Thread Ryanne Dolan
without using an LB, you should do that. Generally they don't help since Kafka will tell clients which brokers to connect to, regardless of which broker they originally connected to. That said, I'm aware of cases where LB and NAT and whatnot are required. In those cases the usual approach is to have one

Re: Help !! Apache-Kafka On-Premises Setup.

2021-06-18 Thread Marcus Horsley-Rai
t;zookeeper, do you have the same number of nodes on-premises ( Data > > > >centre ) that you intend to utilise? > > > >6. Finally what is not working in your Data centre > > > > > > > > > > > > HTH > > > >

Re: Help !! Apache-Kafka On-Premises Setup.

2021-06-18 Thread Nitin Sharma
t; > > > > > > > > > >view my Linkedin profile > > > <https://www.linkedin.com/in/mich-talebzadeh-ph-d-5205b2/> > > > > > > > > > > > > *Disclaimer:* Use it at your own risk. Any and all responsibility for &g

Re: Help !! Apache-Kafka On-Premises Setup.

2021-06-18 Thread Mich Talebzadeh
and all responsibility for any > > loss, damage or destruction of data or any other property which may arise > > from relying on this email's technical content is explicitly disclaimed. > > The author will in no case be liable for any monetary damages arising > from > > such loss, damage or destruct

Re: Help !! Apache-Kafka On-Premises Setup.

2021-06-18 Thread Nitin Sharma
data or any other property which may arise > from relying on this email's technical content is explicitly disclaimed. > The author will in no case be liable for any monetary damages arising from > such loss, damage or destruction. > > > > > On Fri, 18 Jun 2021 at 15:41, N

Re: Help !! Apache-Kafka On-Premises Setup.

2021-06-18 Thread Mich Talebzadeh
laimed. The author will in no case be liable for any monetary damages arising from such loss, damage or destruction. On Fri, 18 Jun 2021 at 15:41, Nitin Sharma wrote: > Hi Team, > > Hope you are well!! > > I need your help in setting up the Kafka On-Premises Setup. > > Prob

Help !! Apache-Kafka On-Premises Setup.

2021-06-18 Thread Nitin Sharma
Hi Team, Hope you are well!! I need your help in setting up the Kafka On-Premises Setup. Problem Setup :- 1. We have tested the setup on the AWS environment and it is working fine. 2. We are trying to replicate the same in the On-Premises environment but it seems not working properly. Please

Odd problem with Kafka, need help to troubleshoot

2021-03-23 Thread Kent Närling
ng related to my network locally on my laptop that has become messed up/corrupted? So technically this is not a Kafka issue in itself, but I need help/tips on how to troubleshoot and get to the root of this. I even tried using Wireshark to look into the traffic, but its hard to see anything us

Need help in setting up the IDE

2021-03-22 Thread Aviral Srivastava
Hey everyone! I need help in setting up my IDE with Kafka. I have loaded and successfully build the Gradle project in IDEA. I looked around and found a blog post <https://mailtrack.io/trace/link/e4b2216e251bc1bf71dc39f2e0b7517530cf40bb?url=https%3A%2F%2Fmanasvigupta.github.io%2Fgetting-star

Re: Introducing JulieOps, a tool to help you build your GitOps and self-service with Apache Kafka and related

2021-03-01 Thread Pere Urbón Bayes
at 2:05 PM Pere Urbón Bayes > wrote: > >> Hi, >>I hope this message finds everyone healthy and good. I wanted to reach >> out to the community to introduce JulieOps ( >> https://github.com/kafka-ops/julie). This is a project I have been >> working >>

Re: Introducing JulieOps, a tool to help you build your GitOps and self-service with Apache Kafka and related

2021-03-01 Thread Andrew Otto
reach > out to the community to introduce JulieOps ( > https://github.com/kafka-ops/julie). This is a project I have been working > in recent times to help bring automation and self-service when using Apache > Kafka. > > From here I would like to thanks the many people who cont

Introducing JulieOps, a tool to help you build your GitOps and self-service with Apache Kafka and related

2021-02-27 Thread Pere Urbón Bayes
Hi, I hope this message finds everyone healthy and good. I wanted to reach out to the community to introduce JulieOps ( https://github.com/kafka-ops/julie). This is a project I have been working in recent times to help bring automation and self-service when using Apache Kafka. >From her

Re: Help - Issue with Kafka Machines

2020-08-03 Thread 宋英拴
for the write to be considered successful. So the new record append failed beacuse 2 is larger than 1. So you are suggested to check out the reason why the follower replicas out of sync, maybe other brokers down etc. Manoj Chitrala 于2020年8月2日周日 上午2:14写道: > Hi, > > Can anyone help with our kafk

Help - Issue with Kafka Machines

2020-08-01 Thread Manoj Chitrala
Hi, Can anyone help with our kafka servers. Below is the service status. [root@d-u2-kfk-ms-03 bin]# systemctl status kafka -l ● kafka.service - Apache Kafka server (broker) Loaded: loaded (/etc/systemd/system/kafka.service; enabled; vendor preset: disabled) Active: active (running

Re: help needed, kafka-streams 2.5.0 does not support Named on reduce?

2020-07-14 Thread Dumitru-Nicolae Marasoui
I think it does help thank you very much On Fri, 10 Jul 2020 at 17:29, Matthias J. Sax wrote: > It should be possible to name all processors/stores/topics. > > However, it's not always clear how the API works -- in fact, some > `Named` parameters "overlap". It's a k

Re: help needed, kafka-streams 2.5.0 does not support Named on reduce?

2020-07-10 Thread Matthias J. Sax
u can name the corresponding store, via `Materialized`, and the store name will be reused for the changelog topic. If you want to name a repartition topic, you can pass a name via the `Grouped` parameter of `groupBy()` or `groupByKey()`. Does that help? -Matthias On 7/10/20 4:46 AM, Dumitru-Nicolae Mara

Re: help needed, kafka-streams 2.5.0 does not support Named on reduce?

2020-07-10 Thread Dumitru-Nicolae Marasoui
> > LinkedIn <https://www.linkedin.com/company/kaluza> | Twitter > <https://twitter.com/Kaluza_tech> > > Kaluza Ltd. registered in England and Wales No. 08785057 > > VAT No. 100119879 > > Help save paper - do you need to print this email? > -- Dumitru-Nicolae

help needed, kafka-streams 2.5.0 does not support Named on reduce?

2020-07-10 Thread Dumitru-Nicolae Marasoui
registered in England and Wales No. 08785057 VAT No. 100119879 Help save paper - do you need to print this email?

Re: NEED HELP : OutOfMemoryError: Java heap space error while starting KafkaStream with a simple topology

2020-05-28 Thread Guozhang Wang
; free to > do the same. > > Thanks, > -John > > On Thu, May 28, 2020, at 02:55, Pushkar Deole wrote: > > Thanks for the help Guozhang! > > however i realized that the exception and actual problem is totally > > different. The problem was the client was not

Re: NEED HELP : OutOfMemoryError: Java heap space error while starting KafkaStream with a simple topology

2020-05-28 Thread John Roesler
Woah, that's a nasty bug. I've just pinged the Jira ticket. Please feel free to do the same. Thanks, -John On Thu, May 28, 2020, at 02:55, Pushkar Deole wrote: > Thanks for the help Guozhang! > however i realized that the exception and actual problem is totally > different. Th

Re: NEED HELP : OutOfMemoryError: Java heap space error while starting KafkaStream with a simple topology

2020-05-28 Thread Pushkar Deole
Thanks for the help Guozhang! however i realized that the exception and actual problem is totally different. The problem was the client was not set with SSL truststore while server is SSLenabled. I also found this open bug on kafka https://issues.apache.org/jira/browse/KAFKA-4493 After setting

NEED HELP : OutOfMemoryError: Java heap space error while starting KafkaStream with a simple topology

2020-05-27 Thread Pushkar Deole
think 2.4 but that should not be an issue. Any help would be appreciated since I am blocked at this point. Properties props = new Properties(); props.put(StreamsConfig.APPLICATION_ID_CONFIG, DEFAULT_APPLICATION_ID); props.put(StreamsConfig.BOOTSTRAP_SERVERS_CONFIG, theKafkaServers); StreamsBuilder

Need help regarding missing kafka producer metrics while upgrade from 1.1.0 to 2.0.0

2020-05-14 Thread Rajkumar Natarajan
kafka.producer.async:type=ProducerSendThread,name=ProducerQueueSize Could you guys please help me the kafka metrics documentation link or KIP documentation for the above specific producer metrics in kafka 2.0.0 versions.

Re: Help with setting up Kafka Node

2020-04-21 Thread Liam Clarke-Hutchinson
; Sebastian > > > -Ursprüngliche Nachricht- > Von: JOHN, BIBIN > Gesendet: Montag, 20. April 2020 19:04 > An: users@kafka.apache.org > Betreff: RE: Help with setting up Kafka Node > > How are you starting it? > > -Original Message- > From: i...

AW: Help with setting up Kafka Node

2020-04-21 Thread info
-on-debian-9 But note that I am not using the service at the moment, I will start zookeeper and kafka for debugging purpose manually. Kind regards, Sebastian -Ursprüngliche Nachricht- Von: JOHN, BIBIN Gesendet: Montag, 20. April 2020 19:04 An: users@kafka.apache.org Betreff: RE: Help

RE: Help with setting up Kafka Node

2020-04-20 Thread JOHN, BIBIN
How are you starting it? -Original Message- From: i...@fluent-software.de Sent: Monday, April 20, 2020 11:56 AM To: users@kafka.apache.org Subject: AW: Help with setting up Kafka Node I can't see any errors. Changing the debug level to debug I got the following log: [2020-04-20 18

AW: Help with setting up Kafka Node

2020-04-20 Thread info
. (kafka.log.LogManager) Killed $ Kind regards, Sebastian. -Ursprüngliche Nachricht- Von: Lisheng Wang Gesendet: Montag, 20. April 2020 17:56 An: users@kafka.apache.org Betreff: Re: Help with setting up Kafka Node Seems zk's log is normal, the KeeperException dose not matter when you start

Re: Help with setting up Kafka Node

2020-04-20 Thread Lisheng Wang
:19写道: > Hi, > > > > I have a problem with an kafka installation and need some help to go ahead > with my issue. Maybe someone can help. > > If I start kafka, the process is being killed during the startup phrase > after some seconds: > > > > [2020-04-20 17:

Help with setting up Kafka Node

2020-04-20 Thread info
Hi, I have a problem with an kafka installation and need some help to go ahead with my issue. Maybe someone can help. If I start kafka, the process is being killed during the startup phrase after some seconds: [2020-04-20 17:12:26,244] INFO [ThrottledChannelReaper-Fetch]: Starting

Re: Kafka Quota help

2020-04-04 Thread Alex Woolford
Hey Ravi, There's a KIP to add quota management to the admin API: KIP-546 My best guess (based on searching through Slack, Google, etc...) is that this will be part of Apache Kafka

Kafka Quota help

2020-04-03 Thread Ravinder Matte
Team, We are trying to automate quota allocations. Are there any client API’s accessible for users to apply Kafka quotas other than the kafka-configs.sh script? Thank you in advance. Ravi

RE: Please help: How to print --reporting-interval in the perf metrics?

2020-03-04 Thread Sunil CHAUDHARI
Hello Experts, Any thought on this? From: Sunil CHAUDHARI Sent: Tuesday, March 3, 2020 5:46 PM To: users@kafka.apache.org Subject: Please help: How to print --reporting-interval in the perf metrics? Hi, I want to test consumer perf using kafka-consumer-perf-test.sh I am running below command

Please help: How to print --reporting-interval in the perf metrics?

2020-03-03 Thread Sunil CHAUDHARI
Hi, I want to test consumer perf using kafka-consumer-perf-test.sh I am running below command: ./kafka-consumer-perf-test.sh --broker-list localhost:9092 --topic MB3P3R --messages 65495 --num-fetch-threads 9 --print-metrics --reporting-interval 5000 --show-detailed-stats >

RE: HELP in Usage of JMX port in Kafka

2020-02-27 Thread Sunil CHAUDHARI
Hi All, Sorry to bother you all. It was simple.  Just put one line in required .sh file export JMX_PORT= and it will run  thanks, Sunil. From: Sunil CHAUDHARI Sent: Friday, February 28, 2020 10:06 AM To: users@kafka.apache.org Subject: HELP in Usage of JMX port in Kafka Hi all, I have used

HELP in Usage of JMX port in Kafka

2020-02-27 Thread Sunil CHAUDHARI
running manual utilities? Or is there a way I can give different port for kafka-producer-perf-test.sh ? Please help me in this regards. Error: Exception thrown by the agent : java.rmi.server.ExportException: Port already in use: 9099; nested exception is: java.net.BindException: Address

?????? [HELP]

2020-02-12 Thread ??????
tks Have a nice dayFrancis Lee QQ : 1026203200

Re: [HELP]

2020-02-12 Thread Guozhang Wang
I've added francis lee (francislee) to the contribution list. On Wed, Feb 12, 2020 at 1:41 AM 萨尔卡 <1026203...@qq.com> wrote: > hiGuozhang Wang, > info in cwiki: > > > full name: francis lee > mail: francislee...@outlook.com > > > Have a nice dayFrancis Lee > > > QQ : 1026203200 > > > -- --

?????? [HELP]

2020-02-12 Thread ??????
hiGuozhang Wang, info in cwiki: full name: francis lee mail: francislee...@outlook.com Have a nice dayFrancis Lee QQ : 1026203200

Re: [HELP]

2020-02-11 Thread 1026203200
francis lee francislee...@outlook.com > 在 2020年2月11日,20:12,Bruno Cadonna 写道: > > Hi Francis, > > You need to sign-up to the Apache wiki at > https://cwiki.apache.org/confluence/signup.action > > Best, > Bruno > > On Tue, Feb 11, 2020 at 1:05 PM 萨尔卡

Re: [HELP]

2020-02-11 Thread Bruno Cadonna
Hi Francis, You need to sign-up to the Apache wiki at https://cwiki.apache.org/confluence/signup.action Best, Bruno On Tue, Feb 11, 2020 at 1:05 PM 萨尔卡 <1026203...@qq.com> wrote: > > i don't have a apache id. how can i apply one for create KIP? > > > > Have a nice dayFrancis Lee > > > QQ :

?????? [HELP]

2020-02-11 Thread ??????
i don't have a apache id. how can i apply one for create KIP? Have a nice dayFrancis Lee QQ : 1026203200

Re: [HELP]

2020-02-09 Thread Guozhang Wang
Hi Francis, What's your apache id? Guozhang On Sun, Feb 9, 2020 at 5:50 AM 萨尔卡 <1026203...@qq.com> wrote: > hi , > i want to make a KIP for kafka-exporter by java. how can i do it ? > > > > > Have a nice dayFrancis Lee > > > QQ : 1026203200 > > > -- -- Guozhang

[HELP]

2020-02-09 Thread ??????
hi , i want to make a KIP for kafka-exporter by java. how can i do it ? Have a nice dayFrancis Lee QQ : 1026203200

Need Help For Kafka Android Clients

2020-01-08 Thread Israt Jahan
Dear Concerned,​ Hope you are doing well. We wanted to create Apache Kafka Producer and Consumer Client for our Android app. But we are getting this error that the Management Factory is not present in Android. Is there any alternative way we can use for that? If we can, will you suggest any

Re: Please help me with link to documentation ... (generics I think)

2019-12-29 Thread Matthias J. Sax
If it's about generics, see https://stackoverflow.com/questions/5297978/calling-static-generic-methods On 12/28/19 8:50 AM, Guozhang Wang wrote: > Hello Aurel, > > Maybe this helps: > https://kafka.apache.org/24/documentation/streams/developer-guide/dsl-api.html > > Guozhang > > On Fri, Dec

Re: Please help me with link to documentation ... (generics I think)

2019-12-28 Thread Guozhang Wang
Hello Aurel, Maybe this helps: https://kafka.apache.org/24/documentation/streams/developer-guide/dsl-api.html Guozhang On Fri, Dec 27, 2019 at 8:50 AM Aurel Sandu wrote: > Hi all of you, > > I am reading the following code : > .. > KTable wordCounts = textLines >

Please help me with link to documentation ... (generics I think)

2019-12-27 Thread Aurel Sandu
Hi all of you, I am reading the following code : .. KTable wordCounts = textLines .flatMapValues(textLine -> Arrays.asList(textLine.toLowerCase().split("\\W+"))) .groupBy((key, word) -> word) .count(Materialized.>as("counts-store")); ..

Re: help for regarding my question

2019-11-15 Thread Ashutosh singh
Developer Advocate | ro...@confluent.io | @rmoff > > > On Thu, 14 Nov 2019 at 05:04, prashanth sri > wrote: > > > i am new to kafka , can any one help me , regarding my problem. > > > -- Thanx & Regard Ashutosh Singh 08151945559

Re: help for regarding my question

2019-11-15 Thread Robin Moffatt
wrote: > i am new to kafka , can any one help me , regarding my problem. >

Re: help for regarding my question

2019-11-13 Thread Stephen Powis
true On Thu, Nov 14, 2019 at 2:03 PM prashanth sri wrote: > i am new to kafka , can any one help me , regarding my problem. >

  1   2   3   4   >