e it easier to debug.
>
> Please note that for any KC sink or source connector, response times from
> the underlying data source/store can impact performance, so you may also
> need to look into that aspect also.
>
> Cheers,
>
> Liam Clarke-Hutchinson
>
> On Thu, 1 Apr
Did anyone face it before? The connector URL is giving 500 request time out.
On Thu, Apr 1, 2021 at 9:55 AM Himanshu Shukla
wrote:
> Hi,
> I am using kafka-connect-file-pulse connector and scanning around 20K
> files. After the scan step, the whole connect cluster is becoming
> unr
utedHerder.java:1034)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:51
--
Regards,
Himanshu Shukla
t.io | @rmoff
>
>
> On Tue, 23 Mar 2021 at 02:02, Himanshu Shukla >
> wrote:
>
> > Hi All,
> >
> > I am having these below understanding regarding Kafka connect.
> >
> > 1. Kafka Connect Standalone has the provision of either running the job
> >
nce, dynamic scaling, etc.
4. Distribute mode only provides the connector job configuration through
the REST interface. There is no other option like reading the connector job
config from the property file or reading it from JDBC etc.
Please confirm, if the above understanding is correct.
--
Regards,
Himanshu Shukla
> > > > Luke
> > > > >
> > > > > On Fri, Mar 5, 2021 at 1:50 PM Pushkar Deole >
> > > > wrote:
> > > > >
> > > > > > Hi All,
> > > > > >
> > > > > > I was looking for some options to backup a running kafka cluster,
> > for
> > > > > > disaster recovery requirements. Can someone provide what are the
> > > > > available
> > > > > > options to backup and restore a running cluster in case the
> entire
> > > > > cluster
> > > > > > goes down?
> > > > > >
> > > > > > Thanks..
> > > > > >
> > > > >
> > > >
> > >
> >
>
--
Regards,
Himanshu Shukla
You can probably look at maxwell by zendesk as well for CDC. They too have
a very simple producer for Kafka.
On Mon, 5 Oct 2020, 04:42 Naveen D, wrote:
> Hi Guys,
>
> We have below scenario to achieve via KAfka windows stand alone
>
> 1. Download apache kafka for windows
> 2.Start Zookeeper
> 3.
across the AZs.
On Mon, Sep 7, 2020 at 2:45 PM Tom Black wrote:
>
>
> Himanshu Shukla wrote:
> > We are planning to go for amazon MSK instead of having our own self
> > launched cluster on bare EC2 machines.
> >
> > It would be very helpful, if someone who has us
?
Will there be any complexity or problem in the future if we go ahead with
this?
--
Regards,
Himanshu Shukla
er my understanding, a new
consumer will be assigned for that partition and it will read these 100
messages again. Is this understanding correct? If yes, then we ended up
reprocessing these 10 messages.
--
Regards,
Himanshu Shukla
It's okay. You could probably take the screenshot and share it.
On Tue, 3 Mar 2020, 20:13 sunil chaudhari,
wrote:
> Hi Himanshu,
> Sorry but I pasted from excel. Dont know how it got messed up?
>
> Will resend it.
>
> On Tue, 3 Mar 2020 at 6:48 PM, Himanshu Sh
95
>
>
>
> 46417.43444
>
> 9.32 MB/sec
>
> 411.44
>
> 705
>
>
>
> Regards,
> Sunil.
> CONFIDENTIAL NOTE:
> The information contained in this email is intended only for the use of
> the individual or entity named above and may contain information that is
> privileged, confidential and exempt from disclosure under applicable law.
> If the reader of this message is not the intended recipient, you are hereby
> notified that any dissemination, distribution or copying of this
> communication is strictly prohibited. If you have received this message in
> error, please immediately notify the sender and delete the mail. Thank you.
>
--
Regards,
Himanshu Shukla
Thanks, Robin. Got the clarification.
Thanks and Regards,
Himanshu Shukla
On Wed, Jan 15, 2020 at 3:40 PM Robin Moffatt wrote:
> If you use a load balancer bear in mind the importance of the
> advertised.listeners setting:
> https://rmoff.net/2018/08/02/kafka-listeners-
is it recommended to use ALB(running all 3 nodes on ec2 instances) or
something similar?
Thanks and Regards,
Himanshu Shukla
On Wed, Jan 15, 2020 at 12:52 PM Tom Bentley wrote:
> Hi Himanshu,
>
> Short answer: yes.
>
> The way a Kafka client works is to connect to one of the
Hi all,
do I have to necessarily have public IPs for all the brokers? Since we can
give a few of the IPs in bootstrap.servers config.
Hi,
Please allow me to join kafka discussion.
Thanks and Regards,
Himanshu Shukla
On Tue, Jan 14, 2020 at 10:32 PM Sunil CHAUDHARI
wrote:
> Hi,
> Please allow me to join kafka discussion.
>
>
> Thanks & regards,
> Sunil.
> CONFIDENTIAL NOTE:
> The informatio
Hi,
I am running a 3 broker Kafka cluster. While doing the performance test, I
am seeing that the broker is not processing the records more than 50MB/sec.
if I am running multiple producer threads on the same machine, even this
50K is getting divided into 50K/no_of_prod_thread.
is there any co
17 matches
Mail list logo
