Strange error in Kafka server logs

2023-12-21 Thread Kostroun Petr
Hi, I have problem with SASL_SSL configuration of Kafka. In Server.log is strange error: 2023-12-21 00:22:17,254] DEBUG Setting SASL/SCRAM_SHA_256 server state to FAILED (org.apache.kafka.common.security.scram.internals.ScramSaslServer) [2023-12-21 00:22:17,256] DEBUG Set SASL server state to

Re: ingesting web server logs, or log4j log files from a boss server

2020-01-15 Thread George
thanks G On Wed, Jan 15, 2020 at 6:19 PM Robin Moffatt wrote: > If spooldir doesn't suit, there's also > https://github.com/streamthoughts/kafka-connect-file-pulse to check out. > Also bear in mind tools like filebeat from Elastic support Kafka as a > target. > > > -- > > Robin Moffatt |

Re: ingesting web server logs, or log4j log files from a boss server

2020-01-15 Thread Robin Moffatt
If spooldir doesn't suit, there's also https://github.com/streamthoughts/kafka-connect-file-pulse to check out. Also bear in mind tools like filebeat from Elastic support Kafka as a target. -- Robin Moffatt | Senior Developer Advocate | ro...@confluent.io | @rmoff On Wed, 15 Jan 2020 at

Re: ingesting web server logs, or log4j log files from a boss server

2020-01-15 Thread George
Hi Tom will do. for now I have 4 specific file types I need to ingest. 1. reading apache web server log files, http.log's. 2. reading in our custom log files 3. reading in log4j log files 4. mysql connection as a source 5. cassandra connection, as a sink I can not use NFS mounting the source

Re: ingesting web server logs, or log4j log files from a boss server

2020-01-15 Thread Tom Bentley
Hi George, Since you mentioned CDC specifically you might want to check out Debezium ( https://debezium.io/) which operates as a connector of the sort Robin referred to and does CDC for MySQL and others. Cheers, Tom On Wed, Jan 15, 2020 at 10:18 AM Robin Moffatt wrote: > The integration part

Re: ingesting web server logs, or log4j log files from a boss server

2020-01-15 Thread Robin Moffatt
The integration part of Apache Kafka that you're talking about is called Kafka Connect. Kafka Connect runs as its own process, known as a Kafka Connect Worker, either on its own or as part of a cluster. Kafka Connect will usually be deployed on a separate instance from the Kafka brokers. Kafka

ingesting web server logs, or log4j log files from a boss server

2020-01-14 Thread George
Hi all. Please advise, a real noob here still, unpacking how the stack still works... if I have a mySQL server, or a web server, or a 2 node JBOSS cluster. If I want to use the mysql connector to connect to the MySQL DB to pull data using CDC... then I need to install the Kafka stack on the DB

RE: Server Logs

2016-01-03 Thread chandra sekar
Dear Ewen, Thanks for your information. If separate app to collect logs, How could to collect logs from sensor devices. Regards Sekar. > Date: Fri, 1 Jan 2016 10:20:37 -0500 > Subject: Re: Server Logs > From: e...@confluent.io > To: users@kafka.apache.org > > Chandra, >

Re: Server Logs

2016-01-01 Thread Ewen Cheslack-Postava
application? Is it IIS server side or Hadoop > Cluster side (kafka)? > Thanks & Regards Sekar > > > > Date: Mon, 28 Dec 2015 13:06:22 -0800 > > Subject: Re: Server Logs > > From: e...@confluent.io > > To: users@kafka.apache.org > > > > Chandra, &

RE: Server Logs

2015-12-29 Thread chandra sekar
Dear Ewen, Where do i run the separate application? Is it IIS server side or Hadoop Cluster side (kafka)? Thanks & Regards Sekar > Date: Mon, 28 Dec 2015 13:06:22 -0800 > Subject: Re: Server Logs > From: e...@confluent.io > To: users@kafka.apache.org > > Chandra, >

Re: Server Logs

2015-12-28 Thread Ewen Cheslack-Postava
Chandra, If you're just serving files from IIS and want to collect logs, you'll probably want to run a separate application to collect the log files and report each log entry to Kafka. If you're running a web application, you can use the producer yourself to report events to Kafka. -Ewen On