Re: AccessDeniedException in Kafka on Windows

Hi Martijn de Bruijn, I think I've reponsed your other mail. But you're right: > On several places FileChannel.open(path, StandardOpenOption.READ) is called which will always fail on Windows when path is a directory. Yes, we tried to flush(fsync) data on directory to make sure it's successfully

AccessDeniedException in Kafka on Windows

We are upgrading our Spring Boot applications to Spring Boot 2.6.1. Spring Boot 2.6.1 upgrade our Kafka dependency from 2.7.1 to 3.0.0. After upgrading I'm getting a AccessDeniedException on all my tests using @EmbeddedKafka. Caused by: java.nio.file.AccessDeniedException:

Re: Using Kafka on Windows (Production environment)

On 2019/06/04 12:58:10, "M. Manna" wrote: > Kafka cannot be run on Windows in production. There are problems with > memory map allocation/releases which results into fatal shutdown. On Linux > it’s allowed, but on Windows it’s prevented. > > You can reproduce this by setting a small log

Re: Using Kafka on Windows (Production environment)

Kafka cannot be run on Windows in production. There are problems with memory map allocation/releases which results into fatal shutdown. On Linux it’s allowed, but on Windows it’s prevented. You can reproduce this by setting a small log retention period on your windows and test with a QuickStart.

Using Kafka on Windows (Production environment)

Hi everyone! I know it is not a common scenario, but I would like to know whether Kafka is ready for running on Windows in a production environment? If yes, does someone have any experience with this scenario to tell me if it is good or not? Thanks in advance! Best Regards, Thiago Sebestyen

Re: Kafka on Windows

>> no idea what a .sh file is,or what that would imply. I guess it's bash >> so yeah. >> But what's so terrifying about actually stating in the FAQ that you >> should not run it as production on windows? >> Why should I conclude that kafka on windows, with java (

Re: Kafka on Windows

But what's so terrifying about actually stating in the FAQ that you > should not run it as production on windows? > Why should I conclude that kafka on windows, with java (which is > supported on windows), and a filesystem (which windows has), and > reliable networking (ditto), doesn'

Re: Kafka on Windows

missing info. It > >> >> sounds like (compared to @M. Manna) that I got off lightly. > >> >> > >> >> So can we put a clear caveat in the documentation, please, right at > >> >> the > >> >> top? > >> >> > >>

Re: Kafka on Windows

that kafka on windows, with java (which is supported on windows), and a filesystem (which windows has), and reliable networking (ditto), doesn't work? When is "just read the code" ever an acceptable answer? Why should I lose 3 days just because someone couldn't put "don't do it" in

Re: Kafka on Windows

share the link? Thanks, Koushik From: M. Manna Sent: Wednesday, August 8, 2018 4:49 AM To: Kafka Users Subject: Re: Kafka on Windows Using docker is probably the best option. The one thing I cannot confirm (and I haven't tried yet) is how the volumes will behav

Re: Kafka on Windows

gt; Serious question. > >> > >> > >> > >> I resent losing 3 days of work because of essential missing info. > It > >> > >> sounds like (compared to @M. Manna) that I got off lightly. > >> > >> > >

Re: Kafka on Windows

> the >> > >> top? >> > >> >> > >> jan >> > >> >> > >> On 07/08/2018, M. Manna wrote: >> > >> > The answer is - Absolutely not. If you don’t have Linux rack, or >> > >> > Kubernetes >> > >> > deployment -it will not work on Windows as guaranteed. >> > >> > >> > >> > I know this because I have tried to make it work for the past 1 >> year. >> > >> > File >> > >> > handling always fails and crashes the cluster on Windows. >> > >> > >> > >> > Thanks, >> > >> > >> > >> > >> > >> > >> > >> > On Tue, 7 Aug 2018 at 01:54, Alew wrote: >> > >> > >> > >> > > Hi! >> > >> > > >> > >> > > Is it recommended to use production Kafka cluster on Windows? >> > >> > > >> > >> > > Can't get it from the documentation. It is possible to start >> > >> > > Kafka >> > on >> > >> > > Windows, but maybe it's for development purposes only. >> > >> > > >> > >> > > Thanks. >> > >> > > >> > >> > > >> > >> > > >> > >> > > >> > >> > >> > > >> > >> >> >> >

Re: Kafka on Windows

rack, or > > >> > Kubernetes > > >> > deployment -it will not work on Windows as guaranteed. > > >> > > > >> > I know this because I have tried to make it work for the past 1 > year. > > >> > File > > >> > handling always fails and crashes the cluster on Windows. > > >> > > > >> > Thanks, > > >> > > > >> > > > >> > > > >> > On Tue, 7 Aug 2018 at 01:54, Alew wrote: > > >> > > > >> > > Hi! > > >> > > > > >> > > Is it recommended to use production Kafka cluster on Windows? > > >> > > > > >> > > Can't get it from the documentation. It is possible to start Kafka > > on > > >> > > Windows, but maybe it's for development purposes only. > > >> > > > > >> > > Thanks. > > >> > > > > >> > > > > >> > > > > >> > > > > >> > > > > > > > > >

Re: Kafka on Windows

t -it will not work on Windows as guaranteed. > >> > > >> > I know this because I have tried to make it work for the past 1 year. > >> > File > >> > handling always fails and crashes the cluster on Windows. > >> > > >> > Thanks, > >> > > >> > > >> > > >> > On Tue, 7 Aug 2018 at 01:54, Alew wrote: > >> > > >> > > Hi! > >> > > > >> > > Is it recommended to use production Kafka cluster on Windows? > >> > > > >> > > Can't get it from the documentation. It is possible to start Kafka > on > >> > > Windows, but maybe it's for development purposes only. > >> > > > >> > > Thanks. > >> > > > >> > > > >> > > > >> > > > >> > > > >

Re: Kafka on Windows

M. Manna wrote: > >> > The answer is - Absolutely not. If you don’t have Linux rack, or > >> > Kubernetes > >> > deployment -it will not work on Windows as guaranteed. > >> > > >> > I know this because I have tried to make it work for th

Re: Kafka on Windows

’t have Linux rack, or >> > Kubernetes >> > deployment -it will not work on Windows as guaranteed. >> > >> > I know this because I have tried to make it work for the past 1 year. >> > File >> > handling always fails and crashes the cluster on W

Re: Kafka on Windows

as guaranteed. > > > > I know this because I have tried to make it work for the past 1 year. File > > handling always fails and crashes the cluster on Windows. > > > > Thanks, > > > > > > > > On Tue, 7 Aug 2018 at 01:54, Alew wrote: > >

Re: Kafka on Windows

past 1 year. File > handling always fails and crashes the cluster on Windows. > > Thanks, > > > > On Tue, 7 Aug 2018 at 01:54, Alew wrote: > >> Hi! >> >> Is it recommended to use production Kafka cluster on Windows? >> >> Can't get it from the doc

Re: Kafka on Windows

at 01:54, Alew wrote: > Hi! > > Is it recommended to use production Kafka cluster on Windows? > > Can't get it from the documentation. It is possible to start Kafka on > Windows, but maybe it's for development purposes only. > > Thanks. > > > >

Kafka on Windows

Hi! Is it recommended to use production Kafka cluster on Windows? Can't get it from the documentation. It is possible to start Kafka on Windows, but maybe it's for development purposes only. Thanks.

Re: Kafka on windows

Kafka uses Linux OS page cache and flushing techniques as well as in-sync replicas to bring down latency since storing to the hard drive is likely the slowest part. It seems it would be defeating the point if you were to install it on Windows, just like everyone here mentioned. ;) Just wanted to

Re: Kafka on windows

If you want reduce maintenance headaches, I highly recommend not running brokers on windows (or in vm’s for that matter). It really isn’t supported. Kafka needs highly performant OS primitives. For example, XFS, and ext4 are recommended filesystems for reasons specific to Kafka. If this is

Re: Kafka on windows

I'm curious as well. That doc blurb doesn't give specifics. How is kafka run (or tested) on Windows? Natively via the command line shell, etc. or via cygwin, within a *nix VM on Windows, or via Windows 10's Ubuntu Linux Bash shell? Would be interesting to see how each method I listed performs,

Re: Kafka on windows

One issue is that Kafka leverage some very specific features of the linux kernel that are probably far different from Windows, so I imagine the performance profile is likewise much different. On 4/11/17, 8:52 AM, "Tomasz Rojek" wrote: Hi All, We want to

Kafka on windows

Hi All, We want to choose provider of messaging system in our company, one of possible choices is Apache Kafka. One of operating system that will host brokers is windows, according to documentation: https://kafka.apache.org/documentation.html#os "*We have seen a few issues running on Windows and

Re: Problems with Kafka Quickstart (Windows)

.apache.org Date: 03/04/2017 08:26 AM Subject: Problems with Kafka Quickstart (Windows) Dear Sir/Madam, I just started exploring Kafka on Windows(10) but there are some of the things that i found missing, not sure of all as i am still not completed the exploration. 1.)Window

Problems with Kafka Quickstart (Windows)

Dear Sir/Madam, I just started exploring Kafka on Windows(10) but there are some of the things that i found missing, not sure of all as i am still not completed the exploration. 1.)Windows support should be provided in better way... Just writing Windows platforms use bin\windows\ instead of bin

Re: Kafka Streams windows strange behavior

Hello Adrienne, Are you running the Streams library of 0.10.0.0 version? If yes could you try it again with current trunk of Kafka? Guozhang On Thu, Sep 8, 2016 at 8:19 AM, Adrienne Kole wrote: > Hi, > > I am trying to implement simple scenario on streams library of

Kafka Streams windows strange behavior

Hi, I am trying to implement simple scenario on streams library of kafka. I insert data to kafka topic 1 tuple/second. Streams library is connected to particular topic and what it does is: 1. construct 8 second windows with 4 second sliding time, 2. sum values of tuples

Kafka C++ Windows Client for 0.8 Releases

Hi Tianning Zhang http://grokbase.com/user/Tianning-Zhang/cU7bvxhLspNvF9E5i946Aj, Did you make this Kafka C++ native client library for windows public? I would like to use your library. Thanks Vindhyavasini

RE: Re: Kafka C++ Windows Client for 0.8 Releases

Hoffman hoffman...@gmail.com Betreff: Re: Kafka C++ Windows Client for 0.8 Releases An: users@kafka.apache.org users@kafka.apache.org Datum: Mittwoch, 19. März, 2014 16:04 Uhr That would be fantastic. How long will that take you? Would you put it up on github? On Wednesday, March 19, 2014

Re: Kafka C++ Windows Client for 0.8 Releases

schrieb am Mi, 19.3.2014: Betreff: Re: Kafka C++ Windows Client for 0.8 Releases An: users@kafka.apache.org Datum: Mittwoch, 19. März, 2014 13:42 Uhr If you are okay to use Cygwin then librdkafka might be of interest: https://github.com/edenhill/librdkafka/tree/c++_configure 2014

Kafka C++ Windows Client for 0.8 Releases

Dear all, I am writing to this list to check if there is any new progress concerning 0.8 Windows C++ clients and if there are experiences we can share. My company (we are in the context of performance advertising networks) is using Kafka 0.8 as the backbone for the event infrastructure. As the

Re: Kafka C++ Windows Client for 0.8 Releases

Curious- does your impl require Cygwin? If not, I'd love to use it On Wednesday, March 19, 2014, Tianning Zhang tianning.zh...@zanox.com wrote: Dear all, I am writing to this list to check if there is any new progress concerning 0.8 Windows C++ clients and if there are experiences we can

Re: Kafka C++ Windows Client for 0.8 Releases

If you are okay to use Cygwin then librdkafka might be of interest: https://github.com/edenhill/librdkafka/tree/c++_configure 2014-03-19 19:10 GMT+07:00 Tianning Zhang tianning.zh...@zanox.com: Dear all, I am writing to this list to check if there is any new progress concerning 0.8 Windows

Re: Kafka C++ Windows Client for 0.8 Releases

...@gmail.com schrieb am Mi, 19.3.2014: Betreff: Re: Kafka C++ Windows Client for 0.8 Releases An: users@kafka.apache.org users@kafka.apache.org Datum: Mittwoch, 19. März, 2014 13:13 Uhr Curious- does your impl require Cygwin?  If not, I'd love to use it On Wednesday, March 19, 2014, Tianning

Re: Kafka C++ Windows Client for 0.8 Releases

will separate generic part from our proprietary resources/Apis and make it public, KR Tianning Dan Hoffman hoffman...@gmail.com javascript:; schrieb am Mi, 19.3.2014: Betreff: Re: Kafka C++ Windows Client for 0.8 Releases An: users@kafka.apache.org

Re: Kafka C++ Windows Client for 0.8 Releases

the package for windows - e.g. with Pthreads-win32? KR Tianning Magnus Edenhill mag...@edenhill.se schrieb am Mi, 19.3.2014: Betreff: Re: Kafka C++ Windows Client for 0.8 Releases An: users@kafka.apache.org Datum: Mittwoch, 19. März, 2014 13:42

Using Kafka on Windows - file path problems

Hi, I have a problem going through start guide on Windows. Basically what I found are file path problems it seems: If I try to set Kafka log dir path in server.properties using Windows file separator, such as D:\tmp\kafka-logs, or even \tmp\kafka-logs , then kafka cannot be started, since it

Re: Using Kafka on Windows - file path problems

It sounds like \tmp\kafka-logs should work since that's what File.getParent() returns. Not sure why you can't use that to create the file. Thanks, Jun On Sat, Jan 25, 2014 at 12:43 AM, Vjeran Marcinko vjeran.marci...@email.t-com.hr wrote: Hi, I have a problem going through start guide on

RE: Using Kafka on Windows - file path problems

, January 25, 2014 5:25 PM To: users@kafka.apache.org Subject: Re: Using Kafka on Windows - file path problems It sounds like \tmp\kafka-logs should work since that's what File.getParent() returns. Not sure why you can't use that to create the file. Thanks, Jun On Sat, Jan 25, 2014 at 12:43 AM

RE: Using Kafka on Windows - file path problems

-Original Message- From: Vjeran Marcinko [mailto:vjeran.marci...@email.t-com.hr] Sent: Saturday, January 25, 2014 6:10 PM To: users@kafka.apache.org Subject: RE: Using Kafka on Windows - file path problems Even if in that one case the thing would work, it would be best if any correct windows

Re: Need help for kafka on windows

I think your bug was reported here, but there is not enough details so maybe i'm wrong https://issues.apache.org/jira/browse/KAFKA-1195 If this is your bug, the good new is you are not alone on the other hand, the bug priority is minor and there is no fix yet... On Tue, Jan 14, 2014 at 6:15

Re: Need help for kafka on windows

Hi Sripada, Unfortunately I can't provide a code fix, but it's an easy fix actually. Basically the path that is trying to look for kafka-run-class.bat is wrong as it expects that file to be from the current window's folder. You can either cd into the parent and run it or fix the script. Tim

RE: Running Kafka on Windows?

11:01 PM To: users@kafka.apache.org Subject: Re: Running Kafka on Windows? I ported them for both 7.2 and 8.0 but the patch was only commited for the 8.0 branch. You can find the 7.2 scripts here : https://github.com/avianey/kafka/tree/0.7.2 2012/12/5 Johan Lundahl johan.lund...@gmail.com I've

Running Kafka on Windows?

for provides windows batch script for starting Kafka/Zookeeper; patched b Is this the one I should download and use to run Kafka on Windows? Can someone please point me to the right direction? Thanks for your help. Jamie