Re: AccessDeniedException in Kafka on Windows

2021-12-09 Thread Luke Chen
Hi Martijn de Bruijn, I think I've reponsed your other mail. But you're right: > On several places FileChannel.open(path, StandardOpenOption.READ) is called which will always fail on Windows when path is a directory. Yes, we tried to flush(fsync) data on directory to make sure it's successfully

AccessDeniedException in Kafka on Windows

2021-12-08 Thread de Bruijn, M. (Martijn)
We are upgrading our Spring Boot applications to Spring Boot 2.6.1. Spring Boot 2.6.1 upgrade our Kafka dependency from 2.7.1 to 3.0.0. After upgrading I'm getting a AccessDeniedException on all my tests using @EmbeddedKafka. Caused by: java.nio.file.AccessDeniedException: C:\Temp\spring.kafka

Re: Using Kafka on Windows (Production environment)

2019-06-20 Thread avivros
On 2019/06/04 12:58:10, "M. Manna" wrote: > Kafka cannot be run on Windows in production. There are problems with > memory map allocation/releases which results into fatal shutdown. On Linux > it’s allowed, but on Windows it’s prevented. > > You can reproduce this by setting a small log reten

Re: Using Kafka on Windows (Production environment)

2019-06-04 Thread M. Manna
Kafka cannot be run on Windows in production. There are problems with memory map allocation/releases which results into fatal shutdown. On Linux it’s allowed, but on Windows it’s prevented. You can reproduce this by setting a small log retention period on your windows and test with a QuickStart.

Using Kafka on Windows (Production environment)

2019-06-04 Thread Thiago Sebestyen Varea
Hi everyone! I know it is not a common scenario, but I would like to know whether Kafka is ready for running on Windows in a production environment? If yes, does someone have any experience with this scenario to tell me if it is good or not? Thanks in advance! Best Regards, Thiago Sebestyen V

Re: Kafka on Windows

2018-09-05 Thread jan
uy that does MSSQL (on windows, obviously) I literally have >> no idea what a .sh file is,or what that would imply. I guess it's bash >> so yeah. >> But what's so terrifying about actually stating in the FAQ that you >> should not run it as production on windows

Re: Kafka on Windows

2018-09-05 Thread Liam Clarke
s bash > so yeah. > But what's so terrifying about actually stating in the FAQ that you > should not run it as production on windows? > Why should I conclude that kafka on windows, with java (which is > supported on windows), and a filesystem (which windows has), and > relia

Re: Kafka on Windows

2018-09-05 Thread M. Manna
at > >> >> the > >> >> top? > >> >> > >> >> jan > >> >> > >> >> On 07/08/2018, M. Manna wrote: > >> >> > The answer is - Absolutely not. If you don’t have Linux rack, or > >> >> > Kubernetes > >> >> > deployment -it will not work on Windows as guaranteed. > >> >> > > >> >> > I know this because I have tried to make it work for the past 1 > >> >> > year. > >> >> > File > >> >> > handling always fails and crashes the cluster on Windows. > >> >> > > >> >> > Thanks, > >> >> > > >> >> > > >> >> > > >> >> > On Tue, 7 Aug 2018 at 01:54, Alew wrote: > >> >> > > >> >> > > Hi! > >> >> > > > >> >> > > Is it recommended to use production Kafka cluster on Windows? > >> >> > > > >> >> > > Can't get it from the documentation. It is possible to start > Kafka > >> on > >> >> > > Windows, but maybe it's for development purposes only. > >> >> > > > >> >> > > Thanks. > >> >> > > > >> >> > > > >> >> > > > >> >> > > > >> >> > > >> > > >> > > >

Re: Kafka on Windows

2018-09-05 Thread jan
clude that kafka on windows, with java (which is supported on windows), and a filesystem (which windows has), and reliable networking (ditto), doesn't work? When is "just read the code" ever an acceptable answer? Why should I lose 3 days just because someone couldn't put "d

Re: Kafka on Windows

2018-09-04 Thread Liam Clarke
er is - Absolutely not. If you don’t have Linux rack, or > >> > Kubernetes > >> > deployment -it will not work on Windows as guaranteed. > >> > > >> > I know this because I have tried to make it work for the past 1 year. > >> > File > >> > handlin

Re: Kafka on Windows

2018-09-04 Thread Koushik Chitta
s? Can you share the link? Thanks, Koushik From: M. Manna Sent: Wednesday, August 8, 2018 4:49 AM To: Kafka Users Subject: Re: Kafka on Windows Using docker is probably the best option. The one thing I cannot confirm (and I haven't tried yet) is how the vol

Re: Kafka on Windows

2018-08-08 Thread M. Manna
hat I got off lightly. > >> > >> > >> > >> So can we put a clear caveat in the documentation, please, right at > >> the > >> > >> top? > >> > >> > >> > >> jan > >> > >> > >> > >> On 07/08/2018, M. Manna wrote: > >> > >> > The answer is - Absolutely not. If you don’t have Linux rack, or > >> > >> > Kubernetes > >> > >> > deployment -it will not work on Windows as guaranteed. > >> > >> > > >> > >> > I know this because I have tried to make it work for the past 1 > >> year. > >> > >> > File > >> > >> > handling always fails and crashes the cluster on Windows. > >> > >> > > >> > >> > Thanks, > >> > >> > > >> > >> > > >> > >> > > >> > >> > On Tue, 7 Aug 2018 at 01:54, Alew wrote: > >> > >> > > >> > >> > > Hi! > >> > >> > > > >> > >> > > Is it recommended to use production Kafka cluster on Windows? > >> > >> > > > >> > >> > > Can't get it from the documentation. It is possible to start > >> > >> > > Kafka > >> > on > >> > >> > > Windows, but maybe it's for development purposes only. > >> > >> > > > >> > >> > > Thanks. > >> > >> > > > >> > >> > > > >> > >> > > > >> > >> > > > >> > >> > > >> > > > >> > > >> > >> > >> > > >

Re: Kafka on Windows

2018-08-07 Thread jan
n, please, right at >> the >> > >> top? >> > >> >> > >> jan >> > >> >> > >> On 07/08/2018, M. Manna wrote: >> > >> > The answer is - Absolutely not. If you don’t have Linux rack, or >> > >> > Kubernetes >> > >> > deployment -it will not work on Windows as guaranteed. >> > >> > >> > >> > I know this because I have tried to make it work for the past 1 >> year. >> > >> > File >> > >> > handling always fails and crashes the cluster on Windows. >> > >> > >> > >> > Thanks, >> > >> > >> > >> > >> > >> > >> > >> > On Tue, 7 Aug 2018 at 01:54, Alew wrote: >> > >> > >> > >> > > Hi! >> > >> > > >> > >> > > Is it recommended to use production Kafka cluster on Windows? >> > >> > > >> > >> > > Can't get it from the documentation. It is possible to start >> > >> > > Kafka >> > on >> > >> > > Windows, but maybe it's for development purposes only. >> > >> > > >> > >> > > Thanks. >> > >> > > >> > >> > > >> > >> > > >> > >> > > >> > >> > >> > > >> > >> >> >> >

Re: Kafka on Windows

2018-08-07 Thread M. Manna
y not. If you don’t have Linux rack, or > > >> > Kubernetes > > >> > deployment -it will not work on Windows as guaranteed. > > >> > > > >> > I know this because I have tried to make it work for the past 1 > year. > > >> > File > > >> > handling always fails and crashes the cluster on Windows. > > >> > > > >> > Thanks, > > >> > > > >> > > > >> > > > >> > On Tue, 7 Aug 2018 at 01:54, Alew wrote: > > >> > > > >> > > Hi! > > >> > > > > >> > > Is it recommended to use production Kafka cluster on Windows? > > >> > > > > >> > > Can't get it from the documentation. It is possible to start Kafka > > on > > >> > > Windows, but maybe it's for development purposes only. > > >> > > > > >> > > Thanks. > > >> > > > > >> > > > > >> > > > > >> > > > > >> > > > > > > > > >

Re: Kafka on Windows

2018-08-07 Thread M. Manna
s > >> > deployment -it will not work on Windows as guaranteed. > >> > > >> > I know this because I have tried to make it work for the past 1 year. > >> > File > >> > handling always fails and crashes the cluster on Windows. > >> > > >> > Thanks, > >> > > >> > > >> > > >> > On Tue, 7 Aug 2018 at 01:54, Alew wrote: > >> > > >> > > Hi! > >> > > > >> > > Is it recommended to use production Kafka cluster on Windows? > >> > > > >> > > Can't get it from the documentation. It is possible to start Kafka > on > >> > > Windows, but maybe it's for development purposes only. > >> > > > >> > > Thanks. > >> > > > >> > > > >> > > > >> > > > >> > > > >

Re: Kafka on Windows

2018-08-07 Thread Jacob Sheck
to make it work for the past 1 year. > >> > File > >> > handling always fails and crashes the cluster on Windows. > >> > > >> > Thanks, > >> > > >> > > >> > > >> > On Tue, 7 Aug 2018 at 01:54, Alew wrote: > >> > > >> > > Hi! > >> > > > >> > > Is it recommended to use production Kafka cluster on Windows? > >> > > > >> > > Can't get it from the documentation. It is possible to start Kafka > on > >> > > Windows, but maybe it's for development purposes only. > >> > > > >> > > Thanks. > >> > > > >> > > > >> > > > >> > > > >> > > > >

Re: Kafka on Windows

2018-08-07 Thread jan
ashes the cluster on Windows. >> > >> > Thanks, >> > >> > >> > >> > On Tue, 7 Aug 2018 at 01:54, Alew wrote: >> > >> > > Hi! >> > > >> > > Is it recommended to use production Kafka cluster on Windows? >> > > >> > > Can't get it from the documentation. It is possible to start Kafka on >> > > Windows, but maybe it's for development purposes only. >> > > >> > > Thanks. >> > > >> > > >> > > >> > > >> > >

Re: Kafka on Windows

2018-08-07 Thread Rahul Singh
rote: > > > > > Hi! > > > > > > Is it recommended to use production Kafka cluster on Windows? > > > > > > Can't get it from the documentation. It is possible to start Kafka on > > > Windows, but maybe it's for development purposes only. > > > > > > Thanks. > > > > > > > > > > > > > >

Re: Kafka on Windows

2018-08-07 Thread jan
ake it work for the past 1 year. File > handling always fails and crashes the cluster on Windows. > > Thanks, > > > > On Tue, 7 Aug 2018 at 01:54, Alew wrote: > >> Hi! >> >> Is it recommended to use production Kafka cluster on Windows? >> >> Can'

Re: Kafka on Windows

2018-08-07 Thread M. Manna
at 01:54, Alew wrote: > Hi! > > Is it recommended to use production Kafka cluster on Windows? > > Can't get it from the documentation. It is possible to start Kafka on > Windows, but maybe it's for development purposes only. > > Thanks. > > > >

Kafka on Windows

2018-08-06 Thread Alew
Hi! Is it recommended to use production Kafka cluster on Windows? Can't get it from the documentation. It is possible to start Kafka on Windows, but maybe it's for development purposes only. Thanks.

Re: Kafka on windows

2017-04-14 Thread Daniel Hinojosa
Kafka uses Linux OS page cache and flushing techniques as well as in-sync replicas to bring down latency since storing to the hard drive is likely the slowest part. It seems it would be defeating the point if you were to install it on Windows, just like everyone here mentioned. ;) Just wanted to

Re: Kafka on windows

2017-04-14 Thread David Garcia
If you want reduce maintenance headaches, I highly recommend not running brokers on windows (or in vm’s for that matter). It really isn’t supported. Kafka needs highly performant OS primitives. For example, XFS, and ext4 are recommended filesystems for reasons specific to Kafka. If this is j

Re: Kafka on windows

2017-04-11 Thread David Luu
I'm curious as well. That doc blurb doesn't give specifics. How is kafka run (or tested) on Windows? Natively via the command line shell, etc. or via cygwin, within a *nix VM on Windows, or via Windows 10's Ubuntu Linux Bash shell? Would be interesting to see how each method I listed performs, mayb

Re: Kafka on windows

2017-04-11 Thread David Garcia
One issue is that Kafka leverage some very specific features of the linux kernel that are probably far different from Windows, so I imagine the performance profile is likewise much different. On 4/11/17, 8:52 AM, "Tomasz Rojek" wrote: Hi All, We want to choose provider of messagin

Kafka on windows

2017-04-11 Thread Tomasz Rojek
Hi All, We want to choose provider of messaging system in our company, one of possible choices is Apache Kafka. One of operating system that will host brokers is windows, according to documentation: https://kafka.apache.org/documentation.html#os "*We have seen a few issues running on Windows and

RE: Using Kafka on Windows - file path problems

2014-01-25 Thread Vjeran Marcinko
. -Vjeran -Original Message- From: Vjeran Marcinko [mailto:vjeran.marci...@email.t-com.hr] Sent: Saturday, January 25, 2014 6:10 PM To: users@kafka.apache.org Subject: RE: Using Kafka on Windows - file path problems Even if in that one case the thing would work, it would be best if a

RE: Using Kafka on Windows - file path problems

2014-01-25 Thread Vjeran Marcinko
urday, January 25, 2014 5:25 PM To: users@kafka.apache.org Subject: Re: Using Kafka on Windows - file path problems It sounds like \tmp\kafka-logs should work since that's what File.getParent() returns. Not sure why you can't use that to create the file. Thanks, Jun On Sat, Jan 25, 2

Re: Using Kafka on Windows - file path problems

2014-01-25 Thread Jun Rao
It sounds like \tmp\kafka-logs should work since that's what File.getParent() returns. Not sure why you can't use that to create the file. Thanks, Jun On Sat, Jan 25, 2014 at 12:43 AM, Vjeran Marcinko < vjeran.marci...@email.t-com.hr> wrote: > Hi, > > I have a problem going through start guide

Using Kafka on Windows - file path problems

2014-01-25 Thread Vjeran Marcinko
Hi, I have a problem going through start guide on Windows. Basically what I found are file path problems it seems: If I try to set Kafka log dir path in server.properties using Windows file separator, such as D:\tmp\kafka-logs, or even \tmp\kafka-logs , then kafka cannot be started, since it thro

Re: Need help for kafka on windows

2014-01-14 Thread Timothy Chen
Hi Sripada, Unfortunately I can't provide a code fix, but it's an easy fix actually. Basically the path that is trying to look for kafka-run-class.bat is wrong as it expects that file to be from the current window's folder. You can either cd into the parent and run it or fix the script. Tim O

Re: Need help for kafka on windows

2014-01-14 Thread Francois Langelier
I think your bug was reported here, but there is not enough details so maybe i'm wrong https://issues.apache.org/jira/browse/KAFKA-1195 If this is your bug, the good new is you are not alone on the other hand, the bug priority is minor and there is no fix yet... On Tue, Jan 14, 2014 at 6:15 AM

Need help for kafka on windows

2014-01-14 Thread sripada.ngg
Hi All, I am new to apache kafka. Can you please any one help me to setup apache kafka (kafka_2.8.0-0.8.0). I have download and try to run batch file under bin/windows folder I am getting below error. "'kafka-run-class.bat' is not recognized as an internal or external command,operable progr

RE: Running Kafka on Windows?

2012-12-05 Thread Jamie Wang
bat file to include the path to the run-class .bat. Jamie -Original Message- From: Jamie Wang [mailto:jamie.w...@actuate.com] Sent: Wednesday, December 05, 2012 12:33 PM To: users@kafka.apache.org Subject: RE: Running Kafka on Windows? Thanks for all the replies. I downloaded th

RE: Running Kafka on Windows?

2012-12-05 Thread Jamie Wang
11:01 PM To: users@kafka.apache.org Subject: Re: Running Kafka on Windows? I ported them for both 7.2 and 8.0 but the patch was only commited for the 8.0 branch. You can find the 7.2 scripts here : https://github.com/avianey/kafka/tree/0.7.2 2012/12/5 Johan Lundahl > I've been test

Re: Running Kafka on Windows?

2012-12-04 Thread Antoine Vianey
51ace71b783751ec8434for"; > provides windows batch script for starting Kafka/Zookeeper; patched > > > b...". Is this the one I should download and use to run Kafka on > > Windows? > > > Can someone please point me to the right direction? Thanks for your > > help. > > > > > > Jamie > > > > > >

Re: Running Kafka on Windows?

2012-12-04 Thread Johan Lundahl
rovides windows batch script for starting Kafka/Zookeeper; patched > > b...". Is this the one I should download and use to run Kafka on > Windows? > > Can someone please point me to the right direction? Thanks for your > help. > > > > Jamie > > >

Re: Running Kafka on Windows?

2012-12-04 Thread Jun Rao
ed > b...". Is this the one I should download and use to run Kafka on Windows? > Can someone please point me to the right direction? Thanks for your help. > > Jamie >

Running Kafka on Windows?

2012-12-04 Thread Jamie Wang
c8434 for " provides windows batch script for starting Kafka/Zookeeper; patched b...". Is this the one I should download and use to run Kafka on Windows? Can someone please point me to the right direction? Thanks for your help. Jamie