Do you have anything like Graphite or Ganglia monitoring the box to see
exactly what's going on?
On Fri, Jan 31, 2014 at 1:45 PM, David Montgomery <davidmontgom...@gmail.com
> wrote:
> Welll...I did get kafka to run on a digiocean box with 4 gigs or ram. All
> great but now i am paying 40 USD a month for dev servers when I was paying
> 5. I have 5 dev servers around the worlds. Would be great to get back ot
> 5 USD for boxes that just need to start up rather just doing anything
> substantial.
>
> Going back to the original issue. Is this the only lever I have to get
> kafka to work on a 512megs ram box? KAFKA_HEAP_OPTS="-Xmx256M -Xms128M?
> Any other trick?
>
> Thanks
>
>
>
> On Sat, Feb 1, 2014 at 5:21 AM, Benjamin Black <b...@b3k.us> wrote:
>
> > Sorry, was looking at pre-release 0.8 code. No idea now why they are not
> > being set as expected.
> >
> >
> > On Fri, Jan 31, 2014 at 1:20 PM, Benjamin Black <b...@b3k.us> wrote:
> >
> > > kafka-run-class.sh in 0.8 does not define KAFKA_HEAP_OPTS. i think you
> > > want KAFKA_OPTS.
> > >
> > >
> > > On Fri, Jan 31, 2014 at 1:14 PM, David Montgomery <
> > > davidmontgom...@gmail.com> wrote:
> > >
> > >> What d you mean?
> > >>
> > >> This is appended to kafka-run-class.sh
> > >>
> > >> KAFKA_JMX_OPTS="-Dcom.sun.management.jmxremote=true
> > >> -Dcom.sun.management.jmxremote.authenticate=false
> > >> -Dcom.sun.management.jmxremote.ssl=false"
> > >>
> > >> prior to running the below in the shel I run => export
> > >> KAFKA_HEAP_OPTS="-Xmx1G -Xms1G"
> > >>
> > >> I start kafka like this:
> > >> /var/lib/kafka-0.8.0-src/bin/kafka-server-start.sh
> > >> /var/lib/kafka-0.8.0-src/config/server.properties
> > >>
> > >> What else is there do? I did not have an issue with kafka 7. Only 8.
> > >>
> > >> Thanks
> > >>
> > >>
> > >>
> > >>
> > >>
> > >>
> > >>
> > >>
> > >> On Fri, Jan 31, 2014 at 4:47 AM, Benjamin Black <b...@b3k.us> wrote:
> > >>
> > >> > are you sure the java opts are being set as you expect?
> > >> > On Jan 30, 2014 12:41 PM, "David Montgomery" <
> > davidmontgom...@gmail.com
> > >> >
> > >> > wrote:
> > >> >
> > >> > > Hi,
> > >> > >
> > >> > > This is a dedicated machine on DO. But i can say I did not
> have a
> > >> > > problem with kafka 7.
> > >> > > I just upgraded the macine to 1gig on digi ocean. Same error.
> > >> > >
> > >> > > export KAFKA_HEAP_OPTS="-Xmx1G -Xms1G"
> > >> > > root@do-kafka-sf-development-20140130195343
> :/etc/supervisor/conf.d#
> > >> > > /var/lib/kafka-0.8.0-src/bin/kafka-server-start.sh
> > >> > > /var/lib/kafka-0.8.0-src/config/server.properties
> > >> > > OpenJDK 64-Bit Server VM warning: INFO:
> > >> > > os::commit_memory(0x00000000bad30000, 986513408, 0) failed;
> > >> error='Cannot
> > >> > > allocate memory' (errno=12)
> > >> > > #
> > >> > > # There is insufficient memory for the Java Runtime Environment to
> > >> > > continue.
> > >> > > # Native memory allocation (malloc) failed to allocate 986513408
> > bytes
> > >> > for
> > >> > > committing reserved memory.
> > >> > > # An error report file with more information is saved as:
> > >> > > # /etc/supervisor/conf.d/hs_err_pid11635.log
> > >> > >
> > >> > >
> > >> > >
> > >> > > Below is how I install via chef
> > >> > >
> > >> > > version = '0.8.0'
> > >> > > tar -xzf kafka-#{version}-src.tgz
> > >> > > cd kafka-#{version}-src
> > >> > > ./sbt update
> > >> > > ./sbt package
> > >> > > ./sbt assembly-package-dependency
> > >> > > echo 'KAFKA_JMX_OPTS="-Dcom.sun.management.jmxremote=true
> > >> > > -Dcom.sun.management.jmxremote.authenticate=false
> > >> > > -Dcom.sun.management.jmxremote.ssl=false"' | tee -a
> > >> > > /var/lib/kafka-#{version}-src/bin/kafka-run-class.sh
> > >> > > echo 'export JMX_PORT=${JMX_PORT:-9999}' | tee -a
> > >> > > /var/lib/kafka-#{version}-src/bin/kafka-server-start.sh
> > >> > >
> > >> > >
> > >> > >
> > >> > >
> > >> > >
> > >> > >
> > >> > >
> > >> > >
> > >> > >
> > >> > >
> > >> > >
> > >> > >
> > >> > >
> > >> > > On Fri, Jan 31, 2014 at 4:04 AM, Jay Kreps <jay.kr...@gmail.com>
> > >> wrote:
> > >> > >
> > >> > > > I think this may be more a general java thing. Can you try
> running
> > >> any
> > >> > > java
> > >> > > > class with the same command line options you are using for kafka
> > and
> > >> > > > confirm that that also doesn't work.
> > >> > > >
> > >> > > > -Jay
> > >> > > >
> > >> > > > On Thu, Jan 30, 2014 at 11:23 AM, David Montgomery <
> > >> > > > davidmontgom...@gmail.com> wrote:
> > >> > > >
> > >> > > > > Hi, <%20us...@kafka.apache.org>
> > >> > > > >
> > >> > > > > Why oh whhy can I nt start kafka 8? I am on a machine with
> 512
> > >> megs
> > >> > of
> > >> > > > ram
> > >> > > > > on digi ocean. What does one have to do to get kafka to work?
> > >> > > > >
> > >> > > > >
> > >> > > > >
> > >> > > > > root@do-kafka-sf-development-20140130051956: export
> > >> > > > > KAFKA_HEAP_OPTS="-Xmx256M -Xms128M
> > >> > > > > root@do-kafka-sf-development-20140130051956
> > >> :/etc/supervisor/conf.d#
> > >> > > > > /var/lib/kafka-0.8.0-src/bin/kafka-server-start.sh
> > >> > > > > /var/lib/kafka-0.8.0-src/config/server.properties
> > >> > > > > OpenJDK 64-Bit Server VM warning: INFO:
> > >> > > > > os::commit_memory(0x00000000bad30000, 986513408, 0) failed;
> > >> > > error='Cannot
> > >> > > > > allocate memory' (errno=12)
> > >> > > > > #
> > >> > > > > # There is insufficient memory for the Java Runtime
> Environment
> > to
> > >> > > > > continue.
> > >> > > > > # Native memory allocation (malloc) failed to allocate
> 986513408
> > >> > bytes
> > >> > > > for
> > >> > > > > committing reserved memory.
> > >> > > > > # An error report file with more information is saved as:
> > >> > > > > # /etc/supervisor/conf.d/hs_err_pid17533.log
> > >> > > > >
> > >> > > > >
> > >> > > > > Thanks
> > >> > > > >
> > >> > > >
> > >> > >
> > >> >
> > >>
> > >
> > >
> >
>
