There is no 'best' configuration, it all depends on your use cases,
expected load, etc.
Documentation is a good place to start
https://kafka.apache.org/documentation.html#hwandos
There are a few good benchmark articles. They're a bit dated by now, but
still hold true in most cases:
*
https://engineering.linkedin.com/kafka/benchmarking-apache-kafka-2-million-writes-second-three-cheap-machines
* https://grey-boundary.io/load-testing-apache-kafka-on-aws/
As to what procedures I'd propose is spinning up a cluster and running
some tests on it. Sangrenel (used in the second article above) is a
great tool https://github.com/jamiealquiza/sangrenel for that.
On 2016.11.09 09:58, Majid Golshadi wrote:
Hello
We want to use Kafka in our production environment but we don't have any
information about what's the best server configuration and the best
benchmark can be achieve in our production environment (Based on our
hardware and VMs)
I'm really rookie in this area.
For getting to the best configuration for our production environment what
procedures do you propose?
suppose I want to run kafka on 3 machines with the following configuration:
cpu: 2 core
Ram: 4 gig
HDD. 7500 rpm
