Hi All, When I Increase the KafkaConfig.bufferSizeBytes & KafkaConfig.fetchSizeBytes values to (100 * 1024 * 1024), I get the desired throughput, but the spout after sometime or whenever I restart the topology goes OUT OF MEMORY, but when I reduce the value of Bytes to (5 * 1024 * 1024) then it impacts the throughput largely.
I also wanted to know the relation between Max Spout Pending VS (KafkaConfig.bufferSizeBytes & KafkaConfig.fetchSizeBytes), does batch size is decided with Max Spout Pending Config or with KafkaConfig.bufferSizeBytes. Regards, Nilesh Chhapru.
