Re: Testing Flink with identity program in hibench

2021-05-17 Thread Nicolaus Weidner
Hi, I am not familiar with hibench. Does the Flink UI show the configured parallelism of 20 for the job, and there are indeed 20 partitions on the Kafka topic you consume? Which Flink version are you running? The repo https://github.com/Intel-bigdata/HiBench mentions Flink 1.0.3, which is *very *o

Testing Flink with identity program in hibench

2021-05-17 Thread penguin.
Thanks for reading this email. According to the introduction, the identity program in hibench reads data from Kafka and then writes it back to Kafka. When using the identity program in hibench to test the Flink, set the parallelism to 20 in the flink.conf file in the conf directory of hiben