Re: spark stream kafka wait for all data process done

2019-08-01 Thread 刘 勇
message From: zenglong chen Date: 8/2/19 09:59 (GMT+08:00) To: user@spark.apache.org Subject: spark stream kafka wait for all data process done How can kafka wait for tasks process done then begin receive next batch?I want to process 5000 record once by pandas and it may take too long time

spark stream kafka wait for all data process done

2019-08-01 Thread zenglong chen
How can kafka wait for tasks process done then begin receive next batch?I want to process 5000 record once by pandas and it may take too long time to process.