Re: Python API + Unit Testing

2021-03-22 Thread Dian Fu
Hi Kevin, >> One approach I could see is using StreamingFileSinks, and validating the output files for a bounded stream. This is a good approach from my point of view. Actually, the end to end tests in Flink also takes this kind of approach. This doesn't only apply for Python jobs, but also for

Re: Python API + Unit Testing

2021-03-19 Thread Kevin Lam
Hi Dian Fu, I meant testing in application development. When I'm developing a Pyflink Pipeline, are there any recommended approaches to testing the Flink application? For instance, how should we test applications end-to-end? Individual operators? I'm interested in the Datastream API. One approach

Re: Python API + Unit Testing

2021-03-18 Thread Dian Fu
Hi, Do you mean how to run Python unit test? If so, you could refer to [1] for more details. Regards, Dian [1] https://cwiki.apache.org/confluence/display/FLINK/Setting+up+a+Flink+development+environment > 2021年3月18日 下午10:46,Kevin Lam 写道: > > Hi all, > > I noticed there isn't much in the w