yanghua commented on pull request #1707: URL: https://github.com/apache/hudi/pull/1707#issuecomment-640572401
> > The unit test structure need to be refactored. Right now we initialized and clean up resources for every single test, which is inefficient. > > @xushiyan @yanghua WDYT? This part is true.. I was also looking into whether we can use a single spark context for the entire test run.. Nonetheless.. Would love some helping hand with the test situation currently.. We need to get CI back stable again, so we can merge with confidence.. My thought: Can we distinguish the objects of `HoodieClientTestHarness` into **weight** and **light** level? For example, `JavaSparkContext` and `MiniDFSCluster` can be considered as the weight objects. Then we can initialize them via `ClassRule` or `Rule` mode? WDYT? @xushiyan and other guys. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
