Can you share a sample test case? How are you doing the unit tests? Are you creating the session in a beforeAll block or similar?
As far as I know, if you use spark you will end up with light integration tests rather than “real” unit tests (please correct me if I am wrong). From: marcos rebelo <ole...@gmail.com> Sent: Tuesday, May 1, 2018 11:25 AM To: user <user@spark.apache.org> Subject: Fast Unit Tests Hey all, We are using Scala and SQL heavily, but I have a problem with VERY SLOW Unit Tests. Is there a way to do fast Unit Tests on Spark? How are you guys going around it? Best Regards Marcos Rebelo
