Hello All, I've been trying to subtract one dataset from another. Both datasets contain case classes of the same type. When I subtract B from A, I end up with a copy of A that still has the records of B in it. (An intersection of A and B always results in 0 results.) All I can figure is that spark is doing an equality check that determines nothing matches. What is that equality function and is there some way I can change it?
Thanks Tim