As part of TDD I am using com.holdenkarau.spark.testing.DatasetSuiteBase to assert if 2 Dataframes values are equal using
assertDataFrameEquals(dataframe1, dataframe2) Although the values are same but it fails assertion because nullable property does not match for some column. Is there are way to get assertDataFrameEquals ignore nullable property? Also can we also extends that to ignore datatypes as well and just match the values? Thanks, Afzal