how to get assertDataFrameEquals ignore nullable

2017-05-05 Thread A Shaikh
As part of TDD I am using com.holdenkarau.spark.testing.DatasetSuiteBase to assert if 2 Dataframes values are equal using assertDataFrameEquals(dataframe1, dataframe2) Although the values are same but it fails assertion because nullable property does not match for some column. Is there are way t

how to get assertDataFrameEquals ignore nullable

2017-05-05 Thread A Shaikh
As part of TDD I am using com.holdenkarau.spark.testing.DatasetSuiteBase to assert if 2 Dataframes values are equal using assertDataFrameEquals(dataframe1, dataframe2) Although the values are same but it fails assertion because nullable property does not match for some column. Is there are way t