Grant Henke has submitted this change and it was merged. ( http://gerrit.cloudera.org:8080/11815 )
Change subject: KUDU-2584: Prevent flaky off-by-one errors in backup tests ...................................................................... KUDU-2584: Prevent flaky off-by-one errors in backup tests This patch adds 1 ms to the target snapshot time when a backup is taken. This ensures that we don’t have flakes due to off-by-one errors where all the values are not read. The underlying reason for adding 1 ms is that we pass the timestamp in ms granularity but the snapshot time consists of microseconds plus a logical clock. This means if the data is inserted with a fraction of a ms remaining it could be truncated and unread. Additionaly this patch copies over the timestamp propagation call from the KuduRDD and ensures the Spark tests use the Kudu client from the KuduContext. This should further prevent future snapshot issues. This patch also includes an auto-formating change in KuduBackupOptions that must have been missed in a previous commit. Change-Id: Ia0f1b4a4138cc8c913543a68fad748927cdc439d Reviewed-on: http://gerrit.cloudera.org:8080/11815 Tested-by: Grant Henke <[email protected]> Reviewed-by: Adar Dembo <[email protected]> --- M java/kudu-backup/src/main/scala/org/apache/kudu/backup/KuduBackupOptions.scala M java/kudu-backup/src/main/scala/org/apache/kudu/backup/KuduBackupRDD.scala M java/kudu-backup/src/test/scala/org/apache/kudu/backup/TestKuduBackup.scala M java/kudu-spark/src/test/scala/org/apache/kudu/spark/kudu/KuduTestSuite.scala 4 files changed, 29 insertions(+), 7 deletions(-) Approvals: Grant Henke: Verified Adar Dembo: Looks good to me, approved -- To view, visit http://gerrit.cloudera.org:8080/11815 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: kudu Gerrit-Branch: master Gerrit-MessageType: merged Gerrit-Change-Id: Ia0f1b4a4138cc8c913543a68fad748927cdc439d Gerrit-Change-Number: 11815 Gerrit-PatchSet: 4 Gerrit-Owner: Grant Henke <[email protected]> Gerrit-Reviewer: Adar Dembo <[email protected]> Gerrit-Reviewer: Grant Henke <[email protected]> Gerrit-Reviewer: Hao Hao <[email protected]> Gerrit-Reviewer: Kudu Jenkins (120) Gerrit-Reviewer: Mike Percy <[email protected]> Gerrit-Reviewer: Will Berkeley <[email protected]>
