jonvex opened a new pull request, #7831:
URL: https://github.com/apache/hudi/pull/7831
### Change Logs
The test was timing out sometimes. This was because the datagen source was
not being reset. When the source creates 3000 unique keys, it will only give
out updates after that. After the first run, each fetch data it would get
1000/3000 records. This will get nearly all after the first few fetches, but
getting every single one takes a lot of fetches
<details>
<summary>Here is an example of this effect</summary>
```
jon@Jonathans-MBP testtable_MERGE_ON_READ % grep numInserts .hoodie/* | grep
-v inflight | grep -v requested
grep: .hoodie/archived: Is a directory
grep: .hoodie/metadata: Is a directory
.hoodie/20230202130912581.deltacommit: "numInserts" : 328,
.hoodie/20230202130912581.deltacommit: "numInserts" : 344,
.hoodie/20230202130912581.deltacommit: "numInserts" : 328,
.hoodie/20230202130920274.deltacommit: "numInserts" : 235,
.hoodie/20230202130920274.deltacommit: "numInserts" : 219,
.hoodie/20230202130920274.deltacommit: "numInserts" : 222,
.hoodie/20230202130925101.deltacommit: "numInserts" : 157,
.hoodie/20230202130925101.deltacommit: "numInserts" : 148,
.hoodie/20230202130925101.deltacommit: "numInserts" : 143,
.hoodie/20230202130928902.deltacommit: "numInserts" : 93,
.hoodie/20230202130928902.deltacommit: "numInserts" : 102,
.hoodie/20230202130928902.deltacommit: "numInserts" : 118,
.hoodie/20230202130932465.deltacommit: "numInserts" : 73,
.hoodie/20230202130932465.deltacommit: "numInserts" : 63,
.hoodie/20230202130932465.deltacommit: "numInserts" : 54,
.hoodie/20230202130937296.deltacommit: "numInserts" : 35,
.hoodie/20230202130937296.deltacommit: "numInserts" : 39,
.hoodie/20230202130937296.deltacommit: "numInserts" : 44,
.hoodie/20230202130945028.deltacommit: "numInserts" : 26,
.hoodie/20230202130945028.deltacommit: "numInserts" : 26,
.hoodie/20230202130945028.deltacommit: "numInserts" : 36,
.hoodie/20230202130949980.deltacommit: "numInserts" : 15,
.hoodie/20230202130949980.deltacommit: "numInserts" : 26,
.hoodie/20230202130949980.deltacommit: "numInserts" : 16,
.hoodie/20230202130955462.deltacommit: "numInserts" : 13,
.hoodie/20230202130955462.deltacommit: "numInserts" : 13,
.hoodie/20230202130955462.deltacommit: "numInserts" : 11,
.hoodie/20230202131000533.deltacommit: "numInserts" : 11,
.hoodie/20230202131000533.deltacommit: "numInserts" : 4,
.hoodie/20230202131000533.deltacommit: "numInserts" : 11,
.hoodie/20230202131007097.deltacommit: "numInserts" : 6,
.hoodie/20230202131007097.deltacommit: "numInserts" : 4,
.hoodie/20230202131007097.deltacommit: "numInserts" : 7,
.hoodie/20230202131013141.deltacommit: "numInserts" : 3,
.hoodie/20230202131013141.deltacommit: "numInserts" : 2,
.hoodie/20230202131013141.deltacommit: "numInserts" : 2,
.hoodie/20230202131018138.deltacommit: "numInserts" : 2,
.hoodie/20230202131018138.deltacommit: "numInserts" : 2,
.hoodie/20230202131018138.deltacommit: "numInserts" : 4,
.hoodie/20230202131023542.deltacommit: "numInserts" : 2,
.hoodie/20230202131023542.deltacommit: "numInserts" : 0,
.hoodie/20230202131023542.deltacommit: "numInserts" : 1,
.hoodie/20230202131028359.commit: "numInserts" : 0,
.hoodie/20230202131029163.deltacommit: "numInserts" : 3,
.hoodie/20230202131029163.deltacommit: "numInserts" : 0,
.hoodie/20230202131029163.deltacommit: "numInserts" : 0,
```
</details>
### Impact
Less randomly failing ci
### Risk level (write none, low medium or high below)
none
### Documentation Update
_Describe any necessary documentation update if there is any new feature,
config, or user-facing change_
N/A
### Contributor's checklist
- [ ] Read through [contributor's
guide](https://hudi.apache.org/contribute/how-to-contribute)
- [ ] Change Logs and Impact were stated clearly
- [ ] Adequate tests were added if applicable
- [ ] CI passed
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
