hansva opened a new pull request, #9142: URL: https://github.com/apache/hop/pull/9142
### What An experimental option on the **Local** pipeline run configuration: **Lock-free row sets (experimental)**, stored as `lock_free_rowsets`, off by default. When it is on, rows are passed between transforms through a new `LockFreeRowSet` instead of the lock-based row sets: - **Batched wake-ups:** the transform that reads a buffer is woken once a batch of rows is ready, not for every row. - **Several inputs:** a transform with several inputs waits on all of them at once, and is woken by whichever input has rows. - **No polling:** transforms no longer poll their inputs, so *Wait time buffer check (ms)* is not used with this option. - **Spilling hops:** hops that spill to disk to avoid a buffer deadlock keep their spilling buffer. With the option off, nothing changes. ### Changes - `LockFreeRowSet` (new) and an extension of `IRowSet`. - `BaseTransform` and `Pipeline` pick the row set from the run configuration. - The run configuration editor gets the checkbox, with label and tooltip. - Docs: the option is described in the native local pipeline engine page. - Removed: the earlier `BlockingBatchingRowSet` prototype and its `HOP_BATCHING_ROWSET` variable, from `Const`, the variables docs and the sample `hop-config.json` files. ------------------------ Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Run `mvn clean install apache-rat:check` to make sure basic checks pass. A more thorough check will be performed on your pull request automatically. - [ ] If you have a group of commits related to the same change, please squash your commits into one and force push your branch using `git rebase -i`. - [ ] Mention the appropriate issue in your description (for example: `addresses #123`), if applicable. To make clear that you license your contribution under the [Apache License Version 2.0, January 2004](http://www.apache.org/licenses/LICENSE-2.0) you have to acknowledge this by using the following check-box. - [ ] I hereby declare this contribution to be licensed under the [Apache License Version 2.0, January 2004](http://www.apache.org/licenses/LICENSE-2.0) - [ ] In any other case, please file an [Apache Individual Contributor License Agreement](https://www.apache.org/licenses/icla.pdf). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
