mattcasters opened a new pull request, #8675: URL: https://github.com/apache/hop/pull/8675
Apache Hop had no sizing guide. The installation page only states a floor for the default client (one core and 4 GB of RAM) and a 2 GB heap, which does not answer how small a device can be or how a large batch run should be sized. This adds a user-manual page, linked from the navigation and from the system-requirements section. It explains what actually holds memory (the row-set buffer, lookups, JSON and Excel, Hop Server logs) and then covers three cases. For an edge device it walks through a JSON-input to REST-client pipeline with every unused plugin folder removed. For a data-engineer workstation it covers memory, cores, disk, database latency and a Full HD display. For big data it points at the native Spark and Beam engines instead of raising the Hop heap. The edge numbers come from running that pipeline with `hop-run` on Linux x86_64 and Java 21 against the current client layout. A stripped tree was about 215 MB on disk. The tiny file finished with `-Xmx32m` and about 200 MB resident; the same file with every client plugin still installed needed `-Xmx64m`. A 4.6 MB JSON file finished with `-Xmx48m` and about 270 MB resident. The native Spark engine plugin is about 340 MB and is not part of that client. No Maven tests were run. The change is documentation only. fixes #2408 ------------------------ Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Run `mvn clean install apache-rat:check` to make sure basic checks pass. A more thorough check will be performed on your pull request automatically. - [x] If you have a group of commits related to the same change, please squash your commits into one and force push your branch using `git rebase -i`. - [x] Mention the appropriate issue in your description (for example: `addresses #123`), if applicable. To make clear that you license your contribution under the [Apache License Version 2.0, January 2004](http://www.apache.org/licenses/LICENSE-2.0) you have to acknowledge this by using the following check-box. - [x] I hereby declare this contribution to be licensed under the [Apache License Version 2.0, January 2004](http://www.apache.org/licenses/LICENSE-2.0) - [ ] In any other case, please file an [Apache Individual Contributor License Agreement](https://www.apache.org/licenses/icla.pdf). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
