mattcasters opened a new pull request, #8716: URL: https://github.com/apache/hop/pull/8716
This continues the Beam engine work for #8708. The new commit adds the remaining IO transforms and the source-topology guard that goes with them. Beam MQTT input and output, Debezium input, and Elasticsearch input and output are Beam transforms with annotated dialogs. A source rejects an enabled incoming hop, including an error hop, before it expands. Splunk output writes HEC events through SplunkIO. Failure text contains the HTTP status only. Snowflake input and output copy a bounded collection through a GCS external stage. There is no streaming read and no Snowpipe write. The Direct runner run configuration can set the GCP temp location separately from the general temp location. The Beam plugin non-UI suite ran 307 tests and the isolated-display UI suite ran 187 tests, both with no failures. The Beam module RAT check reported 0 unapproved files. No pipeline was run against a live Snowflake account or GCS bucket, and the new connectors are not certified on remote runners. Parquet and Avro file handlers are still not implemented. The Flink job-id finding is documented and has not been posted on #3131. addresses #8708 ------------------------ Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Run `mvn clean install apache-rat:check` to make sure basic checks pass. A more thorough check will be performed on your pull request automatically. - [ ] If you have a group of commits related to the same change, please squash your commits into one and force push your branch using `git rebase -i`. - [x] Mention the appropriate issue in your description (for example: `addresses #123`), if applicable. To make clear that you license your contribution under the [Apache License Version 2.0, January 2004](http://www.apache.org/licenses/LICENSE-2.0) you have to acknowledge this by using the following check-box. - [x] I hereby declare this contribution to be licensed under the [Apache License Version 2.0, January 2004](http://www.apache.org/licenses/LICENSE-2.0) - [ ] In any other case, please file an [Apache Individual Contributor License Agreement](https://www.apache.org/licenses/icla.pdf). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
