bamaer opened a new issue, #9322:
URL: https://github.com/apache/hop/issues/9322
### What would you like to happen?
Lineage sinks need more from the engine than they get today, and a few
things are wrong:
- An action's STARTED event is emitted before the action has its own log
channel, so it
carries the wrong run id.
- Every nested pipeline or workflow flushes the lineage hub when it ends. In
a Pipeline
Executor loop that is a flush per row; only top-level runs should flush.
- The lineage exit hook is never registered, so events queued at JVM exit
can be lost.
- Sinks get no workflow graph (which action follows which), no parent
workflow/action/
pipeline/transform names, and no descriptions.
- File inputs do not report which fields they read from the file.
Proposal: fix the above and add a WORKFLOW_GRAPH event kind plus parent and
description
attributes on run lifecycle events. Event kinds stay append-only.
### Issue Priority
Priority: 2
### Issue Component
Component: Other
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
