GitHub user dmainou added a comment to the discussion: Best practice for dynamic 'De-serialize From File' in a Producer/Consumer pattern
and just to nit pick. take a look at these https://hop.apache.org//manual/latest/pipeline/transforms/pipeline-logging.html https://hop.apache.org//manual/latest/pipeline/transforms/workflow-logging.html and look at the samples. Far better logging capability than that logging you are executing. Both have their place, and if you want to scale to hundreds of api calls and run 24*7 then you want to use the above to write your metrics elsewhere. Likely a place where you can throw observability (e.g. prometheus) and governance (open metadata/collibra) over it. GitHub link: https://github.com/apache/hop/discussions/6545#discussioncomment-15774958 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected]
