GitHub user dmainou edited a comment on the discussion: Best practice for dynamic 'De-serialize From File' in a Producer/Consumer pattern
Hey variables is fine but I think you got this not quite right. 2 distinct processes running in parallel Process 1 REST call -> landing/filename_timestamp.json Process 2 get current time as batch_id /landing/filename_.\*.json -> /archive/batch_id/filename_.\*.json /archive/batch_id/filename_.\*.json -> oracle super simple and scalable. Add error handling + backfill and you are done. GitHub link: https://github.com/apache/hop/discussions/6545#discussioncomment-15763644 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected]
