GitHub user dmainou added a comment to the discussion: Best practice for dynamic 'De-serialize From File' in a Producer/Consumer pattern
ok then ### Process 1 **Pipeline1** P_DATA_SOURCE = customers (parameter) get current time create filename (e.g. P_DATA_SOURCE + "_" + timestamp+ ".ser" pipeline executor passing filename as P_FILENAME (parameter) **Pipeline 2** P_FILENAME REST call -> landing/P_FILENAME ### Process 2 **Pipeline 1** get current time as batch_id /landing/filename_.*.json -> /archive/batch_id/filename_.*.json get list of files in /archive/batch_id/filename_.*.json pipeline executor passing filename as P_FILENAME (parameter) **Pipeline 2** P_FILENAME -> oracle GitHub link: https://github.com/apache/hop/discussions/6545#discussioncomment-15764352 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected]
