GitHub user zoomingrocket added a comment to the discussion: Best practice for dynamic 'De-serialize From File' in a Producer/Consumer pattern
@dmainou - Yup, we have that working without serialization but raw flat files per API page are 6-8MB vs a serialized binary file is just 350kb! We need to scale this to 100s of similar pipelines so trying to be conservative about transient disk space needs. Also the performance with serialized file vs raw text is considerably better. GitHub link: https://github.com/apache/hop/discussions/6545#discussioncomment-15763943 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected]
