csteegz commented on PR #23217: URL: https://github.com/apache/beam/pull/23217#issuecomment-1245936415
It's going to depend on the nesting of the schema, use of options etc and length of the field names, but I'd expect a decent amount. The JSON representation of a large pipeline I have that extensively utilizes schemas went from ~18.7 MB to ~14.2 MB on disc when I manually stripped whitespace characters. While I'm guessing they compress well, this change should save some storage, and depending on how the validation works might let some more pipelines be run. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
