[
https://issues.apache.org/jira/browse/BEAM-11904?focusedWorklogId=559602&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-559602
]
ASF GitHub Bot logged work on BEAM-11904:
-----------------------------------------
Author: ASF GitHub Bot
Created on: 01/Mar/21 22:00
Start Date: 01/Mar/21 22:00
Worklog Time Spent: 10m
Work Description: dpcollins-google commented on pull request #14122:
URL: https://github.com/apache/beam/pull/14122#issuecomment-788329463
R: @pabloem
I don't know if this would affect anything in the dataflow backend? But
AFAICT this would result in more compressed JSON and fewer user jobs over the
limit.
@Fokko, I don't know that this solves your issue. Even after this change,
your job graph size is still over the limit (20 MiB IIUC?)
https://cloud.google.com/dataflow/docs/guides/common-errors#job-graph-too-large
It might be good to look at what is in the serialized JSON payload for your
job, see if there's any multi-MiB blobs of data that you shouldn't be
serializing?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 559602)
Time Spent: 20m (was: 10m)
> Remove PrettyPrinting from json job definition
> ----------------------------------------------
>
> Key: BEAM-11904
> URL: https://issues.apache.org/jira/browse/BEAM-11904
> Project: Beam
> Issue Type: Improvement
> Components: extensions-java-gcp
> Affects Versions: 2.28.0
> Reporter: Fokko Driesprong
> Assignee: Fokko Driesprong
> Priority: P2
> Fix For: 2.29.0
>
> Time Spent: 20m
> Remaining Estimate: 0h
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
