[
https://issues.apache.org/jira/browse/FLINK-2978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14996535#comment-14996535
]
ASF GitHub Bot commented on FLINK-2978:
---------------------------------------
Github user sachingoel0101 commented on the pull request:
https://github.com/apache/flink/pull/1338#issuecomment-155064766
This can be fixed, but it requires breaking the existing Netty pipeline.
The `HttpObjectAggregator` requires a max content length, which I think cannot
be set to too high; 10 MB seemed reasonable. [I tried setting it to 100 MB and
the JVM ran out of heap space surprisingly. Does the web monitor also use heap
space out of Job Manager? ]
I am not at all familiar with Netty however, and all I know is what I
learnt while working on this. If anyone has an idea how to handle large
uploads, in the existing pipeline, please let me know. :)
Otherwise I think replacing the `HttpObjectAggregator` with something that
handles large payloads on disk might be a good idea. An example is here:
https://github.com/netty/netty/blob/master/example/src/main/java/io/netty/example/http/upload/HttpUploadServerHandler.java
It should be able to handle everything cleanly.
> Integrate web submission interface into the new dashboard
> ---------------------------------------------------------
>
> Key: FLINK-2978
> URL: https://issues.apache.org/jira/browse/FLINK-2978
> Project: Flink
> Issue Type: Bug
> Components: Web Client, Webfrontend
> Reporter: Sachin Goel
> Assignee: Sachin Goel
>
> As discussed in
> http://mail-archives.apache.org/mod_mbox/flink-dev/201511.mbox/%3CCAL3J2zQg6UBKNDnm=8tshpz6r4p2jvx7nrlom7caajrb9s6...@mail.gmail.com%3E,
> we should integrate job submission from the web into the dashboard.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
