[ https://issues.apache.org/jira/browse/FLINK-20811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17267661#comment-17267661 ]
Xintong Song commented on FLINK-20811: -------------------------------------- [~ZhenqiuHuang] [~nicholasjiang] [~trohrmann] [~jiang7chengzitc] [~fly_in_gis] Let's first try to clarify the scope of the three related tickets. My understanding from the above discussion is as follow. * FLINK-20681: support hdfs paths for ship files/archives for yarn integration * FLINK-20811 (this ticket): support http paths for ship files/archives for yarn integration * FLINK-20867: support local, hdfs and http paths for ship files/archives for native k8s integration Are we all on the same page? And thank both [~nicholasjiang] and [~sanath.mv] for volunteering on this effort. [~nicholasjiang], you have mentioned willing to work on this ticket weeks ago. Are you still interested? > Support HTTP paths for yarn ship files/archives > ----------------------------------------------- > > Key: FLINK-20811 > URL: https://issues.apache.org/jira/browse/FLINK-20811 > Project: Flink > Issue Type: New Feature > Components: Deployment / YARN > Reporter: Xintong Song > Priority: Major > > Flink's Yarn integration supports shipping workload-specific local > files/directories/archives to the Yarn cluster. > As discussed in FLINK-20505, it would be helpful to support directly > downloading contents from HTTP paths to the Yarn cluster, so that users won't > need to first download the contents locally and then upload it to the Yarn > cluster. > -- This message was sent by Atlassian Jira (v8.3.4#803005)