[jira] [Updated] (YARN-9561) Add C changes for the new RuncContainerRuntime

2019-08-13 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-9561: -- Attachment: YARN-9561.003.patch > Add C changes for the new RuncContainerRuntime > -

[jira] [Commented] (YARN-9562) Add Java changes for the new RuncContainerRuntime

2019-08-13 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16906295#comment-16906295 ] Eric Badger commented on YARN-9562: --- [~eyang], yes that's the error. I caught this error

[jira] [Updated] (YARN-9562) Add Java changes for the new RuncContainerRuntime

2019-08-13 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-9562: -- Attachment: YARN-9562.003.patch > Add Java changes for the new RuncContainerRuntime > --

[jira] [Commented] (YARN-9562) Add Java changes for the new RuncContainerRuntime

2019-08-12 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16905630#comment-16905630 ] Eric Badger commented on YARN-9562: --- {noformat:title=ImageTagToManifestPlugin.java}

[jira] [Commented] (YARN-9562) Add Java changes for the new RuncContainerRuntime

2019-08-12 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16905586#comment-16905586 ] Eric Badger commented on YARN-9562: --- [~eyang], could you post your relevant config setti

[jira] [Commented] (YARN-9564) Create docker-to-squash tool for image conversion

2019-08-12 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16905579#comment-16905579 ] Eric Badger commented on YARN-9564: --- [~eyang], those logs are normal. When debug logging

[jira] [Commented] (YARN-9564) Create docker-to-squash tool for image conversion

2019-08-09 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16904219#comment-16904219 ] Eric Badger commented on YARN-9564: --- The skopeo error looks to be because {{XDG_RUNTIME_

[jira] [Commented] (YARN-9442) container working directory has group read permissions

2019-08-09 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16904172#comment-16904172 ] Eric Badger commented on YARN-9442: --- YARN-88 gives some relevant discussion based on the

[jira] [Commented] (YARN-9442) container working directory has group read permissions

2019-08-09 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16904118#comment-16904118 ] Eric Badger commented on YARN-9442: --- [~Jim_Brennan], [~eyang], [~shaneku...@gmail.com],

[jira] [Commented] (YARN-9527) Rogue LocalizerRunner/ContainerLocalizer repeatedly downloading same file

2019-08-09 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16904104#comment-16904104 ] Eric Badger commented on YARN-9527: --- Thanks, [~eyang]! > Rogue LocalizerRunner/Containe

[jira] [Commented] (YARN-9564) Create docker-to-squash tool for image conversion

2019-08-08 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16903391#comment-16903391 ] Eric Badger commented on YARN-9564: --- {noformat} [ebadger@foobar sbin]$ pwd /home/ebadger

[jira] [Updated] (YARN-9564) Create docker-to-squash tool for image conversion

2019-08-08 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-9564: -- Attachment: YARN-9564.003.patch > Create docker-to-squash tool for image conversion > --

[jira] [Commented] (YARN-9527) Rogue LocalizerRunner/ContainerLocalizer repeatedly downloading same file

2019-08-06 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16901665#comment-16901665 ] Eric Badger commented on YARN-9527: --- [~billie.rina...@gmail.com], [~djp], [~eyang], [~bi

[jira] [Commented] (YARN-9442) container working directory has group read permissions

2019-08-06 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16901647#comment-16901647 ] Eric Badger commented on YARN-9442: --- +1 lgtm. I'll commit in a day or two if there are n

[jira] [Commented] (YARN-9564) Create docker-to-squash tool for image conversion

2019-08-06 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16901413#comment-16901413 ] Eric Badger commented on YARN-9564: --- Patch 002 addresses the rest of your review comment

[jira] [Updated] (YARN-9564) Create docker-to-squash tool for image conversion

2019-08-06 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-9564: -- Attachment: YARN-9564.002.patch > Create docker-to-squash tool for image conversion > --

[jira] [Commented] (YARN-8045) Reduce log output from container status calls

2019-08-06 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16901179#comment-16901179 ] Eric Badger commented on YARN-8045: --- [~shaneku...@gmail.com], can you review the 2.8 pat

[jira] [Commented] (YARN-9564) Create docker-to-squash tool for image conversion

2019-08-05 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16900209#comment-16900209 ] Eric Badger commented on YARN-9564: --- Hi [~eyang], appreciate the comments. First and for

[jira] [Updated] (YARN-8045) Reduce log output from container status calls

2019-08-02 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-8045: -- Attachment: YARN-8045.001-branch-2.8.patch > Reduce log output from container status calls > ---

[jira] [Updated] (YARN-8045) Reduce log output from container status calls

2019-08-02 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-8045: -- Fix Version/s: 3.1.3 2.9.3 2.8.6 3.0.4

[jira] [Reopened] (YARN-8045) Reduce log output from container status calls

2019-08-02 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger reopened YARN-8045: --- > Reduce log output from container status calls > - > >

[jira] [Commented] (YARN-9562) Add Java changes for the new RuncContainerRuntime

2019-08-01 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16898350#comment-16898350 ] Eric Badger commented on YARN-9562: --- Hey [~eyang], thanks for trying out the patch! Here

[jira] [Commented] (YARN-9564) Create docker-to-squash tool for image conversion

2019-08-01 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16898345#comment-16898345 ] Eric Badger commented on YARN-9564: --- Once the tool completes, your hdfs-root should look

[jira] [Commented] (YARN-9564) Create docker-to-squash tool for image conversion

2019-08-01 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16898342#comment-16898342 ] Eric Badger commented on YARN-9564: --- {noformat} [ebadger@foo bin]$ ./docker-to-squash.py

[jira] [Updated] (YARN-9564) Create docker-to-squash tool for image conversion

2019-08-01 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-9564: -- Attachment: YARN-9564.001.patch > Create docker-to-squash tool for image conversion > --

[jira] [Commented] (YARN-8045) Reduce log output from container status calls

2019-07-25 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16893064#comment-16893064 ] Eric Badger commented on YARN-8045: --- [~shaneku...@gmail.com], [~ccondit], do you have an

[jira] [Commented] (YARN-9647) Docker launch fails when local-dirs or log-dirs is unhealthy.

2019-07-22 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16890443#comment-16890443 ] Eric Badger commented on YARN-9647: --- bq. We can resolve this error by keeping track of t

[jira] [Commented] (YARN-9647) Docker launch fails when local-dirs or log-dirs is unhealthy.

2019-07-22 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16890394#comment-16890394 ] Eric Badger commented on YARN-9647: --- [~eyang], [~Jim_Brennan], [~billie.rinaldi], any id

[jira] [Commented] (YARN-9647) Docker launch fails when local-dirs or log-dirs is unhealthy.

2019-07-22 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16890393#comment-16890393 ] Eric Badger commented on YARN-9647: --- [~magnum], thanks for the explanation. I understand

[jira] [Commented] (YARN-9562) Add Java changes for the new RuncContainerRuntime

2019-07-19 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16889228#comment-16889228 ] Eric Badger commented on YARN-9562: --- Uploading patch 002 with unit tests added. bq. Wh

[jira] [Updated] (YARN-9562) Add Java changes for the new RuncContainerRuntime

2019-07-19 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-9562: -- Attachment: YARN-9562.002.patch > Add Java changes for the new RuncContainerRuntime > --

[jira] [Commented] (YARN-9562) Add Java changes for the new RuncContainerRuntime

2019-07-19 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16889182#comment-16889182 ] Eric Badger commented on YARN-9562: --- bq. GetContainerRuntimeData is designed to return a

[jira] [Commented] (YARN-9647) Docker launch fails when local-dirs or log-dirs is unhealthy.

2019-07-12 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16883948#comment-16883948 ] Eric Badger commented on YARN-9647: --- Hi [~magnum], thanks for the patch. Could you expl

[jira] [Commented] (YARN-9562) Add Java changes for the new RuncContainerRuntime

2019-06-28 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16875283#comment-16875283 ] Eric Badger commented on YARN-9562: --- Attaching patch 001 as an initial patch to give eve

[jira] [Updated] (YARN-9562) Add Java changes for the new RuncContainerRuntime

2019-06-28 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-9562: -- Attachment: YARN-9562.001.patch > Add Java changes for the new RuncContainerRuntime > --

[jira] [Commented] (YARN-9560) Restructure DockerLinuxContainerRuntime to extend a new OCIContainerRuntime

2019-06-28 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16875252#comment-16875252 ] Eric Badger commented on YARN-9560: --- Thanks [~eyang], [~Jim_Brennan], [~ccondit], [~shan

[jira] [Commented] (YARN-9560) Restructure DockerLinuxContainerRuntime to extend a new OCIContainerRuntime

2019-06-28 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16875018#comment-16875018 ] Eric Badger commented on YARN-9560: --- Patch 013 addresses checkstyle in the meantime > R

[jira] [Updated] (YARN-9560) Restructure DockerLinuxContainerRuntime to extend a new OCIContainerRuntime

2019-06-28 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-9560: -- Attachment: YARN-9560.013.patch > Restructure DockerLinuxContainerRuntime to extend a new OCIContainerRu

[jira] [Commented] (YARN-9560) Restructure DockerLinuxContainerRuntime to extend a new OCIContainerRuntime

2019-06-28 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16875010#comment-16875010 ] Eric Badger commented on YARN-9560: --- The reason for having the {{isDockerContainerReques

[jira] [Commented] (YARN-9560) Restructure DockerLinuxContainerRuntime to extend a new OCIContainerRuntime

2019-06-27 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16874630#comment-16874630 ] Eric Badger commented on YARN-9560: --- Patch 012 keeps the environment variables as static

[jira] [Updated] (YARN-9560) Restructure DockerLinuxContainerRuntime to extend a new OCIContainerRuntime

2019-06-27 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-9560: -- Attachment: YARN-9560.012.patch > Restructure DockerLinuxContainerRuntime to extend a new OCIContainerRu

[jira] [Updated] (YARN-9564) Create docker-to-squash tool for image conversion

2019-06-27 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-9564: -- Description: The new runc runtime uses docker images that are converted into multiple squashfs images. E

[jira] [Commented] (YARN-9560) Restructure DockerLinuxContainerRuntime to extend a new OCIContainerRuntime

2019-06-25 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16872716#comment-16872716 ] Eric Badger commented on YARN-9560: --- Patch 011 changes the names of the non static keys

[jira] [Updated] (YARN-9560) Restructure DockerLinuxContainerRuntime to extend a new OCIContainerRuntime

2019-06-25 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-9560: -- Attachment: YARN-9560.011.patch > Restructure DockerLinuxContainerRuntime to extend a new OCIContainerRu

[jira] [Commented] (YARN-9560) Restructure DockerLinuxContainerRuntime to extend a new OCIContainerRuntime

2019-06-25 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16872669#comment-16872669 ] Eric Badger commented on YARN-9560: --- I'm not sure about the checkstyle warnings. The var

[jira] [Updated] (YARN-9561) Add C changes for the new RuncContainerRuntime

2019-06-24 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-9561: -- Description: This JIRA will be used to add the C changes to the container-executor native binary that ar

[jira] [Updated] (YARN-9562) Add Java changes for the new RuncContainerRuntime

2019-06-24 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-9562: -- Description: This JIRA will be used to add the Java changes for the new RuncContainerRuntime. This will

[jira] [Updated] (YARN-9560) Restructure DockerLinuxContainerRuntime to extend a new OCIContainerRuntime

2019-06-24 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-9560: -- Description: Since the new OCI/squashFS/runc runtime will be using a lot of the same code as DockerLinu

[jira] [Updated] (YARN-9560) Restructure DockerLinuxContainerRuntime to extend a new OCIContainerRuntime

2019-06-24 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-9560: -- Description: Since the new RuncContainerRuntime will be using a lot of the same code as DockerLinuxCont

[jira] [Updated] (YARN-9560) Restructure DockerLinuxContainerRuntime to extend a new OCIContainerRuntime

2019-06-24 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-9560: -- Attachment: YARN-9560.010.patch > Restructure DockerLinuxContainerRuntime to extend a new OCIContainerRu

[jira] [Commented] (YARN-9560) Restructure DockerLinuxContainerRuntime to extend a new OCIContainerRuntime

2019-06-24 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16871712#comment-16871712 ] Eric Badger commented on YARN-9560: --- Attaching patch 010 to fix some checkstyle issues

[jira] [Commented] (YARN-9560) Restructure DockerLinuxContainerRuntime to extend a new OCIContainerRuntime

2019-06-24 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16871711#comment-16871711 ] Eric Badger commented on YARN-9560: --- Thanks for the reviews [~Jim_Brennan], [~eyang]! Co

[jira] [Updated] (YARN-9560) Restructure DockerLinuxContainerRuntime to extend a new OCIContainerRuntime

2019-06-24 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-9560: -- Attachment: YARN-9560.009.patch > Restructure DockerLinuxContainerRuntime to extend a new OCIContainerRu

[jira] [Commented] (YARN-9014) OCI/squashfs container runtime

2019-06-21 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16869634#comment-16869634 ] Eric Badger commented on YARN-9014: --- [~ccondit], uploaded v002 of the design document. I

[jira] [Updated] (YARN-9014) OCI/squashfs container runtime

2019-06-21 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-9014: -- Attachment: RuncContainerRuntime.v002.pdf > OCI/squashfs container runtime > ---

[jira] [Updated] (YARN-9582) Port YARN-8569 to RuncContainerRuntime

2019-06-20 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-9582: -- Summary: Port YARN-8569 to RuncContainerRuntime (was: Port YARN-8569 to FSImageContainerRuntime) > Por

[jira] [Commented] (YARN-9560) Restructure DockerLinuxContainerRuntime to extend a new OCIContainerRuntime

2019-06-20 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16868664#comment-16868664 ] Eric Badger commented on YARN-9560: --- Attaching path 008 to address checkstyle. There wil

[jira] [Updated] (YARN-9560) Restructure DockerLinuxContainerRuntime to extend a new OCIContainerRuntime

2019-06-20 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-9560: -- Attachment: YARN-9560.008.patch > Restructure DockerLinuxContainerRuntime to extend a new OCIContainerRu

[jira] [Commented] (YARN-9560) Restructure DockerLinuxContainerRuntime to extend a new OCIContainerRuntime

2019-06-19 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16868189#comment-16868189 ] Eric Badger commented on YARN-9560: --- Attached patch 007 that moves a bunch of the config

[jira] [Updated] (YARN-9560) Restructure DockerLinuxContainerRuntime to extend a new OCIContainerRuntime

2019-06-19 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-9560: -- Attachment: YARN-9560.007.patch > Restructure DockerLinuxContainerRuntime to extend a new OCIContainerRu

[jira] [Commented] (YARN-9560) Restructure DockerLinuxContainerRuntime to extend a new OCIContainerRuntime

2019-06-12 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16862386#comment-16862386 ] Eric Badger commented on YARN-9560: --- bq. Perhaps we could have the OCI interface class e

[jira] [Commented] (YARN-9560) Restructure DockerLinuxContainerRuntime to extend a new OCIContainerRuntime

2019-06-12 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16862329#comment-16862329 ] Eric Badger commented on YARN-9560: --- {quote} At this time, the end user configuration YA

[jira] [Updated] (YARN-9560) Restructure DockerLinuxContainerRuntime to extend a new OCIContainerRuntime

2019-05-29 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-9560: -- Labels: Docker (was: ) > Restructure DockerLinuxContainerRuntime to extend a new OCIContainerRuntime >

[jira] [Commented] (YARN-9585) Order of environment variables set up inside ContainerLaunchContext cannot be guaranteed inside the launch_container.sh resulting in inconsistent resolution of transitiv

2019-05-28 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16849903#comment-16849903 ] Eric Badger commented on YARN-9585: --- Is this fixed by YARN-5714? > Order of environment

[jira] [Commented] (YARN-9560) Restructure DockerLinuxContainerRuntime to extend a new OCIContainerRuntime

2019-05-24 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16847833#comment-16847833 ] Eric Badger commented on YARN-9560: --- I've opened YARN-9582 to port the yarn sysfs featur

[jira] [Created] (YARN-9582) Port YARN-8569 to FSImageContainerRuntime

2019-05-24 Thread Eric Badger (JIRA)
Eric Badger created YARN-9582: - Summary: Port YARN-8569 to FSImageContainerRuntime Key: YARN-9582 URL: https://issues.apache.org/jira/browse/YARN-9582 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Commented] (YARN-9560) Restructure DockerLinuxContainerRuntime to extend a new OCIContainerRuntime

2019-05-24 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16847782#comment-16847782 ] Eric Badger commented on YARN-9560: --- bq. Are there two JSON formats used in OCIContainer

[jira] [Commented] (YARN-9560) Restructure DockerLinuxContainerRuntime to extend a new OCIContainerRuntime

2019-05-24 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16847658#comment-16847658 ] Eric Badger commented on YARN-9560: --- Patch 006 adds the Private and Unstable flags to {{

[jira] [Updated] (YARN-9560) Restructure DockerLinuxContainerRuntime to extend a new OCIContainerRuntime

2019-05-24 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-9560: -- Attachment: YARN-9560.006.patch > Restructure DockerLinuxContainerRuntime to extend a new OCIContainerRu

[jira] [Commented] (YARN-9560) Restructure DockerLinuxContainerRuntime to extend a new OCIContainerRuntime

2019-05-23 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16847093#comment-16847093 ] Eric Badger commented on YARN-9560: --- bq. The current change will generate OCIContainerRu

[jira] [Commented] (YARN-9561) Add C changes for the new OCI/squashfs/runc runtime

2019-05-22 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16846239#comment-16846239 ] Eric Badger commented on YARN-9561: --- bq. Can we have some test cases? Yes, definitely.

[jira] [Commented] (YARN-9560) Restructure DockerLinuxContainerRuntime to extend a new OCIContainerRuntime

2019-05-22 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16846226#comment-16846226 ] Eric Badger commented on YARN-9560: --- Hey [~eyang], if {{YARN_CONTAINER_RUNTIME_TYPE}} is

[jira] [Commented] (YARN-9560) Restructure DockerLinuxContainerRuntime to extend a new OCIContainerRuntime

2019-05-22 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16846007#comment-16846007 ] Eric Badger commented on YARN-9560: --- [~Jim_Brennan], thanks for the thorough reviews! [

[jira] [Commented] (YARN-9560) Restructure DockerLinuxContainerRuntime to extend a new OCIContainerRuntime

2019-05-22 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16845957#comment-16845957 ] Eric Badger commented on YARN-9560: --- Thanks [~Jim_Brennan]. Patch 5 moves the OCIContain

[jira] [Updated] (YARN-9560) Restructure DockerLinuxContainerRuntime to extend a new OCIContainerRuntime

2019-05-22 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-9560: -- Attachment: YARN-9560.005.patch > Restructure DockerLinuxContainerRuntime to extend a new OCIContainerRu

[jira] [Commented] (YARN-9560) Restructure DockerLinuxContainerRuntime to extend a new OCIContainerRuntime

2019-05-21 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16845439#comment-16845439 ] Eric Badger commented on YARN-9560: --- Uploading patch 004 to fix the indentation checksty

[jira] [Updated] (YARN-9560) Restructure DockerLinuxContainerRuntime to extend a new OCIContainerRuntime

2019-05-21 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-9560: -- Attachment: YARN-9560.004.patch > Restructure DockerLinuxContainerRuntime to extend a new OCIContainerRu

[jira] [Commented] (YARN-9560) Restructure DockerLinuxContainerRuntime to extend a new OCIContainerRuntime

2019-05-21 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16845273#comment-16845273 ] Eric Badger commented on YARN-9560: --- [~Jim_Brennan], fixed up everything according to yo

[jira] [Updated] (YARN-9560) Restructure DockerLinuxContainerRuntime to extend a new OCIContainerRuntime

2019-05-21 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-9560: -- Attachment: YARN-9560.003.patch > Restructure DockerLinuxContainerRuntime to extend a new OCIContainerRu

[jira] [Commented] (YARN-9014) OCI/squashfs container runtime

2019-05-21 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16844986#comment-16844986 ] Eric Badger commented on YARN-9014: --- [~ccondit], sure thing. Honestly, nothing major has

[jira] [Commented] (YARN-9560) Restructure DockerLinuxContainerRuntime to extend a new OCIContainerRuntime

2019-05-20 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16844282#comment-16844282 ] Eric Badger commented on YARN-9560: --- Thanks for the review, [~Jim_Brennan]! I uploaded p

[jira] [Updated] (YARN-9560) Restructure DockerLinuxContainerRuntime to extend a new OCIContainerRuntime

2019-05-20 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-9560: -- Attachment: YARN-9560.002.patch > Restructure DockerLinuxContainerRuntime to extend a new OCIContainerRu

[jira] [Created] (YARN-9564) Create docker-to-squash tool for image conversion

2019-05-17 Thread Eric Badger (JIRA)
Eric Badger created YARN-9564: - Summary: Create docker-to-squash tool for image conversion Key: YARN-9564 URL: https://issues.apache.org/jira/browse/YARN-9564 Project: Hadoop YARN Issue Type: Sub

[jira] [Commented] (YARN-9561) Add C changes for the new OCI/squashfs/runc runtime

2019-05-17 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16842373#comment-16842373 ] Eric Badger commented on YARN-9561: --- Uploading patch 002 which adds in some code fixes a

[jira] [Updated] (YARN-9561) Add C changes for the new OCI/squashfs/runc runtime

2019-05-17 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-9561: -- Attachment: YARN-9561.002.patch > Add C changes for the new OCI/squashfs/runc runtime >

[jira] [Commented] (YARN-9561) Add C changes for the new OCI/squashfs/runc runtime

2019-05-17 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16842281#comment-16842281 ] Eric Badger commented on YARN-9561: --- This patch has all of the necessary code to support

[jira] [Updated] (YARN-9561) Add C changes for the new OCI/squashfs/runc runtime

2019-05-17 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-9561: -- Attachment: YARN-9561.001.patch > Add C changes for the new OCI/squashfs/runc runtime >

[jira] [Updated] (YARN-9560) Restructure DockerLinuxContainerRuntime to extend a new OCIContainerRuntime

2019-05-16 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-9560: -- Attachment: YARN-9560.001.patch > Restructure DockerLinuxContainerRuntime to extend a new OCIContainerRu

[jira] [Updated] (YARN-9560) Restructure DockerLinuxContainerRuntime to extend a new OCIContainerRuntime

2019-05-16 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-9560: -- Description: Since the new OCI/squashFS/runc runtime will be using a lot of the same code as DockerLinu

[jira] [Created] (YARN-9562) Add Java changes for the new OCI/squashfs/runc runtime

2019-05-16 Thread Eric Badger (JIRA)
Eric Badger created YARN-9562: - Summary: Add Java changes for the new OCI/squashfs/runc runtime Key: YARN-9562 URL: https://issues.apache.org/jira/browse/YARN-9562 Project: Hadoop YARN Issue Type

[jira] [Created] (YARN-9561) Add C changes for the new OCI/squashfs/runc runtime

2019-05-16 Thread Eric Badger (JIRA)
Eric Badger created YARN-9561: - Summary: Add C changes for the new OCI/squashfs/runc runtime Key: YARN-9561 URL: https://issues.apache.org/jira/browse/YARN-9561 Project: Hadoop YARN Issue Type: S

[jira] [Created] (YARN-9560) Restructure DockerLinuxContainerRuntime to extend a new OCIContainerRuntime

2019-05-16 Thread Eric Badger (JIRA)
Eric Badger created YARN-9560: - Summary: Restructure DockerLinuxContainerRuntime to extend a new OCIContainerRuntime Key: YARN-9560 URL: https://issues.apache.org/jira/browse/YARN-9560 Project: Hadoop YAR

[jira] [Commented] (YARN-9527) Rogue LocalizerRunner/ContainerLocalizer repeatedly downloading same file

2019-05-08 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16835712#comment-16835712 ] Eric Badger commented on YARN-9527: --- Thanks for the analysis and patches, [~Jim_Brennan]

[jira] [Commented] (YARN-9523) Build application catalog docker image as part of hadoop dist build

2019-05-03 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16832746#comment-16832746 ] Eric Badger commented on YARN-9523: --- bq. Jonathan Eagles no one disputed against using "

[jira] [Commented] (YARN-5670) Add support for Docker image clean up

2019-04-17 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16820449#comment-16820449 ] Eric Badger commented on YARN-5670: --- I think that we need to be able to remove the thing

[jira] [Updated] (YARN-7848) Force removal of docker containers that do not get removed on first try

2019-04-15 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-7848: -- Fix Version/s: 3.3.0 Thanks for the update, [~eyang]! +1 I just committed this to trunk. Thanks [~Jim_B

[jira] [Updated] (YARN-9379) Can't specify docker runtime through environment

2019-04-15 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-9379: -- Fix Version/s: 3.3.0 Thanks for the final update, [~caozhiqiang]! +1 and I just committed this to trunk

[jira] [Commented] (YARN-9379) Can't specify docker runtime through environment

2019-04-12 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16816612#comment-16816612 ] Eric Badger commented on YARN-9379: --- Hey [~caozhiqiang], the updated patch looks good. H

[jira] [Commented] (YARN-9379) Can't specify docker runtime through environment

2019-04-10 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16814818#comment-16814818 ] Eric Badger commented on YARN-9379: --- [~caozhiqiang], yep I agree with your assessment. I

[jira] [Commented] (YARN-9379) Can't specify docker runtime through environment

2019-04-09 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16813797#comment-16813797 ] Eric Badger commented on YARN-9379: --- Thanks for the update, [~caozhiqiang]. The findbugs

<    1   2   3   4   5   6   7   8   9   10   >