[
https://issues.apache.org/jira/browse/YARN-9564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16904188#comment-16904188
]
Eric Yang commented on YARN-9564:
---------------------------------
If I added sudo to skopeo, the script only fail on removing temp directory. I
think this is toward the end of conversion process. I think this script is
suffering from mixed identity that some operations must be done as root, and
some operation must be done as hdfs admin. If running this script as root user
with a kerberos credential to hdfs, the script is likely pass. However, most
admin will require to run this script has themselves to avoid getting root user
mixed up with normal user kerberos ticket cache. In the later case, the
current script would encounter permission denied errors.
{code}
DEBUG: command: ['sudo', 'mksquashfs',
u'/tmp/sq/expand_archive_8ba884070f611d31cb2c42eddb691319dc9facf5e0ec67672fcfa135181ab3df',
u'/tmp/sq/centos:latest/8ba884070f611d31cb2c42eddb691319dc9facf5e0ec67672fcfa135181ab3df.sqsh']
DEBUG: command: ['sudo', 'rm', '-rf', '/tmp/sq']
Traceback (most recent call last):
File "./docker_to_squash.py", line 1283, in <module>
main()
File "./docker_to_squash.py", line 1280, in main
args.func(args)
File "./docker_to_squash.py", line 612, in pull_build_push_update
docker_to_squash(skopeo_dir, layer, working_dir)
File "./docker_to_squash.py", line 512, in docker_to_squash
os.remove(layer_path)
OSError: [Errno 13] Permission denied:
'/tmp/sq/centos:latest/8ba884070f611d31cb2c42eddb691319dc9facf5e0ec67672fcfa135181ab3df'
{code}
> Create docker-to-squash tool for image conversion
> -------------------------------------------------
>
> Key: YARN-9564
> URL: https://issues.apache.org/jira/browse/YARN-9564
> Project: Hadoop YARN
> Issue Type: Sub-task
> Reporter: Eric Badger
> Assignee: Eric Badger
> Priority: Major
> Attachments: YARN-9564.001.patch, YARN-9564.002.patch,
> YARN-9564.003.patch
>
>
> The new runc runtime uses docker images that are converted into multiple
> squashfs images. Each layer of the docker image will get its own squashfs
> image. We need a tool to help automate the creation of these squashfs images
> when all we have is a docker image
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
