[
https://issues.apache.org/jira/browse/YARN-7129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16790717#comment-16790717
]
Eric Badger commented on YARN-7129:
-----------------------------------
{noformat}
[INFO] ------------------------------------------------------------------------
[INFO] Building YARN Application Catalog Docker Image 3.3.0-SNAPSHOT
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-antrun-plugin:1.7:run (create-testdirs) @
hadoop-yarn-applications-catalog-docker ---
[INFO] Executing tasks
main:
[mkdir] Created dir:
/home/ebadger/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-docker/target/test-dir
[INFO] Executed tasks
[INFO]
[INFO] --- maven-remote-resources-plugin:1.5:process (default) @
hadoop-yarn-applications-catalog-docker ---
[INFO]
[INFO] --- maven-javadoc-plugin:3.0.1:jar (module-javadocs) @
hadoop-yarn-applications-catalog-docker ---
[INFO] Skipping javadoc generation
[INFO]
[INFO] --- maven-source-plugin:2.3:jar-no-fork (hadoop-java-sources) @
hadoop-yarn-applications-catalog-docker ---
[INFO]
[INFO] --- maven-source-plugin:2.3:test-jar-no-fork (hadoop-java-sources) @
hadoop-yarn-applications-catalog-docker ---
[INFO]
[INFO] --- maven-enforcer-plugin:3.0.0-M1:enforce (dist-enforce) @
hadoop-yarn-applications-catalog-docker ---
[INFO]
[INFO] --- maven-site-plugin:3.6:attach-descriptor (attach-descriptor) @
hadoop-yarn-applications-catalog-docker ---
[INFO] No site descriptor found: nothing to attach.
[INFO]
[INFO] --- maven-dependency-plugin:3.0.1:copy (copy-dependencies) @
hadoop-yarn-applications-catalog-docker ---
[INFO] Configured Artifact:
org.apache.hadoop:hadoop-yarn-applications-catalog-webapp:3.3.0-SNAPSHOT:war
[INFO] Copying app.war to
/home/ebadger/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-docker/target/ROOT.war
[INFO]
[INFO] --- dockerfile-maven-plugin:1.3.4:build (default) @
hadoop-yarn-applications-catalog-docker ---
[INFO] Building Docker context
/home/ebadger/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-docker
[INFO]
[INFO] Image will be built as
apache/hadoop-yarn-applications-catalog-docker:3.3.0-SNAPSHOT
[INFO]
Mar 12, 2019 4:14:54 PM org.apache.http.impl.execchain.RetryExec execute
INFO: I/O exception (java.io.IOException) caught when processing request to
{}->unix://localhost:80: Permission denied
Mar 12, 2019 4:14:54 PM org.apache.http.impl.execchain.RetryExec execute
INFO: Retrying request to {}->unix://localhost:80
Mar 12, 2019 4:14:54 PM org.apache.http.impl.execchain.RetryExec execute
INFO: I/O exception (java.io.IOException) caught when processing request to
{}->unix://localhost:80: Permission denied
Mar 12, 2019 4:14:54 PM org.apache.http.impl.execchain.RetryExec execute
INFO: Retrying request to {}->unix://localhost:80
Mar 12, 2019 4:14:54 PM org.apache.http.impl.execchain.RetryExec execute
INFO: I/O exception (java.io.IOException) caught when processing request to
{}->unix://localhost:80: Permission denied
Mar 12, 2019 4:14:54 PM org.apache.http.impl.execchain.RetryExec execute
INFO: Retrying request to {}->unix://localhost:80
[WARNING] An attempt failed, will retry 1 more times
org.apache.maven.plugin.MojoExecutionException: Could not build image
at com.spotify.plugin.dockerfile.BuildMojo.buildImage (BuildMojo.java:184)
at com.spotify.plugin.dockerfile.BuildMojo.execute (BuildMojo.java:105)
at com.spotify.plugin.dockerfile.AbstractDockerMojo.tryExecute
(AbstractDockerMojo.java:227)
at com.spotify.plugin.dockerfile.AbstractDockerMojo.execute
(AbstractDockerMojo.java:216)
at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo
(DefaultBuildPluginManager.java:134)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute
(MojoExecutor.java:208)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute
(MojoExecutor.java:154)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute
(MojoExecutor.java:146)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject
(LifecycleModuleBuilder.java:117)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject
(LifecycleModuleBuilder.java:81)
at
org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build
(SingleThreadedBuilder.java:51)
at org.apache.maven.lifecycle.internal.LifecycleStarter.execute
(LifecycleStarter.java:128)
at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:309)
at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:194)
at org.apache.maven.DefaultMaven.execute (DefaultMaven.java:107)
at org.apache.maven.cli.MavenCli.execute (MavenCli.java:955)
at org.apache.maven.cli.MavenCli.doMain (MavenCli.java:290)
at org.apache.maven.cli.MavenCli.main (MavenCli.java:194)
at sun.reflect.NativeMethodAccessorImpl.invoke0 (Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke
(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke
(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke (Method.java:498)
at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced
(Launcher.java:289)
at org.codehaus.plexus.classworlds.launcher.Launcher.launch
(Launcher.java:229)
at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode
(Launcher.java:415)
at org.codehaus.plexus.classworlds.launcher.Launcher.main
(Launcher.java:356)
Caused by: com.spotify.docker.client.exceptions.DockerException:
java.util.concurrent.ExecutionException:
com.spotify.docker.client.shaded.javax.ws.rs.ProcessingException:
java.io.IOException: Permission denied
at com.spotify.docker.client.DefaultDockerClient.propagate
(DefaultDockerClient.java:2512)
at com.spotify.docker.client.DefaultDockerClient.request
(DefaultDockerClient.java:2443)
at com.spotify.docker.client.DefaultDockerClient.version
(DefaultDockerClient.java:501)
at com.spotify.docker.client.DefaultDockerClient.authRegistryHeader
(DefaultDockerClient.java:2555)
at com.spotify.docker.client.DefaultDockerClient.build
(DefaultDockerClient.java:1396)
at com.spotify.docker.client.DefaultDockerClient.build
(DefaultDockerClient.java:1365)
at com.spotify.plugin.dockerfile.BuildMojo.buildImage (BuildMojo.java:177)
at com.spotify.plugin.dockerfile.BuildMojo.execute (BuildMojo.java:105)
at com.spotify.plugin.dockerfile.AbstractDockerMojo.tryExecute
(AbstractDockerMojo.java:227)
at com.spotify.plugin.dockerfile.AbstractDockerMojo.execute
(AbstractDockerMojo.java:216)
at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo
(DefaultBuildPluginManager.java:134)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute
(MojoExecutor.java:208)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute
(MojoExecutor.java:154)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute
(MojoExecutor.java:146)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject
(LifecycleModuleBuilder.java:117)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject
(LifecycleModuleBuilder.java:81)
at
org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build
(SingleThreadedBuilder.java:51)
at org.apache.maven.lifecycle.internal.LifecycleStarter.execute
(LifecycleStarter.java:128)
at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:309)
at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:194)
at org.apache.maven.DefaultMaven.execute (DefaultMaven.java:107)
at org.apache.maven.cli.MavenCli.execute (MavenCli.java:955)
at org.apache.maven.cli.MavenCli.doMain (MavenCli.java:290)
at org.apache.maven.cli.MavenCli.main (MavenCli.java:194)
at sun.reflect.NativeMethodAccessorImpl.invoke0 (Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke
(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke
(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke (Method.java:498)
at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced
(Launcher.java:289)
at org.codehaus.plexus.classworlds.launcher.Launcher.launch
(Launcher.java:229)
at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode
(Launcher.java:415)
at org.codehaus.plexus.classworlds.launcher.Launcher.main
(Launcher.java:356)
Caused by: java.util.concurrent.ExecutionException:
com.spotify.docker.client.shaded.javax.ws.rs.ProcessingException:
java.io.IOException: Permission denied
at
jersey.repackaged.com.google.common.util.concurrent.AbstractFuture$Sync.getValue
(AbstractFuture.java:299)
at
jersey.repackaged.com.google.common.util.concurrent.AbstractFuture$Sync.get
(AbstractFuture.java:286)
at jersey.repackaged.com.google.common.util.concurrent.AbstractFuture.get
(AbstractFuture.java:116)
at com.spotify.docker.client.DefaultDockerClient.request
(DefaultDockerClient.java:2441)
at com.spotify.docker.client.DefaultDockerClient.version
(DefaultDockerClient.java:501)
at com.spotify.docker.client.DefaultDockerClient.authRegistryHeader
(DefaultDockerClient.java:2555)
at com.spotify.docker.client.DefaultDockerClient.build
(DefaultDockerClient.java:1396)
at com.spotify.docker.client.DefaultDockerClient.build
(DefaultDockerClient.java:1365)
at com.spotify.plugin.dockerfile.BuildMojo.buildImage (BuildMojo.java:177)
at com.spotify.plugin.dockerfile.BuildMojo.execute (BuildMojo.java:105)
at com.spotify.plugin.dockerfile.AbstractDockerMojo.tryExecute
(AbstractDockerMojo.java:227)
at com.spotify.plugin.dockerfile.AbstractDockerMojo.execute
(AbstractDockerMojo.java:216)
at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo
(DefaultBuildPluginManager.java:134)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute
(MojoExecutor.java:208)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute
(MojoExecutor.java:154)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute
(MojoExecutor.java:146)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject
(LifecycleModuleBuilder.java:117)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject
(LifecycleModuleBuilder.java:81)
at
org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build
(SingleThreadedBuilder.java:51)
at org.apache.maven.lifecycle.internal.LifecycleStarter.execute
(LifecycleStarter.java:128)
at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:309)
at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:194)
at org.apache.maven.DefaultMaven.execute (DefaultMaven.java:107)
at org.apache.maven.cli.MavenCli.execute (MavenCli.java:955)
at org.apache.maven.cli.MavenCli.doMain (MavenCli.java:290)
at org.apache.maven.cli.MavenCli.main (MavenCli.java:194)
at sun.reflect.NativeMethodAccessorImpl.invoke0 (Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke
(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke
(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke (Method.java:498)
at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced
(Launcher.java:289)
at org.codehaus.plexus.classworlds.launcher.Launcher.launch
(Launcher.java:229)
at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode
(Launcher.java:415)
at org.codehaus.plexus.classworlds.launcher.Launcher.main
(Launcher.java:356)
Caused by: com.spotify.docker.client.shaded.javax.ws.rs.ProcessingException:
java.io.IOException: Permission denied
at org.glassfish.jersey.apache.connector.ApacheConnector.apply
(ApacheConnector.java:481)
at org.glassfish.jersey.apache.connector.ApacheConnector$1.run
(ApacheConnector.java:491)
at java.util.concurrent.Executors$RunnableAdapter.call (Executors.java:511)
at java.util.concurrent.FutureTask.run (FutureTask.java:266)
at
jersey.repackaged.com.google.common.util.concurrent.MoreExecutors$DirectExecutorService.execute
(MoreExecutors.java:299)
at java.util.concurrent.AbstractExecutorService.submit
(AbstractExecutorService.java:112)
at
jersey.repackaged.com.google.common.util.concurrent.AbstractListeningExecutorService.submit
(AbstractListeningExecutorService.java:50)
at
jersey.repackaged.com.google.common.util.concurrent.AbstractListeningExecutorService.submit
(AbstractListeningExecutorService.java:37)
at org.glassfish.jersey.apache.connector.ApacheConnector.apply
(ApacheConnector.java:487)
at org.glassfish.jersey.client.ClientRuntime$2.run (ClientRuntime.java:178)
at org.glassfish.jersey.internal.Errors$1.call (Errors.java:271)
at org.glassfish.jersey.internal.Errors$1.call (Errors.java:267)
at org.glassfish.jersey.internal.Errors.process (Errors.java:315)
at org.glassfish.jersey.internal.Errors.process (Errors.java:297)
at org.glassfish.jersey.internal.Errors.process (Errors.java:267)
at org.glassfish.jersey.process.internal.RequestScope.runInScope
(RequestScope.java:340)
at org.glassfish.jersey.client.ClientRuntime$3.run (ClientRuntime.java:210)
at java.util.concurrent.Executors$RunnableAdapter.call (Executors.java:511)
at java.util.concurrent.FutureTask.run (FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker
(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run
(ThreadPoolExecutor.java:624)
at java.lang.Thread.run (Thread.java:748)
Caused by: java.io.IOException: Permission denied
at jnr.unixsocket.UnixSocketChannel.doConnect (UnixSocketChannel.java:94)
at jnr.unixsocket.UnixSocketChannel.connect (UnixSocketChannel.java:102)
at com.spotify.docker.client.ApacheUnixSocket.connect
(ApacheUnixSocket.java:76)
at com.spotify.docker.client.UnixConnectionSocketFactory.connectSocket
(UnixConnectionSocketFactory.java:78)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect
(DefaultHttpClientConnectionOperator.java:134)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect
(PoolingHttpClientConnectionManager.java:353)
at org.apache.http.impl.execchain.MainClientExec.establishRoute
(MainClientExec.java:380)
at org.apache.http.impl.execchain.MainClientExec.execute
(MainClientExec.java:236)
at org.apache.http.impl.execchain.ProtocolExec.execute
(ProtocolExec.java:184)
at org.apache.http.impl.execchain.RetryExec.execute (RetryExec.java:88)
at org.apache.http.impl.execchain.RedirectExec.execute
(RedirectExec.java:110)
at org.apache.http.impl.client.InternalHttpClient.doExecute
(InternalHttpClient.java:184)
at org.apache.http.impl.client.CloseableHttpClient.execute
(CloseableHttpClient.java:71)
at org.glassfish.jersey.apache.connector.ApacheConnector.apply
(ApacheConnector.java:435)
at org.glassfish.jersey.apache.connector.ApacheConnector$1.run
(ApacheConnector.java:491)
at java.util.concurrent.Executors$RunnableAdapter.call (Executors.java:511)
at java.util.concurrent.FutureTask.run (FutureTask.java:266)
at
jersey.repackaged.com.google.common.util.concurrent.MoreExecutors$DirectExecutorService.execute
(MoreExecutors.java:299)
at java.util.concurrent.AbstractExecutorService.submit
(AbstractExecutorService.java:112)
at
jersey.repackaged.com.google.common.util.concurrent.AbstractListeningExecutorService.submit
(AbstractListeningExecutorService.java:50)
at
jersey.repackaged.com.google.common.util.concurrent.AbstractListeningExecutorService.submit
(AbstractListeningExecutorService.java:37)
at org.glassfish.jersey.apache.connector.ApacheConnector.apply
(ApacheConnector.java:487)
at org.glassfish.jersey.client.ClientRuntime$2.run (ClientRuntime.java:178)
at org.glassfish.jersey.internal.Errors$1.call (Errors.java:271)
at org.glassfish.jersey.internal.Errors$1.call (Errors.java:267)
at org.glassfish.jersey.internal.Errors.process (Errors.java:315)
at org.glassfish.jersey.internal.Errors.process (Errors.java:297)
at org.glassfish.jersey.internal.Errors.process (Errors.java:267)
at org.glassfish.jersey.process.internal.RequestScope.runInScope
(RequestScope.java:340)
at org.glassfish.jersey.client.ClientRuntime$3.run (ClientRuntime.java:210)
at java.util.concurrent.Executors$RunnableAdapter.call (Executors.java:511)
at java.util.concurrent.FutureTask.run (FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker
(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run
(ThreadPoolExecutor.java:624)
at java.lang.Thread.run (Thread.java:748)
[INFO] Building Docker context
/home/ebadger/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-docker
[INFO]
[INFO] Image will be built as
apache/hadoop-yarn-applications-catalog-docker:3.3.0-SNAPSHOT
[INFO]
Mar 12, 2019 4:14:57 PM org.apache.http.impl.execchain.RetryExec execute
INFO: I/O exception (java.io.IOException) caught when processing request to
{}->unix://localhost:80: Permission denied
Mar 12, 2019 4:14:57 PM org.apache.http.impl.execchain.RetryExec execute
INFO: Retrying request to {}->unix://localhost:80
Mar 12, 2019 4:14:57 PM org.apache.http.impl.execchain.RetryExec execute
INFO: I/O exception (java.io.IOException) caught when processing request to
{}->unix://localhost:80: Permission denied
Mar 12, 2019 4:14:57 PM org.apache.http.impl.execchain.RetryExec execute
INFO: Retrying request to {}->unix://localhost:80
Mar 12, 2019 4:14:57 PM org.apache.http.impl.execchain.RetryExec execute
INFO: I/O exception (java.io.IOException) caught when processing request to
{}->unix://localhost:80: Permission denied
Mar 12, 2019 4:14:57 PM org.apache.http.impl.execchain.RetryExec execute
INFO: Retrying request to {}->unix://localhost:80
{noformat}
This seems to have broken the build on my system. I think we should revert both
this and YARN-9348 until we have a fix.
> Application Catalog for YARN applications
> -----------------------------------------
>
> Key: YARN-7129
> URL: https://issues.apache.org/jira/browse/YARN-7129
> Project: Hadoop YARN
> Issue Type: New Feature
> Components: applications
> Reporter: Eric Yang
> Assignee: Eric Yang
> Priority: Major
> Fix For: 3.3.0
>
> Attachments: YARN Appstore.pdf, YARN-7129.001.patch,
> YARN-7129.002.patch, YARN-7129.003.patch, YARN-7129.004.patch,
> YARN-7129.005.patch, YARN-7129.006.patch, YARN-7129.007.patch,
> YARN-7129.008.patch, YARN-7129.009.patch, YARN-7129.010.patch,
> YARN-7129.011.patch, YARN-7129.012.patch, YARN-7129.013.patch,
> YARN-7129.014.patch, YARN-7129.015.patch, YARN-7129.016.patch,
> YARN-7129.017.patch, YARN-7129.018.patch, YARN-7129.019.patch,
> YARN-7129.020.patch, YARN-7129.021.patch, YARN-7129.022.patch,
> YARN-7129.023.patch, YARN-7129.024.patch, YARN-7129.025.patch,
> YARN-7129.026.patch, YARN-7129.027.patch, YARN-7129.028.patch
>
>
> YARN native services provides web services API to improve usability of
> application deployment on Hadoop using collection of docker images. It would
> be nice to have an application catalog system which provides an editorial and
> search interface for YARN applications. This improves usability of YARN for
> manage the life cycle of applications.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
