[
https://issues.apache.org/jira/browse/TAJO-2122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15255781#comment-15255781
]
ASF GitHub Bot commented on TAJO-2122:
--------------------------------------
Github user jinossy commented on a diff in the pull request:
https://github.com/apache/tajo/pull/1001#discussion_r60856908
--- Diff: tajo-yarn/pom.xml ---
@@ -0,0 +1,185 @@
+<?xml version="1.0" encoding="UTF-8"?>
+<!--
+ ~ Licensed to the Apache Software Foundation (ASF) under one
+ ~ or more contributor license agreements. See the NOTICE file
+ ~ distributed with this work for additional information
+ ~ regarding copyright ownership. The ASF licenses this file
+ ~ to you under the Apache License, Version 2.0 (the
+ ~ "License"); you may not use this file except in compliance
+ ~ with the License. You may obtain a copy of the License at
+ ~
+ ~ http://www.apache.org/licenses/LICENSE-2.0
+ ~
+ ~ Unless required by applicable law or agreed to in writing, software
+ ~ distributed under the License is distributed on an "AS IS" BASIS,
+ ~ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or
implied.
+ ~ See the License for the specific language governing permissions and
+ ~ limitations under the License.
+ -->
+
+<project xmlns="http://maven.apache.org/POM/4.0.0";
+ xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance";
+ xsi:schemaLocation="http://maven.apache.org/POM/4.0.0
http://maven.apache.org/xsd/maven-4.0.0.xsd";>
+ <parent>
+ <artifactId>tajo-project</artifactId>
+ <groupId>org.apache.tajo</groupId>
+ <version>0.12.0-SNAPSHOT</version>
+ <relativePath>../tajo-project</relativePath>
+ </parent>
+ <modelVersion>4.0.0</modelVersion>
+ <artifactId>tajo-yarn</artifactId>
+ <packaging>jar</packaging>
+ <name>Tajo Yarn</name>
+ <properties>
+ <project.build.sourceEncoding>UTF-8</project.build.sourceEncoding>
+
<project.reporting.outputEncoding>UTF-8</project.reporting.outputEncoding>
+ </properties>
+
+ <build>
+ <plugins>
+ <plugin>
+ <groupId>org.apache.maven.plugins</groupId>
+ <artifactId>maven-compiler-plugin</artifactId>
+ </plugin>
+ <plugin>
+ <groupId>org.apache.rat</groupId>
+ <artifactId>apache-rat-plugin</artifactId>
+ <executions>
+ <execution>
+ <phase>verify</phase>
+ <goals>
+ <goal>check</goal>
+ </goals>
+ </execution>
+ </executions>
+ </plugin>
+ <plugin>
+ <groupId>org.apache.maven.plugins</groupId>
+ <artifactId>maven-surefire-report-plugin</artifactId>
+ </plugin>
+ <plugin>
+ <artifactId>maven-assembly-plugin</artifactId>
+ <version>2.4.1</version>
+ <configuration>
+ <descriptorRefs>
+ <descriptorRef>jar-with-dependencies</descriptorRef>
+ </descriptorRefs>
+ </configuration>
+ <executions>
+ <execution>
+ <id>make-assembly</id>
+ <phase>package</phase>
+ <goals>
+ <goal>single</goal>
+ </goals>
+ </execution>
+ </executions>
+ </plugin>
+ </plugins>
+ </build>
+
+ <dependencies>
+ <dependency>
+ <groupId>org.apache.hadoop</groupId>
+ <artifactId>hadoop-mapreduce-client-shuffle</artifactId>
+ <scope>provided</scope>
+ </dependency>
+ <dependency>
+ <groupId>org.apache.hadoop</groupId>
+ <artifactId>hadoop-yarn-api</artifactId>
+ <scope>provided</scope>
+ </dependency>
+ <dependency>
+ <groupId>org.apache.hadoop</groupId>
+ <artifactId>hadoop-common</artifactId>
+ <scope>provided</scope>
+ </dependency>
+ <dependency>
+ <groupId>org.apache.tajo</groupId>
+ <artifactId>tajo-common</artifactId>
+ </dependency>
+ <dependency>
+ <groupId>org.apache.tajo</groupId>
+ <artifactId>tajo-storage-common</artifactId>
+ </dependency>
+ <dependency>
+ <groupId>org.apache.tajo</groupId>
+ <artifactId>tajo-storage-hdfs</artifactId>
+ </dependency>
+ <dependency>
+ <groupId>org.apache.tajo</groupId>
+ <artifactId>tajo-pullserver</artifactId>
+ </dependency>
+ </dependencies>
+ <profiles>
+ <profile>
+ <id>docs</id>
+ <activation>
+ <activeByDefault>false</activeByDefault>
+ </activation>
+ <build>
+ <plugins>
+ <plugin>
+ <groupId>org.apache.maven.plugins</groupId>
+ <artifactId>maven-javadoc-plugin</artifactId>
+ <executions>
+ <execution>
+ <!-- build javadoc jars per jar for publishing to maven -->
+ <id>module-javadocs</id>
+ <phase>package</phase>
+ <goals>
+ <goal>jar</goal>
+ </goals>
+ <configuration>
+ <destDir>${project.build.directory}</destDir>
+ </configuration>
+ </execution>
+ </executions>
+ </plugin>
+ </plugins>
+ </build>
+ </profile>
+ <profile>
+ <id>src</id>
+ <activation>
+ <activeByDefault>false</activeByDefault>
+ </activation>
+ <build>
+ <plugins>
+ <plugin>
+ <groupId>org.apache.maven.plugins</groupId>
+ <artifactId>maven-source-plugin</artifactId>
+ <executions>
+ <execution>
+ <!-- builds source jars and attaches them to the project
for publishing -->
+ <id>tajo-java-sources</id>
+ <phase>package</phase>
+ <goals>
+ <goal>jar-no-fork</goal>
+ </goals>
+ </execution>
+ </executions>
+ </plugin>
+ </plugins>
+ </build>
+ </profile>
+ </profiles>
+
+ <reporting>
+ <plugins>
+ <plugin>
+ <groupId>org.apache.maven.plugins</groupId>
+ <artifactId>maven-project-info-reports-plugin</artifactId>
+ <version>2.4</version>
+ <configuration>
+ <dependencyLocationsEnabled>false</dependencyLocationsEnabled>
+ </configuration>
+ </plugin>
+ <plugin>
+ <groupId>org.apache.maven.plugins</groupId>
+ <artifactId>maven-surefire-report-plugin</artifactId>
+ </plugin>
+ </plugins>
+ </reporting>
+
+</project>
--- End diff --
@jihoonson
There are included too many dependencies. Could exclude unused module ?
```
[INFO]
------------------------------------------------------------------------
[INFO] Building Tajo Yarn 0.12.0-SNAPSHOT
[INFO]
------------------------------------------------------------------------
[INFO]
[INFO] --- maven-dependency-plugin:2.4:tree (default-cli) @ tajo-yarn ---
[INFO] org.apache.tajo:tajo-yarn:jar:0.12.0-SNAPSHOT
[INFO] +-
org.apache.hadoop:hadoop-mapreduce-client-shuffle:jar:2.7.2:provided
[INFO] | +- org.apache.hadoop:hadoop-yarn-server-common:jar:2.7.2:provided
[INFO] | | \- org.apache.hadoop:hadoop-yarn-common:jar:2.7.2:provided
[INFO] | | +- javax.xml.bind:jaxb-api:jar:2.2.2:provided
[INFO] | | | +- javax.xml.stream:stax-api:jar:1.0-2:provided
[INFO] | | | \- javax.activation:activation:jar:1.1:provided
[INFO] | | +- com.sun.jersey:jersey-client:jar:1.9:provided
[INFO] | | \- com.sun.jersey.contribs:jersey-guice:jar:1.9:provided
[INFO] | +-
org.apache.hadoop:hadoop-mapreduce-client-common:jar:2.7.2:provided
[INFO] | | \- org.apache.hadoop:hadoop-yarn-client:jar:2.7.2:provided
[INFO] | +- org.fusesource.leveldbjni:leveldbjni-all:jar:1.8:provided
[INFO] | +- org.slf4j:slf4j-log4j12:jar:1.7.10:provided
[INFO] | +- org.apache.hadoop:hadoop-annotations:jar:2.7.2:provided
[INFO] | | \- jdk.tools:jdk.tools:jar:1.8:system
[INFO] | \- com.google.inject.extensions:guice-servlet:jar:3.0:provided
[INFO] | \- com.google.inject:guice:jar:3.0:provided
[INFO] | +- javax.inject:javax.inject:jar:1:provided
[INFO] | \- aopalliance:aopalliance:jar:1.0:provided
[INFO] +- org.apache.hadoop:hadoop-yarn-api:jar:2.7.2:provided
[INFO] +- org.apache.hadoop:hadoop-common:jar:2.7.2:provided (scope not
updated to compile)
[INFO] | +- commons-cli:commons-cli:jar:1.2:provided
[INFO] | +- org.apache.commons:commons-math3:jar:3.1.1:provided
[INFO] | +- xmlenc:xmlenc:jar:0.52:provided
[INFO] | +- commons-httpclient:commons-httpclient:jar:3.1:provided
[INFO] | +- commons-codec:commons-codec:jar:1.10:provided
[INFO] | +- commons-io:commons-io:jar:2.4:provided
[INFO] | +- commons-net:commons-net:jar:3.1:provided
[INFO] | +- javax.servlet:servlet-api:jar:2.5:provided
[INFO] | +- javax.servlet.jsp:jsp-api:jar:2.1:provided
[INFO] | +- com.sun.jersey:jersey-core:jar:1.9:provided
[INFO] | +- com.sun.jersey:jersey-json:jar:1.9:provided
[INFO] | | +- org.codehaus.jettison:jettison:jar:1.1:provided
[INFO] | | +- com.sun.xml.bind:jaxb-impl:jar:2.2.3-1:provided
[INFO] | | +- org.codehaus.jackson:jackson-jaxrs:jar:1.8.3:provided
[INFO] | | \- org.codehaus.jackson:jackson-xc:jar:1.8.3:provided
[INFO] | +- com.sun.jersey:jersey-server:jar:1.9:provided
[INFO] | +- log4j:log4j:jar:1.2.17:provided
[INFO] | +- net.java.dev.jets3t:jets3t:jar:0.9.0:provided
[INFO] | | +- org.apache.httpcomponents:httpclient:jar:4.1.2:provided
[INFO] | | +- org.apache.httpcomponents:httpcore:jar:4.1.2:provided
[INFO] | | \- com.jamesmurty.utils:java-xmlbuilder:jar:0.4:provided
[INFO] | +- commons-configuration:commons-configuration:jar:1.6:provided
[INFO] | | +- commons-digester:commons-digester:jar:1.8:provided
[INFO] | | | \- commons-beanutils:commons-beanutils:jar:1.7.0:provided
[INFO] | | \- commons-beanutils:commons-beanutils-core:jar:1.8.0:provided
[INFO] | +- org.apache.hadoop:hadoop-auth:jar:2.7.2:provided
[INFO] | | +-
org.apache.directory.server:apacheds-kerberos-codec:jar:2.0.0-M15:provided
[INFO] | | | +-
org.apache.directory.server:apacheds-i18n:jar:2.0.0-M15:provided
[INFO] | | | +-
org.apache.directory.api:api-asn1-api:jar:1.0.0-M20:provided
[INFO] | | | \- org.apache.directory.api:api-util:jar:1.0.0-M20:provided
[INFO] | | \- org.apache.curator:curator-framework:jar:2.7.1:provided
[INFO] | +- com.jcraft:jsch:jar:0.1.42:provided
[INFO] | +- org.apache.curator:curator-client:jar:2.7.1:provided
[INFO] | +- org.apache.curator:curator-recipes:jar:2.7.1:provided
[INFO] | +- org.apache.htrace:htrace-core:jar:3.1.0-incubating:provided
[INFO] | +- org.apache.zookeeper:zookeeper:jar:3.4.6:provided
[INFO] | \- org.apache.commons:commons-compress:jar:1.4.1:provided
[INFO] | \- org.tukaani:xz:jar:1.0:provided
[INFO] +- org.apache.tajo:tajo-common:jar:0.12.0-SNAPSHOT:compile
[INFO] | +- com.google.protobuf:protobuf-java:jar:2.5.0:compile
[INFO] | +- commons-logging:commons-logging:jar:1.1.1:compile
[INFO] | +- commons-logging:commons-logging-api:jar:1.1:compile
[INFO] | +- commons-lang:commons-lang:jar:2.6:compile
[INFO] | +- com.google.guava:guava:jar:11.0.2:compile
[INFO] | | \- com.google.code.findbugs:jsr305:jar:3.0.0:compile
[INFO] | +- com.google.code.gson:gson:jar:2.2.2:compile
[INFO] | +- io.netty:netty-buffer:jar:4.0.34.Final:compile
[INFO] | | \- io.netty:netty-common:jar:4.0.34.Final:compile
[INFO] | \- org.iq80.snappy:snappy:jar:0.4:compile
[INFO] +- org.apache.tajo:tajo-storage-common:jar:0.12.0-SNAPSHOT:compile
[INFO] | +- org.apache.tajo:tajo-catalog-common:jar:0.12.0-SNAPSHOT:compile
[INFO] | +- org.apache.tajo:tajo-plan:jar:0.12.0-SNAPSHOT:compile
[INFO] | | \- org.apache.tajo:tajo-algebra:jar:0.12.0-SNAPSHOT:compile
[INFO] | \- net.minidev:json-smart:jar:2.1.1:compile
[INFO] | \- net.minidev:asm:jar:1.0.2:compile
[INFO] | \- asm:asm:jar:3.1:compile
[INFO] +- org.apache.tajo:tajo-storage-hdfs:jar:0.12.0-SNAPSHOT:compile
[INFO] | +- io.netty:netty-transport:jar:4.0.34.Final:compile
[INFO] | +- io.netty:netty-codec:jar:4.0.34.Final:compile
[INFO] | +- io.netty:netty-codec-http:jar:4.0.34.Final:compile
[INFO] | | \- io.netty:netty-handler:jar:4.0.34.Final:compile
[INFO] | +- org.apache.avro:trevni-core:jar:1.7.3:compile
[INFO] | | +- org.xerial.snappy:snappy-java:jar:1.0.4.1:compile
[INFO] | | \- org.slf4j:slf4j-api:jar:1.7.10:compile
[INFO] | +- org.apache.avro:trevni-avro:jar:1.7.3:compile
[INFO] | | \- org.apache.avro:avro-mapred:jar:1.7.3:compile
[INFO] | | +- org.apache.avro:avro-ipc:jar:1.7.3:compile
[INFO] | | | +- org.apache.avro:avro:jar:1.7.4:compile
[INFO] | | | | \-
com.thoughtworks.paranamer:paranamer:jar:2.3:compile
[INFO] | | | +- org.mortbay.jetty:jetty:jar:6.1.26:compile
[INFO] | | | +- org.mortbay.jetty:jetty-util:jar:6.1.26:compile
[INFO] | | | +- io.netty:netty:jar:3.6.2.Final:compile
[INFO] | | | +- org.apache.velocity:velocity:jar:1.7:compile
[INFO] | | | | \-
commons-collections:commons-collections:jar:3.2.2:compile
[INFO] | | | \- org.mortbay.jetty:servlet-api:jar:2.5-20081211:compile
[INFO] | | +- org.apache.avro:avro-ipc:jar:tests:1.7.3:compile
[INFO] | | +- org.codehaus.jackson:jackson-core-asl:jar:1.8.8:compile
[INFO] | | \- org.codehaus.jackson:jackson-mapper-asl:jar:1.8.8:compile
[INFO] | +- org.apache.parquet:parquet-hadoop-bundle:jar:1.8.1:compile
[INFO] | +- org.apache.hive:hive-orc:jar:2.0.0:compile
[INFO] | \- org.apache.hive:hive-storage-api:jar:2.0.0:compile
[INFO] \- org.apache.tajo:tajo-pullserver:jar:0.12.0-SNAPSHOT:compile
[INFO] \- org.apache.tajo:tajo-rpc-protobuf:jar:0.12.0-SNAPSHOT:compile
[INFO] \- org.apache.tajo:tajo-rpc-common:jar:0.12.0-SNAPSHOT:compile
```
> PullServer as an Auxiliary service of Yarn
> ------------------------------------------
>
> Key: TAJO-2122
> URL: https://issues.apache.org/jira/browse/TAJO-2122
> Project: Tajo
> Issue Type: New Feature
> Components: Pull Server
> Reporter: Jihoon Son
> Assignee: Jihoon Son
> Fix For: 0.12.0
>
>
> We are going to support Yarn as Tajo's one of resource schedulers. To do so,
> the PullServer should be capable of executing as an Auxiliary service.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
