[jira] [Updated] (HAWQ-1637) Compile apache hawq failure due to Failed to execute goal org.apache.maven.plugins:maven-javadoc-plugin:2.9.1:aggregate-jar on osx 10.11
[
https://issues.apache.org/jira/browse/HAWQ-1637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Oushu_WangZiming updated HAWQ-1637:
---
Description:
Follow instruction ([https://cwiki.apache.org/confluence/disp
/usr/local/bin/mvn package
-DskipTestslay/HAWQ/Build+and+Install)|https://cwiki.apache.org/confluence/display/HAWQ/Build+and+Install)]
to build apache hawq on osx 10.11, it fails due to Failed to execute goal
org.apache.maven.plugins:maven-javadoc-plugin:2.9.1:aggregate-jar
{code:java}
/usr/local/bin/mvn package -DskipTests
[INFO] Scanning for projects...
[INFO]
[INFO] Reactor Build Order:
[INFO]
[INFO] hawq-hadoop [pom]
[INFO] hawq-mapreduce-common [jar]
[INFO] hawq-mapreduce-ao [jar]
[INFO] hawq-mapreduce-parquet [jar]
[INFO] hawq-mapreduce-tool [jar]
[INFO]
[INFO] < com.pivotal.hawq:hawq-hadoop >
[INFO] Building hawq-hadoop 1.1.0 [1/5]
[INFO] [ pom ]-
[INFO]
[INFO] --- maven-jar-plugin:2.4:test-jar (default) @ hawq-hadoop ---
[WARNING] JAR will be empty - no content was marked for inclusion!
[WARNING] The following dependencies could not be resolved at this point of the
build but seem to be part of the reactor:
[WARNING] o com.pivotal.hawq:hawq-mapreduce-common:jar:1.1.0 (compile)
[WARNING] Try running the build up to the lifecycle phase "package"
[WARNING] The following dependencies could not be resolved at this point of the
build but seem to be part of the reactor:
[WARNING] o com.pivotal.hawq:hawq-mapreduce-common:jar:1.1.0 (compile)
[WARNING] Try running the build up to the lifecycle phase "package"
[WARNING] The following dependencies could not be resolved at this point of the
build but seem to be part of the reactor:
[WARNING] o com.pivotal.hawq:hawq-mapreduce-ao:jar:1.1.0 (compile)
[WARNING] o com.pivotal.hawq:hawq-mapreduce-common:jar:1.1.0 (compile)
[WARNING] o com.pivotal.hawq:hawq-mapreduce-parquet:jar:1.1.0 (compile)
[WARNING] Try running the build up to the lifecycle phase "package"
[INFO]
[INFO] --- maven-javadoc-plugin:2.9.1:aggregate-jar (default) @ hawq-hadoop ---
[WARNING] The dependency: [com.pivotal.hawq:hawq-mapreduce-common:jar:1.1.0]
can't be resolved but has been found in the reactor (probably snapshots).
This dependency has been excluded from the Javadoc classpath. You should rerun
javadoc after executing mvn install.
[WARNING] IGNORED to add some artifacts in the classpath. See above.
[WARNING] The dependency: [com.pivotal.hawq:hawq-mapreduce-common:jar:1.1.0]
can't be resolved but has been found in the reactor (probably snapshots).
This dependency has been excluded from the Javadoc classpath. You should rerun
javadoc after executing mvn install.
[WARNING] IGNORED to add some artifacts in the classpath. See above.
[WARNING] The dependency: [com.pivotal.hawq:hawq-mapreduce-common:jar:1.1.0]
can't be resolved but has been found in the reactor (probably snapshots).
This dependency has been excluded from the Javadoc classpath. You should rerun
javadoc after executing mvn install.
[WARNING] The dependency: [com.pivotal.hawq:hawq-mapreduce-ao:jar:1.1.0] can't
be resolved but has been found in the reactor (probably snapshots).
This dependency has been excluded from the Javadoc classpath. You should rerun
javadoc after executing mvn install.
[WARNING] The dependency: [com.pivotal.hawq:hawq-mapreduce-parquet:jar:1.1.0]
can't be resolved but has been found in the reactor (probably snapshots).
This dependency has been excluded from the Javadoc classpath. You should rerun
javadoc after executing mvn install.
[WARNING] IGNORED to add some artifacts in the classpath. See above.
[INFO]
正在加载程序包com.pivotal.hawq.mapreduce.conf的源文件...
正在加载程序包com.pivotal.hawq.mapreduce.datatype的源文件...
正在加载程序包com.pivotal.hawq.mapreduce.file的源文件...
正在加载程序包com.pivotal.hawq.mapreduce的源文件...
正在加载程序包com.pivotal.hawq.mapreduce.metadata的源文件...
正在加载程序包com.pivotal.hawq.mapreduce.schema的源文件...
正在加载程序包com.pivotal.hawq.mapreduce.util的源文件...
正在加载程序包com.pivotal.hawq.mapreduce.ao.file的源文件...
正在加载程序包com.pivotal.hawq.mapreduce.ao的源文件...
正在加载程序包com.pivotal.hawq.mapreduce.ao.io的源文件...
正在加载程序包com.pivotal.hawq.mapreduce.ao.util的源文件...
正在加载程序包com.pivotal.hawq.mapreduce.parquet.convert的源文件...
正在加载程序包com.pivotal.hawq.mapreduce.parquet的源文件...
正在加载程序包com.pivotal.hawq.mapreduce.parquet.support的源文件...
正在加载程序包com.pivotal.hawq.mapreduce.parquet.util的源文件...
正在构造 Javadoc 信息...
100 个错误
[INFO]
[INFO] Reactor Summary:
[INFO]
[INFO] hawq-hadoop 1.1.0 .. FAILURE [ 7.035 s]
[INFO] hawq-mapreduce-common .. SKIPPED
[INFO] hawq-mapreduce-ao .. SKIPPED
[INFO] hawq-mapreduce-parquet . SKIPPED
[INFO]
[jira] [Updated] (HAWQ-1637) Compile apache hawq failure due to Failed to execute goal org.apache.maven.plugins:maven-javadoc-plugin:2.9.1:aggregate-jar on osx 10.11
[
https://issues.apache.org/jira/browse/HAWQ-1637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruilong Huo updated HAWQ-1637:
--
Description:
Follow instruction ([https://cwiki.apache.org/confluence/disp
/usr/local/bin/mvn package
-DskipTestslay/HAWQ/Build+and+Install)|https://cwiki.apache.org/confluence/display/HAWQ/Build+and+Install)]
to build apache hawq on osx 10.11, it fails due to Failed to execute goal
org.apache.maven.plugins:maven-javadoc-plugin:2.9.1:aggregate-jar
{code:java}
[INFO] --- maven-jar-plugin:2.4:test-jar (default) @ hawq-hadoop --- [WARNING]
JAR will be empty - no content was marked for inclusion! [WARNING] The
following dependencies could not be resolved at this point of the build but
seem to be part of the reactor: [WARNING] o
com.pivotal.hawq:hawq-mapreduce-common:jar:1.1.0 (compile) [WARNING] Try
running the build up to the lifecycle phase "package" [WARNING] The following
dependencies could not be resolved at this point of the build but seem to be
part of the reactor: [WARNING] o
com.pivotal.hawq:hawq-mapreduce-common:jar:1.1.0 (compile) [WARNING] Try
running the build up to the lifecycle phase "package" [WARNING] The following
dependencies could not be resolved at this point of the build but seem to be
part of the reactor: [WARNING] o com.pivotal.hawq:hawq-mapreduce-ao:jar:1.1.0
(compile) [WARNING] o com.pivotal.hawq:hawq-mapreduce-common:jar:1.1.0
(compile) [WARNING] o com.pivotal.hawq:hawq-mapreduce-parquet:jar:1.1.0
(compile) [WARNING] Try running the build up to the lifecycle phase "package"
[INFO] [INFO] --- maven-javadoc-plugin:2.9.1:aggregate-jar (default) @
hawq-hadoop --- [WARNING] The dependency:
[com.pivotal.hawq:hawq-mapreduce-common:jar:1.1.0] can't be resolved but has
been found in the reactor (probably snapshots). This dependency has been
excluded from the Javadoc classpath. You should rerun javadoc after executing
mvn install. [WARNING] IGNORED to add some artifacts in the classpath. See
above. [WARNING] The dependency:
[com.pivotal.hawq:hawq-mapreduce-common:jar:1.1.0] can't be resolved but has
been found in the reactor (probably snapshots). This dependency has been
excluded from the Javadoc classpath. You should rerun javadoc after executing
mvn install. [WARNING] IGNORED to add some artifacts in the classpath. See
above. [WARNING] The dependency:
[com.pivotal.hawq:hawq-mapreduce-common:jar:1.1.0] can't be resolved but has
been found in the reactor (probably snapshots). This dependency has been
excluded from the Javadoc classpath. You should rerun javadoc after executing
mvn install. [WARNING] The dependency:
[com.pivotal.hawq:hawq-mapreduce-ao:jar:1.1.0] can't be resolved but has been
found in the reactor (probably snapshots). This dependency has been excluded
from the Javadoc classpath. You should rerun javadoc after executing mvn
install. [WARNING] The dependency:
[com.pivotal.hawq:hawq-mapreduce-parquet:jar:1.1.0] can't be resolved but has
been found in the reactor (probably snapshots). This dependency has been
excluded from the Javadoc classpath. You should rerun javadoc after executing
mvn install. [WARNING] IGNORED to add some artifacts in the classpath. See
above.[ERROR] import parquet.hadoop.ParquetInputFormat;
[ERROR] ^
[ERROR]
/Users/wangziming/workplace/incubator-hawq/contrib/hawq-hadoop/hawq-mapreduce-parquet/src/main/java/com/pivotal/hawq/mapreduce/parquet/HAWQParquetInputFormat.java:43:
错误: 找不到符号
[ERROR] public class HAWQParquetInputFormat extends
ParquetInputFormat {
[ERROR] ^
[ERROR] 符号: 类 ParquetInputFormat
[ERROR]
/Users/wangziming/workplace/incubator-hawq/contrib/hawq-hadoop/hawq-mapreduce-parquet/src/main/java/com/pivotal/hawq/mapreduce/parquet/convert/HAWQBoxConverter.java:25:
错误: 程序包parquet.io.api不存在
[ERROR] import parquet.io.api.Converter;
[ERROR] ^
[ERROR]
/Users/wangziming/workplace/incubator-hawq/contrib/hawq-hadoop/hawq-mapreduce-parquet/src/main/java/com/pivotal/hawq/mapreduce/parquet/convert/HAWQBoxConverter.java:26:
错误: 程序包parquet.io.api不存在
[ERROR] import parquet.io.api.GroupConverter;
[ERROR] ^
[ERROR]
/Users/wangziming/workplace/incubator-hawq/contrib/hawq-hadoop/hawq-mapreduce-parquet/src/main/java/com/pivotal/hawq/mapreduce/parquet/convert/HAWQBoxConverter.java:27:
错误: 程序包parquet.io.api不存在
[ERROR] import parquet.io.api.PrimitiveConverter;
[ERROR] ^
[ERROR]
/Users/wangziming/workplace/incubator-hawq/contrib/hawq-hadoop/hawq-mapreduce-parquet/src/main/java/com/pivotal/hawq/mapreduce/parquet/convert/HAWQBoxConverter.java:38:
错误: 找不到符号
[ERROR] public class HAWQBoxConverter extends GroupConverter {
[ERROR] ^
[ERROR] 符号: 类 GroupConverter
[ERROR]
/Users/wangziming/workplace/incubator-hawq/contrib/hawq-hadoop/hawq-mapreduce-parquet/src/main/java/com/pivotal/hawq/mapreduce/parquet/convert/HAWQBoxConverter.java:41:
错误: 找不到符号
[ERROR] private Converter[] converters;
[ERROR] ^
[ERROR] 符号: 类 Converter
[ERROR] 位置: 类
[jira] [Updated] (HAWQ-1637) Compile apache hawq failure due to Failed to execute goal org.apache.maven.plugins:maven-javadoc-plugin:2.9.1:aggregate-jar on osx 10.11
[
https://issues.apache.org/jira/browse/HAWQ-1637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Oushu_WangZiming updated HAWQ-1637:
---
Description:
Follow instruction ([https://cwiki.apache.org/confluence/disp
/usr/local/bin/mvn package
-DskipTestslay/HAWQ/Build+and+Install)|https://cwiki.apache.org/confluence/display/HAWQ/Build+and+Install)]
to build apache hawq on osx 10.11, it fails due to Failed to execute goal
org.apache.maven.plugins:maven-javadoc-plugin:2.9.1:aggregate-jar
{code:java}
[INFO] --- maven-jar-plugin:2.4:test-jar (default) @ hawq-hadoop --- [WARNING]
JAR will be empty - no content was marked for inclusion! [WARNING] The
following dependencies could not be resolved at this point of the build but
seem to be part of the reactor: [WARNING] o
com.pivotal.hawq:hawq-mapreduce-common:jar:1.1.0 (compile) [WARNING] Try
running the build up to the lifecycle phase "package" [WARNING] The following
dependencies could not be resolved at this point of the build but seem to be
part of the reactor: [WARNING] o
com.pivotal.hawq:hawq-mapreduce-common:jar:1.1.0 (compile) [WARNING] Try
running the build up to the lifecycle phase "package" [WARNING] The following
dependencies could not be resolved at this point of the build but seem to be
part of the reactor: [WARNING] o com.pivotal.hawq:hawq-mapreduce-ao:jar:1.1.0
(compile) [WARNING] o com.pivotal.hawq:hawq-mapreduce-common:jar:1.1.0
(compile) [WARNING] o com.pivotal.hawq:hawq-mapreduce-parquet:jar:1.1.0
(compile) [WARNING] Try running the build up to the lifecycle phase "package"
[INFO] [INFO] --- maven-javadoc-plugin:2.9.1:aggregate-jar (default) @
hawq-hadoop --- [WARNING] The dependency:
[com.pivotal.hawq:hawq-mapreduce-common:jar:1.1.0] can't be resolved but has
been found in the reactor (probably snapshots). This dependency has been
excluded from the Javadoc classpath. You should rerun javadoc after executing
mvn install. [WARNING] IGNORED to add some artifacts in the classpath. See
above. [WARNING] The dependency:
[com.pivotal.hawq:hawq-mapreduce-common:jar:1.1.0] can't be resolved but has
been found in the reactor (probably snapshots). This dependency has been
excluded from the Javadoc classpath. You should rerun javadoc after executing
mvn install. [WARNING] IGNORED to add some artifacts in the classpath. See
above. [WARNING] The dependency:
[com.pivotal.hawq:hawq-mapreduce-common:jar:1.1.0] can't be resolved but has
been found in the reactor (probably snapshots). This dependency has been
excluded from the Javadoc classpath. You should rerun javadoc after executing
mvn install. [WARNING] The dependency:
[com.pivotal.hawq:hawq-mapreduce-ao:jar:1.1.0] can't be resolved but has been
found in the reactor (probably snapshots). This dependency has been excluded
from the Javadoc classpath. You should rerun javadoc after executing mvn
install. [WARNING] The dependency:
[com.pivotal.hawq:hawq-mapreduce-parquet:jar:1.1.0] can't be resolved but has
been found in the reactor (probably snapshots). This dependency has been
excluded from the Javadoc classpath. You should rerun javadoc after executing
mvn install. [WARNING] IGNORED to add some artifacts in the classpath. See
above.[ERROR] import parquet.hadoop.ParquetInputFormat;
{code}
{code:java}
[ERROR] ^
[ERROR]
/Users/wangziming/workplace/incubator-hawq/contrib/hawq-hadoop/hawq-mapreduce-parquet/src/main/java/com/pivotal/hawq/mapreduce/parquet/HAWQParquetInputFormat.java:43:
错误: 找不到符号
[ERROR] public class HAWQParquetInputFormat extends
ParquetInputFormat {
[ERROR] ^
[ERROR] 符号: 类 ParquetInputFormat
[ERROR]
/Users/wangziming/workplace/incubator-hawq/contrib/hawq-hadoop/hawq-mapreduce-parquet/src/main/java/com/pivotal/hawq/mapreduce/parquet/convert/HAWQBoxConverter.java:25:
错误: 程序包parquet.io.api不存在
[ERROR] import parquet.io.api.Converter;
[ERROR] ^
[ERROR]
/Users/wangziming/workplace/incubator-hawq/contrib/hawq-hadoop/hawq-mapreduce-parquet/src/main/java/com/pivotal/hawq/mapreduce/parquet/convert/HAWQBoxConverter.java:26:
错误: 程序包parquet.io.api不存在
[ERROR] import parquet.io.api.GroupConverter;
[ERROR] ^
[ERROR]
/Users/wangziming/workplace/incubator-hawq/contrib/hawq-hadoop/hawq-mapreduce-parquet/src/main/java/com/pivotal/hawq/mapreduce/parquet/convert/HAWQBoxConverter.java:27:
错误: 程序包parquet.io.api不存在
[ERROR] import parquet.io.api.PrimitiveConverter;
[ERROR] ^
[ERROR]
/Users/wangziming/workplace/incubator-hawq/contrib/hawq-hadoop/hawq-mapreduce-parquet/src/main/java/com/pivotal/hawq/mapreduce/parquet/convert/HAWQBoxConverter.java:38:
错误: 找不到符号
[ERROR] public class HAWQBoxConverter extends GroupConverter {
[ERROR] ^
[ERROR] 符号: 类 GroupConverter
[ERROR]
/Users/wangziming/workplace/incubator-hawq/contrib/hawq-hadoop/hawq-mapreduce-parquet/src/main/java/com/pivotal/hawq/mapreduce/parquet/convert/HAWQBoxConverter.java:41:
错误: 找不到符号
[ERROR] private Converter[] converters;
[ERROR] ^
[ERROR] 符号:
[GitHub] incubator-hawq pull request #1380: HAWQ-1636. Fix compile apache hawq failur...
Github user asfgit closed the pull request at: https://github.com/apache/incubator-hawq/pull/1380 ---
[jira] [Created] (HAWQ-1637) Compile apache hawq failure due to Failed to execute goal org.apache.maven.plugins:maven-javadoc-plugin:2.9.1:aggregate-jar on osx 10.11
Oushu_WangZiming created HAWQ-1637:
--
Summary: Compile apache hawq failure due to Failed to execute goal
org.apache.maven.plugins:maven-javadoc-plugin:2.9.1:aggregate-jar on osx 10.11
Key: HAWQ-1637
URL: https://issues.apache.org/jira/browse/HAWQ-1637
Project: Apache HAWQ
Issue Type: Bug
Components: Build
Reporter: Oushu_WangZiming
Assignee: Radar Lei
Follow instruction
([https://cwiki.apache.org/confluence/display/HAWQ/Build+and+Install)] to build
apache hawq on osx 10.11, it fails due to Failed to execute goal
org.apache.maven.plugins:maven-javadoc-plugin:2.9.1:aggregate-jar
{code:java}
[ERROR] Failed to execute goal
org.apache.maven.plugins:maven-javadoc-plugin:2.9.1:aggregate-jar (default) on
project hawq-hadoop: MavenReportException: Error while creating archive:
[ERROR] Exit code: 1 -
/Users/wangziming/workplace/incubator-hawq/contrib/hawq-hadoop/hawq-mapreduce-parquet/src/main/java/com/pivotal/hawq/mapreduce/parquet/HAWQParquetInputFormat.java:35:
错误: 程序包parquet.hadoop不存在
[ERROR] import parquet.hadoop.ParquetInputFormat;
[ERROR] ^
[ERROR]
/Users/wangziming/workplace/incubator-hawq/contrib/hawq-hadoop/hawq-mapreduce-parquet/src/main/java/com/pivotal/hawq/mapreduce/parquet/HAWQParquetInputFormat.java:43:
错误: 找不到符号
[ERROR] public class HAWQParquetInputFormat extends
ParquetInputFormat {
[ERROR] ^
[ERROR] 符号: 类 ParquetInputFormat
[ERROR]
/Users/wangziming/workplace/incubator-hawq/contrib/hawq-hadoop/hawq-mapreduce-parquet/src/main/java/com/pivotal/hawq/mapreduce/parquet/convert/HAWQBoxConverter.java:25:
错误: 程序包parquet.io.api不存在
[ERROR] import parquet.io.api.Converter;
[ERROR] ^
[ERROR]
/Users/wangziming/workplace/incubator-hawq/contrib/hawq-hadoop/hawq-mapreduce-parquet/src/main/java/com/pivotal/hawq/mapreduce/parquet/convert/HAWQBoxConverter.java:26:
错误: 程序包parquet.io.api不存在
[ERROR] import parquet.io.api.GroupConverter;
[ERROR] ^
[ERROR]
/Users/wangziming/workplace/incubator-hawq/contrib/hawq-hadoop/hawq-mapreduce-parquet/src/main/java/com/pivotal/hawq/mapreduce/parquet/convert/HAWQBoxConverter.java:27:
错误: 程序包parquet.io.api不存在
[ERROR] import parquet.io.api.PrimitiveConverter;
[ERROR] ^
[ERROR]
/Users/wangziming/workplace/incubator-hawq/contrib/hawq-hadoop/hawq-mapreduce-parquet/src/main/java/com/pivotal/hawq/mapreduce/parquet/convert/HAWQBoxConverter.java:38:
错误: 找不到符号
[ERROR] public class HAWQBoxConverter extends GroupConverter {
[ERROR] ^
[ERROR] 符号: 类 GroupConverter
[ERROR]
/Users/wangziming/workplace/incubator-hawq/contrib/hawq-hadoop/hawq-mapreduce-parquet/src/main/java/com/pivotal/hawq/mapreduce/parquet/convert/HAWQBoxConverter.java:41:
错误: 找不到符号
[ERROR] private Converter[] converters;
[ERROR] ^
[ERROR] 符号: 类 Converter
[ERROR] 位置: 类 HAWQBoxConverter
[ERROR]
/Users/wangziming/workplace/incubator-hawq/contrib/hawq-hadoop/hawq-mapreduce-parquet/src/main/java/com/pivotal/hawq/mapreduce/parquet/convert/HAWQBoxConverter.java:78:
错误: 找不到符号
[ERROR] public Converter getConverter(int fieldIndex) {
[ERROR] ^
[ERROR] 符号: 类 Converter
[ERROR] 位置: 类 HAWQBoxConverter
[ERROR]
/Users/wangziming/workplace/incubator-hawq/contrib/hawq-hadoop/hawq-mapreduce-parquet/src/main/java/com/pivotal/hawq/mapreduce/parquet/convert/HAWQCircleConverter.java:25:
错误: 程序包parquet.io.api不存在
[ERROR] import parquet.io.api.Converter;
[ERROR] ^
[ERROR]
/Users/wangziming/workplace/incubator-hawq/contrib/hawq-hadoop/hawq-mapreduce-parquet/src/main/java/com/pivotal/hawq/mapreduce/parquet/convert/HAWQCircleConverter.java:26:
错误: 程序包parquet.io.api不存在
[ERROR] import parquet.io.api.GroupConverter;
[ERROR] ^
[ERROR]
/Users/wangziming/workplace/incubator-hawq/contrib/hawq-hadoop/hawq-mapreduce-parquet/src/main/java/com/pivotal/hawq/mapreduce/parquet/convert/HAWQCircleConverter.java:27:
错误: 程序包parquet.io.api不存在
[ERROR] import parquet.io.api.PrimitiveConverter;
[ERROR] ^
[ERROR]
/Users/wangziming/workplace/incubator-hawq/contrib/hawq-hadoop/hawq-mapreduce-parquet/src/main/java/com/pivotal/hawq/mapreduce/parquet/convert/HAWQCircleConverter.java:37:
错误: 找不到符号
[ERROR] public class HAWQCircleConverter extends GroupConverter {
[ERROR] ^
[ERROR] 符号: 类 GroupConverter
[ERROR]
/Users/wangziming/workplace/incubator-hawq/contrib/hawq-hadoop/hawq-mapreduce-parquet/src/main/java/com/pivotal/hawq/mapreduce/parquet/convert/HAWQCircleConverter.java:40:
错误: 找不到符号
[ERROR] private Converter[] converters;
[ERROR] ^
[ERROR] 符号: 类 Converter
[ERROR] 位置: 类 HAWQCircleConverter
[ERROR]
/Users/wangziming/workplace/incubator-hawq/contrib/hawq-hadoop/hawq-mapreduce-parquet/src/main/java/com/pivotal/hawq/mapreduce/parquet/convert/HAWQCircleConverter.java:70:
错误: 找不到符号
[ERROR] public Converter getConverter(int fieldIndex) {
[ERROR] ^
[ERROR] 符号: 类 Converter
[ERROR] 位置: 类 HAWQCircleConverter
[ERROR]
[GitHub] incubator-hawq issue #1380: HAWQ-1636. Fix compile apache hawq failure due t...
Github user huor commented on the issue: https://github.com/apache/incubator-hawq/pull/1380 +1 ---
[jira] [Resolved] (HAWQ-1636) Compile apache hawq failure due to unsupported syntax in libyarn on osx 10.11
[
https://issues.apache.org/jira/browse/HAWQ-1636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
oushu_WangZiming resolved HAWQ-1636.
Resolution: Fixed
Fix Version/s: 2.4.0.0-incubating
> Compile apache hawq failure due to unsupported syntax in libyarn on osx 10.11
> -
>
> Key: HAWQ-1636
> URL: https://issues.apache.org/jira/browse/HAWQ-1636
> Project: Apache HAWQ
> Issue Type: Bug
> Components: Build
>Affects Versions: 2.3.0.0-incubating
>Reporter: oushu_WangZiming
>Assignee: oushu_WangZiming
>Priority: Major
> Fix For: 2.4.0.0-incubating
>
>
> Follow instruction
> ([https://cwiki.apache.org/confluence/display/HAWQ/Build+and+Install)] to
> build apache hawq on osx 10.11, it fails due to unsupported syntax in libyarn:
> {code:java}
> 1. ./configure
> 2. make
> [ 9%] Building CXX object
> src/CMakeFiles/libyarn-shared.dir/libyarnclient/ApplicationClient.cpp.o
> cd /Users/wangziming/workplace/incubator-hawq/depends/libyarn/build/src &&
> /usr/bin/g++ -DTEST_HDFS_PREFIX=\"./\" -D_GNU_SOURCE -D__STDC_FORMAT_MACROS
> -Dlibyarn_shared_EXPORTS
> -I/Users/wangziming/workplace/incubator-hawq/depends/thirdparty/googletest/googletest/include
>
> -I/Users/wangziming/workplace/incubator-hawq/depends/thirdparty/googletest/googlemock/include
> -I/Users/wangziming/workplace/incubator-hawq/depends/libyarn/src
> -I/Users/wangziming/workplace/incubator-hawq/depends/libyarn/src/common
> -I/Users/wangziming/workplace/incubator-hawq/depends/libyarn/build/src
> -I/usr/local/include -I/usr/include/libxml2
> -I/Users/wangziming/workplace/incubator-hawq/depends/libyarn/mock
> -fno-omit-frame-pointer -msse4.2 -std=c++0x -O2 -g -DNDEBUG -fPIC -o
> CMakeFiles/libyarn-shared.dir/libyarnclient/ApplicationClient.cpp.o -c
> /Users/wangziming/workplace/incubator-hawq/depends/libyarn/src/libyarnclient/ApplicationClient.cpp
> /Users/wangziming/workplace/incubator-hawq/depends/libyarn/src/libyarnclient/ApplicationClient.cpp:76:10:
> error: no template named 'vector'; did you mean 'std::vector'?
> for (vector::iterator it = rmConfInfos.begin();
> ^~
> std::vector
> /Library/Developer/CommandLineTools/usr/bin/../include/c++/v1/vector:457:29:
> note: 'std::vector' declared here
> class _LIBCPP_TYPE_VIS_ONLY vector
> ^
> /Users/wangziming/workplace/incubator-hawq/depends/libyarn/src/libyarnclient/ApplicationClient.cpp:79:14:
> error: no template named 'vector'; did you mean 'std::vector'?
> for (vector::iterator it2 = rmInfos.begin();
> ^~
> std::vector
> /Library/Developer/CommandLineTools/usr/bin/../include/c++/v1/iterator:1244:75:
> note: 'std::vector' declared here
> template friend class _LIBCPP_TYPE_VIS_ONLY vector;
> ^
> /Users/wangziming/workplace/incubator-hawq/depends/libyarn/src/libyarnclient/ApplicationClient.cpp:98:17:
> warning: format specifies type 'int' but the argument has type 'size_type'
> (aka 'unsigned long') [-Wformat]
> rmInfos.size());
> ^~
> /Users/wangziming/workplace/incubator-hawq/depends/libyarn/src/common/Logger.h:59:47:
> note: expanded from macro 'LOG'
> Yarn::Internal::RootLogger.printf(s, fmt, ##_VA_ARGS_)
> ^~~
> 1 warning and 2 errors generated.
> make[4]: ***
> [src/CMakeFiles/libyarn-shared.dir/libyarnclient/ApplicationClient.cpp.o]
> Error 1
> make[3]: *** [src/CMakeFiles/libyarn-shared.dir/all] Error 2
> make[2]: *** [all] Error 2
> make[1]: *** [build] Error 2
> make: *** [all] Error 2{code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Closed] (HAWQ-1636) Compile apache hawq failure due to unsupported syntax in libyarn on osx 10.11
[
https://issues.apache.org/jira/browse/HAWQ-1636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
oushu_WangZiming closed HAWQ-1636.
--
> Compile apache hawq failure due to unsupported syntax in libyarn on osx 10.11
> -
>
> Key: HAWQ-1636
> URL: https://issues.apache.org/jira/browse/HAWQ-1636
> Project: Apache HAWQ
> Issue Type: Bug
> Components: Build
>Affects Versions: 2.3.0.0-incubating
>Reporter: oushu_WangZiming
>Assignee: oushu_WangZiming
>Priority: Major
> Fix For: 2.4.0.0-incubating
>
>
> Follow instruction
> ([https://cwiki.apache.org/confluence/display/HAWQ/Build+and+Install)] to
> build apache hawq on osx 10.11, it fails due to unsupported syntax in libyarn:
> {code:java}
> 1. ./configure
> 2. make
> [ 9%] Building CXX object
> src/CMakeFiles/libyarn-shared.dir/libyarnclient/ApplicationClient.cpp.o
> cd /Users/wangziming/workplace/incubator-hawq/depends/libyarn/build/src &&
> /usr/bin/g++ -DTEST_HDFS_PREFIX=\"./\" -D_GNU_SOURCE -D__STDC_FORMAT_MACROS
> -Dlibyarn_shared_EXPORTS
> -I/Users/wangziming/workplace/incubator-hawq/depends/thirdparty/googletest/googletest/include
>
> -I/Users/wangziming/workplace/incubator-hawq/depends/thirdparty/googletest/googlemock/include
> -I/Users/wangziming/workplace/incubator-hawq/depends/libyarn/src
> -I/Users/wangziming/workplace/incubator-hawq/depends/libyarn/src/common
> -I/Users/wangziming/workplace/incubator-hawq/depends/libyarn/build/src
> -I/usr/local/include -I/usr/include/libxml2
> -I/Users/wangziming/workplace/incubator-hawq/depends/libyarn/mock
> -fno-omit-frame-pointer -msse4.2 -std=c++0x -O2 -g -DNDEBUG -fPIC -o
> CMakeFiles/libyarn-shared.dir/libyarnclient/ApplicationClient.cpp.o -c
> /Users/wangziming/workplace/incubator-hawq/depends/libyarn/src/libyarnclient/ApplicationClient.cpp
> /Users/wangziming/workplace/incubator-hawq/depends/libyarn/src/libyarnclient/ApplicationClient.cpp:76:10:
> error: no template named 'vector'; did you mean 'std::vector'?
> for (vector::iterator it = rmConfInfos.begin();
> ^~
> std::vector
> /Library/Developer/CommandLineTools/usr/bin/../include/c++/v1/vector:457:29:
> note: 'std::vector' declared here
> class _LIBCPP_TYPE_VIS_ONLY vector
> ^
> /Users/wangziming/workplace/incubator-hawq/depends/libyarn/src/libyarnclient/ApplicationClient.cpp:79:14:
> error: no template named 'vector'; did you mean 'std::vector'?
> for (vector::iterator it2 = rmInfos.begin();
> ^~
> std::vector
> /Library/Developer/CommandLineTools/usr/bin/../include/c++/v1/iterator:1244:75:
> note: 'std::vector' declared here
> template friend class _LIBCPP_TYPE_VIS_ONLY vector;
> ^
> /Users/wangziming/workplace/incubator-hawq/depends/libyarn/src/libyarnclient/ApplicationClient.cpp:98:17:
> warning: format specifies type 'int' but the argument has type 'size_type'
> (aka 'unsigned long') [-Wformat]
> rmInfos.size());
> ^~
> /Users/wangziming/workplace/incubator-hawq/depends/libyarn/src/common/Logger.h:59:47:
> note: expanded from macro 'LOG'
> Yarn::Internal::RootLogger.printf(s, fmt, ##_VA_ARGS_)
> ^~~
> 1 warning and 2 errors generated.
> make[4]: ***
> [src/CMakeFiles/libyarn-shared.dir/libyarnclient/ApplicationClient.cpp.o]
> Error 1
> make[3]: *** [src/CMakeFiles/libyarn-shared.dir/all] Error 2
> make[2]: *** [all] Error 2
> make[1]: *** [build] Error 2
> make: *** [all] Error 2{code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (HAWQ-1636) Compile apache hawq failure due to unsupported syntax in libyarn on osx 10.11
[
https://issues.apache.org/jira/browse/HAWQ-1636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16533236#comment-16533236
]
Ruilong Huo commented on HAWQ-1636:
---
Assigning to oushu1wangziming1 for fix.
> Compile apache hawq failure due to unsupported syntax in libyarn on osx 10.11
> -
>
> Key: HAWQ-1636
> URL: https://issues.apache.org/jira/browse/HAWQ-1636
> Project: Apache HAWQ
> Issue Type: Bug
> Components: Build
>Affects Versions: 2.3.0.0-incubating
>Reporter: WangZiming
>Assignee: WangZiming
>Priority: Major
>
> Follow instruction
> ([https://cwiki.apache.org/confluence/display/HAWQ/Build+and+Install)] to
> build apache hawq on osx 10.11, it fails due to unsupported syntax in libyarn:
> {code:java}
> 1. ./configure
> 2. make
> [ 9%] Building CXX object
> src/CMakeFiles/libyarn-shared.dir/libyarnclient/ApplicationClient.cpp.o
> cd /Users/wangziming/workplace/incubator-hawq/depends/libyarn/build/src &&
> /usr/bin/g++ -DTEST_HDFS_PREFIX=\"./\" -D_GNU_SOURCE -D__STDC_FORMAT_MACROS
> -Dlibyarn_shared_EXPORTS
> -I/Users/wangziming/workplace/incubator-hawq/depends/thirdparty/googletest/googletest/include
>
> -I/Users/wangziming/workplace/incubator-hawq/depends/thirdparty/googletest/googlemock/include
> -I/Users/wangziming/workplace/incubator-hawq/depends/libyarn/src
> -I/Users/wangziming/workplace/incubator-hawq/depends/libyarn/src/common
> -I/Users/wangziming/workplace/incubator-hawq/depends/libyarn/build/src
> -I/usr/local/include -I/usr/include/libxml2
> -I/Users/wangziming/workplace/incubator-hawq/depends/libyarn/mock
> -fno-omit-frame-pointer -msse4.2 -std=c++0x -O2 -g -DNDEBUG -fPIC -o
> CMakeFiles/libyarn-shared.dir/libyarnclient/ApplicationClient.cpp.o -c
> /Users/wangziming/workplace/incubator-hawq/depends/libyarn/src/libyarnclient/ApplicationClient.cpp
> /Users/wangziming/workplace/incubator-hawq/depends/libyarn/src/libyarnclient/ApplicationClient.cpp:76:10:
> error: no template named 'vector'; did you mean 'std::vector'?
> for (vector::iterator it = rmConfInfos.begin();
> ^~
> std::vector
> /Library/Developer/CommandLineTools/usr/bin/../include/c++/v1/vector:457:29:
> note: 'std::vector' declared here
> class _LIBCPP_TYPE_VIS_ONLY vector
> ^
> /Users/wangziming/workplace/incubator-hawq/depends/libyarn/src/libyarnclient/ApplicationClient.cpp:79:14:
> error: no template named 'vector'; did you mean 'std::vector'?
> for (vector::iterator it2 = rmInfos.begin();
> ^~
> std::vector
> /Library/Developer/CommandLineTools/usr/bin/../include/c++/v1/iterator:1244:75:
> note: 'std::vector' declared here
> template friend class _LIBCPP_TYPE_VIS_ONLY vector;
> ^
> /Users/wangziming/workplace/incubator-hawq/depends/libyarn/src/libyarnclient/ApplicationClient.cpp:98:17:
> warning: format specifies type 'int' but the argument has type 'size_type'
> (aka 'unsigned long') [-Wformat]
> rmInfos.size());
> ^~
> /Users/wangziming/workplace/incubator-hawq/depends/libyarn/src/common/Logger.h:59:47:
> note: expanded from macro 'LOG'
> Yarn::Internal::RootLogger.printf(s, fmt, ##_VA_ARGS_)
> ^~~
> 1 warning and 2 errors generated.
> make[4]: ***
> [src/CMakeFiles/libyarn-shared.dir/libyarnclient/ApplicationClient.cpp.o]
> Error 1
> make[3]: *** [src/CMakeFiles/libyarn-shared.dir/all] Error 2
> make[2]: *** [all] Error 2
> make[1]: *** [build] Error 2
> make: *** [all] Error 2{code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Assigned] (HAWQ-1636) Compile apache hawq failure due to unsupported syntax in libyarn on osx 10.11
[
https://issues.apache.org/jira/browse/HAWQ-1636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruilong Huo reassigned HAWQ-1636:
-
Assignee: WangZiming (was: Radar Lei)
> Compile apache hawq failure due to unsupported syntax in libyarn on osx 10.11
> -
>
> Key: HAWQ-1636
> URL: https://issues.apache.org/jira/browse/HAWQ-1636
> Project: Apache HAWQ
> Issue Type: Bug
> Components: Build
>Affects Versions: 2.3.0.0-incubating
>Reporter: WangZiming
>Assignee: WangZiming
>Priority: Major
>
> Follow instruction
> ([https://cwiki.apache.org/confluence/display/HAWQ/Build+and+Install)] to
> build apache hawq on osx 10.11, it fails due to unsupported syntax in libyarn:
> {code:java}
> 1. ./configure
> 2. make
> [ 9%] Building CXX object
> src/CMakeFiles/libyarn-shared.dir/libyarnclient/ApplicationClient.cpp.o
> cd /Users/wangziming/workplace/incubator-hawq/depends/libyarn/build/src &&
> /usr/bin/g++ -DTEST_HDFS_PREFIX=\"./\" -D_GNU_SOURCE -D__STDC_FORMAT_MACROS
> -Dlibyarn_shared_EXPORTS
> -I/Users/wangziming/workplace/incubator-hawq/depends/thirdparty/googletest/googletest/include
>
> -I/Users/wangziming/workplace/incubator-hawq/depends/thirdparty/googletest/googlemock/include
> -I/Users/wangziming/workplace/incubator-hawq/depends/libyarn/src
> -I/Users/wangziming/workplace/incubator-hawq/depends/libyarn/src/common
> -I/Users/wangziming/workplace/incubator-hawq/depends/libyarn/build/src
> -I/usr/local/include -I/usr/include/libxml2
> -I/Users/wangziming/workplace/incubator-hawq/depends/libyarn/mock
> -fno-omit-frame-pointer -msse4.2 -std=c++0x -O2 -g -DNDEBUG -fPIC -o
> CMakeFiles/libyarn-shared.dir/libyarnclient/ApplicationClient.cpp.o -c
> /Users/wangziming/workplace/incubator-hawq/depends/libyarn/src/libyarnclient/ApplicationClient.cpp
> /Users/wangziming/workplace/incubator-hawq/depends/libyarn/src/libyarnclient/ApplicationClient.cpp:76:10:
> error: no template named 'vector'; did you mean 'std::vector'?
> for (vector::iterator it = rmConfInfos.begin();
> ^~
> std::vector
> /Library/Developer/CommandLineTools/usr/bin/../include/c++/v1/vector:457:29:
> note: 'std::vector' declared here
> class _LIBCPP_TYPE_VIS_ONLY vector
> ^
> /Users/wangziming/workplace/incubator-hawq/depends/libyarn/src/libyarnclient/ApplicationClient.cpp:79:14:
> error: no template named 'vector'; did you mean 'std::vector'?
> for (vector::iterator it2 = rmInfos.begin();
> ^~
> std::vector
> /Library/Developer/CommandLineTools/usr/bin/../include/c++/v1/iterator:1244:75:
> note: 'std::vector' declared here
> template friend class _LIBCPP_TYPE_VIS_ONLY vector;
> ^
> /Users/wangziming/workplace/incubator-hawq/depends/libyarn/src/libyarnclient/ApplicationClient.cpp:98:17:
> warning: format specifies type 'int' but the argument has type 'size_type'
> (aka 'unsigned long') [-Wformat]
> rmInfos.size());
> ^~
> /Users/wangziming/workplace/incubator-hawq/depends/libyarn/src/common/Logger.h:59:47:
> note: expanded from macro 'LOG'
> Yarn::Internal::RootLogger.printf(s, fmt, ##_VA_ARGS_)
> ^~~
> 1 warning and 2 errors generated.
> make[4]: ***
> [src/CMakeFiles/libyarn-shared.dir/libyarnclient/ApplicationClient.cpp.o]
> Error 1
> make[3]: *** [src/CMakeFiles/libyarn-shared.dir/all] Error 2
> make[2]: *** [all] Error 2
> make[1]: *** [build] Error 2
> make: *** [all] Error 2{code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[GitHub] incubator-hawq pull request #1380: HAWQ-1636. Fix compile apache hawq failur...
GitHub user oushu1wangziming1 opened a pull request: https://github.com/apache/incubator-hawq/pull/1380 HAWQ-1636. Fix compile apache hawq failure due to unsupported syntax in libyarn on osx 10.11 You can merge this pull request into a Git repository by running: $ git pull https://github.com/oushu1wangziming1/incubator-hawq HAWQ-1636 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-hawq/pull/1380.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1380 commit 845ffe87576587d4591894a77da531cef5e85fb3 Author: oushu1wangziming1 Date: 2018-07-05T02:12:27Z HAWQ-1636. Fix compile apache hawq failure due to unsupported syntax in libyarn on osx 10.11 ---
[jira] [Commented] (HAWQ-1636) Compile apache hawq failure due to unsupported syntax in libyarn on osx 10.11
[
https://issues.apache.org/jira/browse/HAWQ-1636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16533185#comment-16533185
]
WangZiming commented on HAWQ-1636:
--
Right. I will create a PR for fix right away.
> Compile apache hawq failure due to unsupported syntax in libyarn on osx 10.11
> -
>
> Key: HAWQ-1636
> URL: https://issues.apache.org/jira/browse/HAWQ-1636
> Project: Apache HAWQ
> Issue Type: Bug
> Components: Build
>Affects Versions: 2.3.0.0-incubating
>Reporter: WangZiming
>Assignee: Radar Lei
>Priority: Major
>
> Follow instruction
> ([https://cwiki.apache.org/confluence/display/HAWQ/Build+and+Install)] to
> build apache hawq on osx 10.11, it fails due to unsupported syntax in libyarn:
> {code:java}
> 1. ./configure
> 2. make
> [ 9%] Building CXX object
> src/CMakeFiles/libyarn-shared.dir/libyarnclient/ApplicationClient.cpp.o
> cd /Users/wangziming/workplace/incubator-hawq/depends/libyarn/build/src &&
> /usr/bin/g++ -DTEST_HDFS_PREFIX=\"./\" -D_GNU_SOURCE -D__STDC_FORMAT_MACROS
> -Dlibyarn_shared_EXPORTS
> -I/Users/wangziming/workplace/incubator-hawq/depends/thirdparty/googletest/googletest/include
>
> -I/Users/wangziming/workplace/incubator-hawq/depends/thirdparty/googletest/googlemock/include
> -I/Users/wangziming/workplace/incubator-hawq/depends/libyarn/src
> -I/Users/wangziming/workplace/incubator-hawq/depends/libyarn/src/common
> -I/Users/wangziming/workplace/incubator-hawq/depends/libyarn/build/src
> -I/usr/local/include -I/usr/include/libxml2
> -I/Users/wangziming/workplace/incubator-hawq/depends/libyarn/mock
> -fno-omit-frame-pointer -msse4.2 -std=c++0x -O2 -g -DNDEBUG -fPIC -o
> CMakeFiles/libyarn-shared.dir/libyarnclient/ApplicationClient.cpp.o -c
> /Users/wangziming/workplace/incubator-hawq/depends/libyarn/src/libyarnclient/ApplicationClient.cpp
> /Users/wangziming/workplace/incubator-hawq/depends/libyarn/src/libyarnclient/ApplicationClient.cpp:76:10:
> error: no template named 'vector'; did you mean 'std::vector'?
> for (vector::iterator it = rmConfInfos.begin();
> ^~
> std::vector
> /Library/Developer/CommandLineTools/usr/bin/../include/c++/v1/vector:457:29:
> note: 'std::vector' declared here
> class _LIBCPP_TYPE_VIS_ONLY vector
> ^
> /Users/wangziming/workplace/incubator-hawq/depends/libyarn/src/libyarnclient/ApplicationClient.cpp:79:14:
> error: no template named 'vector'; did you mean 'std::vector'?
> for (vector::iterator it2 = rmInfos.begin();
> ^~
> std::vector
> /Library/Developer/CommandLineTools/usr/bin/../include/c++/v1/iterator:1244:75:
> note: 'std::vector' declared here
> template friend class _LIBCPP_TYPE_VIS_ONLY vector;
> ^
> /Users/wangziming/workplace/incubator-hawq/depends/libyarn/src/libyarnclient/ApplicationClient.cpp:98:17:
> warning: format specifies type 'int' but the argument has type 'size_type'
> (aka 'unsigned long') [-Wformat]
> rmInfos.size());
> ^~
> /Users/wangziming/workplace/incubator-hawq/depends/libyarn/src/common/Logger.h:59:47:
> note: expanded from macro 'LOG'
> Yarn::Internal::RootLogger.printf(s, fmt, ##_VA_ARGS_)
> ^~~
> 1 warning and 2 errors generated.
> make[4]: ***
> [src/CMakeFiles/libyarn-shared.dir/libyarnclient/ApplicationClient.cpp.o]
> Error 1
> make[3]: *** [src/CMakeFiles/libyarn-shared.dir/all] Error 2
> make[2]: *** [all] Error 2
> make[1]: *** [build] Error 2
> make: *** [all] Error 2{code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (HAWQ-1636) Compile apache hawq failure due to unsupported syntax in libyarn on osx 10.11
[
https://issues.apache.org/jira/browse/HAWQ-1636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16533182#comment-16533182
]
Hongxu Ma commented on HAWQ-1636:
-
[~oushu1wangziming1] Thanks.
This issue is the same as HAWQ travis failure:
[https://travis-ci.org/apache/incubator-hawq/builds/399048338?utm_source=github_status_medium=notification]
I think it's a env problem (e.g. compiler) and can be fixed easily.
Are you planning to open a PR? It's good opportunity for new contributor, :-)
> Compile apache hawq failure due to unsupported syntax in libyarn on osx 10.11
> -
>
> Key: HAWQ-1636
> URL: https://issues.apache.org/jira/browse/HAWQ-1636
> Project: Apache HAWQ
> Issue Type: Bug
> Components: Build
>Affects Versions: 2.3.0.0-incubating
>Reporter: WangZiming
>Assignee: Radar Lei
>Priority: Major
>
> Follow instruction
> ([https://cwiki.apache.org/confluence/display/HAWQ/Build+and+Install)] to
> build apache hawq on osx 10.11, it fails due to unsupported syntax in libyarn:
> {code:java}
> 1. ./configure
> 2. make
> [ 9%] Building CXX object
> src/CMakeFiles/libyarn-shared.dir/libyarnclient/ApplicationClient.cpp.o
> cd /Users/wangziming/workplace/incubator-hawq/depends/libyarn/build/src &&
> /usr/bin/g++ -DTEST_HDFS_PREFIX=\"./\" -D_GNU_SOURCE -D__STDC_FORMAT_MACROS
> -Dlibyarn_shared_EXPORTS
> -I/Users/wangziming/workplace/incubator-hawq/depends/thirdparty/googletest/googletest/include
>
> -I/Users/wangziming/workplace/incubator-hawq/depends/thirdparty/googletest/googlemock/include
> -I/Users/wangziming/workplace/incubator-hawq/depends/libyarn/src
> -I/Users/wangziming/workplace/incubator-hawq/depends/libyarn/src/common
> -I/Users/wangziming/workplace/incubator-hawq/depends/libyarn/build/src
> -I/usr/local/include -I/usr/include/libxml2
> -I/Users/wangziming/workplace/incubator-hawq/depends/libyarn/mock
> -fno-omit-frame-pointer -msse4.2 -std=c++0x -O2 -g -DNDEBUG -fPIC -o
> CMakeFiles/libyarn-shared.dir/libyarnclient/ApplicationClient.cpp.o -c
> /Users/wangziming/workplace/incubator-hawq/depends/libyarn/src/libyarnclient/ApplicationClient.cpp
> /Users/wangziming/workplace/incubator-hawq/depends/libyarn/src/libyarnclient/ApplicationClient.cpp:76:10:
> error: no template named 'vector'; did you mean 'std::vector'?
> for (vector::iterator it = rmConfInfos.begin();
> ^~
> std::vector
> /Library/Developer/CommandLineTools/usr/bin/../include/c++/v1/vector:457:29:
> note: 'std::vector' declared here
> class _LIBCPP_TYPE_VIS_ONLY vector
> ^
> /Users/wangziming/workplace/incubator-hawq/depends/libyarn/src/libyarnclient/ApplicationClient.cpp:79:14:
> error: no template named 'vector'; did you mean 'std::vector'?
> for (vector::iterator it2 = rmInfos.begin();
> ^~
> std::vector
> /Library/Developer/CommandLineTools/usr/bin/../include/c++/v1/iterator:1244:75:
> note: 'std::vector' declared here
> template friend class _LIBCPP_TYPE_VIS_ONLY vector;
> ^
> /Users/wangziming/workplace/incubator-hawq/depends/libyarn/src/libyarnclient/ApplicationClient.cpp:98:17:
> warning: format specifies type 'int' but the argument has type 'size_type'
> (aka 'unsigned long') [-Wformat]
> rmInfos.size());
> ^~
> /Users/wangziming/workplace/incubator-hawq/depends/libyarn/src/common/Logger.h:59:47:
> note: expanded from macro 'LOG'
> Yarn::Internal::RootLogger.printf(s, fmt, ##_VA_ARGS_)
> ^~~
> 1 warning and 2 errors generated.
> make[4]: ***
> [src/CMakeFiles/libyarn-shared.dir/libyarnclient/ApplicationClient.cpp.o]
> Error 1
> make[3]: *** [src/CMakeFiles/libyarn-shared.dir/all] Error 2
> make[2]: *** [all] Error 2
> make[1]: *** [build] Error 2
> make: *** [all] Error 2{code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Updated] (HAWQ-1636) Compile apache hawq failure due to unsupported syntax in libyarn on osx 10.11
[
https://issues.apache.org/jira/browse/HAWQ-1636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
WangZiming updated HAWQ-1636:
-
Description:
Follow instruction
([https://cwiki.apache.org/confluence/display/HAWQ/Build+and+Install)] to build
apache hawq on osx 10.11, it fails due to unsupported syntax in libyarn:
{code:java}
1. ./configure
2. make
[ 9%] Building CXX object
src/CMakeFiles/libyarn-shared.dir/libyarnclient/ApplicationClient.cpp.o
cd /Users/wangziming/workplace/incubator-hawq/depends/libyarn/build/src &&
/usr/bin/g++ -DTEST_HDFS_PREFIX=\"./\" -D_GNU_SOURCE -D__STDC_FORMAT_MACROS
-Dlibyarn_shared_EXPORTS
-I/Users/wangziming/workplace/incubator-hawq/depends/thirdparty/googletest/googletest/include
-I/Users/wangziming/workplace/incubator-hawq/depends/thirdparty/googletest/googlemock/include
-I/Users/wangziming/workplace/incubator-hawq/depends/libyarn/src
-I/Users/wangziming/workplace/incubator-hawq/depends/libyarn/src/common
-I/Users/wangziming/workplace/incubator-hawq/depends/libyarn/build/src
-I/usr/local/include -I/usr/include/libxml2
-I/Users/wangziming/workplace/incubator-hawq/depends/libyarn/mock
-fno-omit-frame-pointer -msse4.2 -std=c++0x -O2 -g -DNDEBUG -fPIC -o
CMakeFiles/libyarn-shared.dir/libyarnclient/ApplicationClient.cpp.o -c
/Users/wangziming/workplace/incubator-hawq/depends/libyarn/src/libyarnclient/ApplicationClient.cpp
/Users/wangziming/workplace/incubator-hawq/depends/libyarn/src/libyarnclient/ApplicationClient.cpp:76:10:
error: no template named 'vector'; did you mean 'std::vector'?
for (vector::iterator it = rmConfInfos.begin();
^~
std::vector
/Library/Developer/CommandLineTools/usr/bin/../include/c++/v1/vector:457:29:
note: 'std::vector' declared here
class _LIBCPP_TYPE_VIS_ONLY vector
^
/Users/wangziming/workplace/incubator-hawq/depends/libyarn/src/libyarnclient/ApplicationClient.cpp:79:14:
error: no template named 'vector'; did you mean 'std::vector'?
for (vector::iterator it2 = rmInfos.begin();
^~
std::vector
/Library/Developer/CommandLineTools/usr/bin/../include/c++/v1/iterator:1244:75:
note: 'std::vector' declared here
template friend class _LIBCPP_TYPE_VIS_ONLY vector;
^
/Users/wangziming/workplace/incubator-hawq/depends/libyarn/src/libyarnclient/ApplicationClient.cpp:98:17:
warning: format specifies type 'int' but the argument has type 'size_type'
(aka 'unsigned long') [-Wformat]
rmInfos.size());
^~
/Users/wangziming/workplace/incubator-hawq/depends/libyarn/src/common/Logger.h:59:47:
note: expanded from macro 'LOG'
Yarn::Internal::RootLogger.printf(s, fmt, ##_VA_ARGS_)
^~~
1 warning and 2 errors generated.
make[4]: ***
[src/CMakeFiles/libyarn-shared.dir/libyarnclient/ApplicationClient.cpp.o] Error
1
make[3]: *** [src/CMakeFiles/libyarn-shared.dir/all] Error 2
make[2]: *** [all] Error 2
make[1]: *** [build] Error 2
make: *** [all] Error 2{code}
was:
Follow instruction
([https://cwiki.apache.org/confluence/display/HAWQ/Build+and+Install)] to build
apache hawq on osx 10.11, it fails due to unsupported syntax in libyarn:
```
1. ./configure
2. make
[ 9%] Building CXX object
src/CMakeFiles/libyarn-shared.dir/libyarnclient/ApplicationClient.cpp.o
cd /Users/wangziming/workplace/incubator-hawq/depends/libyarn/build/src &&
/usr/bin/g++ -DTEST_HDFS_PREFIX=\"./\" -D_GNU_SOURCE -D__STDC_FORMAT_MACROS
-Dlibyarn_shared_EXPORTS
-I/Users/wangziming/workplace/incubator-hawq/depends/thirdparty/googletest/googletest/include
-I/Users/wangziming/workplace/incubator-hawq/depends/thirdparty/googletest/googlemock/include
-I/Users/wangziming/workplace/incubator-hawq/depends/libyarn/src
-I/Users/wangziming/workplace/incubator-hawq/depends/libyarn/src/common
-I/Users/wangziming/workplace/incubator-hawq/depends/libyarn/build/src
-I/usr/local/include -I/usr/include/libxml2
-I/Users/wangziming/workplace/incubator-hawq/depends/libyarn/mock
-fno-omit-frame-pointer -msse4.2 -std=c++0x -O2 -g -DNDEBUG -fPIC -o
CMakeFiles/libyarn-shared.dir/libyarnclient/ApplicationClient.cpp.o -c
/Users/wangziming/workplace/incubator-hawq/depends/libyarn/src/libyarnclient/ApplicationClient.cpp
/Users/wangziming/workplace/incubator-hawq/depends/libyarn/src/libyarnclient/ApplicationClient.cpp:76:10:
error: no template named 'vector'; did you mean 'std::vector'?
for (vector::iterator it = rmConfInfos.begin();
^~
std::vector
/Library/Developer/CommandLineTools/usr/bin/../include/c++/v1/vector:457:29:
note: 'std::vector' declared here
class _LIBCPP_TYPE_VIS_ONLY vector
^
/Users/wangziming/workplace/incubator-hawq/depends/libyarn/src/libyarnclient/ApplicationClient.cpp:79:14:
error: no template named 'vector'; did you mean 'std::vector'?
for (vector::iterator it2 = rmInfos.begin();
^~
std::vector
/Library/Developer/CommandLineTools/usr/bin/../include/c++/v1/iterator:1244:75:
note: 'std::vector' declared here
template friend class _LIBCPP_TYPE_VIS_ONLY vector;
[jira] [Updated] (HAWQ-1636) Compile apache hawq failure due to unsupported syntax in libyarn on osx 10.11
[ https://issues.apache.org/jira/browse/HAWQ-1636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] WangZiming updated HAWQ-1636: - Affects Version/s: 2.3.0.0-incubating > Compile apache hawq failure due to unsupported syntax in libyarn on osx 10.11 > - > > Key: HAWQ-1636 > URL: https://issues.apache.org/jira/browse/HAWQ-1636 > Project: Apache HAWQ > Issue Type: Bug > Components: Build >Affects Versions: 2.3.0.0-incubating >Reporter: WangZiming >Assignee: Radar Lei >Priority: Major > > Follow instruction > ([https://cwiki.apache.org/confluence/display/HAWQ/Build+and+Install)] to > build apache hawq on osx 10.11, it fails due to unsupported syntax in libyarn: > > ``` > 1. ./configure > 2. make > [ 9%] Building CXX object > src/CMakeFiles/libyarn-shared.dir/libyarnclient/ApplicationClient.cpp.o > cd /Users/wangziming/workplace/incubator-hawq/depends/libyarn/build/src && > /usr/bin/g++ -DTEST_HDFS_PREFIX=\"./\" -D_GNU_SOURCE -D__STDC_FORMAT_MACROS > -Dlibyarn_shared_EXPORTS > -I/Users/wangziming/workplace/incubator-hawq/depends/thirdparty/googletest/googletest/include > > -I/Users/wangziming/workplace/incubator-hawq/depends/thirdparty/googletest/googlemock/include > -I/Users/wangziming/workplace/incubator-hawq/depends/libyarn/src > -I/Users/wangziming/workplace/incubator-hawq/depends/libyarn/src/common > -I/Users/wangziming/workplace/incubator-hawq/depends/libyarn/build/src > -I/usr/local/include -I/usr/include/libxml2 > -I/Users/wangziming/workplace/incubator-hawq/depends/libyarn/mock > -fno-omit-frame-pointer -msse4.2 -std=c++0x -O2 -g -DNDEBUG -fPIC -o > CMakeFiles/libyarn-shared.dir/libyarnclient/ApplicationClient.cpp.o -c > /Users/wangziming/workplace/incubator-hawq/depends/libyarn/src/libyarnclient/ApplicationClient.cpp > /Users/wangziming/workplace/incubator-hawq/depends/libyarn/src/libyarnclient/ApplicationClient.cpp:76:10: > error: no template named 'vector'; did you mean 'std::vector'? > for (vector::iterator it = rmConfInfos.begin(); > ^~ > std::vector > /Library/Developer/CommandLineTools/usr/bin/../include/c++/v1/vector:457:29: > note: 'std::vector' declared here > class _LIBCPP_TYPE_VIS_ONLY vector > ^ > /Users/wangziming/workplace/incubator-hawq/depends/libyarn/src/libyarnclient/ApplicationClient.cpp:79:14: > error: no template named 'vector'; did you mean 'std::vector'? > for (vector::iterator it2 = rmInfos.begin(); > ^~ > std::vector > /Library/Developer/CommandLineTools/usr/bin/../include/c++/v1/iterator:1244:75: > note: 'std::vector' declared here > template friend class _LIBCPP_TYPE_VIS_ONLY vector; > ^ > /Users/wangziming/workplace/incubator-hawq/depends/libyarn/src/libyarnclient/ApplicationClient.cpp:98:17: > warning: format specifies type 'int' but the argument has type 'size_type' > (aka 'unsigned long') [-Wformat] > rmInfos.size()); > ^~ > /Users/wangziming/workplace/incubator-hawq/depends/libyarn/src/common/Logger.h:59:47: > note: expanded from macro 'LOG' > Yarn::Internal::RootLogger.printf(s, fmt, ##__VA_ARGS__) > ^~~ > 1 warning and 2 errors generated. > make[4]: *** > [src/CMakeFiles/libyarn-shared.dir/libyarnclient/ApplicationClient.cpp.o] > Error 1 > make[3]: *** [src/CMakeFiles/libyarn-shared.dir/all] Error 2 > make[2]: *** [all] Error 2 > make[1]: *** [build] Error 2 > make: *** [all] Error 2 > ``` -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (HAWQ-1636) Compile apache hawq failure due to unsupported syntax in libyarn on osx 10.11
WangZiming created HAWQ-1636: Summary: Compile apache hawq failure due to unsupported syntax in libyarn on osx 10.11 Key: HAWQ-1636 URL: https://issues.apache.org/jira/browse/HAWQ-1636 Project: Apache HAWQ Issue Type: Bug Components: Build Reporter: WangZiming Assignee: Radar Lei Follow instruction ([https://cwiki.apache.org/confluence/display/HAWQ/Build+and+Install)] to build apache hawq on osx 10.11, it fails due to unsupported syntax in libyarn: ``` 1. ./configure 2. make [ 9%] Building CXX object src/CMakeFiles/libyarn-shared.dir/libyarnclient/ApplicationClient.cpp.o cd /Users/wangziming/workplace/incubator-hawq/depends/libyarn/build/src && /usr/bin/g++ -DTEST_HDFS_PREFIX=\"./\" -D_GNU_SOURCE -D__STDC_FORMAT_MACROS -Dlibyarn_shared_EXPORTS -I/Users/wangziming/workplace/incubator-hawq/depends/thirdparty/googletest/googletest/include -I/Users/wangziming/workplace/incubator-hawq/depends/thirdparty/googletest/googlemock/include -I/Users/wangziming/workplace/incubator-hawq/depends/libyarn/src -I/Users/wangziming/workplace/incubator-hawq/depends/libyarn/src/common -I/Users/wangziming/workplace/incubator-hawq/depends/libyarn/build/src -I/usr/local/include -I/usr/include/libxml2 -I/Users/wangziming/workplace/incubator-hawq/depends/libyarn/mock -fno-omit-frame-pointer -msse4.2 -std=c++0x -O2 -g -DNDEBUG -fPIC -o CMakeFiles/libyarn-shared.dir/libyarnclient/ApplicationClient.cpp.o -c /Users/wangziming/workplace/incubator-hawq/depends/libyarn/src/libyarnclient/ApplicationClient.cpp /Users/wangziming/workplace/incubator-hawq/depends/libyarn/src/libyarnclient/ApplicationClient.cpp:76:10: error: no template named 'vector'; did you mean 'std::vector'? for (vector::iterator it = rmConfInfos.begin(); ^~ std::vector /Library/Developer/CommandLineTools/usr/bin/../include/c++/v1/vector:457:29: note: 'std::vector' declared here class _LIBCPP_TYPE_VIS_ONLY vector ^ /Users/wangziming/workplace/incubator-hawq/depends/libyarn/src/libyarnclient/ApplicationClient.cpp:79:14: error: no template named 'vector'; did you mean 'std::vector'? for (vector::iterator it2 = rmInfos.begin(); ^~ std::vector /Library/Developer/CommandLineTools/usr/bin/../include/c++/v1/iterator:1244:75: note: 'std::vector' declared here template friend class _LIBCPP_TYPE_VIS_ONLY vector; ^ /Users/wangziming/workplace/incubator-hawq/depends/libyarn/src/libyarnclient/ApplicationClient.cpp:98:17: warning: format specifies type 'int' but the argument has type 'size_type' (aka 'unsigned long') [-Wformat] rmInfos.size()); ^~ /Users/wangziming/workplace/incubator-hawq/depends/libyarn/src/common/Logger.h:59:47: note: expanded from macro 'LOG' Yarn::Internal::RootLogger.printf(s, fmt, ##__VA_ARGS__) ^~~ 1 warning and 2 errors generated. make[4]: *** [src/CMakeFiles/libyarn-shared.dir/libyarnclient/ApplicationClient.cpp.o] Error 1 make[3]: *** [src/CMakeFiles/libyarn-shared.dir/all] Error 2 make[2]: *** [all] Error 2 make[1]: *** [build] Error 2 make: *** [all] Error 2 ``` -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[GitHub] incubator-hawq pull request #1379: WIP: Cache UGI objects and clean them per...
Github user lavjain commented on a diff in the pull request:
https://github.com/apache/incubator-hawq/pull/1379#discussion_r200169586
--- Diff:
pxf/pxf-service/src/main/java/org/apache/hawq/pxf/service/servlet/SecurityServletFilter.java
---
@@ -89,32 +188,103 @@ public Boolean run() throws IOException,
ServletException {
};
// create proxy user UGI from the UGI of the logged in user
and execute the servlet chain as that user
-UserGroupInformation proxyUGI = null;
+TimedProxyUGI timedProxyUGI = getTimedProxyUGI(user, session);
try {
-LOG.debug("Creating proxy user = " + user);
-proxyUGI = UserGroupInformation.createProxyUser(user,
UserGroupInformation.getLoginUser());
-proxyUGI.doAs(action);
+timedProxyUGI.proxyUGI.doAs(action);
} catch (UndeclaredThrowableException ute) {
// unwrap the real exception thrown by the action
throw new ServletException(ute.getCause());
} catch (InterruptedException ie) {
throw new ServletException(ie);
-} finally {
-try {
-if (proxyUGI != null) {
-LOG.debug("Closing FileSystem for proxy user = " +
proxyUGI.getUserName());
-FileSystem.closeAllForUGI(proxyUGI);
-}
-} catch (Throwable t) {
-LOG.warn("Error closing FileSystem for proxy user = "
+ proxyUGI.getUserName());
-}
+}
+finally {
+release(timedProxyUGI, fragmentIndex, fragmentCount);
}
} else {
// no user impersonation is configured
chain.doFilter(request, response);
}
}
+ private TimedProxyUGI getTimedProxyUGI(String user,
SegmentTransactionId session) throws IOException {
+synchronized (session.segmentTransactionId.intern()) {
+TimedProxyUGI timedProxyUGI = cache.get(session);
+if (timedProxyUGI == null || timedProxyUGI.getDelayMillis() <
0) {
+cleanup();
+LOG.info(session.toString() + " Creating proxy user = " +
user);
+UserGroupInformation proxyUGI =
+UserGroupInformation.createProxyUser(user,
UserGroupInformation.getLoginUser());
+timedProxyUGI = new TimedProxyUGI(proxyUGI, session);
+delayQueue.offer(timedProxyUGI);
+cache.put(session, timedProxyUGI);
+} else {
+timedProxyUGI.incrementCounter();
+}
+return timedProxyUGI;
+}
+}
+
+private void release(TimedProxyUGI timedProxyUGI, Integer
fragmentIndex, Integer fragmentCount) {
+synchronized (timedProxyUGI.session.segmentTransactionId.intern())
{
+timedProxyUGI.resetTime();
+timedProxyUGI.decrementCounter();
+if (fragmentIndex != null &&
fragmentCount.equals(fragmentIndex))
+closeUGI(timedProxyUGI);
+}
+}
+
+private void cleanup() {
+TimedProxyUGI timedProxyUGI = delayQueue.poll();
+while (timedProxyUGI != null) {
+closeUGI(timedProxyUGI);
+LOG.info(timedProxyUGI.session.toString() + " Delay Queue Size
= " + delayQueue.size());
+timedProxyUGI = delayQueue.poll();
+}
+}
+
+private void closeUGI(TimedProxyUGI timedProxyUGI) {
+synchronized (timedProxyUGI.session.segmentTransactionId.intern())
{
--- End diff --
Good catch. The locking should only operate on one lock at a time. This
could be accomplished if the clean method is called by a reaper thread.
---
[GitHub] incubator-hawq pull request #1379: WIP: Cache UGI objects and clean them per...
Github user lavjain commented on a diff in the pull request:
https://github.com/apache/incubator-hawq/pull/1379#discussion_r200168483
--- Diff:
pxf/pxf-service/src/main/java/org/apache/hawq/pxf/service/servlet/SecurityServletFilter.java
---
@@ -89,32 +182,98 @@ public Boolean run() throws IOException,
ServletException {
};
// create proxy user UGI from the UGI of the logged in user
and execute the servlet chain as that user
-UserGroupInformation proxyUGI = null;
+TimedProxyUGI timedProxyUGI = getTimedProxyUGI(user, session);
try {
-LOG.debug("Creating proxy user = " + user);
-proxyUGI = UserGroupInformation.createProxyUser(user,
UserGroupInformation.getLoginUser());
-proxyUGI.doAs(action);
+timedProxyUGI.proxyUGI.doAs(action);
} catch (UndeclaredThrowableException ute) {
// unwrap the real exception thrown by the action
throw new ServletException(ute.getCause());
} catch (InterruptedException ie) {
throw new ServletException(ie);
-} finally {
-try {
-if (proxyUGI != null) {
-LOG.debug("Closing FileSystem for proxy user = " +
proxyUGI.getUserName());
-FileSystem.closeAllForUGI(proxyUGI);
-}
-} catch (Throwable t) {
-LOG.warn("Error closing FileSystem for proxy user = "
+ proxyUGI.getUserName());
-}
+}
+finally {
+release(timedProxyUGI, fragmentIndex, fragmentCount);
}
} else {
// no user impersonation is configured
chain.doFilter(request, response);
}
}
+ private TimedProxyUGI getTimedProxyUGI(String user,
SegmentTransactionId session) throws IOException {
+synchronized (session.segmentTransactionId.intern()) {
--- End diff --
Agreed. Using the lock on interned string helped me to test the logic
without any explicit lock management.
---
