[jira] [Commented] (HDFS-14900) Fix build failure of hadoop-hdfs-native-client

2019-10-10 Thread Hudson (Jira) 


[ 
https://issues.apache.org/jira/browse/HDFS-14900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16948752#comment-16948752
 ] 

Hudson commented on HDFS-14900:
---

SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #17518 (See 
[https://builds.apache.org/job/Hadoop-trunk-Commit/17518/])
HDFS-14900. Fix build failure of hadoop-hdfs-native-client. Contributed 
(ayushsaxena: rev 104ccca916997bbf3c37d87adbae673f4dd42036)
* (edit) dev-support/docker/Dockerfile
* (edit) BUILDING.txt


>  Fix build failure of hadoop-hdfs-native-client
> ---
>
> Key: HDFS-14900
> URL: https://issues.apache.org/jira/browse/HDFS-14900
> Project: Hadoop HDFS
>  Issue Type: Bug
>Affects Versions: 3.3.0
>Reporter: Masatake Iwasaki
>Assignee: Masatake Iwasaki
>Priority: Major
> Fix For: 3.3.0
>
> Attachments: HDFS-14900.001.patch, HDFS-14900.002.patch, 
> HDFS-14900.003.patch
>
>
> HADOOP-16558 removed protocol buffers from build requirements but libhdfspp 
> requires libprotobuf and libprotoc. {{-Pnative}} build fails if protocol 
> buffers is not installed.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org

[jira] [Commented] (HDFS-14900) Fix build failure of hadoop-hdfs-native-client

2019-10-10 Thread Ayush Saxena (Jira) 


[ 
https://issues.apache.org/jira/browse/HDFS-14900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16948735#comment-16948735
 ] 

Ayush Saxena commented on HDFS-14900:
-

Committed to trunk.
Thanx [~iwasakims] for the contribution and [~vinayakumarb] for the review!!!

>  Fix build failure of hadoop-hdfs-native-client
> ---
>
> Key: HDFS-14900
> URL: https://issues.apache.org/jira/browse/HDFS-14900
> Project: Hadoop HDFS
>  Issue Type: Bug
>Affects Versions: 3.3.0
>Reporter: Masatake Iwasaki
>Assignee: Masatake Iwasaki
>Priority: Major
> Attachments: HDFS-14900.001.patch, HDFS-14900.002.patch, 
> HDFS-14900.003.patch
>
>
> HADOOP-16558 removed protocol buffers from build requirements but libhdfspp 
> requires libprotobuf and libprotoc. {{-Pnative}} build fails if protocol 
> buffers is not installed.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org

[jira] [Commented] (HDFS-14900) Fix build failure of hadoop-hdfs-native-client

2019-10-10 Thread Ayush Saxena (Jira) 


[ 
https://issues.apache.org/jira/browse/HDFS-14900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16948723#comment-16948723
 ] 

Ayush Saxena commented on HDFS-14900:
-

v03 LGTM +1

>  Fix build failure of hadoop-hdfs-native-client
> ---
>
> Key: HDFS-14900
> URL: https://issues.apache.org/jira/browse/HDFS-14900
> Project: Hadoop HDFS
>  Issue Type: Bug
>Affects Versions: 3.3.0
>Reporter: Masatake Iwasaki
>Assignee: Masatake Iwasaki
>Priority: Major
> Attachments: HDFS-14900.001.patch, HDFS-14900.002.patch, 
> HDFS-14900.003.patch
>
>
> HADOOP-16558 removed protocol buffers from build requirements but libhdfspp 
> requires libprotobuf and libprotoc. {{-Pnative}} build fails if protocol 
> buffers is not installed.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org

[jira] [Commented] (HDFS-14900) Fix build failure of hadoop-hdfs-native-client

2019-10-09 Thread Ayush Saxena (Jira) 


[ 
https://issues.apache.org/jira/browse/HDFS-14900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16947394#comment-16947394
 ] 

Ayush Saxena commented on HDFS-14900:
-

I too tried couple of things, but none worked.
 [~vinayakumarb]  any suggestions?

> Fix build failure of hadoop-hdfs-native-client
> --
>
> Key: HDFS-14900
> URL: https://issues.apache.org/jira/browse/HDFS-14900
> Project: Hadoop HDFS
>  Issue Type: Bug
>Affects Versions: 3.3.0
>Reporter: Masatake Iwasaki
>Assignee: Masatake Iwasaki
>Priority: Major
>
> HADOOP-16558 removed protocol buffers from build requirements but libhdfspp 
> requires libprotobuf and libprotoc. {{-Pnative}} build fails if protocol 
> buffers is not installed.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org

[jira] [Commented] (HDFS-14900) Fix build failure of hadoop-hdfs-native-client

2019-10-09 Thread Masatake Iwasaki (Jira) 


[ 
https://issues.apache.org/jira/browse/HDFS-14900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16947391#comment-16947391
 ] 

Masatake Iwasaki commented on HDFS-14900:
-

I could not find a portable way to download libprotobuf and libprotoc and 
headers on build time automatically.

I thought copying files under 
https://github.com/protocolbuffers/protobuf/tree/v3.7.1/src to 
hadoop-hdfs-project/hadoop-hdfs-native-client/src/main/native/libhdfspp/third_party/
 might be an option but [FindProtobuf module of 
cmake|https://cmake.org/cmake/help/v3.9/module/FindProtobuf.html] seems not to 
work with it.

I'm considering to add description about Protocol Buffers back to BUILDING.txt 
as an optional requirement for {{-Pnative}} build.

> Fix build failure of hadoop-hdfs-native-client
> --
>
> Key: HDFS-14900
> URL: https://issues.apache.org/jira/browse/HDFS-14900
> Project: Hadoop HDFS
>  Issue Type: Bug
>Affects Versions: 3.3.0
>Reporter: Masatake Iwasaki
>Assignee: Masatake Iwasaki
>Priority: Major
>
> HADOOP-16558 removed protocol buffers from build requirements but libhdfspp 
> requires libprotobuf and libprotoc. {{-Pnative}} build fails if protocol 
> buffers is not installed.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org

[jira] [Commented] (HDFS-14900) Fix build failure of hadoop-hdfs-native-client

2019-10-07 Thread Masatake Iwasaki (Jira) 


[ 
https://issues.apache.org/jira/browse/HDFS-14900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16946505#comment-16946505
 ] 

Masatake Iwasaki commented on HDFS-14900:
-

{quote}
If I catch it correct now, you are telling, The build fails when no protobuf is 
installed explicitly?
{quote}

Yes. Sorry for unclear problem statement.

{quote}
Anyway if so, do you have fix for it?
{quote}

I'm looking for the way without manual protobuf installation.


> Fix build failure of hadoop-hdfs-native-client
> --
>
> Key: HDFS-14900
> URL: https://issues.apache.org/jira/browse/HDFS-14900
> Project: Hadoop HDFS
>  Issue Type: Bug
>Affects Versions: 3.3.0
>Reporter: Masatake Iwasaki
>Assignee: Masatake Iwasaki
>Priority: Major
>
> Build with native profile failed due to lack of protobuf resources. I did not 
> noticed this because build scceeds if protobuf-2.5.0 is installed. 
> protobuf-3.7.1 is the correct version after HADOOP-16558.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org

[jira] [Commented] (HDFS-14900) Fix build failure of hadoop-hdfs-native-client

2019-10-07 Thread Ayush Saxena (Jira) 


[ 
https://issues.apache.org/jira/browse/HDFS-14900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16946489#comment-16946489
 ] 

Ayush Saxena commented on HDFS-14900:
-

bq.  I did not noticed this because build succeeds if protobuf-2.5.0 is 
installed. protobuf-3.7.1

Oh I thought, You are telling if protobuf 2.5.0 is installed the build passed, 
with 3.7.1 it doesn't.
If I catch it correct now, you are telling, The build fails when no protobuf is 
installed explicitly? 
Anyway if so, do you have fix for it?

> Fix build failure of hadoop-hdfs-native-client
> --
>
> Key: HDFS-14900
> URL: https://issues.apache.org/jira/browse/HDFS-14900
> Project: Hadoop HDFS
>  Issue Type: Bug
>Affects Versions: 3.3.0
>Reporter: Masatake Iwasaki
>Assignee: Masatake Iwasaki
>Priority: Major
>
> Build with native profile failed due to lack of protobuf resources. I did not 
> noticed this because build scceeds if protobuf-2.5.0 is installed. 
> protobuf-3.7.1 is the correct version after HADOOP-16558.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org

[jira] [Commented] (HDFS-14900) Fix build failure of hadoop-hdfs-native-client

2019-10-07 Thread Masatake Iwasaki (Jira) 


[ 
https://issues.apache.org/jira/browse/HDFS-14900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16946484#comment-16946484
 ] 

Masatake Iwasaki commented on HDFS-14900:
-

> Tried on my system, seems working..

[~ayushtkn] If you have installed protobuf on your system, native build works. 
I think this jira is a follow-up of HADOOP-16620 which removed protobuf from 
build env.


> Fix build failure of hadoop-hdfs-native-client
> --
>
> Key: HDFS-14900
> URL: https://issues.apache.org/jira/browse/HDFS-14900
> Project: Hadoop HDFS
>  Issue Type: Bug
>Affects Versions: 3.3.0
>Reporter: Masatake Iwasaki
>Assignee: Masatake Iwasaki
>Priority: Major
>
> Build with native profile failed due to lack of protobuf resources. I did not 
> noticed this because build scceeds if protobuf-2.5.0 is installed. 
> protobuf-3.7.1 is the correct version after HADOOP-16558.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org

[jira] [Commented] (HDFS-14900) Fix build failure of hadoop-hdfs-native-client

2019-10-07 Thread Ayush Saxena (Jira) 


[ 
https://issues.apache.org/jira/browse/HDFS-14900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16946449#comment-16946449
 ] 

Ayush Saxena commented on HDFS-14900:
-

Thanx [~iwasakims] for the report.
Tried on my system, seems working..

{noformat}
[INFO] Reactor Summary for Apache Hadoop HDFS Project 3.3.0-SNAPSHOT:
[INFO] 
[INFO] Apache Hadoop HDFS Client .. SUCCESS [ 26.240 s]
[INFO] Apache Hadoop HDFS . SUCCESS [ 39.070 s]
[INFO] Apache Hadoop HDFS Native Client ... SUCCESS [02:14 min]
[INFO] Apache Hadoop HttpFS ... SUCCESS [ 16.890 s]
[INFO] Apache Hadoop HDFS-NFS . SUCCESS [ 11.721 s]
[INFO] Apache Hadoop HDFS-RBF . SUCCESS [ 11.887 s]
[INFO] Apache Hadoop HDFS Project . SUCCESS [  0.274 s]
[INFO] 
[INFO] BUILD SUCCESS
[INFO] 
[INFO] Total time:  04:01 min
[INFO] Finished at: 2019-10-08T08:51:43+05:30
[INFO] 
ayush@ayushpc:~/hadoop/trunk/hadoop-hdfs-project$ protoc --version
libprotoc 3.7.1
ayush@ayushpc:~/hadoop/trunk/hadoop-hdfs-project$ 

{noformat}

Can you share your OS details, Or if something extra needs to be done?

> Fix build failure of hadoop-hdfs-native-client
> --
>
> Key: HDFS-14900
> URL: https://issues.apache.org/jira/browse/HDFS-14900
> Project: Hadoop HDFS
>  Issue Type: Bug
>Affects Versions: 3.3.0
>Reporter: Masatake Iwasaki
>Assignee: Masatake Iwasaki
>Priority: Major
>
> Build with native profile failed due to lack of protobuf resources. I did not 
> noticed this because build scceeds if protobuf-2.5.0 is installed. 
> protobuf-3.7.1 is the correct version after HADOOP-16558.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org

[jira] [Commented] (HDFS-14900) Fix build failure of hadoop-hdfs-native-client

2019-10-07 Thread Masatake Iwasaki (Jira) 


[ 
https://issues.apache.org/jira/browse/HDFS-14900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16946311#comment-16946311
 ] 

Masatake Iwasaki commented on HDFS-14900:
-

from CMakeError.log:
{noformat}
/usr/bin/cc   -DCHECK_FUNCTION_EXISTS=pthread_create   -o 
CMakeFiles/cmTC_cace7.dir/CheckFunctionExists.c.o   -c 
/usr/local/share/cmake-3.3/Modules/CheckFunctionExists.c
Linking C executable cmTC_cace7
/usr/local/bin/cmake -E cmake_link_script CMakeFiles/cmTC_cace7.dir/link.txt 
--verbose=1
/usr/bin/cc   -DCHECK_FUNCTION_EXISTS=pthread_create
CMakeFiles/cmTC_cace7.dir/CheckFunctionExists.c.o  -o cmTC_cace7 -rdynamic 
-lpthreads 
/usr/bin/ld: cannot find -lpthreads
collect2: error: ld returned 1 exit status
{noformat}
{noformat}
Building CXX object CMakeFiles/cmTC_6c0d6.dir/src.cxx.o
/usr/bin/c++-g -O2 -Wall -pthread -D_FILE_OFFSET_BITS=64 -D_GNU_SOURCE 
-DPROTOC_IS_COMPATIBLE   -std=c++11 -o CMakeFiles/cmTC_6c0d6.dir/src.cxx.o -c 
/home/iwasakims/srcs/hadoop/hadoop-hdfs-project/hadoop-hdfs-native-client/target/CMakeFiles/CMakeTmp/src.cxx
/home/iwasakims/srcs/hadoop/hadoop-hdfs-project/hadoop-hdfs-native-client/target/CMakeFiles/CMakeTmp/src.cxx:1:40:
 fatal error: google/protobuf/io/printer.h: No such file or directory
 #include 
{noformat}


> Fix build failure of hadoop-hdfs-native-client
> --
>
> Key: HDFS-14900
> URL: https://issues.apache.org/jira/browse/HDFS-14900
> Project: Hadoop HDFS
>  Issue Type: Bug
>Affects Versions: 3.3.0
>Reporter: Masatake Iwasaki
>Assignee: Masatake Iwasaki
>Priority: Major
>
> Build with native profile failed due to lack of protobuf resources. I did not 
> noticed this because build scceeds if protobuf-2.5.0 is installed. 
> protobuf-3.7.1 is the correct version after HADOOP-16558.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org