1. I am using these 2 commands below to try to copy data from local disk to HDFS. Unfortunately these commands are not working, and I don't understand why they are not working. I have configured HDFS to use WebHDFS protocol. How I copy data from the local disk to HDFS using WebHDfS protocol?
xubuntu@hadoop-coc-1:~/Programs/hadoop$ *hdfs dfs -copyFromLocal ~/input1 webhdfs://192.168.56.101:8080/ <http://192.168.56.101:8080/> * Java HotSpot(TM) Client VM warning: You have loaded library /home/xubuntu/Programs/hadoop-2.6.0/lib/native/libhadoop.so which might have disabled stack guard. The VM will try to fix the stack guard now. It's highly recommended that you fix the library with 'execstack -c <libfile>', or link it with '-z noexecstack'. 15/03/02 11:50:16 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable copyFromLocal: Call From hadoop-coc-1/192.168.56.101 to hadoop-coc-1:9000 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused copyFromLocal: Call From hadoop-coc-1/192.168.56.101 to hadoop-coc-1:9000 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused xubuntu@hadoop-coc-1:~/Programs/hadoop$ *curl -i -X PUT -T ~/input1 "http://192.168.56.101:8080/?op=CREATE"; <http://192.168.56.101:8080/?op=CREATE>* HTTP/1.1 100 Continue HTTP/1.1 405 HTTP method PUT is not supported by this URL Date: Mon, 02 Mar 2015 16:50:36 GMT Pragma: no-cache Date: Mon, 02 Mar 2015 16:50:36 GMT Pragma: no-cache Content-Length: 0 Server: Jetty(6.1.26) 2. Every time I launch a command in YARN I get a java hotspot warning (warning below). How I remove the Java HotSpotWarning? xubuntu@hadoop-coc-1:~/Programs/hadoop$ hdfs dfs -copyFromLocal ~/input1 webhdfs://192.168.56.101:8080/ Java HotSpot(TM) Client VM warning: You have loaded library /home/xubuntu/Programs/hadoop-2.6.0/lib/native/libhadoop.so which might have disabled stack guard. The VM will try to fix the stack guard now. It's highly recommended that you fix the library with 'execstack -c <libfile>', or link it with '-z noexecstack'. Thanks, On Monday, March 2, 2015, xeonmailinglist <[email protected]> wrote: > Hi, > > 1 - I have HDFS running with WebHDFS protocol. I want to copy data from > local disk to HDFS, but I get the error below. How I copy data from the > local disk to HDFS? > > xubuntu@hadoop-coc-1:~/Programs/hadoop$ hdfs dfs -copyFromLocal ~/input1 > webhdfs://192.168.56.101:8080/ > Java HotSpot(TM) Client VM warning: You have loaded library > /home/xubuntu/Programs/hadoop-2.6.0/lib/native/libhadoop.so which might have > disabled stack guard. The VM will try to fix the stack guard now. > It's highly recommended that you fix the library with 'execstack -c > <libfile>', or link it with '-z noexecstack'. > 15/03/02 11:50:16 WARN util.NativeCodeLoader: Unable to load native-hadoop > library for your platform... using builtin-java classes where applicable > copyFromLocal: Call From hadoop-coc-1/192.168.56.101 to hadoop-coc-1:9000 > failed on connection exception: java.net.ConnectException: Connection > refused; For more details see: > http://wiki.apache.org/hadoop/ConnectionRefused > copyFromLocal: Call From hadoop-coc-1/192.168.56.101 to hadoop-coc-1:9000 > failed on connection exception: java.net.ConnectException: Connection > refused; For more details see: > http://wiki.apache.org/hadoop/ConnectionRefused > > > xubuntu@hadoop-coc-1:~/Programs/hadoop$ curl -i -X PUT -T ~/input1 > "http://192.168.56.101:8080/?op=CREATE"; > <http://192.168.56.101:8080/?op=CREATE> > HTTP/1.1 100 Continue > > HTTP/1.1 405 HTTP method PUT is not supported by this URL > Date: Mon, 02 Mar 2015 16:50:36 GMT > Pragma: no-cache > Date: Mon, 02 Mar 2015 16:50:36 GMT > Pragma: no-cache > Content-Length: 0 > Server: Jetty(6.1.26) > > $ netstat -plnet > tcp 0 0 192.168.56.101:8080 0.0.0.0:* LISTEN > 1000 587397 8229/java > tcp 0 0 0.0.0.0:4369 0.0.0.0:* LISTEN > 115 8049 - > tcp 0 0 127.0.0.1:53 0.0.0.0:* LISTEN > 0 8336 - > tcp 0 0 0.0.0.0:22 0.0.0.0:* LISTEN > 0 7102 - > tcp 0 0 127.0.0.1:631 0.0.0.0:* LISTEN > 0 104794 - > tcp 0 0 0.0.0.0:50010 0.0.0.0:* LISTEN > 1000 588404 8464/java > tcp 0 0 0.0.0.0:50075 0.0.0.0:* LISTEN > 1000 589155 8464/java > tcp 0 0 0.0.0.0:50020 0.0.0.0:* LISTEN > 1000 589169 8464/java > tcp 0 0 192.168.56.101:6600 0.0.0.0:* LISTEN > 1000 587403 8229/java > tcp6 0 0 :::22 :::* LISTEN > 0 7086 - > tcp6 0 0 ::1:631 :::* LISTEN > 0 104793 - > > 2 - How I remove the Warning that I am always having every time I launch a > command in YARN? > > xubuntu@hadoop-coc-1:~/Programs/hadoop$ hdfs dfs -copyFromLocal ~/input1 > webhdfs://192.168.56.101:8080/ > Java HotSpot(TM) Client VM warning: You have loaded library > /home/xubuntu/Programs/hadoop-2.6.0/lib/native/libhadoop.so which might have > disabled stack guard. The VM will try to fix the stack guard now. > It's highly recommended that you fix the library with 'execstack -c > <libfile>', or link it with '-z noexecstack'. > > > > >
