[
https://issues.apache.org/jira/browse/MAHOUT-1516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Palumbo updated MAHOUT-1516:
-----------------------------------
Resolution: Not a Problem
Assignee: Andrew Palumbo
Status: Resolved (was: Patch Available)
We'll need to use {{hadoop dfs -rmr}} in as long as we support hadoop 1.2.1.
Running classify-20newsgroups.sh on hadoop 2.2.0 in pseudo-cluster mode i get
no errors:
{code}
+ '[' /home/andy/apache/hadoop-2.2.0 '!=' '' ']'
+ '[' '' == '' ']'
+ echo 'Copying 20newsgroups data to HDFS'
Copying 20newsgroups data to HDFS
+ set +e
+ /home/andy/apache/hadoop-2.2.0/bin/hadoop dfs -rmr
/tmp/mahout-work-andy/20news-all
DEPRECATED: Use of this script to execute hdfs command is deprecated.
Instead use the hdfs command for it.
rmr: DEPRECATED: Please use 'rm -r' instead.
15/03/29 20:32:06 WARN util.NativeCodeLoader: Unable to load native-hadoop
library for your platform... using builtin-java classes where applicable
15/03/29 20:32:07 INFO fs.TrashPolicyDefault: Namenode trash configuration:
Deletion interval = 0 minutes, Emptier interval = 0 minutes.
Deleted /tmp/mahout-work-andy/20news-all
+ /home/andy/apache/hadoop-2.2.0/bin/hadoop dfs -rmr
/tmp/mahout-work-andy/spark-model
DEPRECATED: Use of this script to execute hdfs command is deprecated.
Instead use the hdfs command for it.
rmr: DEPRECATED: Please use 'rm -r' instead.
15/03/29 20:32:10 WARN util.NativeCodeLoader: Unable to load native-hadoop
library for your platform... using builtin-java classes where applicable
15/03/29 20:32:12 INFO fs.TrashPolicyDefault: Namenode trash configuration:
Deletion interval = 0 minutes, Emptier interval = 0 minutes.
Deleted /tmp/mahout-work-andy/spark-model
+ set -e
+ /home/andy/apache/hadoop-2.2.0/bin/hadoop dfs -put
/tmp/mahout-work-andy/20news-all /tmp/mahout-work-andy/20news-all
DEPRECATED: Use of this script to execute hdfs command is deprecated.
Instead use the hdfs command for it.
15/03/29 20:32:15 WARN util.NativeCodeLoader: Unable to load native-hadoop
library for your platform... using builtin-java classes where applicable
15/03/29 20:32:15 WARN util.NativeCodeLoader: Unable to load native-hadoop
library for your platform... using builtin-java classes where applicable
+ echo 'Creating sequence files from 20newsgroups data'
Creating sequence files from 20newsgroups data
+ ./bin/mahout seqdirectory -i /tmp/mahout-work-andy/20news-all -o
/tmp/mahout-work-andy/20news-seq -ow
MAHOUT_LOCAL is not set; adding HADOOP_CONF_DIR to classpath.
Running on hadoop, using /home/andy/apache/hadoop-2.2.0/bin/hadoop and
HADOOP_CONF_DIR=/home/andy/apache/hadoop-2.2.0/etc/hadoop
MAHOUT-JOB:
/home/andy/sandbox/mahout/examples/target/mahout-examples-1.0-SNAPSHOT-job.jar
{code}
> run classify-20newsgroups.sh failed cause by /tmp/mahout-work-jpan/20news-all
> does not exists in hdfs.
> ------------------------------------------------------------------------------------------------------
>
> Key: MAHOUT-1516
> URL: https://issues.apache.org/jira/browse/MAHOUT-1516
> Project: Mahout
> Issue Type: Bug
> Components: Examples
> Affects Versions: 0.9
> Environment: hadoop2.2.0 mahout0.9 ubuntu12.04
> Reporter: Jian Pan
> Assignee: Andrew Palumbo
> Priority: Minor
> Labels: legacy, patch
> Fix For: 0.10.0
>
>
> + echo 'Copying 20newsgroups data to HDFS'
> Copying 20newsgroups data to HDFS
> + set +e
> + /home/jpan/Software/hadoop-2.2.0/bin/hadoop dfs -rmr
> /tmp/mahout-work-jpan/20news-all
> DEPRECATED: Use of this script to execute hdfs command is deprecated.
> Instead use the hdfs command for it.
> rmr: DEPRECATED: Please use 'rm -r' instead.
> 14/04/17 10:26:25 WARN util.NativeCodeLoader: Unable to load native-hadoop
> library for your platform... using builtin-java classes where applicable
> rmr: `/tmp/mahout-work-jpan/20news-all': No such file or directory
> + set -e
> + /home/jpan/Software/hadoop-2.2.0/bin/hadoop dfs -put
> /tmp/mahout-work-jpan/20news-all /tmp/mahout-work-jpan/20news-all
> DEPRECATED: Use of this script to execute hdfs command is deprecated.
> Instead use the hdfs command for it.
> 14/04/17 10:26:26 WARN util.NativeCodeLoader: Unable to load native-hadoop
> library for your platform... using builtin-java classes where applicable
> put: `/tmp/mahout-work-jpan/20news-all': No such file or directory
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
