Tmp - mahout
and this would be an exsample of rapid typing because blah blah blah im right you're wrong. eachshould have been a different email. could be dangerous.
Tmp - mahout
Channel names seem to be the subject. I'd like to add this to the 0.14.0 release.
[jira] [Resolved] (MAHOUT-1516) run classify-20newsgroups.sh failed cause by /tmp/mahout-work-jpan/20news-all does not exists in hdfs.
[ https://issues.apache.org/jira/browse/MAHOUT-1516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Palumbo resolved MAHOUT-1516. Resolution: Fixed run classify-20newsgroups.sh failed cause by /tmp/mahout-work-jpan/20news-all does not exists in hdfs. -- Key: MAHOUT-1516 URL: https://issues.apache.org/jira/browse/MAHOUT-1516 Project: Mahout Issue Type: Bug Components: Examples Affects Versions: 0.9 Environment: hadoop2.2.0 mahout0.9 ubuntu12.04 Reporter: Jian Pan Assignee: Andrew Palumbo Priority: Minor Labels: legacy, patch Fix For: 0.10.0 + echo 'Copying 20newsgroups data to HDFS' Copying 20newsgroups data to HDFS + set +e + /home/jpan/Software/hadoop-2.2.0/bin/hadoop dfs -rmr /tmp/mahout-work-jpan/20news-all DEPRECATED: Use of this script to execute hdfs command is deprecated. Instead use the hdfs command for it. rmr: DEPRECATED: Please use 'rm -r' instead. 14/04/17 10:26:25 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable rmr: `/tmp/mahout-work-jpan/20news-all': No such file or directory + set -e + /home/jpan/Software/hadoop-2.2.0/bin/hadoop dfs -put /tmp/mahout-work-jpan/20news-all /tmp/mahout-work-jpan/20news-all DEPRECATED: Use of this script to execute hdfs command is deprecated. Instead use the hdfs command for it. 14/04/17 10:26:26 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable put: `/tmp/mahout-work-jpan/20news-all': No such file or directory -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Reopened] (MAHOUT-1516) run classify-20newsgroups.sh failed cause by /tmp/mahout-work-jpan/20news-all does not exists in hdfs.
[
https://issues.apache.org/jira/browse/MAHOUT-1516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Palumbo reopened MAHOUT-1516:
oops.. spoke too soon must have added the HDFS directory by hand when I was
walking through the steps by step Naive Bayes example.
we do need to create the base {{tmp/mahout-work-user}} directory in HDFS
run classify-20newsgroups.sh failed cause by /tmp/mahout-work-jpan/20news-all
does not exists in hdfs.
--
Key: MAHOUT-1516
URL: https://issues.apache.org/jira/browse/MAHOUT-1516
Project: Mahout
Issue Type: Bug
Components: Examples
Affects Versions: 0.9
Environment: hadoop2.2.0 mahout0.9 ubuntu12.04
Reporter: Jian Pan
Assignee: Andrew Palumbo
Priority: Minor
Labels: legacy, patch
Fix For: 0.10.0
+ echo 'Copying 20newsgroups data to HDFS'
Copying 20newsgroups data to HDFS
+ set +e
+ /home/jpan/Software/hadoop-2.2.0/bin/hadoop dfs -rmr
/tmp/mahout-work-jpan/20news-all
DEPRECATED: Use of this script to execute hdfs command is deprecated.
Instead use the hdfs command for it.
rmr: DEPRECATED: Please use 'rm -r' instead.
14/04/17 10:26:25 WARN util.NativeCodeLoader: Unable to load native-hadoop
library for your platform... using builtin-java classes where applicable
rmr: `/tmp/mahout-work-jpan/20news-all': No such file or directory
+ set -e
+ /home/jpan/Software/hadoop-2.2.0/bin/hadoop dfs -put
/tmp/mahout-work-jpan/20news-all /tmp/mahout-work-jpan/20news-all
DEPRECATED: Use of this script to execute hdfs command is deprecated.
Instead use the hdfs command for it.
14/04/17 10:26:26 WARN util.NativeCodeLoader: Unable to load native-hadoop
library for your platform... using builtin-java classes where applicable
put: `/tmp/mahout-work-jpan/20news-all': No such file or directory
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Comment Edited] (MAHOUT-1516) run classify-20newsgroups.sh failed cause by /tmp/mahout-work-jpan/20news-all does not exists in hdfs.
[
https://issues.apache.org/jira/browse/MAHOUT-1516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14387281#comment-14387281
]
Andrew Palumbo edited comment on MAHOUT-1516 at 3/30/15 7:39 PM:
-
oops.. spoke too soon must have added the HDFS directory by hand when I was
walking through the steps by step Naive Bayes example.
we do need to create the base {{tmp/mahout-work-user}} directory in HDFS
will do this today.
was (Author: andrew_palumbo):
oops.. spoke too soon must have added the HDFS directory by hand when I was
walking through the steps by step Naive Bayes example.
we do need to create the base {{tmp/mahout-work-user}} directory in HDFS
run classify-20newsgroups.sh failed cause by /tmp/mahout-work-jpan/20news-all
does not exists in hdfs.
--
Key: MAHOUT-1516
URL: https://issues.apache.org/jira/browse/MAHOUT-1516
Project: Mahout
Issue Type: Bug
Components: Examples
Affects Versions: 0.9
Environment: hadoop2.2.0 mahout0.9 ubuntu12.04
Reporter: Jian Pan
Assignee: Andrew Palumbo
Priority: Minor
Labels: legacy, patch
Fix For: 0.10.0
+ echo 'Copying 20newsgroups data to HDFS'
Copying 20newsgroups data to HDFS
+ set +e
+ /home/jpan/Software/hadoop-2.2.0/bin/hadoop dfs -rmr
/tmp/mahout-work-jpan/20news-all
DEPRECATED: Use of this script to execute hdfs command is deprecated.
Instead use the hdfs command for it.
rmr: DEPRECATED: Please use 'rm -r' instead.
14/04/17 10:26:25 WARN util.NativeCodeLoader: Unable to load native-hadoop
library for your platform... using builtin-java classes where applicable
rmr: `/tmp/mahout-work-jpan/20news-all': No such file or directory
+ set -e
+ /home/jpan/Software/hadoop-2.2.0/bin/hadoop dfs -put
/tmp/mahout-work-jpan/20news-all /tmp/mahout-work-jpan/20news-all
DEPRECATED: Use of this script to execute hdfs command is deprecated.
Instead use the hdfs command for it.
14/04/17 10:26:26 WARN util.NativeCodeLoader: Unable to load native-hadoop
library for your platform... using builtin-java classes where applicable
put: `/tmp/mahout-work-jpan/20news-all': No such file or directory
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (MAHOUT-1516) run classify-20newsgroups.sh failed cause by /tmp/mahout-work-jpan/20news-all does not exists in hdfs.
[ https://issues.apache.org/jira/browse/MAHOUT-1516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14387409#comment-14387409 ] Hudson commented on MAHOUT-1516: SUCCESS: Integrated in Mahout-Quality #3030 (See [https://builds.apache.org/job/Mahout-Quality/3030/]) MAHOUT-1516: classify-20newsgroups.sh failed: /tmp/mahout-work-jpan/20news-all does not exists in hdfs. (apalumbo: rev edec611f07d4e7a352a3332af271207652caab02) * CHANGELOG * examples/bin/classify-20newsgroups.sh run classify-20newsgroups.sh failed cause by /tmp/mahout-work-jpan/20news-all does not exists in hdfs. -- Key: MAHOUT-1516 URL: https://issues.apache.org/jira/browse/MAHOUT-1516 Project: Mahout Issue Type: Bug Components: Examples Affects Versions: 0.9 Environment: hadoop2.2.0 mahout0.9 ubuntu12.04 Reporter: Jian Pan Assignee: Andrew Palumbo Priority: Minor Labels: legacy, patch Fix For: 0.10.0 + echo 'Copying 20newsgroups data to HDFS' Copying 20newsgroups data to HDFS + set +e + /home/jpan/Software/hadoop-2.2.0/bin/hadoop dfs -rmr /tmp/mahout-work-jpan/20news-all DEPRECATED: Use of this script to execute hdfs command is deprecated. Instead use the hdfs command for it. rmr: DEPRECATED: Please use 'rm -r' instead. 14/04/17 10:26:25 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable rmr: `/tmp/mahout-work-jpan/20news-all': No such file or directory + set -e + /home/jpan/Software/hadoop-2.2.0/bin/hadoop dfs -put /tmp/mahout-work-jpan/20news-all /tmp/mahout-work-jpan/20news-all DEPRECATED: Use of this script to execute hdfs command is deprecated. Instead use the hdfs command for it. 14/04/17 10:26:26 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable put: `/tmp/mahout-work-jpan/20news-all': No such file or directory -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (MAHOUT-1516) run classify-20newsgroups.sh failed cause by /tmp/mahout-work-jpan/20news-all does not exists in hdfs.
[
https://issues.apache.org/jira/browse/MAHOUT-1516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Palumbo updated MAHOUT-1516:
---
Resolution: Not a Problem
Assignee: Andrew Palumbo
Status: Resolved (was: Patch Available)
We'll need to use {{hadoop dfs -rmr}} in as long as we support hadoop 1.2.1.
Running classify-20newsgroups.sh on hadoop 2.2.0 in pseudo-cluster mode i get
no errors:
{code}
+ '[' /home/andy/apache/hadoop-2.2.0 '!=' '' ']'
+ '[' '' == '' ']'
+ echo 'Copying 20newsgroups data to HDFS'
Copying 20newsgroups data to HDFS
+ set +e
+ /home/andy/apache/hadoop-2.2.0/bin/hadoop dfs -rmr
/tmp/mahout-work-andy/20news-all
DEPRECATED: Use of this script to execute hdfs command is deprecated.
Instead use the hdfs command for it.
rmr: DEPRECATED: Please use 'rm -r' instead.
15/03/29 20:32:06 WARN util.NativeCodeLoader: Unable to load native-hadoop
library for your platform... using builtin-java classes where applicable
15/03/29 20:32:07 INFO fs.TrashPolicyDefault: Namenode trash configuration:
Deletion interval = 0 minutes, Emptier interval = 0 minutes.
Deleted /tmp/mahout-work-andy/20news-all
+ /home/andy/apache/hadoop-2.2.0/bin/hadoop dfs -rmr
/tmp/mahout-work-andy/spark-model
DEPRECATED: Use of this script to execute hdfs command is deprecated.
Instead use the hdfs command for it.
rmr: DEPRECATED: Please use 'rm -r' instead.
15/03/29 20:32:10 WARN util.NativeCodeLoader: Unable to load native-hadoop
library for your platform... using builtin-java classes where applicable
15/03/29 20:32:12 INFO fs.TrashPolicyDefault: Namenode trash configuration:
Deletion interval = 0 minutes, Emptier interval = 0 minutes.
Deleted /tmp/mahout-work-andy/spark-model
+ set -e
+ /home/andy/apache/hadoop-2.2.0/bin/hadoop dfs -put
/tmp/mahout-work-andy/20news-all /tmp/mahout-work-andy/20news-all
DEPRECATED: Use of this script to execute hdfs command is deprecated.
Instead use the hdfs command for it.
15/03/29 20:32:15 WARN util.NativeCodeLoader: Unable to load native-hadoop
library for your platform... using builtin-java classes where applicable
15/03/29 20:32:15 WARN util.NativeCodeLoader: Unable to load native-hadoop
library for your platform... using builtin-java classes where applicable
+ echo 'Creating sequence files from 20newsgroups data'
Creating sequence files from 20newsgroups data
+ ./bin/mahout seqdirectory -i /tmp/mahout-work-andy/20news-all -o
/tmp/mahout-work-andy/20news-seq -ow
MAHOUT_LOCAL is not set; adding HADOOP_CONF_DIR to classpath.
Running on hadoop, using /home/andy/apache/hadoop-2.2.0/bin/hadoop and
HADOOP_CONF_DIR=/home/andy/apache/hadoop-2.2.0/etc/hadoop
MAHOUT-JOB:
/home/andy/sandbox/mahout/examples/target/mahout-examples-1.0-SNAPSHOT-job.jar
{code}
run classify-20newsgroups.sh failed cause by /tmp/mahout-work-jpan/20news-all
does not exists in hdfs.
--
Key: MAHOUT-1516
URL: https://issues.apache.org/jira/browse/MAHOUT-1516
Project: Mahout
Issue Type: Bug
Components: Examples
Affects Versions: 0.9
Environment: hadoop2.2.0 mahout0.9 ubuntu12.04
Reporter: Jian Pan
Assignee: Andrew Palumbo
Priority: Minor
Labels: legacy, patch
Fix For: 0.10.0
+ echo 'Copying 20newsgroups data to HDFS'
Copying 20newsgroups data to HDFS
+ set +e
+ /home/jpan/Software/hadoop-2.2.0/bin/hadoop dfs -rmr
/tmp/mahout-work-jpan/20news-all
DEPRECATED: Use of this script to execute hdfs command is deprecated.
Instead use the hdfs command for it.
rmr: DEPRECATED: Please use 'rm -r' instead.
14/04/17 10:26:25 WARN util.NativeCodeLoader: Unable to load native-hadoop
library for your platform... using builtin-java classes where applicable
rmr: `/tmp/mahout-work-jpan/20news-all': No such file or directory
+ set -e
+ /home/jpan/Software/hadoop-2.2.0/bin/hadoop dfs -put
/tmp/mahout-work-jpan/20news-all /tmp/mahout-work-jpan/20news-all
DEPRECATED: Use of this script to execute hdfs command is deprecated.
Instead use the hdfs command for it.
14/04/17 10:26:26 WARN util.NativeCodeLoader: Unable to load native-hadoop
library for your platform... using builtin-java classes where applicable
put: `/tmp/mahout-work-jpan/20news-all': No such file or directory
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (MAHOUT-1516) run classify-20newsgroups.sh failed cause by /tmp/mahout-work-jpan/20news-all does not exists in hdfs.
[ https://issues.apache.org/jira/browse/MAHOUT-1516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Musselman updated MAHOUT-1516: - Fix Version/s: (was: 1.0) 0.10.0 run classify-20newsgroups.sh failed cause by /tmp/mahout-work-jpan/20news-all does not exists in hdfs. -- Key: MAHOUT-1516 URL: https://issues.apache.org/jira/browse/MAHOUT-1516 Project: Mahout Issue Type: Bug Components: Examples Affects Versions: 0.9 Environment: hadoop2.2.0 mahout0.9 ubuntu12.04 Reporter: Jian Pan Priority: Minor Labels: legacy, patch Fix For: 0.10.0 + echo 'Copying 20newsgroups data to HDFS' Copying 20newsgroups data to HDFS + set +e + /home/jpan/Software/hadoop-2.2.0/bin/hadoop dfs -rmr /tmp/mahout-work-jpan/20news-all DEPRECATED: Use of this script to execute hdfs command is deprecated. Instead use the hdfs command for it. rmr: DEPRECATED: Please use 'rm -r' instead. 14/04/17 10:26:25 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable rmr: `/tmp/mahout-work-jpan/20news-all': No such file or directory + set -e + /home/jpan/Software/hadoop-2.2.0/bin/hadoop dfs -put /tmp/mahout-work-jpan/20news-all /tmp/mahout-work-jpan/20news-all DEPRECATED: Use of this script to execute hdfs command is deprecated. Instead use the hdfs command for it. 14/04/17 10:26:26 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable put: `/tmp/mahout-work-jpan/20news-all': No such file or directory -- This message was sent by Atlassian JIRA (v6.3.4#6332)
Re: [jira] [Updated] (MAHOUT-1516) run classify-20newsgroups.sh failed cause by /tmp/mahout-work-jpan/20news-all does not exists in hdfs.
Don't think this is an issue, feel free to close it after verifying Sent from my iPhone On Mar 28, 2015, at 1:00 PM, Andrew Musselman (JIRA) j...@apache.org wrote: [ https://issues.apache.org/jira/browse/MAHOUT-1516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Musselman updated MAHOUT-1516: - Fix Version/s: (was: 1.0) 0.10.0 run classify-20newsgroups.sh failed cause by /tmp/mahout-work-jpan/20news-all does not exists in hdfs. -- Key: MAHOUT-1516 URL: https://issues.apache.org/jira/browse/MAHOUT-1516 Project: Mahout Issue Type: Bug Components: Examples Affects Versions: 0.9 Environment: hadoop2.2.0 mahout0.9 ubuntu12.04 Reporter: Jian Pan Priority: Minor Labels: legacy, patch Fix For: 0.10.0 + echo 'Copying 20newsgroups data to HDFS' Copying 20newsgroups data to HDFS + set +e + /home/jpan/Software/hadoop-2.2.0/bin/hadoop dfs -rmr /tmp/mahout-work-jpan/20news-all DEPRECATED: Use of this script to execute hdfs command is deprecated. Instead use the hdfs command for it. rmr: DEPRECATED: Please use 'rm -r' instead. 14/04/17 10:26:25 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable rmr: `/tmp/mahout-work-jpan/20news-all': No such file or directory + set -e + /home/jpan/Software/hadoop-2.2.0/bin/hadoop dfs -put /tmp/mahout-work-jpan/20news-all /tmp/mahout-work-jpan/20news-all DEPRECATED: Use of this script to execute hdfs command is deprecated. Instead use the hdfs command for it. 14/04/17 10:26:26 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable put: `/tmp/mahout-work-jpan/20news-all': No such file or directory -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (MAHOUT-1516) run classify-20newsgroups.sh failed cause by /tmp/mahout-work-jpan/20news-all does not exists in hdfs.
[ https://issues.apache.org/jira/browse/MAHOUT-1516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Palumbo updated MAHOUT-1516: --- Labels: legacy patch (was: patch) run classify-20newsgroups.sh failed cause by /tmp/mahout-work-jpan/20news-all does not exists in hdfs. -- Key: MAHOUT-1516 URL: https://issues.apache.org/jira/browse/MAHOUT-1516 Project: Mahout Issue Type: Bug Components: Examples Affects Versions: 0.9 Environment: hadoop2.2.0 mahout0.9 ubuntu12.04 Reporter: Jian Pan Priority: Minor Labels: legacy, patch Fix For: 1.0 + echo 'Copying 20newsgroups data to HDFS' Copying 20newsgroups data to HDFS + set +e + /home/jpan/Software/hadoop-2.2.0/bin/hadoop dfs -rmr /tmp/mahout-work-jpan/20news-all DEPRECATED: Use of this script to execute hdfs command is deprecated. Instead use the hdfs command for it. rmr: DEPRECATED: Please use 'rm -r' instead. 14/04/17 10:26:25 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable rmr: `/tmp/mahout-work-jpan/20news-all': No such file or directory + set -e + /home/jpan/Software/hadoop-2.2.0/bin/hadoop dfs -put /tmp/mahout-work-jpan/20news-all /tmp/mahout-work-jpan/20news-all DEPRECATED: Use of this script to execute hdfs command is deprecated. Instead use the hdfs command for it. 14/04/17 10:26:26 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable put: `/tmp/mahout-work-jpan/20news-all': No such file or directory -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (MAHOUT-1516) run classify-20newsgroups.sh failed cause by /tmp/mahout-work-jpan/20news-all does not exists in hdfs.
[ https://issues.apache.org/jira/browse/MAHOUT-1516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14171809#comment-14171809 ] Tim Groeneveld commented on MAHOUT-1516: This bug has been tagged as 'PATCH AVAILABLE', where is this patch, or is it just that the issue has now been resolved in trunk? run classify-20newsgroups.sh failed cause by /tmp/mahout-work-jpan/20news-all does not exists in hdfs. -- Key: MAHOUT-1516 URL: https://issues.apache.org/jira/browse/MAHOUT-1516 Project: Mahout Issue Type: Bug Components: Examples Affects Versions: 0.9 Environment: hadoop2.2.0 mahout0.9 ubuntu12.04 Reporter: Jian Pan Priority: Minor Labels: patch Fix For: 1.0 + echo 'Copying 20newsgroups data to HDFS' Copying 20newsgroups data to HDFS + set +e + /home/jpan/Software/hadoop-2.2.0/bin/hadoop dfs -rmr /tmp/mahout-work-jpan/20news-all DEPRECATED: Use of this script to execute hdfs command is deprecated. Instead use the hdfs command for it. rmr: DEPRECATED: Please use 'rm -r' instead. 14/04/17 10:26:25 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable rmr: `/tmp/mahout-work-jpan/20news-all': No such file or directory + set -e + /home/jpan/Software/hadoop-2.2.0/bin/hadoop dfs -put /tmp/mahout-work-jpan/20news-all /tmp/mahout-work-jpan/20news-all DEPRECATED: Use of this script to execute hdfs command is deprecated. Instead use the hdfs command for it. 14/04/17 10:26:26 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable put: `/tmp/mahout-work-jpan/20news-all': No such file or directory -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (MAHOUT-1516) run classify-20newsgroups.sh failed cause by /tmp/mahout-work-jpan/20news-all does not exists in hdfs.
[ https://issues.apache.org/jira/browse/MAHOUT-1516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13989085#comment-13989085 ] Andrew Palumbo commented on MAHOUT-1516: hadoop dfs -mkdir -p does not work with hadoop 1.2.1. [~panjian] were you able to get the script working without making any other changes to your hadoop config? run classify-20newsgroups.sh failed cause by /tmp/mahout-work-jpan/20news-all does not exists in hdfs. -- Key: MAHOUT-1516 URL: https://issues.apache.org/jira/browse/MAHOUT-1516 Project: Mahout Issue Type: Bug Components: Examples Affects Versions: 0.9 Environment: hadoop2.2.0 mahout0.9 ubuntu12.04 Reporter: Jian Pan Priority: Minor Labels: patch Fix For: 1.0 + echo 'Copying 20newsgroups data to HDFS' Copying 20newsgroups data to HDFS + set +e + /home/jpan/Software/hadoop-2.2.0/bin/hadoop dfs -rmr /tmp/mahout-work-jpan/20news-all DEPRECATED: Use of this script to execute hdfs command is deprecated. Instead use the hdfs command for it. rmr: DEPRECATED: Please use 'rm -r' instead. 14/04/17 10:26:25 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable rmr: `/tmp/mahout-work-jpan/20news-all': No such file or directory + set -e + /home/jpan/Software/hadoop-2.2.0/bin/hadoop dfs -put /tmp/mahout-work-jpan/20news-all /tmp/mahout-work-jpan/20news-all DEPRECATED: Use of this script to execute hdfs command is deprecated. Instead use the hdfs command for it. 14/04/17 10:26:26 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable put: `/tmp/mahout-work-jpan/20news-all': No such file or directory -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Comment Edited] (MAHOUT-1516) run classify-20newsgroups.sh failed cause by /tmp/mahout-work-jpan/20news-all does not exists in hdfs.
[ https://issues.apache.org/jira/browse/MAHOUT-1516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13972323#comment-13972323 ] Sebastian Schelter edited comment on MAHOUT-1516 at 5/1/14 7:36 AM: [~panjian] I think the -p option to mkdir is specific to Hadoop 2.x, can someone confirm that? Have you tried whether the script also works without the -p option? was (Author: ssc): I think the -p option to mkdir is specific to Hadoop 2.x, can someone confirm that? Have you tried whether the script also works without the -p option? run classify-20newsgroups.sh failed cause by /tmp/mahout-work-jpan/20news-all does not exists in hdfs. -- Key: MAHOUT-1516 URL: https://issues.apache.org/jira/browse/MAHOUT-1516 Project: Mahout Issue Type: Bug Components: Examples Affects Versions: 0.9 Environment: hadoop2.2.0 mahout0.9 ubuntu12.04 Reporter: Jian Pan Priority: Minor Labels: patch Fix For: 1.0 + echo 'Copying 20newsgroups data to HDFS' Copying 20newsgroups data to HDFS + set +e + /home/jpan/Software/hadoop-2.2.0/bin/hadoop dfs -rmr /tmp/mahout-work-jpan/20news-all DEPRECATED: Use of this script to execute hdfs command is deprecated. Instead use the hdfs command for it. rmr: DEPRECATED: Please use 'rm -r' instead. 14/04/17 10:26:25 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable rmr: `/tmp/mahout-work-jpan/20news-all': No such file or directory + set -e + /home/jpan/Software/hadoop-2.2.0/bin/hadoop dfs -put /tmp/mahout-work-jpan/20news-all /tmp/mahout-work-jpan/20news-all DEPRECATED: Use of this script to execute hdfs command is deprecated. Instead use the hdfs command for it. 14/04/17 10:26:26 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable put: `/tmp/mahout-work-jpan/20news-all': No such file or directory -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Created] (MAHOUT-1516) run classify-20newsgroups.sh failed cause by /tmp/mahout-work-jpan/20news-all does not exists in hdfs.
Jian Pan created MAHOUT-1516: Summary: run classify-20newsgroups.sh failed cause by /tmp/mahout-work-jpan/20news-all does not exists in hdfs. Key: MAHOUT-1516 URL: https://issues.apache.org/jira/browse/MAHOUT-1516 Project: Mahout Issue Type: Bug Components: Examples Affects Versions: 0.9 Environment: hadoop2.2.0 mahout0.9 ubuntu12.04 Reporter: Jian Pan Priority: Minor Fix For: 1.0 + echo 'Copying 20newsgroups data to HDFS' Copying 20newsgroups data to HDFS + set +e + /home/jpan/Software/hadoop-2.2.0/bin/hadoop dfs -rmr /tmp/mahout-work-jpan/20news-all DEPRECATED: Use of this script to execute hdfs command is deprecated. Instead use the hdfs command for it. rmr: DEPRECATED: Please use 'rm -r' instead. 14/04/17 10:26:25 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable rmr: `/tmp/mahout-work-jpan/20news-all': No such file or directory + set -e + /home/jpan/Software/hadoop-2.2.0/bin/hadoop dfs -put /tmp/mahout-work-jpan/20news-all /tmp/mahout-work-jpan/20news-all DEPRECATED: Use of this script to execute hdfs command is deprecated. Instead use the hdfs command for it. 14/04/17 10:26:26 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable put: `/tmp/mahout-work-jpan/20news-all': No such file or directory -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Updated] (MAHOUT-1516) run classify-20newsgroups.sh failed cause by /tmp/mahout-work-jpan/20news-all does not exists in hdfs.
[
https://issues.apache.org/jira/browse/MAHOUT-1516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jian Pan updated MAHOUT-1516:
-
Labels: patch (was: )
Status: Patch Available (was: Open)
*** 97,102
--- 97,103
set +e
$HADOOP dfs -rmr ${WORK_DIR}/20news-all
set -e
+ $HADOOP dfs -mkdir -p ${WORK_DIR}/20news-all
$HADOOP dfs -put ${WORK_DIR}/20news-all ${WORK_DIR}/20news-all
fi
run classify-20newsgroups.sh failed cause by /tmp/mahout-work-jpan/20news-all
does not exists in hdfs.
--
Key: MAHOUT-1516
URL: https://issues.apache.org/jira/browse/MAHOUT-1516
Project: Mahout
Issue Type: Bug
Components: Examples
Affects Versions: 0.9
Environment: hadoop2.2.0 mahout0.9 ubuntu12.04
Reporter: Jian Pan
Priority: Minor
Labels: patch
Fix For: 1.0
+ echo 'Copying 20newsgroups data to HDFS'
Copying 20newsgroups data to HDFS
+ set +e
+ /home/jpan/Software/hadoop-2.2.0/bin/hadoop dfs -rmr
/tmp/mahout-work-jpan/20news-all
DEPRECATED: Use of this script to execute hdfs command is deprecated.
Instead use the hdfs command for it.
rmr: DEPRECATED: Please use 'rm -r' instead.
14/04/17 10:26:25 WARN util.NativeCodeLoader: Unable to load native-hadoop
library for your platform... using builtin-java classes where applicable
rmr: `/tmp/mahout-work-jpan/20news-all': No such file or directory
+ set -e
+ /home/jpan/Software/hadoop-2.2.0/bin/hadoop dfs -put
/tmp/mahout-work-jpan/20news-all /tmp/mahout-work-jpan/20news-all
DEPRECATED: Use of this script to execute hdfs command is deprecated.
Instead use the hdfs command for it.
14/04/17 10:26:26 WARN util.NativeCodeLoader: Unable to load native-hadoop
library for your platform... using builtin-java classes where applicable
put: `/tmp/mahout-work-jpan/20news-all': No such file or directory
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (MAHOUT-1516) run classify-20newsgroups.sh failed cause by /tmp/mahout-work-jpan/20news-all does not exists in hdfs.
[ https://issues.apache.org/jira/browse/MAHOUT-1516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13972323#comment-13972323 ] Sebastian Schelter commented on MAHOUT-1516: I think the -p option to mkdir is specific to Hadoop 2.x, can someone confirm that? Have you tried whether the script also works without the -p option? run classify-20newsgroups.sh failed cause by /tmp/mahout-work-jpan/20news-all does not exists in hdfs. -- Key: MAHOUT-1516 URL: https://issues.apache.org/jira/browse/MAHOUT-1516 Project: Mahout Issue Type: Bug Components: Examples Affects Versions: 0.9 Environment: hadoop2.2.0 mahout0.9 ubuntu12.04 Reporter: Jian Pan Priority: Minor Labels: patch Fix For: 1.0 + echo 'Copying 20newsgroups data to HDFS' Copying 20newsgroups data to HDFS + set +e + /home/jpan/Software/hadoop-2.2.0/bin/hadoop dfs -rmr /tmp/mahout-work-jpan/20news-all DEPRECATED: Use of this script to execute hdfs command is deprecated. Instead use the hdfs command for it. rmr: DEPRECATED: Please use 'rm -r' instead. 14/04/17 10:26:25 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable rmr: `/tmp/mahout-work-jpan/20news-all': No such file or directory + set -e + /home/jpan/Software/hadoop-2.2.0/bin/hadoop dfs -put /tmp/mahout-work-jpan/20news-all /tmp/mahout-work-jpan/20news-all DEPRECATED: Use of this script to execute hdfs command is deprecated. Instead use the hdfs command for it. 14/04/17 10:26:26 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable put: `/tmp/mahout-work-jpan/20news-all': No such file or directory -- This message was sent by Atlassian JIRA (v6.2#6252)
