No its not connecting, its out of the cluster. I am testing node failure
scenario so I am not bothered about node going down.
The issue here is that the job should succeed with remaining nodes
as the replication factor is > 1, but the job is failing.
Regards,
Rajat
On Tue, Dec 27, 2011 at 7:25 P
The DFSClient class is not part of the public API. What do you seek to do with
it though, which isn't exposed already by the regular FileSystem interface?
On 28-Dec-2011, at 9:46 AM, eyun wrote:
> hi all,
>
> I just download the hadoop0.20.203 tarball from apache site, when I want
> to see th
hi all,
I just download the hadoop0.20.203 tarball from apache site, when I want
to see the documentation about DFSClient class,
I have found that there are no no api documentations about hdfs in
hadoop0.20.203 in this tarball, plz tell me how can I get
these api documentations about hdfs, 3k
PLEASE, PLEASE, PLEASE UNSUBSCRIBE ME...PLEASE, PLEASE, PLEASE...PRETTY
PLEASE!!
UNSUBSCRIBE all the below, PLEASE, UNSUBSCRIBE ME!
englan...@yahoo.com
englan...@powergraphxs.com
st...@vdpdirect.com
Steven England
Mobile/Smart 480-522-7678
FAX: 480-452-1775
PO BOX 33186SAN DIEGO C
Masoud,
Can you be a little more concrete on why streaming will not work for you?
http://hadoop.apache.org/common/docs/r0.15.2/streaming.html
Kindest regards.
Ron
On Tue, Dec 27, 2011 at 8:17 PM, Masoud wrote:
> Thank for your reply^^
> but question is how we can write map reduce in C# witho
Thank for your reply^^
but question is how we can write map reduce in C# without using Java
abstract classes and interfaces of Hadoop, should we only
write C# code according to map/reduce app logic?
what do you mean of app can run standalone? you mean its should be .exe
or .dll?
did you do ma
Alex
java -version -Xmx1024m is running fine
I was also able to create directory in /users/hadoop-0.20.203.0/log/userlogs
But anyway I've doe a fresh install with the 0.20.205.0 version and the
mapreduce job completed successfully !
Thank you for your help.
Anthony
> Date: Tue, 27 Dec 2011
Alex
I don't know why but now I got other error code :
On Jobtracker :
java.lang.Throwable: Child Error
at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:271)
Caused by: java.io.IOException: Task process exit with nonzero status of 1.
at org.apache.hadoop.mapred.TaskRun
Anthony,
personally I haven't tested yet, jdk7 have bugs already. Was only a
hint to see if the error occurs.
I would focus on memory issues, the installed RAM are okay? No errors?
My next step would be to downgrade into one JDK earlier to check for a
bug. Did you update the OS before?
- Alex
On
Did the DN you've just rebooted connecting to the NN? Mostly the
datanode daemon is'nt running, check it:
ps waux |grep "DataNode" |grep -v "grep"
- ALex
On Tue, Dec 27, 2011 at 2:44 PM, Rajat Goel wrote:
> Yes. Hdfs and Mapred related dirs are set outside of /tmp.
>
> On Tue, Dec 27, 2011 at 6:
Alex
-XX:+UseCompressedOops option is the default in 1.6.0_24 and above on 64 bit
JVMs (http://wiki.apache.org/hadoop/HadoopJavaVersions)
Anyway, I tested it but same result.
Is it wise to test hadoop with the new jdk7_2 ?
Anthony
> Date: Tue, 27 Dec 2011 13:47:03 +0100
> Subject: Re: Task pr
Yes. Hdfs and Mapred related dirs are set outside of /tmp.
On Tue, Dec 27, 2011 at 6:48 PM, alo alt wrote:
> Hi,
>
> did you set the hdfs-related dirs outside of /tmp? Most *ux systems
> clean them up on reboot.
>
> - Alex
>
> On Tue, Dec 27, 2011 at 2:09 PM, Rajat Goel wrote:
> > Hi,
> >
> > I
Hi,
did you set the hdfs-related dirs outside of /tmp? Most *ux systems
clean them up on reboot.
- Alex
On Tue, Dec 27, 2011 at 2:09 PM, Rajat Goel wrote:
> Hi,
>
> I have a 7-node setup (1 - Namenode/JobTracker, 6 - Datanodes/TaskTrackers)
> running Hadoop version 0.20.203.
>
> I performed the
Hi,
I have a 7-node setup (1 - Namenode/JobTracker, 6 - Datanodes/TaskTrackers)
running Hadoop version 0.20.203.
I performed the following test:
Initially cluster is running smoothly. Just before launching a MapReduce
job (about one or two minutes before), I shutdown one of the data nodes
(reboot
Alex,
Memory available on namenode / Jobtracker :
Tasks: 435 total, 1 running, 434 sleeping, 0 stopped, 0 zombie
Cpu(s): 0.0%us, 0.0%sy, 0.0%ni,100.0%id, 0.0%wa, 0.0%hi, 0.0%si, 0.0%st
Mem: 15360M total,11609M used, 3750M free, 311M buffers
Swap: 2047M total,
Hey guys,
How we can make hadoop as multiuser ?
One way to think as whatever group we currently assigned to use hadoop, add
users to same group and change permissions to hadoop.tmp.dir,
mapred.system.dir, dfs.data.dir, and what not.
I was playing on hadoop 0.20.205 and I observed we can't change
Hi,
I got Nothing in the dmesg
I've checked the Tasktracker and this is what I got :
/
STARTUP_MSG: Starting TaskTracker
STARTUP_MSG: host = ylal2960.inetpsa.com/10.68.217.86
STARTUP_MSG: args = []
STARTUP_MSG: version = 0.20.2
This looks like a sentence extractor? How do you account for periods that are
quoted? Your problem is much like a CSV file with commas inside its quoted
values. Perhaps OpenCSV with delimiters configured may help you greatly as you
write your own InputFormat.
If the above does not concern you,
Hey people,
I have a plain text file.I want to parse it using M/R line by line. When I
am saying line it means plain text line that ends with a DOT.
Can I use M/R to do this kind of job. I know if I have to do it like this,
I have to write my own InputFormat.
Can someone guide me/or share their ex
I haven't used Mono but if your written program can run as a standalone and
read from stdin and write to stdout, then streaming is sufficient to run your
C# MR programs.
On 27-Dec-2011, at 2:31 PM, Masoud wrote:
> Dear All,
> any one did it before: map/reduce by C# & Hadoop ???
>
> As you know
Dear All,
any one did it before: map/reduce by C# & Hadoop ???
As you know for developing map/reduce app in hadoop we should extend and
implement special map and reduce abstract classes and interfaces,
and Hadoop pipes is for C++ not C#. The question is what we should do
for C#?
*IS IT RIGHT
BEGIN:VCALENDAR
PRODID:-//Microsoft Corporation//Outlook 14.0 MIMEDIR//EN
VERSION:2.0
METHOD:REQUEST
X-MS-OLK-FORCEINSPECTOROPEN:TRUE
BEGIN:VTIMEZONE
TZID:Egypt Standard Time
BEGIN:STANDARD
DTSTART:16010101T00
TZOFFSETFROM:+0300
TZOFFSETTO:+0200
END:STANDARD
END:VTIMEZONE
BEGIN:VEVENT
ATTENDEE;
22 matches
Mail list logo
