Re: [ANNOUNCE] New Hadoop Committer - Chris Trezzo

2017-04-24 Thread Ted Yu
Congratulations, Chris On Mon, Apr 24, 2017 at 12:42 PM, Sangjin Lee wrote: > It is my pleasure to announce that Chris Trezzo has been elected as a > committer on the Apache Hadoop project. We appreciate his contributions to > Hadoop thus far, and look forward to more. > >

Re: [ANNOUNCE] New Hadoop Committer - Varun Saxena

2016-06-24 Thread Ted Yu
Congratulations Varun! On Fri, Jun 24, 2016 at 11:57 AM, Li Lu wrote: > Congrats Varun! > > Li Lu > > > On Jun 24, 2016, at 11:51, 俊平堵 wrote: > > > > On behalf of the Apache Hadoop PMC, I am pleased to announce that Varun > > Saxena > > has been

Re: [ANNOUNCE] New Hadoop Committer - Larry McCay

2016-04-13 Thread Ted Yu
Congrats, Larry. > On Apr 12, 2016, at 11:33 PM, John Zhuge wrote: > > Congratulations Larry! > > John Zhuge > Software Engineer, Cloudera > >> On Tue, Apr 12, 2016 at 11:31 PM, Xiao Chen wrote: >> >> Congrats Larry! >> >> -Xiao >> >>> On Tue, Apr

Re: [ANNOUNCE] New Apache Hadoop Committer : Kai Zheng

2016-04-13 Thread Ted Yu
Congrats, Kai. > On Apr 13, 2016, at 12:35 AM, Rakesh Radhakrishnan > wrote: > > Congratulations, Kai! > > Rakesh > >> On Wed, Apr 13, 2016 at 1:00 PM, Zhihai Xu wrote: >> >> Congrats Kai! >> >> zhihai >> >> On Wed, Apr 13, 2016 at 12:19 AM,

Re: [ANNOUNCE] New Hadoop PMC Member - Sangjin Lee

2016-04-13 Thread Ted Yu
Congratulations, Sangjin. > On Apr 12, 2016, at 11:10 PM, Zhihai Xu wrote: > > Congrats Sangjin! > > zhihai > > On Tue, Apr 12, 2016 at 11:05 PM, Rohith Sharma K S < > rohithsharm...@huawei.com> wrote: > >> Congrats Sangjin :-) >> >> >> -Original Message-

Re: [ANNOUNCE] New Hadoop Committer - Naganarasimha Garla

2016-04-07 Thread Ted Yu
Congratulations, Naga. On Thu, Apr 7, 2016 at 11:00 AM, Varun Saxena wrote: > Congrats Naga ! > > - Varun. > > On Thu, Apr 7, 2016 at 11:29 PM, Wangda Tan wrote: > > > On behalf of the Apache Hadoop PMC, I am pleased to announce > > that

Re: [ANNOUNCE] Yongjun Zhang added to the Apache Hadoop PMC

2016-02-29 Thread Ted Yu
Congratulations Yongjun. > On Feb 29, 2016, at 12:17 AM, Naganarasimha G R (Naga) > wrote: > > Congrats Yongjun ! > > + Naga > > From: Tsuyoshi Ozawa [oz...@apache.org] > Sent: Monday, February 29, 2016 13:37 > To:

Re: [ANNOUNCE] New Hadoop Committer - Eric Payne

2016-02-11 Thread Ted Yu
Congratulations. On Thu, Feb 11, 2016 at 7:55 AM, Rohith Sharma K S < rohithsharm...@apache.org> wrote: > Congratulations Eric!! :-) > On 11 Feb 2016 21:23, "Jason Lowe" wrote: > > > On behalf of the Apache Hadoop PMC, I am pleased to announce that Eric > > Payne

Re: [ANNOUNCE] New Hadoop Committer - Masatake Iwasaki

2016-01-27 Thread Ted Yu
Congratulations. On Wed, Jan 27, 2016 at 6:43 PM, Xiao Chen wrote: > Congrats Masatake Iwasaki! Well deserved. > > -Xiao > > On Wed, Jan 27, 2016 at 6:38 PM, Yongjun Zhang > wrote: > > > Congratulations Masatake! > > > > --Yongjun > > > > On Wed, Jan 27,

Re: [ANNOUNCE] Additions to Apache Hadoop PMC - Akira, Robert, Tusyoshi and Wangda

2016-01-12 Thread Ted Yu
Congratulations! > On Jan 12, 2016, at 5:08 PM, Karthik Kambatla wrote: > > On behalf of the Apache Hadoop PMC, I am very pleased to announce the > following folks have been elected as a PMC member on the Apache Hadoop > project recognizing their sustained and significant

Re: [ANNOUNCE] New Hadoop Committer - Walter Su

2015-10-28 Thread Ted Yu
Congrats, Walter. > On Oct 28, 2015, at 5:16 PM, Vinayakumar B wrote: > > Congrats Walter! > > Welcome aboard. > > Regards, > Vinay > >> On Thu, Oct 29, 2015 at 5:45 AM, Haohui Mai wrote: >> >> On behalf of the Apache Hadoop PMC, I am very

Re: [ANNOUNCE] New Apache Hadoop committer Zhe Zhang

2015-10-19 Thread Ted Yu
Congrats, Zhe > On Oct 19, 2015, at 1:56 PM, Andrew Wang wrote: > > Hi all, > > It is my pleasure to welcome Zhe Zhang as an Apache Hadoop committer. Zhe > has been working on the project for over a year now, notably on the HDFS > erasure coding feature (HDFS-7285) as

Re: [ANNOUNCE] New Hadoop Committer - Anubhav dhoot

2015-09-20 Thread Ted Yu
Congrats Anubhav > On Sep 20, 2015, at 9:56 PM, Karthik Kambatla wrote: > > On behalf of the Apache Hadoop PMC, I am pleased to announce that Anubhav > Dhoot has been elected a committer on the Apache Hadoop project recognizing > his contributions to the project. > > We

Re: [ANNOUNCE] Welcoming Devaraj K to Apache Hadoop PMC

2015-08-05 Thread Ted Yu
Congrats, Devaraj. On Wed, Aug 5, 2015 at 5:16 PM, Brahma Reddy Battula brahmareddy.batt...@hotmail.com wrote: Congratulations Devaraj! Date: Wed, 5 Aug 2015 16:56:47 -0700 Subject: [ANNOUNCE] Welcoming Devaraj K to Apache Hadoop PMC From: umamah...@apache.org To:

Re: [ANNOUNCE] New Hadoop committer - Zhihai Xu

2015-07-30 Thread Ted Yu
Congratulations, Zhihai. On Thu, Jul 30, 2015 at 12:49 PM, Wangda Tan wheele...@gmail.com wrote: Congrats! Regards, Wangda On Thu, Jul 30, 2015 at 12:36 PM, Karthik Kambatla ka...@cloudera.com wrote: On behalf of the Apache Hadoop PMC, I am pleased to announce that Zhihai Xu has

Re: environment setup

2015-07-26 Thread Ted Yu
Putting general@ to bcc. If you plan to ask about Apache Hadoop setup issue, consider using user@ If you are installing distro from some vendor, please use vendor-specific mailing list. Cheers 2015-07-26 13:13 GMT-07:00 Serkan Taş serkan@likyateknoloji.com: Hi, Which mail list best

Re: [ANNOUNCE] Welcoming Vinayakumar B to Apache Hadoop PMC

2015-07-08 Thread Ted Yu
Congrats, Vinay. On Wed, Jul 8, 2015 at 11:10 AM, Uma gangumalla umamah...@apache.org wrote: Hi, On behalf of the Apache Hadoop Project Management Committee (PMC), it gives me great pleasure to announce that Vinayakumar B is recently welcomed to join as a member of Apache Hadoop PMC. He

Re: [ANNOUNCE] Welcoming Xuan Gong to Apache Hadoop PMC

2015-07-07 Thread Ted Yu
Congrats, Xuan. On Tue, Jul 7, 2015 at 12:49 PM, Vinod Kumar Vavilapalli vino...@apache.org wrote: Hi all, It gives me great pleasure to announce that Xuan Gong is welcomed to join as a member of Apache Hadoop PMC. Here's appreciating all his work so far into the project and looking

Re: [ANNOUNCE] New Hadoop Committer - Rohith Sharma K S

2015-07-07 Thread Ted Yu
Congrats Rohith! On Tue, Jul 7, 2015 at 1:50 PM, Zhijie Shen zs...@hortonworks.com wrote: Congrats! From: Sangjin Lee sjl...@gmail.com Sent: Tuesday, July 07, 2015 1:48 PM To: general@hadoop.apache.org Subject: Re: [ANNOUNCE] New Hadoop Committer -

Re: [ANNOUNCE] New Hadoop committer - Lei (Eddy) Xu

2015-06-22 Thread Ted Yu
Congratulations, Eddy. On Jun 19, 2015, at 8:43 PM, Esteban Gutierrez este...@cloudera.com wrote: Congratulations Eddy! -- Cloudera, Inc. On Fri, Jun 19, 2015 at 3:26 AM, Joep Rottinghuis jrottingh...@gmail.com wrote: Congrats Eddy ! Joep Sent from my iPhone On Jun 18,

Re: [ANNOUNCE] New Hadoop Committer - Ming Ma

2015-06-21 Thread Ted Yu
Congratulations, Ming. On Jun 19, 2015, at 8:25 PM, Esteban Gutierrez este...@cloudera.com wrote: Congratulations Ming Ma! -- Cloudera, Inc. On Fri, Jun 19, 2015 at 2:07 PM, Masatake Iwasaki iwasak...@oss.nttdata.co.jp wrote: Congratulations, Ming Ma! On 6/18/15

Re: [ANNOUNCE] New Hadoop committer - Varun Vasudev

2015-06-17 Thread Ted Yu
Congratulations Varun On Jun 17, 2015, at 3:36 PM, Devaraj K deva...@apache.org wrote: Congrats Varun... Thanks Devaraj On Tue, Jun 16, 2015 at 10:24 PM, Vinod Kumar Vavilapalli vino...@apache.org wrote: Hi all, It gives me great pleasure to announce that the Apache Hadoop

Re: [ANNOUNCE] New Hadoop committer - Arun Suresh

2015-03-28 Thread Ted Yu
Congratulations, Arun. On Fri, Mar 27, 2015 at 9:36 AM, Sangjin Lee sjl...@gmail.com wrote: Congratulations! On Thu, Mar 26, 2015 at 6:29 PM, Sun, Dapeng dapeng@intel.com wrote: Congratulations Arun! Regards Dapeng -Original Message- From: Andrew Wang

Re: Patch review process

2015-01-26 Thread Ted Yu
In some cases, contributor responded to review comments and attached patches addressing the comments. Later on, there was simply no response to the latest patch - even with follow-on ping. I wish this aspect can be improved. Cheers On Sun, Jan 25, 2015 at 6:03 PM, Tsz Wo (Nicholas), Sze

Re: [ANNOUNCE] Welcoming Jian He to Apache Hadoop PMC

2015-01-05 Thread Ted Yu
Congratulations, Jian ! On Mon, Jan 5, 2015 at 3:51 PM, Vinod Kumar Vavilapalli vino...@apache.org wrote: Hi all, On behalf of the Apache Hadoop PMC, it gives me great pleasure to announce that Jian He is recently welcomed to join as a member of Apache Hadoop PMC. Here's appreciating all

Re: [ANNOUNCE] Welcoming Zhijie Shen to Apache Hadoop PMC

2015-01-05 Thread Ted Yu
Congratulations, Zhijie ! On Jan 5, 2015, at 3:51 PM, Vinod Kumar Vavilapalli vino...@apache.org wrote: Hi all, On behalf of the Apache Hadoop PMC, it gives me great pleasure to announce that Zhijie Shen is recently welcomed to join as a member of Apache Hadoop PMC. Here's

Re: [ANNOUNCE] New Hadoop Committer - Carlo Curino

2014-12-05 Thread Ted Yu
Congratulations, Carlo ! On Dec 5, 2014, at 12:43 PM, Chris Douglas cdoug...@apache.org wrote: On behalf of the Apache Hadoop PMC, I'm pleased to announce (albeit belatedly) that Carlo Curino has been elected as a committer on the project. Congratulations Carlo; thank you for all your

Re: [ANNOUNCE] New Hadoop Committers - Gera Shegalov and Robert Kanter

2014-12-04 Thread Ted Yu
Congratulations, Gera and Robert! On Thu, Dec 4, 2014 at 1:43 PM, Chris Nauroth cnaur...@hortonworks.com wrote: Congratulations! Chris Nauroth Hortonworks http://hortonworks.com/ On Thu, Dec 4, 2014 at 11:56 AM, Sandy Ryza sandy.r...@cloudera.com wrote: On behalf of the Apache Hadoop

Re: All mirrored download links from the Apache Hadoop site are broken

2014-10-31 Thread Ted Yu
Looks like the following is working: http://apache.mesi.com.ar/hadoop/common/ FYI On Fri, Oct 31, 2014 at 10:55 AM, Andrew Purtell apurt...@apache.org wrote: http://hadoop.apache.org/releases.html#Download - http://www.apache.org/dyn/closer.cgi/hadoop/common/ Every single mirror link

Re: Some questions for getting help

2014-05-19 Thread Ted Yu
You can connect to chat room #hadoop on IRC. There're many people on that channel. Cheers On May 18, 2014, at 11:31 PM, Pankti Majmudar pankti.majmu...@gmail.com wrote: Hi, I am a newbie to open source development and Hadoop. I was looking at the newbie issues on JIRA and would like to

Re: I stopped receiving any email from this group!

2014-05-11 Thread Ted Yu
See https://twitter.com/infrabot Cheers On Sat, May 10, 2014 at 5:19 PM, Peyman Mohajerian mohaj...@gmail.comwrote:

Re: [ANNOUNCE] New Hadoop Committer - Xuan Gong

2014-04-13 Thread Ted Yu
Congratulations, Xuan. On Sun, Apr 13, 2014 at 5:49 PM, Vinod Kumar Vavilapalli vino...@apache.org wrote: Hi all, I am very pleased to announce that the Apache Hadoop PMC voted in Xuan Gong as a committer in the Apache Hadoop project. His contributions to YARN and MapReduce have been

Re: hadoop eclipse plugin

2014-01-31 Thread Ted Yu
I used the following command in the root of workspace: 859 ant clean compile 860 ant eclipse Eclipse project file is generated: -rw-r--r--1 tyu staff7942 Jan 31 22:21 .classpath -rw-r--r--1 tyu staff 392 Jan 31 22:21 .project Cheers On Fri, Jan 31, 2014 at 9:43 PM,

Re: [ANNOUNCE] New Hadoop Committer - Junping Du

2013-12-09 Thread Ted Yu
Congrats, Junping. On Tue, Dec 10, 2013 at 3:07 AM, Vinod Kumar Vavilapalli vino...@apache.org wrote: Hi all, I am very pleased to announce that Junping Du is voted in as a committer in the Apache Hadoop project. His contributions to Hadoop have been outstanding! We appreciate all the

Re: [ANNOUNCE] New Hadoop Committer - Omkar Vinit Joshi

2013-12-09 Thread Ted Yu
Congratulations, Omkar. On Tue, Dec 10, 2013 at 3:08 AM, Vinod Kumar Vavilapalli vino...@apache.org wrote: Hi all, I am very pleased to announce that Omkar Vinit Joshi is voted in as a committer to the Apache Hadoop project. His contributions to YARN have been nothing short of

Re: [ANNOUNCE] New Hadoop Committer - Mayank Bansal

2013-12-09 Thread Ted Yu
Congrats, Mayank. On Tue, Dec 10, 2013 at 3:11 AM, Vinod Kumar Vavilapalli vino...@apache.org wrote: Hi all, I am very pleased to announce that Mayank Bansal is voted in as a committer in the Apache Hadoop project. A long term Hadoop contributor, his contributions to YARN and MapReduce

Re: [ANNOUNCE] New Hadoop Committer - Jian He

2013-12-09 Thread Ted Yu
Congrats, Jian. On Tue, Dec 10, 2013 at 3:10 AM, Vinod Kumar Vavilapalli vino...@apache.org wrote: Hi all, I am very pleased to announce that Jian He is voted in as a committer to the Apache Hadoop project. His contributions to YARN have been nothing short of outstanding! We appreciate

Re: [ANNOUNCE] New Hadoop Committer - Zhijie Shen

2013-12-09 Thread Ted Yu
Congratulations, Zhijie. On Tue, Dec 10, 2013 at 3:10 AM, Vinod Kumar Vavilapalli vino...@apache.org wrote: Hi all, I am very pleased to announce that Zhijie Shen is voted in as a committer in the Apache Hadoop project. His contributions to YARN and MapReduce have been outstanding! We

Re: [ANNOUNCE] New Hadoop Committer - Roman Shaposhnik

2013-10-24 Thread Ted Yu
Congratulations, Roman. On Oct 24, 2013, at 4:35 PM, Andrew Wang andrew.w...@cloudera.com wrote: Congrats Roman! On Thu, Oct 24, 2013 at 4:33 PM, Alejandro Abdelnur t...@cloudera.comwrote: On behalf of the Apache Hadoop PMC, I am pleased to announce that Roman Shaposhnik has been

Re: Unclear Hadoop 2.1X documentation

2013-09-14 Thread Ted Yu
14, 2013 at 9:09 PM, Ted Yu yuzhih...@gmail.com wrote: For #1, you can get the tar ball from http://www.apache.org/dyn/closer.cgi/hadoop/common/ e.g. http://www.motorlogy.com/apache/hadoop/common/hadoop-2.1.0-beta/ It is in maven too: http://mvnrepository.com/artifact/org.apache.hadoop

Re: Status of 2.0.4-alpha release

2013-04-09 Thread Ted Yu
Good idea, Roman. On Tue, Apr 9, 2013 at 7:26 PM, Roman Shaposhnik r...@apache.org wrote: On Tue, Apr 9, 2013 at 7:03 PM, Arun C Murthy a...@hortonworks.com wrote: Thanks Xuan, Vinod and Cos. I'll spin the rc0 in the next 24hrs. Once the official RC is ready I'll pull the tarball into

Re: [DISCUSS] stabilizing Hadoop releases wrt. downstream

2013-03-07 Thread Ted Yu
Thanks Bobby. HBase trunk can build upon 2.0 SNAPSHOOT so that regression can be detected early. On Tue, Mar 5, 2013 at 7:18 AM, Robert Evans ev...@yahoo-inc.com wrote: That is a great point. I have been meaning to set up the Jenkins build for branch-2 for a while, so I took the 10 mins and

Re: [VOTE] Release hadoop-0.23.2-rc0

2012-03-29 Thread Ted Yu
What are the issues fixed / features added in 0.23.2 compared to 0.23.1 ? Thanks On Thu, Mar 29, 2012 at 3:45 PM, Arun C Murthy a...@hortonworks.com wrote: I've created a release candidate for hadoop-0.23.2 that I would like to release. It is available at:

Re: [VOTE] Rename hadoop branches post hadoop-1.x

2012-03-22 Thread Ted Yu
1, 2, 5 (non-binding) On Mon, Mar 19, 2012 at 5:13 PM, Arun C Murthy a...@hortonworks.com wrote: We've discussed several options: (1) Rename branch-0.22 to branch-2, rename branch-0.23 to branch-3. (2) Rename branch-0.23 to branch-3, keep branch-0.22 as-is i.e. leave a hole. (3) Rename

HBase trunk on 0.23 Was: Update on hadoop-0.23

2011-09-28 Thread Ted Yu
Minor correction to Todd's report, currently HBase TRUNK doesn't compile against 0.23 ( https://builds.apache.org/view/G-L/view/HBase/job/HBase-TRUNK-on-Hadoop-23/42/console ): [ERROR]

Re: Welcoming Alejandro Abdelnur as a Hadoop Committer

2011-09-26 Thread Ted Yu
Alejandro has been making contributions to HBase as well. Congratulations Alejandro ! On Mon, Sep 26, 2011 at 9:21 AM, Tom White t...@cloudera.com wrote: On behalf of the PMC, I am pleased to announce that Alejandro Abdelnur has been elected a committer in the Apache Hadoop Common, HDFS, and

Re: Welcoming Harsh J as a Hadoop committer

2011-09-16 Thread Ted Yu
Harsh definitely deserves this honor. Cheers On Thu, Sep 15, 2011 at 11:36 PM, Aaron T. Myers a...@cloudera.com wrote: Congratulations, Harsh! Very well-deserved. -- Aaron T. Myers Software Engineer, Cloudera

Re: Hadoop´s Internationalization

2011-06-25 Thread Ted Yu
Marcos: Which hadoop version(s) do you plan to work on ? Where I can find the sources of the docs? In the latest TRUNK, you would find these directories: ./common/src/docs ./hdfs/src/c++/libhdfs/docs ./hdfs/src/docs ./mapreduce/src/docs Cheers On Sat, Jun 25, 2011 at 8:17 AM, Marcos Ortiz

Re: hbase

2011-04-10 Thread Ted Yu
Mapreduce isn't required. For your query, Hive would be a better fit. On Sun, Apr 10, 2011 at 5:36 AM, Mag Gam magaw...@gmail.com wrote: Just curious, does hbase require mapreduce? Basically, I have several terabytes of data and I would like to query it similar to sql fashion. Was wondering

Re: How to pass a parameter to map ?

2011-03-17 Thread Ted Yu
I can pass paramenter to map when i configure a job? You can utilize hadoop Configuration (JobConf). On Thu, Mar 17, 2011 at 1:15 PM, Alessandro Binhara binh...@gmail.comwrote: I need select a data on map... I can pass paramenter to map when i configure a job? Other questions : I

Re: DISCUSSION: Cut a hadoop-0.20.0-append release from the tip of branch-0.20-append branch?

2010-12-22 Thread Ted Yu
Thats why I think we should go to 0.22 ASAP and get companies to build their new features on trunk against that. There was a thread in Nov - 'Caution using Hadoop 0.21' It would be helpful to see response to 0.22 Thanks for getting the discussion off the ground, St.Ack

Re: WARNING : There are about 1 missing blocks. Please check the log or run fsck.

2010-08-26 Thread Ted Yu
Run fsck. On Thu, Aug 26, 2010 at 5:56 AM, vaibhav negi sssena...@gmail.comwrote: Hi , I am using hadoop version : 0.20.2 . I am getting this error message. WARNING : There are about 1 missing blocks. Please check the log or run fsck. What to do? Is there any problem in the cluster

Re: [DISCUSS] Hadoop Security Release off Yahoo! patchset

2010-08-26 Thread Ted Yu
This would imply hadoop-0.20-security-append or hadoop-0.20-append-security release be created which contains security and append features. On Thu, Aug 26, 2010 at 4:22 PM, Arun C Murthy a...@yahoo-inc.com wrote: On Aug 26, 2010, at 12:08 PM, Stack wrote: On Mon, Aug 23, 2010 at 5:27 PM,

Re: Child processes on datanodes/task trackers

2010-08-25 Thread Ted Yu
Use jps to find out pid of the Child. Then use this to find out which job the Child belongs to: ps aux | grep pid On Wed, Aug 25, 2010 at 12:20 PM, C J c.josh...@yahoo.com wrote: Hi, I wanted to know why I see running Child processes on my datanodes even though there is no job running at

Re: Child processes on datanodes/task trackers

2010-08-25 Thread Ted Yu
they are still hanging there for long finished jobs. From: Ted Yu yuzhih...@gmail.com To: general@hadoop.apache.org Sent: Wed, August 25, 2010 4:17:38 PM Subject: Re: Child processes on datanodes/task trackers Use jps to find out pid of the Child. Then use

Re: Child processes on datanodes/task trackers

2010-08-25 Thread Ted Yu
. From: Ted Yu yuzhih...@gmail.com To: general@hadoop.apache.org Sent: Wed, August 25, 2010 7:34:35 PM Subject: Re: Child processes on datanodes/task trackers After you obtain pid, you can use jstack to see what the Child process was doing. What hadoop version are you using ? On Wed, Aug 25

Re: Lazy initialization of Reducers

2010-07-21 Thread Ted Yu
I don't find such parameter in 0.20.2 Please create such flag in your own class. On Wed, Jul 21, 2010 at 10:15 AM, Syed Wasti mdwa...@hotmail.com wrote: Hi, I read about this Reducer Lazy initialization in a document found in the below URL.

Re: Hadoop and XML

2010-07-20 Thread Ted Yu
to getLength() http://hadoop.apache.org/common/docs/current/api/org/apache/hadoop/io/Text.html#getLength%28%29 is valid. So try getting the length, truncating the byte array at the value returned by getLength() and THEN converting it to a String. Jeff On Mon, Jul 19, 2010 at 9:08 AM, Ted Yu yuzhih

Re: Hadoop and XML

2010-07-20 Thread Ted Yu
I also added Peter's comment to the JIRA I logged: https://issues.apache.org/jira/browse/HADOOP-6868 On Tue, Jul 20, 2010 at 9:38 AM, Ted Yu yuzhih...@gmail.com wrote: So the correct call should be: String valueString = new String(valueText.getBytes(), 0, valueText.getLength(), UTF-8

Re: Hadoop and XML

2010-07-19 Thread Ted Yu
2 minutes. (Using 2 Core, 8GB machines) -Original Message- From: Ted Yu [mailto:yuzhih...@gmail.com] Sent: Friday, July 16, 2010 9:44 PM To: general@hadoop.apache.org Subject: Re: Hadoop and XML From an earlier post: http://oobaloo.co.uk/articles/2010/1/20/processing-xml

Re: Hadoop and XML

2010-07-16 Thread Ted Yu
From an earlier post: http://oobaloo.co.uk/articles/2010/1/20/processing-xml-in-hadoop.html On Fri, Jul 16, 2010 at 3:07 PM, Peter Minearo peter.mine...@reardencommerce.com wrote: Moving the variable to a local variable did not seem to work: /PrivateRateSetvateRateSet public void

Re: Exception in thread main java.lang.ClassNotFoundException in Hadoop

2010-07-14 Thread Ted Yu
, Ted Yu yuzhih...@gmail.com wrote: Please give the commandline you used. You should have specified the jar containing WordCount class. On Mon, Jul 12, 2010 at 5:15 AM, james isaac jamesisaac.d...@gmail.com wrote: Hi, I have just started my career with Hadoop. I tried to execute

problem starting cdh3b2 jobtracker

2010-07-01 Thread Ted Yu
We installed cdh3b2 0.20.2+320 and saw some strange error in jobtracker log: 2010-07-02 01:49:31,977 INFO org.apache.hadoop.mapred.JobTracker: JobTracker up at: 9001 2010-07-02 01:49:31,977 INFO org.apache.hadoop.mapred.JobTracker: JobTracker webserver: 50030 2010-07-02 01:49:31,988 WARN

checksum error

2010-05-24 Thread Ted Yu
Hi, We currently use hadoop 0.20.1 I found the following trace in our log: 2010-05-17 16:19:55,389 INFO [FSInputChecker] Found checksum error: b[0,

Re: datanode goes down, maybe due to Unexpected problem in creating temporary file

2010-05-17 Thread Ted Yu
blk_926027507678171558_3620 src: /10.32.56.170:34823 dest: / 10.32.56.171:50010 On Mon, May 17, 2010 at 11:43 AM, Todd Lipcon t...@cloudera.com wrote: Hi Ted, Can you please grep your NN and DN logs for blk_926027507678171558 and pastebin the results? -Todd On Mon, May 17, 2010 at 9:57 AM, Ted Yu yuzhih

Re: MultipleInputs in 0.20

2010-05-09 Thread Ted Yu
Please refer to MAPREDUCE-1743. Other option is to duplicate MultipleInputs, DelegatingInputFormat classes and slightly modify TaggedInputSplit (as I suggested earlier). This way you use your own (functional) version :-) On Sun, May 9, 2010 at 2:08 PM, Oded Rosen o...@legolas-media.com wrote:

Re: Compilation failed when compile hadoop common release-0.20.2

2010-03-05 Thread Ted Yu
Did you first try 'ant jar' from under /hadoop_src ? On Fri, Mar 5, 2010 at 3:47 PM, Gary Yang garyya...@yahoo.com wrote: Hi, I try to compile hadoop common of the release 0.20.2. Below are the error messages and java and ant versions I am using. Please tell me what I missed. ..

Re: splittable encrypted compressed files

2010-01-24 Thread Ted Yu
distributed. As far as moving data on the wire is concerned, SSH is already being used. I am wondering about the performance hit when encryption and then again decryption is applied to the data and what value that might add. --- Gautam On Tue, Jan 19, 2010 at 2:38 PM, Ted Yu yuzhih