[jira] [Created] (HADOOP-15221) Swift driver should not fail if JSONUtils reports UnknowPropertyException

2018-02-12 Thread Chen He (JIRA)
Chen He created HADOOP-15221: Summary: Swift driver should not fail if JSONUtils reports UnknowPropertyException Key: HADOOP-15221 URL: https://issues.apache.org/jira/browse/HADOOP-15221 Project: Hadoop

[jira] [Created] (HADOOP-14716) SwiftNativeFileSystem should not eat the exception when rename

2017-08-01 Thread Chen He (JIRA)
Chen He created HADOOP-14716: Summary: SwiftNativeFileSystem should not eat the exception when rename Key: HADOOP-14716 URL: https://issues.apache.org/jira/browse/HADOOP-14716 Project: Hadoop Common

[jira] [Created] (HADOOP-14641) hadoop-openstack driver reports input stream leaking

2017-07-10 Thread Chen He (JIRA)
Chen He created HADOOP-14641: Summary: hadoop-openstack driver reports input stream leaking Key: HADOOP-14641 URL: https://issues.apache.org/jira/browse/HADOOP-14641 Project: Hadoop Common Issue

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha1 RC0

2016-09-01 Thread Chen He
+1 non-binding download source and build successfully; deploy to single node cluster; run wordcount and loadgen passed; Verified that MR-6336 is there and FileOutputCommitter is using algorithm 2 by default. Best Regards! Chen On Wed, Aug 31, 2016 at 9:25 PM, Rakesh Radhakrishnan

[jira] [Resolved] (HADOOP-13570) Hadoop Swift driver should use new Apache httpclient

2016-09-01 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen He resolved HADOOP-13570. -- Resolution: Duplicate Dup to HADOOP-11614, close it. > Hadoop Swift driver should use new Apa

[jira] [Created] (HADOOP-13570) Hadoop swift Driver should use new Apache httpclient

2016-08-31 Thread Chen He (JIRA)
Chen He created HADOOP-13570: Summary: Hadoop swift Driver should use new Apache httpclient Key: HADOOP-13570 URL: https://issues.apache.org/jira/browse/HADOOP-13570 Project: Hadoop Common Issue

[jira] [Created] (HADOOP-13211) Swift driver should have a configurable retry feature when ecounter 5xx error

2016-05-26 Thread Chen He (JIRA)
Chen He created HADOOP-13211: Summary: Swift driver should have a configurable retry feature when ecounter 5xx error Key: HADOOP-13211 URL: https://issues.apache.org/jira/browse/HADOOP-13211 Project

[jira] [Created] (HADOOP-13021) Hadoop swift driver unit test should use unique directory each run

2016-04-13 Thread Chen He (JIRA)
Chen He created HADOOP-13021: Summary: Hadoop swift driver unit test should use unique directory each run Key: HADOOP-13021 URL: https://issues.apache.org/jira/browse/HADOOP-13021 Project: Hadoop Common

Re: [VOTE] Release Apache Hadoop 2.6.4 RC0

2016-02-08 Thread Chen He
Thank you Junping for the release work. +1 non-binding - built from source code using Java7 and deploy to a two-node cluster; - run WC and loadgen, passed; Regards! Chen On Mon, Feb 8, 2016 at 6:11 PM, Mit Desai wrote: > +1 (non-binding) > - verified signatures > -

Re: Yarn / mapreduce scheduling

2016-01-26 Thread Chen He
Hi Sandy Ryza I searched the MRAppMaster.java but did not find exactly where it saves the locality information. Would you mind provide a more detail information about which object is used for keeping those locality info? Regards! Chen On Thu, Apr 3, 2014 at 1:30 PM, Sandy Ryza

Re: Yarn / mapreduce scheduling

2016-01-26 Thread Chen He
Hi Brad IMHO, here is how hadoop scheduler works For Hadoop 1.x In one heartbeat interval, Fifo Scheduler keep strict FIFO order and assign a node as many as possible local task and only one remote task. For Fair scheduler, if you turn on delay algorithm, it also assign local task as many as

Re: [VOTE] Release Apache Hadoop 2.7.2 RC2

2016-01-20 Thread Chen He
+1 (non-binding) -download source code and build in local machine -deploy to a single node -run wc and other 2 examples, passed. Regards! Chen On Wed, Jan 20, 2016 at 12:15 PM, Tsuyoshi Ozawa wrote: > +1 (binding) > > - Verified checksum. > - Built from source code. > - Ran

Re: [VOTE] Release Apache Hadoop 2.7.2 RC1

2015-12-21 Thread Chen He
+1 (non-binding) deploy to a 2-node cluster run loadgen and wc without problem Kindly ask a silly question, why we separate 2.6.x from 2.7.x? On Mon, Dec 21, 2015 at 11:51 AM, Wangda Tan wrote: > +1 (binding) > > - Build & deploy single-node Hadoop from source code > -

Re: [VOTE] Release Apache Hadoop 2.7.2 RC1

2015-12-21 Thread Chen He
I see, thank you for the reply, Mr. Tsuyoshi Ozawa Regards Chen Chen He@Oracle from Samsung Mega On Dec 21, 2015 7:35 PM, "Tsuyoshi Ozawa" <oz...@apache.org> wrote: > Hi Chen, > > > Kindly ask a silly question, why we separate 2.6.x from 2.7.x? > > 2.6.x is th

Re: [VOTE] Release Apache Hadoop 2.6.3 RC0

2015-12-15 Thread Chen He
+1 non-binding compile downloaded code and deploy in a single node, run loadgen and wc successfully Thank Junping for the work. Chen On Tue, Dec 15, 2015 at 10:41 PM, Akira AJISAKA wrote: > Thanks Junping for starting release process. > I noticed there are

[jira] [Created] (HADOOP-12623) Swift should support more flexible container name than RFC952

2015-12-07 Thread Chen He (JIRA)
Chen He created HADOOP-12623: Summary: Swift should support more flexible container name than RFC952 Key: HADOOP-12623 URL: https://issues.apache.org/jira/browse/HADOOP-12623 Project: Hadoop Common

Re: [VOTE] Release Apache Hadoop 2.6.2

2015-10-26 Thread Chen He
download and build successfully on may macOS; deploy on two nodes cluster; run wordcount and loadgen passed; +1 (non-binding) Regards! Chen He On Mon, Oct 26, 2015 at 10:08 AM, Sangjin Lee <sj...@apache.org> wrote: > Thanks Akira! > > A friendly reminder to the community that

[jira] [Created] (HADOOP-12501) Enable SwiftNativeFileSystem to preserve user, group, permission

2015-10-21 Thread Chen He (JIRA)
Chen He created HADOOP-12501: Summary: Enable SwiftNativeFileSystem to preserve user, group, permission Key: HADOOP-12501 URL: https://issues.apache.org/jira/browse/HADOOP-12501 Project: Hadoop Common

Re: [DISCUSS] About the details of JDK-8 support

2015-10-13 Thread Chen He
On Tue, Oct 13, 2015 at 3:00 AM, Jean-Baptiste Note wrote: > Hi, > > As far as security is concerned we (Criteo) are using CDH5 with JDK8 in > production with security enabled. > We reported some gripes with some specific java versions: >

[jira] [Created] (HADOOP-12471) Support Swift file (> 5GB) continuious uploading where there is a failure

2015-10-09 Thread Chen He (JIRA)
Chen He created HADOOP-12471: Summary: Support Swift file (> 5GB) continuious uploading where there is a failure Key: HADOOP-12471 URL: https://issues.apache.org/jira/browse/HADOOP-12471 Project: Had

[jira] [Created] (HADOOP-12461) Swift driver should have the ability to renew token if server has timeout

2015-10-06 Thread Chen He (JIRA)
Chen He created HADOOP-12461: Summary: Swift driver should have the ability to renew token if server has timeout Key: HADOOP-12461 URL: https://issues.apache.org/jira/browse/HADOOP-12461 Project: Hadoop

[jira] [Created] (HADOOP-12343) Error message of Swift driver should be more clear when there is mal-format of hostname and service

2015-08-19 Thread Chen He (JIRA)
Chen He created HADOOP-12343: Summary: Error message of Swift driver should be more clear when there is mal-format of hostname and service Key: HADOOP-12343 URL: https://issues.apache.org/jira/browse/HADOOP-12343

[jira] [Created] (HADOOP-12086) Swift driver reports NPE if user try to create a dir without name

2015-06-11 Thread Chen He (JIRA)
Chen He created HADOOP-12086: Summary: Swift driver reports NPE if user try to create a dir without name Key: HADOOP-12086 URL: https://issues.apache.org/jira/browse/HADOOP-12086 Project: Hadoop Common

[jira] [Created] (HADOOP-12046) Avoid creating ._COPYING_ temporary file when copying file to Swift file system

2015-05-31 Thread Chen He (JIRA)
Chen He created HADOOP-12046: Summary: Avoid creating ._COPYING_ temporary file when copying file to Swift file system Key: HADOOP-12046 URL: https://issues.apache.org/jira/browse/HADOOP-12046 Project

[jira] [Created] (HADOOP-12038) SwiftNativeOutputStream should check whether a file exists or not before deleting

2015-05-27 Thread Chen He (JIRA)
Chen He created HADOOP-12038: Summary: SwiftNativeOutputStream should check whether a file exists or not before deleting Key: HADOOP-12038 URL: https://issues.apache.org/jira/browse/HADOOP-12038 Project

Re: [VOTE] Release Apache Hadoop 2.7.0 RC0

2015-04-13 Thread Chen He
+1 non-binding build from source, deploy to a single node cluster, run wordcount, Terasort, etc. Also run Teragen using DockerContainerExecutor, works fine. Regards! Chen He On Mon, Apr 13, 2015 at 5:43 AM, Junping Du j...@hortonworks.com wrote: +1. (Non-binding) - Download and verify

[jira] [Created] (HADOOP-11811) Fix typos in hadoop-project/pom.xml

2015-04-07 Thread Chen He (JIRA)
Chen He created HADOOP-11811: Summary: Fix typos in hadoop-project/pom.xml Key: HADOOP-11811 URL: https://issues.apache.org/jira/browse/HADOOP-11811 Project: Hadoop Common Issue Type: Bug

[jira] [Created] (HADOOP-11786) Fix Javadoc typos in org.apache.hadoop.fs.FileSystem

2015-04-01 Thread Chen He (JIRA)
Chen He created HADOOP-11786: Summary: Fix Javadoc typos in org.apache.hadoop.fs.FileSystem Key: HADOOP-11786 URL: https://issues.apache.org/jira/browse/HADOOP-11786 Project: Hadoop Common Issue

[jira] [Created] (HADOOP-11759) TockenCache doc has minor problem

2015-03-26 Thread Chen He (JIRA)
Chen He created HADOOP-11759: Summary: TockenCache doc has minor problem Key: HADOOP-11759 URL: https://issues.apache.org/jira/browse/HADOOP-11759 Project: Hadoop Common Issue Type: Bug

[jira] [Created] (HADOOP-11762) Enable swift distcp to secure HDFS

2015-03-26 Thread Chen He (JIRA)
Chen He created HADOOP-11762: Summary: Enable swift distcp to secure HDFS Key: HADOOP-11762 URL: https://issues.apache.org/jira/browse/HADOOP-11762 Project: Hadoop Common Issue Type: Improvement

[jira] [Created] (HADOOP-11750) distcp fails if we copy data from swift to secure HDFS

2015-03-25 Thread Chen He (JIRA)
Chen He created HADOOP-11750: Summary: distcp fails if we copy data from swift to secure HDFS Key: HADOOP-11750 URL: https://issues.apache.org/jira/browse/HADOOP-11750 Project: Hadoop Common

Re: Looking to a Hadoop 3 release

2015-03-02 Thread Chen He
+1 non-binding It is a nice to have hadoop 3.x release. My honor to help. Regards! Chen On Mon, Mar 2, 2015 at 4:58 PM, Zheng, Kai kai.zh...@intel.com wrote: Sorry for the bad. I thought it was sending to my colleagues. By the way, for the JDK8 support, we (Intel) would like to investigate

MRAppMaster running on a docker container failed to load openssl cipher.

2014-12-15 Thread Chen He
Try to run teragen based on hadoop 2.6.0 using docker and met following error: 2014-12-15 04:15:21,385 DEBUG [main] org.apache.hadoop.crypto.OpensslCipher: Failed to load OpenSSL Cipher. java.lang.UnsatisfiedLinkError: org.apache.hadoop.util.NativeCodeLoader.buildSupportsOpenssl()Z at

Re: [VOTE] Release Apache Hadoop 2.6.0

2014-11-14 Thread Chen He
+1 non-binding download and compile source code; setup single node cluster; successfully run sleep job; Regards! Chen On Fri, Nov 14, 2014 at 1:44 AM, Akira AJISAKA ajisa...@oss.nttdata.co.jp wrote: Thanks Arun for creating another rc! +1 (non-binding) - patched Tez 0.5.2 pom to compile

Hadoop maven packaging does not work on JAVA 1.8?

2014-11-10 Thread Chen He
mvn package -Pdist -Dtar -DskipTests reports following error based on latest trunk: [INFO] BUILD FAILURE [INFO] [INFO] Total time: 11.010 s [INFO] Finished at: 2014-11-10T11:23:49-08:00 [INFO] Final Memory: 51M/555M

[jira] [Created] (HADOOP-11292) mvm package reports error when using Java 1.8

2014-11-10 Thread Chen He (JIRA)
Chen He created HADOOP-11292: Summary: mvm package reports error when using Java 1.8 Key: HADOOP-11292 URL: https://issues.apache.org/jira/browse/HADOOP-11292 Project: Hadoop Common Issue Type

Re: Hadoop maven packaging does not work on JAVA 1.8?

2014-11-10 Thread Chen He
for JDK8, might be worth asking him before diving in yourself. On Mon, Nov 10, 2014 at 12:04 PM, Chen He airb...@gmail.com wrote: Thanks, Ted Yu. I will create a JIRA for it. I find a way to fix it. On Mon, Nov 10, 2014 at 11:50 AM, Ted Yu yuzhih...@gmail.com wrote: I can reproduce

Re: [VOTE] Release Apache Hadoop 2.5.1 RC0

2014-09-15 Thread Chen He
+1 non-binding download source code, build from scratch, deploy to a single node, and run sleep job succeed. Regards! Chen On Thu, Sep 11, 2014 at 9:53 PM, Akira AJISAKA ajisa...@oss.nttdata.co.jp wrote: Thanks Karthik for updating the wiki. Now I'm +1 (non-binding). Regards, Akira

[jira] [Resolved] (HADOOP-11020) TestRefreshUserMappings fails

2014-09-10 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen He resolved HADOOP-11020. -- Resolution: Duplicate TestRefreshUserMappings fails

[jira] [Created] (HADOOP-11020) TestRefreshUserMappings fails

2014-08-28 Thread Chen He (JIRA)
Chen He created HADOOP-11020: Summary: TestRefreshUserMappings fails Key: HADOOP-11020 URL: https://issues.apache.org/jira/browse/HADOOP-11020 Project: Hadoop Common Issue Type: Bug

Re: [VOTE] Migration from subversion to git for version control

2014-08-10 Thread Chen He
+1 (non-binding) On Sun, Aug 10, 2014 at 3:44 PM, Jason Lowe jl...@yahoo-inc.com.invalid wrote: +1 Jason On 08/08/2014 09:57 PM, Karthik Kambatla wrote: I have put together this proposal based on recent discussion on this topic. Please vote on the proposal. The vote runs for 7

Re: [VOTE] Release Apache Hadoop 2.5.0 RC2

2014-08-10 Thread Chen He
+1 (non-binding) download source code and build from it (OS is Fedora); deploy to single server; run word count and sleep job succeed. On Sun, Aug 10, 2014 at 6:00 PM, Jason Lowe jl...@yahoo-inc.com.invalid wrote: +1 (binding) - verified signatures and digests - built from source -

Re: [VOTE] Release Apache Hadoop 2.4.1

2014-06-22 Thread Chen He
+1 (non-binding) download source code build binary based on Fedora with Java 1.7 deploy mini cluster and successfully run sleep jobs Regards! Chen On Sun, Jun 22, 2014 at 9:44 PM, Xuan Gong xg...@hortonworks.com wrote: +1 (non-binding) Successfully build from resource code On Sat, Jun

Re: [VOTE] Release Apache Hadoop 0.23.11

2014-06-20 Thread Chen He
+1 (non binding) download source code. compile under Fedora 13 and run sleep job. It works fine Regards! Chen On Fri, Jun 20, 2014 at 9:43 AM, Jean-Baptiste Onofré j...@nanthrax.net wrote: +1 (non binding) Tested with some jobs. Regards JB On 06/20/2014 04:41 PM, Kihwal Lee wrote:

[jira] [Created] (HADOOP-10664) TestNetUtils.testNormalizeHostName failes

2014-06-04 Thread Chen He (JIRA)
Chen He created HADOOP-10664: Summary: TestNetUtils.testNormalizeHostName failes Key: HADOOP-10664 URL: https://issues.apache.org/jira/browse/HADOOP-10664 Project: Hadoop Common Issue Type: Bug

Re: [VOTE] Release Apache Hadoop 2.4.0

2014-04-10 Thread Chen He
+1(non-binding) download source code compile successfully run wordcount and loadgen without problem On Tue, Apr 8, 2014 at 11:11 PM, Tsuyoshi OZAWA ozawa.tsuyo...@gmail.comwrote: Hi Arun, I apologize for the late response. If the problems are recognized correctly, +1 for the

Re: [VOTE] Release Apache Hadoop 2.4.0

2014-04-02 Thread Chen He
+1 non-binding Chen On Wed, Apr 2, 2014 at 12:27 AM, Jean-Baptiste Onofré j...@nanthrax.netwrote: +1 (non binding) Regards JB On 03/31/2014 11:22 AM, Arun C Murthy wrote: Folks, I've created a release candidate (rc0) for hadoop-2.4.0 that I would like to get released. The RC is

Re: [VOTE] Release Apache Hadoop 2.3.0

2014-02-11 Thread Chen He
+1, non-binding successful compiled on MacOS 10.7 deployed to Fedora 7 and run test job without any problem. On Tue, Feb 11, 2014 at 8:49 AM, Arun C Murthy a...@hortonworks.com wrote: Folks, I've created a release candidate (rc0) for hadoop-2.3.0 that I would like to get released. The RC

Re: [VOTE] Merge YARN-321 Generic Application History Service to trunk

2014-01-17 Thread Chen He
As a cluster resource management platform, generic history service is necessary for job-tracing, troubleshooting, fault tolerance, and performance tuning. Like StarterLog in Condor, accounting logs in Torque, and so on. However, generic history service should avoid getting involved into too many