Re: [E] [VOTE] Hadoop 3.1.x EOL

2021-06-07 Thread Kihwal Lee
+1 (binding) On Thu, Jun 3, 2021 at 1:14 AM Akira Ajisaka wrote: > Dear Hadoop developers, > > Given the feedback from the discussion thread [1], I'd like to start > an official vote > thread for the community to vote and start the 3.1 EOL process. > > What this entails: > > (1) an official anno

Re: [E] Re: [DISCUSS] Change project style guidelines to allow line length 100

2021-05-24 Thread Kihwal Lee
+1 for the 100 char limit. But I would have liked 132 columns more. :) Kihwal On Mon, May 24, 2021 at 1:46 PM Sean Busbey wrote: > Hi folks! > > The consensus seems pretty strongly in favor of increasing the line length > limit. Do folks still want to see a formal VOTE thread? > > > > On May 1

[jira] [Resolved] (HADOOP-17533) Server IPC version 9 cannot communicate with client version 4

2021-02-17 Thread Kihwal Lee (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee resolved HADOOP-17533. - Resolution: Invalid > Server IPC version 9 cannot communicate with client versio

[jira] [Resolved] (HADOOP-17517) Non-randomized password used

2021-02-08 Thread Kihwal Lee (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee resolved HADOOP-17517. - Resolution: Invalid > Non-randomized password u

[jira] [Resolved] (HADOOP-17378) java.lang.NoClassDefFoundError: org/apache/hadoop/tracing/SpanReceiverHost

2020-11-12 Thread Kihwal Lee (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee resolved HADOOP-17378. - Resolution: Invalid > java.lang.NoClassDefFoundError: org/apache/hadoop/trac

Re: [VOTE] Release Apache Hadoop 3.1.4 (RC1)

2020-06-23 Thread Kihwal Lee
Gabor, If you want to release asap, you can simply revert HDFS-14941 in the release branch for now. It is causing the issue and was committed after 3.1.3. This causes failure of the automated upgrade process and namenode memory leak. Kihwal On Tue, Jun 23, 2020 at 8:47 AM Akira Ajisaka wrote:

[jira] [Resolved] (HADOOP-17070) LocalFs rename is broken.

2020-06-08 Thread Kihwal Lee (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee resolved HADOOP-17070. - Resolution: Duplicate > LocalFs rename is bro

[jira] [Created] (HADOOP-17070) LocalFs rename is broken.

2020-06-08 Thread Kihwal Lee (Jira)
Kihwal Lee created HADOOP-17070: --- Summary: LocalFs rename is broken. Key: HADOOP-17070 URL: https://issues.apache.org/jira/browse/HADOOP-17070 Project: Hadoop Common Issue Type: Bug

[jira] [Resolved] (HADOOP-17035) Trivial typo(s) which are 'timout', 'interruped' in comment, LOG and documents

2020-05-12 Thread Kihwal Lee (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee resolved HADOOP-17035. - Hadoop Flags: Reviewed Resolution: Fixed Thanks for the patch. I've added you t

[jira] [Resolved] (HADOOP-11610) hadoop-common build fails on JDK9

2020-02-04 Thread Kihwal Lee (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-11610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee resolved HADOOP-11610. - Resolution: Won't Fix > hadoop-common build fails

[jira] [Resolved] (HADOOP-16770) Compare two directories in HDFS filesystem for every 5 mins interval for same cluster. (smiliar like diff command in linux)

2019-12-18 Thread Kihwal Lee (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee resolved HADOOP-16770. - Resolution: Invalid You will probably get more suggestions by asking at the user mailing list

[jira] [Resolved] (HADOOP-16738) Best Big data hadoop training in pune

2019-12-02 Thread Kihwal Lee (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee resolved HADOOP-16738. - Resolution: Invalid > Best Big data hadoop training in p

[jira] [Resolved] (HADOOP-16698) Certificate-based Authentication Support

2019-11-11 Thread Kihwal Lee (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee resolved HADOOP-16698. - Resolution: Duplicate > Certificate-based Authentication Supp

[jira] [Created] (HADOOP-16582) LocalFileSystem's mkdirs() does not work as expected under viewfs.

2019-09-17 Thread Kihwal Lee (Jira)
Kihwal Lee created HADOOP-16582: --- Summary: LocalFileSystem's mkdirs() does not work as expected under viewfs. Key: HADOOP-16582 URL: https://issues.apache.org/jira/browse/HADOOP-16582 Project: H

[jira] [Created] (HADOOP-16524) Automatic keystore reloading for HttpServer2

2019-08-21 Thread Kihwal Lee (Jira)
Kihwal Lee created HADOOP-16524: --- Summary: Automatic keystore reloading for HttpServer2 Key: HADOOP-16524 URL: https://issues.apache.org/jira/browse/HADOOP-16524 Project: Hadoop Common Issue

Re: [VOTE] Mark 2.6, 2.7, 3.0 release lines EOL

2019-08-21 Thread Kihwal Lee
+1 Kihwal On Tue, Aug 20, 2019 at 10:03 PM Wangda Tan wrote: > Hi all, > > This is a vote thread to mark any versions smaller than 2.7 (inclusive), > and 3.0 EOL. This is based on discussions of [1] > > This discussion runs for 7 days and will conclude on Aug 28 Wed. > > Please feel free to sha

[jira] [Created] (HADOOP-16517) Allow optional mutual TLS in HttpServer2

2019-08-15 Thread Kihwal Lee (JIRA)
Kihwal Lee created HADOOP-16517: --- Summary: Allow optional mutual TLS in HttpServer2 Key: HADOOP-16517 URL: https://issues.apache.org/jira/browse/HADOOP-16517 Project: Hadoop Common Issue Type

Re: HDFS Scalability Limit?

2019-06-13 Thread Kihwal Lee
Hi Wei-Chiu, We have experience with 5,000 - 6,000 node clusters. Although it ran/runs fine, any heavy hitter activities such as decommissioning needed to be carefully planned. In terms of files and blocks, we have multiple clusters running stable with over 500M files and blocks. Some at over

Re: About supporting upcoming java versions

2018-11-05 Thread Kihwal Lee
+1 It makes sense to converge on the LTS version. Thanks for the initiative. 73 Kihwal On Sun, Nov 4, 2018 at 10:10 PM Takanobu Asanuma wrote: > Hi all, > > As discussed in HADOOP-11123, we stop fixing incompatibilities of JDK9 and > JDK10, and would like to focus on supporting JDK11. > This we

Re: [VOTE] Release Apache Hadoop 2.8.5 (RC0)

2018-09-12 Thread Kihwal Lee
+1 (binding) - Built from source - Brought up a single node cluster - Checked basic HDFS functions and checked the UIs - Ran several simple jobs. On Mon, Sep 10, 2018 at 7:01 AM 俊平堵 wrote: > Hi all, > > I've created the first release candidate (RC0) for Apache > Hadoop 2.8.5. This is our

[jira] [Created] (HADOOP-15614) TestGroupsCaching.testExceptionOnBackgroundRefreshHandled reliably fails

2018-07-17 Thread Kihwal Lee (JIRA)
Kihwal Lee created HADOOP-15614: --- Summary: TestGroupsCaching.testExceptionOnBackgroundRefreshHandled reliably fails Key: HADOOP-15614 URL: https://issues.apache.org/jira/browse/HADOOP-15614 Project

Re: [VOTE] Release Apache Hadoop 2.7.7

2018-07-16 Thread Kihwal Lee
+1 (binding) -Built from the source -Brought up a single node pseudo-distributed cluster -Ran basic tests -Verified basic hdfs and dfsadmin commands working On Wed, Jul 11, 2018 at 10:05 AM Steve Loughran wrote: > > > Hi > > I've got RC0 of Hadoop 2.7.7 up for people to download and play with >

Broken build env

2018-05-17 Thread Kihwal Lee
Simple commit builds are failing often https://builds.apache.org/job/Hadoop-trunk-Commit/ Many trunk builds are failing on H19. "protoc version is 'libprotoc 2.6.1', expected version is '2.5.0' " On H4, a cmake version problem was seen. The commit builds don't seem to be running in a docker con

Re: Apache Hadoop 3.0.1 Release plan

2018-02-08 Thread Kihwal Lee
HADOOP-14060 is a blocker. Daryn will add more detail to the jira or to this thread. On Thu, Feb 8, 2018 at 7:01 AM, Brahma Reddy Battula wrote: > Hi Eddy, > > HDFS-12990 got committed to 3.0.1,can we have RC for 3.0.1 (only YARN-5742 > blocker is open ) ? > > > On Sat, Feb 3, 2018 at 12:40 A

[jira] [Resolved] (HADOOP-15213) JniBasedUnixGroupsNetgroupMapping.java and ShellBasedUnixGroupsNetgroupMapping.java use netgroup.substring(1)

2018-02-07 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee resolved HADOOP-15213. - Resolution: Invalid > JniBasedUnixGroupsNetgroupMapping.java

Re: [VOTE] Release Apache Hadoop 2.7.5 (RC1)

2017-12-11 Thread Kihwal Lee
+1 (binding) - checked out the rc1 tag and built the source (-Pdist -Pnative) - brought up a pseudo distributed cluster - ran sample MR jobs - verified web UIs working. On Thu, Dec 7, 2017 at 9:22 PM, Konstantin Shvachko wrote: > Hi everybody, > > I updated CHANGES.txt and fixed documentation li

Re: why the doxia-snapshot dependency

2017-09-06 Thread Kihwal Lee
Allen mentioned the reason in HADOOP-14364. I guess 1.7 does not work. 1.8 is not released yet. Kihwal On Wed, Sep 6, 2017 at 9:20 AM, Steve Loughran wrote: > > Every morning my laptop downloads the doxia 1.8 snapshot for its build > > [INFO] > [INFO] --- maven-site-plugin:3.6:attach-descripto

Re: [VOTE] Merge HADOOP-13345 (S3Guard feature branch)

2017-08-24 Thread Kihwal Lee
+1 (binding) Great work guys! On Thu, Aug 24, 2017 at 5:01 AM, Steve Loughran wrote: > > On 23 Aug 2017, at 19:21, Aaron Fabbri mailto:fa > b...@cloudera.com>> wrote: > > > On Tue, Aug 22, 2017 at 10:24 AM, Steve Loughran mailto:ste...@hortonworks.com>> wrote: > video being processed: https://

Re: Apache Hadoop 2.8.2 Release Plan

2017-07-21 Thread Kihwal Lee
Thanks for driving the next 2.8 release, Junping. While I was committing a blocker for 2.7.4, I noticed some of the jiras are back-ported to 2.7, but missing in branch-2.8.2.  Perhaps it is safer and easier to simply rebranch 2.8.2. Thanks,Kihwal On Thursday, July 20, 2017, 3:32:16 PM CDT, Junp

[jira] [Created] (HADOOP-14607) NPE while getting list of live nodes via jmx

2017-06-28 Thread Kihwal Lee (JIRA)
Kihwal Lee created HADOOP-14607: --- Summary: NPE while getting list of live nodes via jmx Key: HADOOP-14607 URL: https://issues.apache.org/jira/browse/HADOOP-14607 Project: Hadoop Common Issue

[jira] [Resolved] (HADOOP-14146) KerberosAuthenticationHandler should authenticate with SPN in AP-REQ

2017-06-23 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee resolved HADOOP-14146. - Resolution: Fixed > KerberosAuthenticationHandler should authenticate with SPN in AP-

[jira] [Reopened] (HADOOP-14146) KerberosAuthenticationHandler should authenticate with SPN in AP-REQ

2017-06-23 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee reopened HADOOP-14146: - > KerberosAuthenticationHandler should authenticate with SPN in AP-

[jira] [Created] (HADOOP-14514) Successfully closed file can stay under-replicated.

2017-06-09 Thread Kihwal Lee (JIRA)
Kihwal Lee created HADOOP-14514: --- Summary: Successfully closed file can stay under-replicated. Key: HADOOP-14514 URL: https://issues.apache.org/jira/browse/HADOOP-14514 Project: Hadoop Common

[jira] [Created] (HADOOP-14368) ExitUtil change by YARN-679 breaks HDFS tests

2017-05-01 Thread Kihwal Lee (JIRA)
Kihwal Lee created HADOOP-14368: --- Summary: ExitUtil change by YARN-679 breaks HDFS tests Key: HADOOP-14368 URL: https://issues.apache.org/jira/browse/HADOOP-14368 Project: Hadoop Common Issue

[jira] [Resolved] (HADOOP-13796) Standby namenode didnot change its role

2016-11-07 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee resolved HADOOP-13796. - Resolution: Invalid > Standby namenode didnot change its r

[jira] [Resolved] (HADOOP-13788) datatransfer.Receiver.processOp error

2016-11-04 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee resolved HADOOP-13788. - Resolution: Invalid > datatransfer.Receiver.processOp er

[jira] [Created] (HADOOP-13671) Fix ClassFormatException during trunk build.

2016-09-30 Thread Kihwal Lee (JIRA)
Kihwal Lee created HADOOP-13671: --- Summary: Fix ClassFormatException during trunk build. Key: HADOOP-13671 URL: https://issues.apache.org/jira/browse/HADOOP-13671 Project: Hadoop Common Issue

Re: Is anyone seeing this during trunk build?

2016-09-30 Thread Kihwal Lee
on did the workaround. I will file a jira to update maven-project-info-reports-plugin. Kihwal From: Arun Suresh To: Kihwal Lee Cc: Ted Yu ; Hdfs-dev ; Hadoop Common Sent: Thursday, September 29, 2016 6:58 PM Subject: Re: Is anyone seeing this during trunk build? It looks l

Re: Is anyone seeing this during trunk build?

2016-09-29 Thread Kihwal Lee
fault locale: en_US, platform encoding: UTF-8 OS name: "mac os x", version: "10.11.3", arch: "x86_64", family: "mac" FYI On Wed, Sep 28, 2016 at 3:54 PM, Kihwal Lee wrote: > I just noticed this during a trunk build. I was doing "mvn clean install &g

Is anyone seeing this during trunk build?

2016-09-28 Thread Kihwal Lee
I just noticed this during a trunk build. I was doing "mvn clean install -DskipTests".  The build succeeds. Is anyone seeing this?  I am using openjdk8u102. === [WARNING] Unable to process class org/apache/hadoop/hdfs/StripeReader.class in JarAnalyzer File /home1/kihwal/devel/apache/hadoo

[jira] [Resolved] (HADOOP-13657) IPC Reader thread could silently die and leave NameNode unresponsive

2016-09-28 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee resolved HADOOP-13657. - Resolution: Duplicate > IPC Reader thread could silently die and leave NameNode unrespons

Re: how about syncing namenode metadata to glusterfs?

2016-09-13 Thread Kihwal Lee
We do. :) Yes, it needs other fencing method. Kihwal From: Andrew Wang To: Zhe Zhang Cc: Levi Nie ; "common-dev@hadoop.apache.org" Sent: Tuesday, September 13, 2016 12:46 PM Subject: Re: how about syncing namenode metadata to glusterfs? This is a similar idea to NFS HA, which yo

[jira] [Resolved] (HADOOP-13425) IPC layer optimizations

2016-09-09 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee resolved HADOOP-13425. - Resolution: Fixed > IPC layer optimizations > --- > >

Re: [Release thread] 2.6.5 release activities

2016-08-12 Thread Kihwal Lee
You might want the snapshot bug fix done in HDFS-7056. This bug creates snapshot filediffs even if you never use snapshot. For 2.6, we will have to do it in a separate jira to pick up the fix only. Related to this, HDFS-9696 might be of interest too. Kihwal From: Chris Trezzo To: Karthi

[jira] [Resolved] (HADOOP-13429) Dispose of unnecessary SASL servers

2016-08-02 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee resolved HADOOP-13429. - Resolution: Fixed Fix Version/s: 3.0.0-alpha2 2.9.0 > Dispose

Re: 2.7.3 release plan

2016-04-06 Thread Kihwal Lee
Just reverted HDFS-8791 from branch-2.7.Eulogy: Although it has ascended to a better version, it did caught an upgrade bug while in branch-2.7. Kihwal From: Vinod Kumar Vavilapalli To: yarn-...@hadoop.apache.org Cc: Hadoop Common ; hdfs-...@hadoop.apache.org; mapreduce-...@hadoop.apach

Re: Looking to a Hadoop 3 release

2016-02-18 Thread Kihwal Lee
Moving Hadoop 3 forward sounds fine. If EC is one of the main motivations, are we getting rid of branch-2.8? Kihwal From: Andrew Wang To: "common-dev@hadoop.apache.org" Cc: "yarn-...@hadoop.apache.org" ; "mapreduce-...@hadoop.apache.org" ; hdfs-dev Sent: Thursday, February 18, 201

Re: [Important] What is the practical maximum HDFS blocksize used in clusters?

2016-02-16 Thread Kihwal Lee
There can be issues coming from the assumption that normal block replication takes under x seconds. Until recently, the partial block copying during pipeline recoveries made such an assumption. We saw the copies were often not complete in 20 seconds even with 384MB blocks on busy systems. This h

Re: 'Target Version' field missing in Jira

2016-02-12 Thread Kihwal Lee
It's still here: https://issues.apache.org/jira/plugins/servlet/project-config/HDFS/fields But somehow not showing up on pages. Kihwal From: Arpit Agarwal To: "common-dev@hadoop.apache.org" ; "hdfs-...@hadoop.apache.org" Sent: Friday, February 12, 2016 1:52 PM Subject: 'Target Versi

Re: [VOTE] Release Apache Hadoop 2.7.2 RC2

2016-01-20 Thread Kihwal Lee
+1 (binding)Checked out the source and built.Ran basic hdfs and mapred tests on a single node cluster Kihwal From: Vinod Kumar Vavilapalli To: Hadoop Common ; hdfs-...@hadoop.apache.org; yarn-...@hadoop.apache.org; mapreduce-...@hadoop.apache.org Sent: Thursday, January 14, 2016 10:

Re: [VOTE] Release Apache Hadoop 2.7.2 RC1

2015-12-21 Thread Kihwal Lee
+1 (binding)- Verified the signature/digest. - I've built the dist tree with the native support from the source.- Brought up a single node cluster and ran a set of basic tests. From: Vinod Kumar Vavilapalli To: Hadoop Common ; hdfs-...@hadoop.apache.org; yarn-...@hadoop.apache.org; ma

Re: [VOTE] Release Apache Hadoop 2.7.2 RC0

2015-11-13 Thread Kihwal Lee
We found HDFS-9426. The rolling upgrade finalization is not backward compatible.I.e. 2.7.1 or 2.6.x datanodes will ignore finalization. So -1. Kihwal From: Vinod Kumar Vavilapalli To: common-dev@hadoop.apache.org; hdfs-...@hadoop.apache.org; yarn-...@hadoop.apache.org; mapreduce-...@hado

Re: 2.7.2 release plan

2015-10-28 Thread Kihwal Lee
I will try to get them in or bug Daryn. HDFS-8498 doesn't seem a new bug, so I kicked it out to 2.7.3. Kihwal From: Vinod Vavilapalli To: "common-dev@hadoop.apache.org" ; Kihwal Lee Cc: "hdfs-...@hadoop.apache.org" ; Chris Nauroth ; "yarn-...@ha

Re: 2.7.2 release plan

2015-10-27 Thread Kihwal Lee
I think we need HDFS-8950 and HDFS-7725 in 2.7.2.It should be easy to backport/cherry-pick HDFS-7725. For HDFS-8950, it will be nice if Ming can chime in. Kihwal From: Tsuyoshi Ozawa To: "common-dev@hadoop.apache.org" Cc: Chris Nauroth ; "yarn-...@hadoop.apache.org" ; "hdfs-...@hadoop

Re: hadoop-hdfs-client splitoff is going to break code

2015-10-23 Thread Kihwal Lee
I think a lot of "client-side" tests use MiniDFSCluster. I know mechanical division is possible, but what about test coverage? Kihwal From: Haohui Mai To: hdfs-...@hadoop.apache.org; Kihwal Lee Cc: "common-dev@hadoop.apache.org" Sent: Friday, October 23, 2015

Re: hadoop-hdfs-client splitoff is going to break code

2015-10-23 Thread Kihwal Lee
I am not sure whether it was mentioned by anyone before, butI noticed that client only changes do not trigger running anytest in hdfs-precommit. This is because hadoop-hdfs-client does nothave any test. Kihwal From: Colin P. McCabe To: "hdfs-...@hadoop.apache.org" Cc: "common-dev@hadoo

[jira] [Reopened] (HADOOP-12418) failure of TestRPC.testRPCInterruptedSimple on java 8 jenkins

2015-10-19 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee reopened HADOOP-12418: - Assignee: Kihwal Lee > failure of TestRPC.testRPCInterruptedSimple on java 8 jenk

Re: [DISCUSS] About the details of JDK-8 support

2015-10-13 Thread Kihwal Lee
sun.security.krb5.KrbApReq was creating a static MD5 digest object and not synchronizing access. This has been fixed in jdk8u60. http://hg.openjdk.java.net/jdk8u/jdk8u60/jdk/rev/02d6b1096e89 One of the visible symptom is RPC reader thread getting ArrayIndexOutOfBoundsException from sun.securi

[jira] [Created] (HADOOP-12464) Interrupted client may try to fail-over and retry

2015-10-07 Thread Kihwal Lee (JIRA)
Kihwal Lee created HADOOP-12464: --- Summary: Interrupted client may try to fail-over and retry Key: HADOOP-12464 URL: https://issues.apache.org/jira/browse/HADOOP-12464 Project: Hadoop Common

Re: Request to correct misinformation

2015-05-11 Thread Kihwal Lee
Kaori, HADOOP-11955 has been filed. Thanks for reporting the issue.Please use jira for reporting bugs in the future. Thanks,Kihwal From: David Nalley To: 有江香織 ; common-dev@hadoop.apache.org Cc: webmas...@apache.org Sent: Saturday, May 9, 2015 9:12 PM Subject: Re: Request to correct mi

[jira] [Created] (HADOOP-11955) A typo in the cluster setup doc

2015-05-11 Thread Kihwal Lee (JIRA)
Kihwal Lee created HADOOP-11955: --- Summary: A typo in the cluster setup doc Key: HADOOP-11955 URL: https://issues.apache.org/jira/browse/HADOOP-11955 Project: Hadoop Common Issue Type: Bug

[jira] [Created] (HADOOP-11940) TestTraceAdmin fails

2015-05-08 Thread Kihwal Lee (JIRA)
Kihwal Lee created HADOOP-11940: --- Summary: TestTraceAdmin fails Key: HADOOP-11940 URL: https://issues.apache.org/jira/browse/HADOOP-11940 Project: Hadoop Common Issue Type: Bug

Re: [VOTE] Release Apache Hadoop 2.7.0 RC0

2015-04-15 Thread Kihwal Lee
+1 (binding)Built the source from the tag and ran basic test on pseudo distributed cluster. Kihwal From: Vinod Kumar Vavilapalli To: common-dev@hadoop.apache.org; hdfs-...@hadoop.apache.org; yarn-...@hadoop.apache.org; mapreduce-...@hadoop.apache.org Cc: vino...@apache.org Sent: Frida

[jira] [Resolved] (HADOOP-11721) switch jenkins patch tester to use git clean instead of mvn clean

2015-03-18 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee resolved HADOOP-11721. - Resolution: Fixed > switch jenkins patch tester to use git clean instead of mvn cl

Erratic Jenkins behavior

2015-02-05 Thread Kihwal Lee
I am sure many of us have seen strange jenkins behavior out of the precommit builds. - build artifacts missing - serving build artifact belonging to another build. This also causes wrong precommit results to be posted on the bug. - etc. The latest one I saw is disappearance of the unit test st

[jira] [Resolved] (HADOOP-9136) Support per-server IPC configuration

2015-01-29 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-9136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee resolved HADOOP-9136. Resolution: Fixed Target Version/s: 2.0.3-alpha, 3.0.0 (was: 3.0.0, 2.0.3-alpha

[jira] [Created] (HADOOP-11518) Prefix-based per-RPC server configuration

2015-01-29 Thread Kihwal Lee (JIRA)
Kihwal Lee created HADOOP-11518: --- Summary: Prefix-based per-RPC server configuration Key: HADOOP-11518 URL: https://issues.apache.org/jira/browse/HADOOP-11518 Project: Hadoop Common Issue Type

[jira] [Created] (HADOOP-11426) Fix native bzip2 codec build dependency

2014-12-18 Thread Kihwal Lee (JIRA)
Kihwal Lee created HADOOP-11426: --- Summary: Fix native bzip2 codec build dependency Key: HADOOP-11426 URL: https://issues.apache.org/jira/browse/HADOOP-11426 Project: Hadoop Common Issue Type

[jira] [Resolved] (HADOOP-11235) execute maven plugin(compile-protoc) failed

2014-11-04 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee resolved HADOOP-11235. - Resolution: Not a Problem > execute maven plugin(compile-protoc) fai

mapreduce precommit build does not show test results

2014-09-15 Thread Kihwal Lee
Ever since build #8430 in 8/29, test results are not showing up.  I see there was build config changes around that time. Anyone with the right permission care to take a look? Thanks,Kihwal

Re: [VOTE] Migration from subversion to git for version control

2014-08-11 Thread Kihwal Lee
+1 (binding) Kihwal On 8/8/14, 9:57 PM, "Karthik Kambatla" wrote: >I have put together this proposal based on recent discussion on this >topic. > >Please vote on the proposal. The vote runs for 7 days. > > 1. Migrate from subversion to git for version control. > 2. Force-push to be disabled

Re: Jenkins build fails

2014-07-09 Thread Kihwal Lee
Now builds are failing because of this. Please make sure build works with "-Pnative". [exec] CMake Error at /usr/share/cmake-2.8/Modules/FindPackageHandleStandardArgs.cmake:108 (message): [exec] Could NOT find PkgConfig (missing: PKG_CONFIG_EXECUTABLE) [exec] Call Stack (most recent

Re: [VOTE] Change by-laws on release votes: 5 days instead of 7

2014-06-25 Thread Kihwal Lee
+1 (binding) Kihwal On 6/24/14, 3:53 AM, "Arun C Murthy" wrote: >Folks, > > As discussed, I'd like to call a vote on changing our by-laws to change >release votes from 7 days to 5. > > I've attached the change to by-laws I'm proposing. > > Please vote, the vote will the usual period of 7 days.

Re: [VOTE] Release Apache Hadoop 2.4.1

2014-06-20 Thread Kihwal Lee
>> Thanks for the feedback Vinod, Akira & Kihwal. >> >> I'll re-spin rc1 with MAPREDUCE-5830 & HDFS-6527. >> >> @Kihwal - Can you, please, merge HDFS-6527 to branch-2.4 and >>branch-2.4.1? >> >> thanks, >> Arun >> >> On Ju

Re: [VOTE] Release Apache Hadoop 0.23.11

2014-06-20 Thread Kihwal Lee
Checked out the source, built and started a single node cluster. Ran a couple of sample jobs. +1 (binding) Kihwal On 6/19/14, 10:14 AM, "Thomas Graves" wrote: >Hey Everyone, > >There have been various bug fixes that have went into >branch-0.23 since the 0.23.10 release. We think its time to d

Re: [VOTE] Release Apache Hadoop 2.4.1

2014-06-20 Thread Kihwal Lee
If we ever respin 2.4.1, I strongly suggest HDFS-6527 be included. Kihwal On 6/19/14, 4:56 PM, "Akira AJISAKA" wrote: >I think we should include this issue in 2.4.1, so I uploaded a patch to >fix it. I'll appreciate your review. > >Thanks, >Akira > >(2014/06/18 12:13), Vinod Kumar Vavilapalli

Re: #Contributors on JIRA

2014-05-16 Thread Kihwal Lee
I removed a bunch who have been inactive for years a couple of months ago from hdfs. Having a limit forces us to remove stale entries, so it is not entirely bad. If the actual number of contributors reach the limit and the limit can't be changed easily, we might be able to create another jira gro

[jira] [Resolved] (HADOOP-10588) Workaround for jetty6 acceptor startup issue

2014-05-16 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee resolved HADOOP-10588. - Resolution: Fixed Fix Version/s: 2.5.0 0.23.11 Hadoop Flags

[jira] [Resolved] (HADOOP-10411) TestCacheDirectives.testExceedsCapacity fails occasionally

2014-05-13 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee resolved HADOOP-10411. - Resolution: Duplicate > TestCacheDirectives.testExceedsCapacity fails occasiona

[jira] [Created] (HADOOP-10527) Fix incorrect return code and allow more retries on EINTR

2014-04-21 Thread Kihwal Lee (JIRA)
Kihwal Lee created HADOOP-10527: --- Summary: Fix incorrect return code and allow more retries on EINTR Key: HADOOP-10527 URL: https://issues.apache.org/jira/browse/HADOOP-10527 Project: Hadoop Common

[jira] [Created] (HADOOP-10522) JniBasedUnixGroupMapping mishandles errors

2014-04-18 Thread Kihwal Lee (JIRA)
Kihwal Lee created HADOOP-10522: --- Summary: JniBasedUnixGroupMapping mishandles errors Key: HADOOP-10522 URL: https://issues.apache.org/jira/browse/HADOOP-10522 Project: Hadoop Common Issue

Re: Policy on adding timeouts to tests

2014-04-18 Thread Kihwal Lee
The most common mistake is making incorrect assumptions on test/component run-time. We often forget how slower/faster things can be on different platforms and how the load on the machine at the time of test execution affect the run time. If not sure, leave it to surefire. If things run generally s

[jira] [Created] (HADOOP-10454) Provide FileContext version of har file system

2014-04-01 Thread Kihwal Lee (JIRA)
Kihwal Lee created HADOOP-10454: --- Summary: Provide FileContext version of har file system Key: HADOOP-10454 URL: https://issues.apache.org/jira/browse/HADOOP-10454 Project: Hadoop Common Issue

[jira] [Created] (HADOOP-10442) Group look-up can cause segmentation fault when certain JNI-based mapping module is used.

2014-03-26 Thread Kihwal Lee (JIRA)
Kihwal Lee created HADOOP-10442: --- Summary: Group look-up can cause segmentation fault when certain JNI-based mapping module is used. Key: HADOOP-10442 URL: https://issues.apache.org/jira/browse/HADOOP-10442

[jira] [Resolved] (HADOOP-9986) HDFS Compatible ViewFileSystem

2014-03-25 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-9986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee resolved HADOOP-9986. Resolution: Invalid > HDFS Compatible ViewFileSys

[jira] [Created] (HADOOP-10315) Log the original exception when getGroups() fail in UGI.

2014-01-30 Thread Kihwal Lee (JIRA)
Kihwal Lee created HADOOP-10315: --- Summary: Log the original exception when getGroups() fail in UGI. Key: HADOOP-10315 URL: https://issues.apache.org/jira/browse/HADOOP-10315 Project: Hadoop Common

[jira] [Created] (HADOOP-10314) The ls command help still shows outdated 0.16 format.

2014-01-30 Thread Kihwal Lee (JIRA)
Kihwal Lee created HADOOP-10314: --- Summary: The ls command help still shows outdated 0.16 format. Key: HADOOP-10314 URL: https://issues.apache.org/jira/browse/HADOOP-10314 Project: Hadoop Common

Re: Logistics for releasing 2.4

2014-01-24 Thread Kihwal Lee
Thanks for the list, Jason.  I scanned through them and except HDFS-5356, all jiras were currently targeted for 2.4.0. I changed the target version of HDFS-5356 to 2.4.0, so now all are targeted for 2.4.0. Assuming "2.3.0" label is clean and doesn't need any mass/batch update, I think we can go

[jira] [Resolved] (HADOOP-6239) Command-line for append

2013-12-10 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-6239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee resolved HADOOP-6239. Resolution: Duplicate > Command-line for append > --- > >

Re: [VOTE] Release Apache Hadoop 0.23.10

2013-12-03 Thread Kihwal Lee
I've built the tag and ran some basic tests on a single node cluster. +1 (binding) Kihwal On Tuesday, December 3, 2013 12:24 AM, Thomas Graves wrote: Hey Everyone, There have been lots of improvements and bug fixes that have went into branch-0.23 since the 0.23.9 release.  We think its ti

[jira] [Created] (HADOOP-10111) Allow DU to be initialized with an initial value

2013-11-18 Thread Kihwal Lee (JIRA)
Kihwal Lee created HADOOP-10111: --- Summary: Allow DU to be initialized with an initial value Key: HADOOP-10111 URL: https://issues.apache.org/jira/browse/HADOOP-10111 Project: Hadoop Common

Re: [VOTE] Release Apache Hadoop 2.2.0

2013-10-09 Thread Kihwal Lee
+1  Ran a set of tests against a single node cluster. Kihwal On Monday, October 7, 2013 2:02 AM, Arun C Murthy wrote: Folks, I've created a release candidate (rc0) for hadoop-2.2.0 that I would like to get released - this release fixes a small number of bugs and some protocol/api issues w

[jira] [Created] (HADOOP-9981) listing in RawLocalFileSystem is inefficient

2013-09-19 Thread Kihwal Lee (JIRA)
Kihwal Lee created HADOOP-9981: -- Summary: listing in RawLocalFileSystem is inefficient Key: HADOOP-9981 URL: https://issues.apache.org/jira/browse/HADOOP-9981 Project: Hadoop Common Issue Type

[jira] [Resolved] (HADOOP-9882) Trunk doesn't compile

2013-08-19 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-9882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee resolved HADOOP-9882. Resolution: Not A Problem > Trunk doesn't

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-08-16 Thread Kihwal Lee
I've changed the target version of HADOOP-9880 to 2.1.1.  Please change it back, if you feel that it needs to be in 2.1.0-beta. Kihwal From: Kihwal Lee To: Arun Murthy ; "common-dev@hadoop.apache.org" Cc: "mapreduce-...@hadoop.

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-08-16 Thread Kihwal Lee
It's your call, Arun.  I.e. as long you believe rc2 meets the expectations and objectives of 2.1.0-beta. Kihwal From: Arun Murthy To: "common-dev@hadoop.apache.org" Cc: Kihwal Lee ; "mapreduce-...@hadoop.apache.org" ; "hdfs-.

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-08-16 Thread Kihwal Lee
We have found HADOOP-9880, which prevents Namenode HA from running with security. Kihwal From: Arun C Murthy To: "common-dev@hadoop.apache.org" ; "hdfs-...@hadoop.apache.org" ; "mapreduce-...@hadoop.apache.org" ; "yarn-...@hadoop.apache.org" Sent: Thurs

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-08-16 Thread Kihwal Lee
We have found HADOOP-9880, which prevents Namenode HA from running with security. Kihwal From: Arun C Murthy To: "common-dev@hadoop.apache.org" ; "hdfs-...@hadoop.apache.org" ; "mapreduce-...@hadoop.apache.org" ; "yarn-...@hadoop.apache.org" Sent: Thursda

[jira] [Created] (HADOOP-9880) RPC Server should not unconditionally create SaslServer with Token auth.

2013-08-15 Thread Kihwal Lee (JIRA)
Kihwal Lee created HADOOP-9880: -- Summary: RPC Server should not unconditionally create SaslServer with Token auth. Key: HADOOP-9880 URL: https://issues.apache.org/jira/browse/HADOOP-9880 Project: Hadoop

[jira] [Resolved] (HADOOP-7883) Upgrade to Avro 1.5.4

2013-08-09 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-7883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee resolved HADOOP-7883. Resolution: Duplicate > Upgrade to Avro 1.5.4 > - > >

  1   2   >