Re: Managing docs with hadoop-1 hadoop-2

# Have stable1/stable2 links: http://hadoop.apache.org/docs/stable1 - hadoop-1.x http://hadoop.apache.org/docs/stable2 - hadoop-2.x +1, would also make: current - stable2(since v2 is the latest) stable - stable1 (for compatibility) +1, Eli's proposal looks good to me. -

Re: [VOTE] Release Apache Hadoop 2.3.0

+1 (non-binding) - Upgraded HDFS including snapshots from 2.2. - Ran a few sample jobs. - WebUI looks good. Thanks, Akira (2014/02/12 7:09), Karthik Kambatla wrote: +1 (non-binding) Built source. Brought up a pseudo-cluster with manual RM HA. Ran a few MR examples. On Tue, Feb 11, 2014

The Activities of Apache Hadoop Community

Hi all, We collected and analyzed JIRA tickets to investigate the activities of Apache Hadoop Community in 2013. http://ajisakaa.blogspot.com/2014/02/the-activities-of-apache-hadoop.html We counted the number of the organizations, the lines of code, and the number of the issues. As a result, we

Re: question about reduce method

Moving to u...@hadoop.apache.org. If you have a question about this, please reply to user mailing list instead of mapreduce-dev@. Thanks, Akira (2014/02/17 10:06), Akira AJISAKA wrote: I know map method put these text file into map,like follows,right? 001, 35.99 001, 35.99 002, 12.49 004

Porting MapReduce document to trunk

Hi developers, I found several MapReduce documents such as MapReduce tutorial, Hadoop Streaming, Hadoop Archives, and DistCp are not ported to trunk. I created some patches for porting them. * MAPREDUCE-5636 * MAPREDUCE-5637 * MAPREDUCE-5638 * MAPREDUCE-5639 Now newcomers have to refer branch-1

Re: Porting MapReduce document to trunk

I compiled the documents with the porting patches and uploaded them to http://aajisaka.github.io/hadoop-project/ . I'll appreciate the patches will be reviewed and finally merged in. Thanks, Akira (2014/02/17 15:35), Akira AJISAKA wrote: Hi developers, I found several MapReduce documents

Re: Thinking ahead

+1 (non-binding) for 2.4.1 release. We can debate whether or June is too early for hadoop-2.5 and it's contents, but I recollect there was consensus that releases every 6 weeks (or so) makes sense. Also, +1 (non-binding) for the 6 weeks (or so) timeline releases. However, I'm thinking it's

Re: Update interval of default counters

Moved to u...@hadoop.apache.org. You can configure the interval by setting mapreduce.client.progressmonitor.pollinterval parameter. The default value is 1000 ms. For more details, please see

Moving 2.4.0 to released version in MapReduce project

Hi JIRA admins, Hadoop 2.4.0 was released, but 2.4.0 is now unreleased and instead 2.2.1 is released in the JIRA. Would you please fix it? Thanks, Akira

Re: Update interval of default counters

. I want to get more finer values, instead of directly jumping from 280 to 516. Did that make sense? mapreduce.client.progressmonitor.pollinterval does not seem to effect it. Any workaround ? Thanks, Dharmesh On Tue, Apr 15, 2014 at 7:51 PM, Akira AJISAKA ajisa...@oss.nttdata.co.jpwrote: Moved

Re: Update interval of default counters

source code. I am willing to take the issue and contribute if required. Thanks, Dharmesh On Wed, Apr 16, 2014 at 3:14 PM, Akira AJISAKA ajisa...@oss.nttdata.co.jpwrote: Moved mapreduce-dev@ to Bcc. Hi Dharmesh, The parameter is to set the interval of polling the progress of the MRAppMaster

Re: hadoop-2.4.1

Hi Arun, I'd like to know when to release Hadoop 2.4.1. It looks like all of the blockers have been resolved. Thanks, Akira (2014/04/24 5:59), Arun C Murthy wrote: Folks, Here is a handy short-cut to track 2.4.1: http://s.apache.org/hadoop-2.4.1-blockers I'm hoping we can get the

Re: [VOTE] Release Apache Hadoop 2.4.1

I think we should include this issue in 2.4.1, so I uploaded a patch to fix it. I'll appreciate your review. Thanks, Akira (2014/06/18 12:13), Vinod Kumar Vavilapalli wrote: There is one item [MAPREDUCE-5830 HostUtil.getTaskLogUrl is not backwards binary compatible with 2.3] marked for 2.4.

Re: hadoop-2.5 - June end?

Extended attributes (HDFS-2006) is already merged to branch-2, so I'll update the Roadmap wiki to change it from 2.6 to 2.5. Please correct me if I am wrong. Thanks, Akira (2014/06/23 16:28), Tsuyoshi OZAWA wrote: IMHO, I'd like to +1 to include YARN-1492 and work-preserving restart in 2.6. I

Re: [VOTE] Change by-laws on release votes: 5 days instead of 7

+1 (non-binding) (2014/06/24 10:33), Zhijie Shen wrote: +1 (non-binding) On Wed, Jun 25, 2014 at 1:26 AM, Aaron T. Myers a...@cloudera.com wrote: +1 (binding) -- Aaron T. Myers Software Engineer, Cloudera On Tue, Jun 24, 2014 at 1:53 AM, Arun C Murthy a...@hortonworks.com wrote: Folks,

Re: Moving to JDK7, JDK8 and new major releases

+1 (non-binding) for 2.5 to be the last release to ensure JDK6. My higher-level goal though is to avoid going through this same pain again when JDK7 goes EOL. I'd like to do a JDK8-based release before then for this reason. This is why I suggested skipping an intermediate 2.x+JDK7 release

Jenkins build fails

Hi Hadoop developers, Now Jenkins is failing with the below message. I'm thinking this is caused by the upgrade of Jenkins server. After the upgrade, the version of svn client was also upgraded, so the following errors occurred. It will be fixed by executing 'svn upgrade' before executing other

Re: Jenkins build fails

Filed https://issues.apache.org/jira/browse/HADOOP-10804 Please correct me if I am wrong.. Thanks, Akira (2014/07/09 11:24), Akira AJISAKA wrote: Hi Hadoop developers, Now Jenkins is failing with the below message. I'm thinking this is caused by the upgrade of Jenkins server. After

Re: [VOTE] Release Apache Hadoop 2.5.0 RC2

-1 (non-binding) + downloaded tarball and deployed HDFS-HA cluster + confirmed HDFS Rolling Upgrade from 2.4.0 + ran some sample jobs - documents are missing in tarball In 2.4.1 release, the documents were deployed at share/doc/hadoop/ . Would you please re-create a tarball with adding -Pdoc

Re: [VOTE] Migration from subversion to git for version control

+1 (non-binding), I don't use subversion at all in creating patches. After the migration, we need to change test-patch.sh to use git. Thanks, Akira (2014/08/11 7:18), Mit Desai wrote: +1 non binding. -M!T On Aug 10, 2014 4:12 PM, Chen He airb...@gmail.com wrote: +1 (non-binding) On Sun,

Re: [VOTE] Release Apache Hadoop 2.5.0 RC2

Thanks Karthik for the update, but the some documents are not included. It looks to me that *.apt.vm files are not compiled. Would you please generate documents with 'mvn site site:stage /path/to/deploy'? I'm +1 (non-binding) if the documents are included. Thanks, Akira (2014/08/12 13:49),

Re: [VOTE] Release Apache Hadoop 2.5.0 RC2

Thanks Karthik for the quick update. +1 (non-binding). Thanks, Akira (2014/08/12 21:20), Karthik Kambatla wrote: Thanks for trying the new binary out, Akira. I just updated the binary to include the site files as well. On Mon, Aug 11, 2014 at 11:28 PM, Akira AJISAKA ajisa

Re: [VOTE] Release Apache Hadoop 2.5.1 RC0

is very much 2.5.0 done right. I just updated the how-to-release wiki to capture this step in the release process, so we don't miss it in the future. On Mon, Sep 8, 2014 at 11:37 PM, Akira AJISAKA ajisa...@oss.nttdata.co.jp wrote: -0 (non-binding) In the document, Apache Hadoop 2.5.1 is a minor

Re: [VOTE] Release Apache Hadoop 2.6.0

Thanks Arun for creating another rc! +1 (non-binding) - patched Tez 0.5.2 pom to compile against 2.6.0-rc1 - patched Hive 0.14 pom to compile against 2.6.0-rc1 - run several Hive queries on Tez Thanks, Akira (11/14/14, 10:16), Wangda Tan wrote: Thanks Arun! Have tried compile, deploy and

Re: Looking to a Hadoop 3 release

Thanks Andrew for bringing this up. +1 mostly looks fine but I'm thinking it's not now to cut branch-3. classpath isolation IMHO, classpath isolation is a good thing to do. We should pay down the technical dept ASAP. I'm willing to help. I'm thinking we can cut branch-3 and release 3.0 alpha

Re: The Activities of Apache Hadoop Community

Hadoop community was continued to expand also in 2014. We hope it will be the same in 2015. Thanks, Akira On 2/13/14 11:20, Akira AJISAKA wrote: Hi all, We collected and analyzed JIRA tickets to investigate the activities of Apache Hadoop Community in 2013. http://ajisakaa.blogspot.com/2014/02

Re: Planning Hadoop 2.6.1 release

Thanks all for collecting jiras for 2.6.1 release. In addition, I'd like to include the following: * HADOOP-11343. Overflow is not properly handled in calculating final iv for AES CTR * YARN-2874. Dead lock in DelegationTokenRenewer which blocks RM to execute any further apps * YARN-2992.

Re: [VOTE] Release Apache Hadoop 2.7.0 RC0

Done. Thank you, Tsuyoshi. On 4/15/15 14:55, Tsuyoshi Ozawa wrote: Hey Akira, could you target the issues to 2.7.1? Thanks, - Tsuyoshi On Wed, Apr 15, 2015 at 2:51 PM, Akira AJISAKA ajisa...@oss.nttdata.co.jp wrote: +0 (non-binding) - Downloaded source - Built from source - Ran a pseudo

Re: [VOTE] Release Apache Hadoop 2.7.0 RC0

+0 (non-binding) - Downloaded source - Built from source - Ran a pseudo-distributed cluster - Read documents downloaded from binary tarball - Looked Web UIs I found several issues to be fixed. - HDFS-8149: The footer of Web UI Hadoop, 2014 is old I'm thinking this is a regression from Hadoop

Removal of unused properties

Hi Folks, In MAPREDUCE-6307, I'd like to remove unused mapreduce.tasktracker.taskmemorymanager.monitoringinterval property, however, the compatibility document says Hadoop-defined properties are to be deprecated at least for one major release before being removed.

Re: Planning Hadoop 2.6.1 release

to the 2.6.1-candidate list. I included everything even though some of them are major tickets. The list is getting large, we will have to cut these down once we get down to the next phase of figuring out what to include and what not to. Thanks +Vinod On Jul 21, 2015, at 2:15 AM, Akira AJISAKA ajisa

Re: Hadoop 2.6.1 Release process thread

Good point. I ran the regression test in HADOOP-10786 successfully on ajisakaa/common-merge branch with JDK6. I'll run all the unit tests against JDK6 locally after merging all the jiras. Thanks, Akira On 8/14/15 23:21, Allen Wittenauer wrote: I hope someone tests this against JDK6,

Re: Planning Hadoop 2.6.1 release

12, 2015 at 10:38 PM, Akira AJISAKA ajisa...@oss.nttdata.co.jp wrote: Thanks all for collecting jiras for 2.6.1 release. In addition, I'd like to include the following: * HADOOP-11343. Overflow is not properly handled in calculating final iv for AES CTR * YARN-2874. Dead lock

Re: 2.7.2 release plan

Thanks Vinod for starting 2.7.2 release plan. The focus obviously is to have blocker issues [2], bug-fixes and *no* features / improvements. Can we adopt the plan as Karthik mentioned in Additional maintenance releases for Hadoop 2.y versions thread? That way we can include not only blocker

Re: Planning Hadoop 2.6.1 release

Thanks Vinod for updating the candidate list. I'd like to include the followings 12 JIRAs: * YARN-3641 * YARN-3585 * YARN-2910 * HDFS-8431 * HDFS-7830 * HDFS-7763 * HDFS-7742 * HDFS-7235 * HDFS-7225 * MAPREDUCE-6324 * HADOOP-11934 * HADOOP-11491 Thanks, Akira On 7/18/15 11:13, Vinod Kumar

Re: [VOTE] Release Apache Hadoop 2.6.2

Thanks Sangjin for creating RC for 2.6.2. +1 (non-binding) - Verified signatures and checksums - Deployed a single node cluster - Built Tez 0.7.0 with Hadoop 2.6.2 pom - Built Hive 1.2.1 with Hadoop 2.6.2 pom - Ran some Hive on Tez queries successfully Regards, Akira On 10/23/15 06:14, Sangjin

Re: IMPORTANT: automatic changelog creation

+1, thanks Allen and Andrew. Regards, Akira On 7/3/15 22:31, Devaraj K wrote: +1 Thanks Allen and Andrew for your efforts on this. Thanks Devaraj On Fri, Jul 3, 2015 at 11:29 AM, Varun Vasudev vvasu...@apache.org wrote: +1 Many thanks to Allen and Andrew for driving this. -Varun On

Re: [VOTE] Release Apache Hadoop 2.6.1 RC0

by other columns works fine. Is anyone else able to reproduce the issue? I checked 2.6.0, and it works fine on 2.6.0. On Wed, Sep 9, 2015 at 6:00 PM, Vinod Kumar Vavilapalli <vino...@apache.org> wrote: Hi all, After a nearly month long [1] toil, with loads of help from Sangjin Lee and

Re: [VOTE] Release Apache Hadoop 2.6.1 RC1

; yarn-...@hadoop.apache.org; hdfs-...@hadoop.apache.org; mapreduce-dev@hadoop.apache.org Cc: vino...@apache.org; Sangjin Lee <sjl...@gmail.com>; Akira AJISAKA <ajisa...@oss.nttdata.co.jp> Sent: Wednesday, September 16, 2015 9:10 PM Subject: [VOTE] Release Apache Hadoop 2.6.1 RC1 Hi all, Af

Re: Planning for Apache Hadoop 2.6.2

Thanks Vinod and Sangjin for releasing 2.6.1 and starting discussion for 2.6.2! +1. If there's anything I can help you with, please tell me. Thanks, Akira On 9/25/15 13:23, Vinayakumar B wrote: Thanks Vinod and Sangjin for making 2.6.1 release possible. Apologies for not getting time to

Re: [VOTE] Release Apache Hadoop 2.6.3 RC0

Thanks Junping for starting release process. I noticed there are duplicated tags: * release-2.6.3-RC0 * release-2.6.3-RC0.1 * release-2.6.3-RC1 Could you remove RC0.1 and RC1? Regards, Akira On 12/16/15 10:17, yliu wrote: Thanks Junping, +1. Download the tarball and deploy a small HDFS/YARN

Re: [DISCUSSION] Release Plan for Apache Hadoop 2.6.4

+1 for releasing 2.6.4 after release 2.7.2. I'll work on the list [2]. Thanks, Akira On 1/7/16 08:59, Junping Du wrote: Hello folks, Hope everyone had a wonderful holiday and good rest in passed weeks. We just had a 2.6.3 release on Dec.17 and now it is a good time to look forward to

Re: [VOTE] Release Apache Hadoop 2.7.2 RC1

Thanks Vinod for starting the discussion. I'm +1 for cherry-picking these issues to 2.7.2. As Andrew said, when users upgrade Hadoop from 2.6.3 to 2.7.2, they can hit the issues. I'm thinking we should reduce the regressions as possible. Regards, Akira On 12/25/15 01:56, Andrew Wang wrote: My

Re: [VOTE] Release Apache Hadoop 2.7.2 RC1

+1 (binding) - Downloaded source tarball - Verified signatures and checksums - Compiled and built a single node cluster - Confirmed commons-collections is upgraded to 3.2.2 - Compiled Hive 1.2.1 and Tez 0.7.0/0.8.1-alpha using Hadoop 2.7.2 pom successfully - Ran some Hive on Tez/MRv2 queries

Re: [RESULT] [VOTE] Release Apache Hadoop 2.6.3 RC0

My late +1 (binding) - Downloaded source tarball - Verified signatures and checksums - Compiled and built a single node cluster - Confirmed commons-collections is upgraded to 3.2.2 - Compiled Hive 1.2.1 and Tez 0.7.0 using Hadoop 2.6.3 pom successfully - Ran some Hive on Tez/MRv2 queries

Re: Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

Thanks Allen for reporting. Agreed that HDFS-10256 broke the tests. Filed HDFS-10561. Regards, Akira On 6/19/16 03:54, Allen Wittenauer wrote: On Jun 17, 2016, at 7:04 AM, Apache Jenkins Server wrote: For more details, see

Re: [VOTE] Release Apache Hadoop 2.7.2 RC1

The general rule sounds good to me. > "any fix in 2.x.y to be there in all 2.b.c releases (while b>=x) that get out after 2.x.y release date" +1 > I would prefer this rule only applies on critical/blocker fixes, but not applies on minor/trivial issues. +1 Thanks, Akira On 12/29/15

Re: [VOTE] Release Apache Hadoop 2.7.2 RC2

Hi Xiao, > From a quick comparison between the releasenotes.html and the CHANGES.txt > files in source tarball, the number of total JIRAs is quite different. In CHANGES.txt, JIRAs fixed in 2.6.1/2.6.2 are not in 2.7.2. That is why the number of JIRAs are different. Regards, Akira On

Re: [UPDATE] New ASF git policy on force-pushes / Tags / Stale branches

Thanks Vinod for the information. +1 for removing origin/bracnh-2.8 and origin/sjlee/hdfs-merge. In addition, I'm thinking we need to delete origin/master, which was pushed wrongly. I've already deleted origin/ajisakaa/common-merge before force-push protection starts. > — There is a general

Re: [VOTE] Release Apache Hadoop 2.6.4 RC0

+1 (binding) - Downloaded source tarball and binary tarball - Verified signatures and checksums - Compiled and built a single node cluster - Compiled Hive 1.2.1 and Tez 0.7.0/0.8.2 using Hadoop 2.6.4 pom successfully - Ran some Hive on Tez/MRv2 queries successfully Thanks, Akira On 2/4/16

Re: [VOTE] Release Apache Hadoop 2.7.2 RC2

+1 (binding) - Downloaded source tarball and binary tarball - Verified signatures and checksums - Compiled and built a single node cluster - Compiled Hive 1.2.1 and Tez 0.7.0/0.8.1-alpha using Hadoop 2.7.2 pom successfully - Ran some Hive on Tez/MRv2 queries successfully Thanks, Akira On

Re: Looking to a Hadoop 3 release

+1 for the 3.0 release plan and continuing 2.x releases. I'm thinking we should consider stopping new 2.x minor releases after 3.x reaches GA. Thanks, Akira On 2/19/16 10:33, Gangumalla, Uma wrote: Yes. I think starting 3.0 release with alpha is good idea. So it would get some time to reach

Re: 2.7.3 release plan

Thank you Vinod! FYI: 2.7.3 will be a bit special release. HDFS-8791 bumped up the datanode layout version, so rolling downgrade from 2.7.3 to 2.7.[0-2] is impossible. We can rollback instead. https://issues.apache.org/jira/browse/HDFS-8791

Re: [Release thread] 2.8.0 release activities

> Also, the docs target (mvn package -Pdocs -DskipTests) is completely busted on branch-2, I figured I have to backport a whole bunch of patches that are only on trunk, and may be more fixes on top of that *sigh* To fix this failure, HADOOP-12022 should be backported to branch-2 and

Re: [DISCUSS] Merge Jersey upgrade(HADOOP-9613) to trunk

+1 for marking HADOOP-9613 as incompatible change and upgrading the version in trunk. Thanks, Akira On 5/9/16 12:12, Tsuyoshi Ozawa wrote: Hi developers, We’ve worked on upgrading jersey(HADOOP-9613) for a years. It's essential change to support complication with JDK8. It’s almost there.

Re: [VOTE] Merge feature branch HADOOP-12930

+1. - Checked out HADOOP-12930 - Built by "mvn package -Pdist -DskipTests -Dtar" successfully - Added custom subcommands to ~/.hadooprc and confirmed they worked - Built documentation and it looks good Thanks, Akira On 5/15/16 02:33, Allen Wittenauer wrote: This vote closes in 2 days and the

[DISCUSS] Set minimum version of Hadoop 3 to JDK8 (HADOOP-11858)

Hi developers, Before cutting 3.0.0-alpha RC, I'd like to drop JDK7 support in trunk. Given this is a critical change, I'm thinking we should get the consensus first. One concern I think is, when the minimum version is set to JDK8, we need to configure Jenkins to disable multi JDK test only

Re: [VOTE] Release Apache Hadoop 2.7.3 RC0

+1 for the source tarball. - Downloaded source tarball and binary tarball - Verified signatures and checksums - Compiled and built a single node cluster - Compiled Hive 2.1.0/1.2.1 and Tez 0.8.4/0.7.1 using Hadoop 2.7.3 pom successfully - Ran some Hive on Tez queries successfully Thanks,

Re: [DISCUSS] Release numbering semantics with concurrent (>2) releases [Was Setting JIRA fix versions for 3.0.0 releases]

Thanks Vinod and Andrew for the summary. > Here's an attempt at encoding this policy as a set of rules for setting fix > versions (credit to Allen): > > 1) Set the fix version for all a.b.c versions, where c > 0. > 2) For each major release line, set the lowest a.b.0 version. Assuming

Re: [DICUSS] Upgrading Guice to 4.0(HADOOP-12064)

As I commented in the jira, I'm +1 for upgrading. -Akira On 6/29/16 10:16, Tsuyoshi Ozawa wrote: No objections here? - Tsuyoshi On Mon, Jun 27, 2016 at 6:01 AM, Tsuyoshi Ozawa wrote: Hi developers, I will plan to upgrade Google Guice dependency on trunk. The change also

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha2 RC0

Hi Marton, This is intentional. source htmls were removed. https://issues.apache.org/jira/browse/HADOOP-13688 Regards, Akira On 2017/01/22 0:50, Marton Elek wrote: hadoop-3.0.0-alpha2.tar.gz is much more smaller than hadoop-3.0.0-alpha1.tar.gz. (246M vs 316M) The big difference is the

Re: Planning for 3.0.0-alpha2

Thanks Sangjin for finding this. > It looks like hadoop-cloud-storage-project was missed in the version set? Yes. Probably this is because hadoop-cloud-storage-project is missing in pom.xml so `mvn versions:set` did not work for the project. Filed HADOOP-14004 for fixing this. Regards,

Re: [VOTE] Release Apache Hadoop 2.7.3 RC2

Thanks Vinod for cutting another RC. +1 - Downloaded source tarball and binary tarball - Verified signatures and checksums - Compiled and built a single node cluster - Compiled Hive 2.1.0/1.2.1 and Tez 0.8.4/0.7.1 using Hadoop 2.7.3 pom successfully - Ran some Hive on Tez queries successfully

Re: [VOTE] Release Apache Hadoop 2.7.3 RC1

-1 (binding) HADOOP-13434 and HADOOP-11814, committed between RC0 and RC1, are not reflected in the release note. -Akira On 8/17/16 13:29, Allen Wittenauer wrote: -1 HDFS-9395 is an incompatible change: a) Why is not marked as such in the changes file? b) Why is an incompatible change

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha1 RC0

Thanks Andrew for the great work. +1 (binding) - Downloaded source and verified checksum and signature - Compiled with -Pnative @ CentOS 7.2 and OpenJDK 8u101 - Ran some MapReduce jobs successfully - Checked Web UIs and logs - hdfs/yarn/mapred "--daemon" option works as expected Regards, Akira

Re: About 2.6.5 and 2.7.4 release

Yes. I can help with releasing them. -Akira On 9/9/16 15:31, Tsuyoshi Ozawa wrote: Chiwan Park reported Hadoop incompatibility by the change of HADOOP-11252. Now, HADOOP-13579 is committed to branch-2.6 and branch-2.7. complement: HADOOP-13579 fixes the problem of incompatibility by

Re: [VOTE] Release Apache Hadoop 2.6.5 (RC1)

Hi Sangjin, When using binary tarball, I'm seeing "2016-09-27T18:26Z by sjlee from branch-2.6.5" in Web UI. Can we rename it? AFAIK, hadoop releases were built by hortonmu in 2014 and was renamed to jenkins. *

Re: [VOTE] Release Apache Hadoop 2.6.5 (RC1)

ould you change the name to 'jenkins' by using the Jenkins infra?" Regards, Akira On 10/7/16 03:04, Allen Wittenauer wrote: On Oct 5, 2016, at 10:35 PM, Akira Ajisaka <ajisa...@oss.nttdata.co.jp> wrote: Can we rename it? AFAIK, hadoop releases were built by hortonmu in 2014 and was

Re: [VOTE] Release Apache Hadoop 2.6.5 (RC0)

-0 (binding) - Downloaded source tarball and binary tarball - Verified signatures and checksums - Compiled successfully with both JDK6 and JDK7 - Compiled and built a single node cluster - Compiled Hive 1.2.1 and Tez 0.7.1/0.8.4 using Hadoop 2.6.5 pom successfully - Ran some Hive on Tez/MRv2

Re: Updated 2.8.0-SNAPSHOT artifact

It's almost a year since branch-2.8 has cut. I'm thinking we need to release 2.8.0 ASAP. According to the following list, there are 5 blocker and 6 critical issues. https://issues.apache.org/jira/issues/?filter=12334985 Regards, Akira On 10/18/16 10:47, Brahma Reddy Battula wrote: Hi Vinod,

Re: Updated 2.8.0-SNAPSHOT artifact

I proceed. Thanks, -Eric -- *From:* Karthik Kambatla <ka...@cloudera.com> *To:* Ming Ma <min...@twitter.com> *Cc:* Sangjin Lee <sjl...@gmail.com>; Jason Lowe <jl...@yahoo-inc.com>; Akira Ajisaka <ajisa...@oss.nttdata.co.jp>; Brahma Reddy B

Re: [DISCUSS] HADOOP-13603 - Remove package line length checkstyle rule

This discussion was split into two separate topics. 1) Remove line length checkstyle rule for package line 2) Remove line length checkstyle rule for the entire source code 1) I'm +1 for removing the rule for package line. I can provide a trivial patch shortly in HADOOP-13603. 2) As Andrew

Re: Updated 2.8.0-SNAPSHOT artifact

-2? On Tue, Oct 25, 2016 at 12:20 AM, Akira Ajisaka <ajisa...@oss.nttdata.co.jp> wrote: It's almost a year since branch-2.8 has cut. I'm thinking we need to release 2.8.0 ASAP. According to the following list, there are 5 blocker and 6 critical issues. https://issues.apache.org/jira/

Re: [VOTE] Release Apache Hadoop 2.6.5 (RC1)

I'm sorry I was wrong. Thanks Allen for the detailed information. -Akira On 10/7/16 15:04, Allen Wittenauer wrote: On Oct 6, 2016, at 1:39 PM, Akira Ajisaka <ajisa...@oss.nttdata.co.jp> wrote: It wasn't 'renamed' to jenkins, prior releases were actually built by and on the J

Re: [Continued] [Release thread] 2.8.0 release activities

Thanks Junping and Andrew! HADOOP-2.8-JACC is not working well, so I manually kicked a job to compare 2.8 with 2.7.3. https://builds.apache.org/view/H-L/view/Hadoop/job/Hadoop-trunk-JACC/24/artifact/target/compat-check/report.html Regards, Akira On 2016/12/02 2:08, Junping Du wrote: Thanks

Re: Upgrading minimum version of Maven to 3.1 from 3.0

please refer: https://archive.apache.org/dist/maven/binaries/). btw, I assume we only plan to change maven version on trunk given new YARN UI only merge to trunk branch. Isn't it? Thanks, Junping ____ From: Akira Ajisaka <aaji

Review request for HADOOP-11875

Hi YARN and MapReduce developers, I'm working for Java 9 support and created a patch to replace '_' with '__' in the hamlet framework (org.apache.hadoop.yarn.webapp.hamlet) used by YARN and MapReduce webapp. In Java 9 '_' as a one-character identifier is banned.

Re: Upgrading minimum version of Maven to 3.1 from 3.0

Based on the positive feedback from Junping, filed HADOOP-14285 for the update. Discussion can continue in the JIRA. Thanks, Akira On 2017/04/05 12:56, Akira Ajisaka wrote: Agreed to upgrade to 3.3+ and change the version only in trunk. -Akira On 2017/04/05 11:21, Sunil G wrote: Thanks

Re: HADOOP-14316: Switching from Findbugs to Spotbugs

HADOOP-14336 is the umbrella jira to fix the newly found warnings. https://issues.apache.org/jira/browse/HADOOP-14336 Regards, Akira On 2017/04/20 3:12, Allen Wittenauer wrote: On Apr 19, 2017, at 10:52 AM, Wei-Chiu Chuang wrote: That sounds scary. Would you mind to

Re: About 2.7.4 Release

Probably 2.8.0 will be released soon. https://issues.apache.org/jira/browse/HADOOP-13866?focusedCommentId=15898379=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-15898379 I'm thinking 2.7.4 release process starts after 2.8.0 release, so 2.7.4 will be released in April

Re: [VOTE] Release Apache Hadoop 2.7.4 (RC0)

Thanks Konstantin for the work! I have a question: Where are the maven artifacts deployed? -Akira On 2017/07/30 8:29, Konstantin Shvachko wrote: Hi everybody, Here is the next release of Apache Hadoop 2.7 line. The previous stable release 2.7.3 was available since 25 August, 2016. Release

Re: [VOTE] Release Apache Hadoop 2.7.4 (RC0)

/repositories/orgapachehadoop-1061/ They are not released yet, which happens once the release is approved. See in Publishing section #5 https://wiki.apache.org/hadoop/HowToReleasePreDSBCR#Publishing Thanks, --Konst On Wed, Aug 2, 2017 at 11:36 PM, Akira Ajisaka <aajis...@apache.org <mailto

Re: [VOTE] Release Apache Hadoop 2.7.4 (RC0)

+1 (binding) - Verified the checksum and the signature of the source tarball - Built from source with CentOS 7.2 and OpenJDK 1.8.0_141 - Built Hive 2.1.0/2.3.0 and Tez 0.8.5/0.9.0 with Hadoop 2.7.4 artifacts - Built single node cluster and ran some Hive on Tez queries successfully Regards,

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha4-RC0

Thanks Andrew! +1 (binding) * Verified signatures and checksums * Built from source on CentOS 7.2 with OpenJDK 1.8.0_131 with -Pnative * Deployed pseudo-distributed cluster and ran some example job * The change log and the release notes look good. Regards, Akira On 2017/06/30 11:40, Andrew

Re: About 2.7.4 Release

-6024. May be we can raise one Jira to track this..? --Brahma Reddy Battula -Original Message- From: Akira Ajisaka [mailto:aajis...@apache.org] Sent: 25 April 2017 15:36 To: Haohui Mai Cc: Brahma Reddy Battula; Andrew Wang; Sangjin Lee; Vinod Kumar Vavilapalli; Marton Elek; Hadoop Common

Re: About 2.7.4 Release

issues resolved in the release. Disable mail notifications for this bulk change. Therefore, let's close them. On 2017/04/27 3:01, Allen Wittenauer wrote: On Apr 25, 2017, at 12:35 AM, Akira Ajisaka <aajis...@apache.org> wrote: Maybe we should create a jira to track this? I think no

Re: About 2.7.4 Release

, old release script, anything else) I would be happy to do any task for new maintenance releases (or more frequent releases). Regards, Marton ________ From: Akira Ajisaka <aajis...@apache.org> Sent: Tuesday, March 07, 2017 7:34 AM To: Brahma Reddy

Re: About 2.7.4 Release

Hi Konstantin, Thank you for volunteering as release manager! > Actually the original link works fine: https://s.apache.org/Dzg4 I couldn't see the link. Maybe is it private filter? Here is a link I generated: https://s.apache.org/ehKy This filter includes resolved issue and excludes

Migrating logging APIs to slf4j (HADOOP-12956)

Hi folks, Now we are migrating from logging APIs (log4j, commons-logging) to slf4j for upgrading from log4j1 to log4j2. https://issues.apache.org/jira/browse/HADOOP-12956 I really appreciate if you are using slf4j APIs in the code instead of other logging APIs. Thanks and regards, Akira

Re: About 2.7.4 Release

2.8 and trunk in following link.?? https://cwiki.apache.org/confluence/display/HADOOP From: Konstantin Shvachko <shv.had...@gmail.com> Sent: Saturday, May 13, 2017 3:58 AM To: Akira Ajisaka Cc: Hadoop Common; Hdfs-dev; mapreduce-dev@hadoop.apache.org;

Re: About 2.7.4 Release

://issues.apache.org/jira/browse/YARN-5988 https://issues.apache.org/jira/browse/YARN-6304 I will raise a JIRAs to back port it. @Akira , could you help to add these JIRAs into wiki? Thanks & Regards Rohith Sharma K S On 29 May 2017 at 12:19, Akira Ajisaka <aajis...@apache.org> wrote:

Re: Reminder to always set x.0.0 and x.y.0 fix versions when backporting

Thanks Andrew for the reminder! I've checked the commit log and set 2.9.0 to the issue if the patch is committed in branch-2. -Akira On 2017/05/08 6:21, Andrew Wang wrote: Hi folks, I've noticed with the backporting efforts for 2.8.1, we're losing some x.y.0 fix versions (e.g. 2.9.0). Our

MapReduce precommit job is still using Yetus 0.3.0

Hi folks, I found MapReduce precommit job is still using Yetus 0.3.0. Would someone upgrade Yetus in this precommit job or would someone give me a privilege to fix it? Thanks, Akira - To unsubscribe, e-mail:

wiki.apache.org is no longer editable

Hi folks, https://wiki.apache.org/hadoop/ is no longer editable. If you want to edit a wiki page in wiki.apache.org, you need to migrate the page to https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+Home. If you want to edit the wiki, please tell me your account for cwiki.apache.org.

Re: Do we still have nightly (or even weekly) unit test run for Hadoop projects?

Yes, qbt runs nightly and it sends e-mail to dev lists. https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/ Regards, Akira On 2017/10/19 7:54, Wangda Tan wrote: Hi, Do we still have nightly (or even weekly) unit test run for Hadoop projects? I couldn't find it on Jenkins dashboard

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

+1 * Downloaded source tarball and verified checksum and signature * Compiled the source with OpenJDK 1.8.0_151 and CentOS 7.4 * Deployed a pseudo cluster and ran some simple MR jobs I noticed ISA-L build options are documented in BUILDING.txt but the options do not exist in 2.x releases. Filed

Re: [VOTE] Release Apache Hadoop 3.0.0 RC0

Hi Andrew, Signatures are missing. Would you upload them? Thanks, Akira On 2017/11/15 6:34, Andrew Wang wrote: Hi folks, Thanks as always to the many, many contributors who helped with this release. I've created RC0 for Apache Hadoop 3.0.0. The artifacts are available here:

Re: [VOTE] Release Apache Hadoop 3.0.0 RC0

> - When did we stop putting CHANGES files into the source artifacts? CHANGES files were removed by https://issues.apache.org/jira/browse/HADOOP-11792 > - Even after "mvn install"ing once, shading is repeated again and again for every new 'mvn install' even though there are no source

Re: [NOTIFICATION] Hadoop trunk rebased

+ common-dev and mapreduce-dev On 2018/04/27 6:23, Owen O'Malley wrote: As we discussed in hdfs-dev@hadoop, I did a force push to Hadoop's trunk to replace the Ozone merge with a rebase. That means that you'll need to rebase your branches. .. Owen

Re: [VOTE] Release Apache Hadoop 3.0.1 (RC1)

+1 (binding) - verified signatures and checksums - built from source and setup 4 node cluster - ran some examples jobs - verified some HDFS operations Thanks, Akira On 2018/03/22 10:08, Robert Kanter wrote: +1 (binding) - verified signatures and checksums - setup pseudo cluster using Fair

  1   2   3   4   >