Re: [DISCUSS] hadoop branch-3.3+ going to java11 only

2023-03-28 Thread Chris Nauroth
[2] https://github.com/apache/spark/blob/v3.3.2/pom.xml#L109 Chris Nauroth On Tue, Mar 28, 2023 at 11:10 AM Ayush Saxena wrote: > > > > it's already hard to migrate from JDK8 why not retarget JDK17. > > > > +1, makes sense to me, sounds like a win-win situation to

Re: [VOTE] Release Apache Hadoop 3.3.5 (RC3)

2023-03-20 Thread Chris Nauroth
* Ran a MapReduce job with the native bzip2 codec for compression, and it worked fine. * Ran a MapReduce job with YARN configured to use LinuxContainerExecutor and verified launching the containers through container-executor worked. Chris Nauroth On Mon, Mar 20, 2023 at 3:45 AM Ayush Sax

Re: [VOTE] Release Apache Hadoop 3.3.5 (RC3)

2023-03-18 Thread Chris Nauroth
Yes, I'm in progress on verification, so you can expect to get a vote from me. Thank you, Steve! Chris Nauroth On Sat, Mar 18, 2023 at 9:19 AM Ashutosh Gupta wrote: > Hi Steve > > I will also do it by today/tomorrow. > > Thanks, > Ashutosh > > On Sat, 18 Mar, 2023

[jira] [Resolved] (YARN-11231) FSDownload set wrong permission in destinationTmp

2023-01-07 Thread Chris Nauroth (Jira)
[ https://issues.apache.org/jira/browse/YARN-11231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth resolved YARN-11231. -- Assignee: Zhang Dongsheng Resolution: Won't Fix Hello [~skysider]. I noticed you closed

Re: [VOTE] Release Apache Hadoop 3.3.5

2023-01-04 Thread Chris Nauroth
to MiniDFSCluster and restarts within a single JVM, then I agree the impact is smaller. Then, we'd want to consider what downstream projects have tests that do restarts on a MiniDFSCluster. Chris Nauroth On Wed, Jan 4, 2023 at 4:22 PM Ayush Saxena wrote: > Hmm I'm looking at HADOOP-11867 related st

Re: [VOTE] Release Apache Hadoop 3.3.5

2023-01-03 Thread Chris Nauroth
timing out. Regarding Hive and Bouncy Castle, there is an existing issue and pull request tracking an upgrade attempt. It's looking like some amount of code changes are required: https://issues.apache.org/jira/browse/HIVE-26648 https://github.com/apache/hive/pull/3744 Chris Nauroth On Tue, Jan 3, 2023

[jira] [Resolved] (YARN-11388) Prevent resource leaks in TestClientRMService.

2022-12-28 Thread Chris Nauroth (Jira)
[ https://issues.apache.org/jira/browse/YARN-11388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth resolved YARN-11388. -- Fix Version/s: 3.4.0 3.2.5 3.3.9 Resolution: Fixed

[jira] [Resolved] (YARN-11392) ClientRMService implemented getCallerUgi and verifyUserAccessForRMApp methods but forget to use sometimes, caused audit log missing.

2022-12-27 Thread Chris Nauroth (Jira)
[ https://issues.apache.org/jira/browse/YARN-11392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth resolved YARN-11392. -- Fix Version/s: 3.4.0 3.2.5 3.3.9 Resolution: Fixed

Re: [VOTE] Release Apache Hadoop 3.3.5

2022-12-27 Thread Chris Nauroth
red to use LinuxContainerExecutor and verified launching the containers through container-executor worked. Chris Nauroth On Wed, Dec 21, 2022 at 11:29 AM Steve Loughran wrote: > Mukund and I have put together a release candidate (RC0) for Hadoop 3.3.5. > > Given the time of year it's a bit unrealistic

[jira] [Resolved] (YARN-11390) TestResourceTrackerService.testNodeRemovalNormally: Shutdown nodes should be 0 now expected: <1> but was: <0>

2022-12-08 Thread Chris Nauroth (Jira)
[ https://issues.apache.org/jira/browse/YARN-11390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth resolved YARN-11390. -- Fix Version/s: 3.4.0 3.2.5 3.3.9 Resolution: Fixed

[jira] [Created] (YARN-11388) Prevent resource leaks in TestClientRMService.

2022-12-05 Thread Chris Nauroth (Jira)
Chris Nauroth created YARN-11388: Summary: Prevent resource leaks in TestClientRMService. Key: YARN-11388 URL: https://issues.apache.org/jira/browse/YARN-11388 Project: Hadoop YARN Issue

[jira] [Resolved] (YARN-11363) Remove unused TimelineVersionWatcher and TimelineVersion from hadoop-yarn-server-tests

2022-11-01 Thread Chris Nauroth (Jira)
[ https://issues.apache.org/jira/browse/YARN-11363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth resolved YARN-11363. -- Fix Version/s: 3.3.5 3.4.0 Resolution: Fixed > Remove unu

[jira] [Resolved] (YARN-11360) Add number of decommissioning/shutdown nodes to YARN cluster metrics.

2022-10-28 Thread Chris Nauroth (Jira)
[ https://issues.apache.org/jira/browse/YARN-11360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth resolved YARN-11360. -- Fix Version/s: 3.4.0 3.2.5 3.3.9 Hadoop Flags

YARN-11360: Proposed "yarn top" output change

2022-10-25 Thread Chris Nauroth
o this would effectively stall that part of the patch indefinitely.) [1] https://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-common/Compatibility.html#Command_Line_Interface_.28CLI.29 Chris Nauroth

[jira] [Created] (YARN-11360) Add number of decommissioning nodes to YARN cluster metrics.

2022-10-21 Thread Chris Nauroth (Jira)
Chris Nauroth created YARN-11360: Summary: Add number of decommissioning nodes to YARN cluster metrics. Key: YARN-11360 URL: https://issues.apache.org/jira/browse/YARN-11360 Project: Hadoop YARN

Re: [VOTE] Release Apache Hadoop 3.3.4

2022-08-03 Thread Chris Nauroth
it's something flaky that's already tracked in a JIRA issue. The release looks good. Steve, thank you for driving this. Chris Nauroth On Wed, Aug 3, 2022 at 11:27 AM Steve Loughran wrote: > my vote for this is +1, binding. > > obviously I`m biased, but i do not want to have to issue

Re: [VOTE] Release Apache Hadoop 3.2.4 - RC0

2022-07-21 Thread Chris Nauroth
for TestFsck, where the failure was caused by missing audit log entries. This test works by toggling global logging state, so I can see why multi-threaded execution might confuse the test. Chris Nauroth On Thu, Jul 21, 2022 at 12:01 AM Ashutosh Gupta wrote: > +1(non-binding) > > * Bu

Re: [VOTE] Release Apache Hadoop 3.2.4 - RC0

2022-07-19 Thread Chris Nauroth
analysis on these new test failures. I don't know if it's a quirk to my environment, though I'm using the start-build-env.sh Docker container, so any build dependencies should be consistent. I'd be comfortable moving ahead if others are seeing these tests pass. Chris Nauroth On Thu, Jul 14, 2022 at 7

Re: [VOTE] Release Apache Hadoop 2.10.2 - RC0

2022-05-29 Thread Chris Nauroth
enough to hold up a release, so I'm still voting +1. Chris Nauroth On Sun, May 29, 2022 at 2:35 AM Masatake Iwasaki < iwasak...@oss.nttdata.co.jp> wrote: > Thanks for the help, Ayush. > > I committed HADOOP-16663/HADOOP-16664 and cherry-picked HADOOP-16985 to > branch-2.

Re: [VOTE] Release Apache Hadoop 3.3.3 (RC1)

2022-05-16 Thread Chris Nauroth
+1 (binding) - Verified all checksums. - Verified all signatures. - Built from source, including native code on Linux. - Ran several examples successfully. Chris Nauroth On Mon, May 16, 2022 at 10:06 AM Chao Sun wrote: > +1 > > - Compiled from source > - Verified checksums

Re: [DISCUSS] Hadoop 3.3.2 release?

2021-09-08 Thread Chris Nauroth
+1 Chao, thank you very much for volunteering on the release. Chris Nauroth On Tue, Sep 7, 2021 at 10:00 PM Igor Dvorzhak wrote: > +1 > > On Tue, Sep 7, 2021 at 10:06 AM Chao Sun wrote: > >> Hi all, >> >> It has been almost 3 months since the 3.3.1 release and

Re: [VOTE] Release Apache Hadoop 2.7.3 RC1

2016-08-18 Thread Chris Nauroth
getting a patch on the compatibility doc that addresses the HDFS audit log specifically. --Chris Nauroth On 8/18/16, 8:47 AM, "Andrew Purtell" <andrew.purt...@gmail.com> wrote: An incompatible APIs change is developer unfriendly. An incompatible behavioral ch

Re: Apache MSDN Offer is Back

2016-07-20 Thread Chris Nauroth
process to see if anything has changed in the benefits. --Chris Nauroth From: Ravi Prakash <ravihad...@gmail.com<mailto:ravihad...@gmail.com>> Date: Wednesday, July 20, 2016 at 12:04 PM To: Chris Nauroth <cnaur...@hortonworks.com<mailto:cnaur...@hortonworks.com>> Cc: "

Apache MSDN Offer is Back

2016-07-19 Thread Chris Nauroth
-licenses/msdn.txt. --Chris Nauroth

Re: Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

2016-06-10 Thread Chris Nauroth
Interestingly, that FindBugs warning in hadoop-azure-datalake was not flagged during pre-commit before I committed HADOOP-12666. I'm going to propose that we address it in scope of HADOOP-12875. --Chris Nauroth On 6/10/16, 10:30 AM, "Apache Jenkins Server" <jenk...@builds.apac

Re: [DISCUSS] what exactly are the stability guarantees of the YARN APIs

2016-05-31 Thread Chris Nauroth
of being backwards-incompatible.) --Chris Nauroth On 5/31/16, 9:46 AM, "Karthik Kambatla" <ka...@cloudera.com> wrote: >Argh! Totally my bad on YARN-2882. Kept missing the changes to >ContainerStatus even after you pointed out. > >Filed YARN-5184 to fix this before we rel

Re: ASF OS X Build Infrastructure

2016-05-21 Thread Chris Nauroth
. I'll send another update when I have something more specific to share. --Chris Nauroth From: Ravi Prakash <ravihad...@gmail.com<mailto:ravihad...@gmail.com>> Date: Friday, May 20, 2016 at 4:56 PM To: Sean Busbey <bus...@cloudera.com<mailto:bus...@cloudera.com>>

Re: ASF OS X Build Infrastructure

2016-05-20 Thread Chris Nauroth
It's very disappointing to see that vanish. I'm following up to see if I can learn more about what happened or if I can do anything to help reinstate it. --Chris Nauroth On 5/20/16, 6:11 AM, "Steve Loughran" <ste...@hortonworks.com> wrote: > >> On 20 May 201

Re: ASF OS X Build Infrastructure

2016-05-19 Thread Chris Nauroth
, but it keeps slipping. I'll try once again to bump up priority. --Chris Nauroth On 5/19/16, 9:41 AM, "Allen Wittenauer" <a...@apache.org> wrote: > > Some of you may not know that the ASF actually does have an OS X machine >(a Mac mini, so it¹s not a

Re: [VOTE] Merge feature branch HADOOP-12930

2016-05-16 Thread Chris Nauroth
Understood about the tests. --Chris Nauroth On 5/15/16, 7:30 AM, "Allen Wittenauer" <a...@apache.org> wrote: > >> On May 14, 2016, at 3:11 PM, Chris Nauroth <cnaur...@hortonworks.com> >>wrote: >> >> +1 (binding) >> >> -Tried a d

Re: [VOTE] Merge feature branch HADOOP-12930

2016-05-14 Thread Chris Nauroth
attach a full patch to HADOOP-12930 to check pre-commit results? While testing this, I discovered a bug in the distro build for Windows. Could someone please code review my patch on HADOOP-13149? --Chris Nauroth On 5/9/16, 1:26 PM, "Allen Wittenauer" <a...@apache.org> wrote

Re: [DISCUSS] Treating LimitedPrivate({"MapReduce"}) as Public APIs for YARN applications

2016-05-10 Thread Chris Nauroth
of its API like Credentials. I'm in the camp that generally questions the usefulness of LimitedPrivate, but I agree that transitions to Public need case-by-case consideration. --Chris Nauroth From: Andrew Wang <andrew.w...@cloudera.com<mailto:andrew.w...@cloudera.com>> Date: Tuesday,

Re: [DISCUSS] Treating LimitedPrivate({"MapReduce"}) as Public APIs for YARN applications

2016-05-10 Thread Chris Nauroth
that want to integrate with a secured Hadoop cluster. There is prior discussion of this topic on HADOOP-10776 and HADOOP-12913. HADOOP-10776 is a blocker for 2.8.0 to make the transition to Public. --Chris Nauroth On 5/10/16, 11:34 AM, "Hitesh Shah" <hit...@apache.org> wrot

Re: ProcFsBasedProcessTree and clean pages in smaps

2016-02-05 Thread Chris Nauroth
Interesting, I didn't know about "Locked" in smaps. Thanks for pointing that out. At this point, if Varun's suggestion to check out YARN-1856 doesn't solve the problem, then I suggest opening a JIRA to track further design discussion. --Chris Nauroth On 2/5/16, 6:10 AM, &quo

Re: [Release thread] 2.8.0 release activities

2016-02-04 Thread Chris Nauroth
FYI, I've just needed to raise HDFS-9761 to blocker status for the 2.8.0 release. --Chris Nauroth On 2/3/16, 6:19 PM, "Karthik Kambatla" <ka...@cloudera.com> wrote: >Thanks Vinod. Not labeling 2.8.0 stable sounds perfectly reasonable to me. >Let us not call i

Re: ProcFsBasedProcessTree and clean pages in smaps

2016-02-04 Thread Chris Nauroth
, then perhaps that behavior could be added as another option in ProcfsBasedProcessTree. Off the top of my head, I can't think of a reliable way to do this, and I can't research it further immediately. Do others on the thread have ideas? --Chris Nauroth [1] http://linux.die.net/man/2/mlock On 2

Re: YARN application container state doubt

2016-01-06 Thread Chris Nauroth
Unfortunately, I'm not deep enough on this code to quickly answer the second part of your question: when would this happen? Can someone deeper on YARN please add to this? --Chris Nauroth On 1/6/16, 10:33 AM, "Prabhu Joseph" <prabhujose.ga...@gmail.com> wrote: >Hi Experts,

Re: How to debug hadoop(or YARN) locally?

2015-12-22 Thread Chris Nauroth
he classes that were bundled in the tarball distro. --Chris Nauroth On 12/21/15, 7:29 PM, "Allen Zhang" <allenzhang...@126.com> wrote: > >oh, so cool. awesome. Thanks > > > > > > > >At 2015-12-22 11:01:55, "Jeff Zhang" <zjf...@gmail.co

Re: How to debug hadoop(or YARN) locally?

2015-12-21 Thread Chris Nauroth
the NameNode process: export HADOOP_NAMENODE_OPTS="-agentlib:jdwp=transport=dt_socket,server=y,address=8 000,suspend=n $HADOOP_NAMENODE_OPTS" Then, you can run "jdb -attach localhost:8000" to attach the debugger, or do the equivalent in your IDE of choice. --Chris N

Re: [DISCUSS] Looking to a 2.8.0 release

2015-11-25 Thread Chris Nauroth
+1. Thanks, Vinod. --Chris Nauroth On 11/25/15, 1:45 PM, "Vinod Kumar Vavilapalli" <vino...@apache.org> wrote: >Okay, tx for this clarification Chris! I dug more into this and now >realized the actual scope of this. Given the the limited nature of this >

Re: [DISCUSS] Looking to a 2.8.0 release

2015-11-25 Thread Chris Nauroth
wanted to prevent any mistaken assumptions for people only reading this thread. --Chris Nauroth On 11/25/15, 11:08 AM, "Vinod Kumar Vavilapalli" <vino...@apache.org> wrote: >This is the current state from the feedback I gathered. > - Support priorities across applic

Re: Hadoop 2.6.1 Release process thread

2015-08-14 Thread Chris Nauroth
, Allen Wittenauer wrote: I hope someone tests this against JDK6, otherwise this is an incompatible change. On Aug 12, 2015, at 2:21 PM, Chris Nauroth cnaur...@hortonworks.com wrote: I've just applied the 2.6.1-candidate label to HADOOP-10786. Since this is somewhat late in the process, I

Re: Hadoop 2.6.1 Release process thread

2015-08-12 Thread Chris Nauroth
HADOOP-10786 is justified for inclusion in a patch release. --Chris Nauroth On 8/11/15, 7:48 PM, Sangjin Lee sjl...@gmail.com wrote: It might have been because we thought that HDFS-7704 was going to make it. It's both make it or neither does. Now that we know HDFS-7704 is out, HDFS-7916 should

Re: 2.7.2 release plan

2015-07-16 Thread Chris Nauroth
I'd be comfortable with inclusion of any doc-only patch in minor releases. There is a lot of value to end users in pushing documentation fixes as quickly as possible, and they don't bear the same risk of regressions or incompatibilities as code changes. --Chris Nauroth On 7/16/15, 12:38 AM

Re: IMPORTANT: automatic changelog creation

2015-07-02 Thread Chris Nauroth
+1 Thank you to Allen for the script, and thank you to Andrew for volunteering to drive the conversion. --Chris Nauroth On 7/2/15, 2:01 PM, Andrew Wang andrew.w...@cloudera.com wrote: Hi all, I want to revive the discussion on this thread, since the overhead of CHANGES.txt came up again

[jira] [Created] (YARN-3834) Scrub debug logging of tokens during resource localization.

2015-06-19 Thread Chris Nauroth (JIRA)
Chris Nauroth created YARN-3834: --- Summary: Scrub debug logging of tokens during resource localization. Key: YARN-3834 URL: https://issues.apache.org/jira/browse/YARN-3834 Project: Hadoop YARN

F 6/19: Jenkins clogged up

2015-06-19 Thread Chris Nauroth
. --Chris Nauroth

Reminder: Apache committers have access to a free MSDN license

2015-06-06 Thread Chris Nauroth
it in a VirtualBox VM (or your hypervisor of choice). Instructions for setting up a Windows development environment have been in BUILDING.txt for a few years. This would prevent situations where patches are blocked from getting committed while waiting for me or any other individual to test. --Chris Nauroth

Re: 2.7.1 status

2015-05-27 Thread Chris Nauroth
Thanks, Larry. I have marked HADOOP-11934 as a blocker for 2.7.1. I have reviewed and +1'd it. I can commit it after we get feedback from Jenkins. --Chris Nauroth On 5/26/15, 12:41 PM, larry mccay lmc...@apache.org wrote: Hi Vinod - I think that https://issues.apache.org/jira/browse

Re: [DISCUSS] branch-1

2015-05-08 Thread Chris Nauroth
that no one is actively developing for the branch, but there would still be the option of filing new critical bugs if someone decides that they want a new 1.x release. --Chris Nauroth On 5/8/15, 10:50 AM, Karthik Kambatla ka...@cloudera.com wrote: I would be -1 to declaring the branch dead just yet

Re: [DISCUSS] Developing features in branches

2015-05-01 Thread Chris Nauroth
I also recommend frequent merges with trunk, ramping up to at least daily as the work on the branch winds down. The sooner you know about the merge conflict, the easier it is to trace back to the commit that caused it and untangle things. --Chris Nauroth On 5/1/15, 2:58 AM, Steve Loughran

Re: [DISCUSS] Developing features in branches

2015-04-30 Thread Chris Nauroth
for that feature, but it's something to keep in mind. --Chris Nauroth On 4/30/15, 3:23 PM, Zhijie Shen zs...@hortonworks.com wrote: Exactly. Branch development is good, but I concerned about too many concurrent branches. In terms of code management, the good branch development candidate could

Re: Planning Hadoop 2.6.1 release

2015-04-30 Thread Chris Nauroth
believe finally fixes the root cause of this issue. --Chris Nauroth On 4/30/15, 3:55 PM, Arpit Agarwal aagar...@hortonworks.com wrote: HDFS candidates for back-porting to Hadoop 2.6.1. The first two were requested in [1]. HADOOP-11674. oneByteBuf in CryptoInputStream and CryptoOutputStream

[jira] [Resolved] (YARN-3524) Mapreduce failed due to AM Container-Launch failure at NM on windows

2015-04-27 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth resolved YARN-3524. - Resolution: Not A Problem Hello [~KaveenBigdata]. Nice debugging! The native components

Re: Set minimum version of Hadoop 3 to JDK 8

2015-04-21 Thread Chris Nauroth
? I'd prefer to avoid executing duplicate builds for different JDK versions. Pre-commit already takes a long time, and I suspect doubling the amount of builds will make us starved for executors in Jenkins. Chris Nauroth Hortonworks http://hortonworks.com/ On 4/21/15, 8:38 PM, Sean Busbey bus

committing HADOOP-11746 test-patch improvements

2015-04-16 Thread Chris Nauroth
the pre-commit process. I have +1'd the patch, but since this is a tool that we all use frequently, I'd like to delay a day before committing. Please comment on the jira if you have any additional feedback. We're aiming to commit on Friday, 4/17. Chris Nauroth Hortonworks http://hortonworks.com/

Re: [VOTE] Release Apache Hadoop 2.7.0 RC0

2015-04-15 Thread Chris Nauroth
of the JCarder build with Java 7 classes. (2.7.0 is our first release compiling as Java 7.) This is not a problem that needs to hold up the release. Vinod, thank you for putting together the release. Chris Nauroth Hortonworks http://hortonworks.com/ On 4/15/15, 7:07 AM, Mit Desai mitde...@yahoo

Re: A 2.7.1 release to follow up 2.7.0

2015-04-09 Thread Chris Nauroth
+1, full agreement with both Vinod and Karthik. Thanks! Chris Nauroth Hortonworks http://hortonworks.com/ On 4/9/15, 12:07 PM, Karthik Kambatla ka...@cloudera.com wrote: Inline. On Thu, Apr 9, 2015 at 11:48 AM, Vinod Kumar Vavilapalli vino...@apache.org wrote: Hi all, I feel like we

Re: Erratic Jenkins behavior

2015-02-18 Thread Chris Nauroth
for this kind of change is increased disk consumption and increased build time, since Maven would need to download dependencies fresh every time. Chris Nauroth Hortonworks http://hortonworks.com/ On 2/12/15, 2:00 PM, Colin P. McCabe cmcc...@apache.org wrote: We could potentially use different .m2

[jira] [Created] (YARN-3015) yarn classpath command should support same options as hadoop classpath.

2015-01-07 Thread Chris Nauroth (JIRA)
Chris Nauroth created YARN-3015: --- Summary: yarn classpath command should support same options as hadoop classpath. Key: YARN-3015 URL: https://issues.apache.org/jira/browse/YARN-3015 Project: Hadoop

Re: [VOTE] Release Apache Hadoop 2.6.0

2014-11-14 Thread Chris Nauroth
-7385, the recent blocker related to incorrect ACLs serialized to the edit log. Thank you to Arun as release manager, and thank you to all of the contributors for their hard work on this release. Chris Nauroth Hortonworks http://hortonworks.com/ On Fri, Nov 14, 2014 at 10:57 AM, Yongjun Zhang yzh

Re: [VOTE] Release Apache Hadoop 2.6.0

2014-11-14 Thread Chris Nauroth
Hi Eric, There was a second release candidate created (named rc1), and voting started fresh in a new thread. You might want to join in on that second thread to make sure that your vote gets counted. Thanks! Chris Nauroth Hortonworks http://hortonworks.com/ On Fri, Nov 14, 2014 at 3:08 PM

Re: [VOTE] Release Apache Hadoop 2.6.0

2014-11-13 Thread Chris Nauroth
I'm helping to expedite a complete, approved patch for HDFS-7385 now. Then, we can make a final decision on its inclusion in 2.6.0. Thank you for bringing it up, Yi. Chris Nauroth Hortonworks http://hortonworks.com/ On Wed, Nov 12, 2014 at 7:31 PM, Liu, Yi A yi.a@intel.com wrote: Arun

Re: [VOTE] Release Apache Hadoop 2.6.0

2014-11-13 Thread Chris Nauroth
I have committed HDFS-7385 down through branch-2.6.0. Thank you! Chris Nauroth Hortonworks http://hortonworks.com/ On Thu, Nov 13, 2014 at 9:14 AM, Chris Nauroth cnaur...@hortonworks.com wrote: I'm helping to expedite a complete, approved patch for HDFS-7385 now. Then, we can make a final

[jira] [Created] (YARN-2803) MR distributed cache not working correctly on Windows after NodeManager privileged account changes.

2014-11-03 Thread Chris Nauroth (JIRA)
Chris Nauroth created YARN-2803: --- Summary: MR distributed cache not working correctly on Windows after NodeManager privileged account changes. Key: YARN-2803 URL: https://issues.apache.org/jira/browse/YARN-2803

[jira] [Created] (YARN-2662) TestCgroupsLCEResourcesHandler leaks file descriptors.

2014-10-08 Thread Chris Nauroth (JIRA)
Chris Nauroth created YARN-2662: --- Summary: TestCgroupsLCEResourcesHandler leaks file descriptors. Key: YARN-2662 URL: https://issues.apache.org/jira/browse/YARN-2662 Project: Hadoop YARN Issue

[jira] [Created] (YARN-2549) TestContainerLaunch fails due to classpath problem with hamcrest classes.

2014-09-12 Thread Chris Nauroth (JIRA)
Chris Nauroth created YARN-2549: --- Summary: TestContainerLaunch fails due to classpath problem with hamcrest classes. Key: YARN-2549 URL: https://issues.apache.org/jira/browse/YARN-2549 Project: Hadoop

Re: should clients be able to override *-site.xml?

2014-09-10 Thread Chris Nauroth
their scripts accordingly. Just echoing what Allen said, there were always plenty of ways for a user to override *-site.xml too. Of course, I'm sorry to hear the change caused an issue at your company, Sangjin. Chris Nauroth Hortonworks http://hortonworks.com/ On Wed, Sep 10, 2014 at 10:55 AM

HDFS-573: Windows builds will require CMake

2014-08-03 Thread Chris Nauroth
convenience. I'll hold off committing for a few more days to give everyone time to react. Chris Nauroth Hortonworks http://hortonworks.com/ -- CONFIDENTIALITY NOTICE NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information

Re: [DISCUSS] Assume Private-Unstable for classes that are not annotated

2014-07-24 Thread Chris Nauroth
+1 for the proposal. I believe stating that classes without annotations are implicitly private is consistent with what we publish for our JavaDocs. IncludePublicAnnotationsStandardDoclet, used in the root pom.xml, filters out classes that don't explicitly have the Public annotation. Chris

Re: Jenkins Build Slaves

2014-07-10 Thread Chris Nauroth
the issue in case someone else gets an opportunity to look. Chris Nauroth Hortonworks http://hortonworks.com/ On Wed, Jul 9, 2014 at 10:33 AM, Giridharan Kesavan gkesa...@hortonworks.com wrote: I dont think so, let me fix that. Thanks Chris for pointing that out. -giri On Wed, Jul 9

Re: Jenkins Build Slaves

2014-07-09 Thread Chris Nauroth
/cmake-2.8/Modules/FindPackageHandleStandardArgs.cmake:108 (message): [exec] Could NOT find PkgConfig (missing: PKG_CONFIG_EXECUTABLE) Chris Nauroth Hortonworks http://hortonworks.com/ On Wed, Jul 9, 2014 at 7:08 AM, Giridharan Kesavan gkesa...@hortonworks.com wrote: Build jobs are now

Re: Moving to JDK7, JDK8 and new major releases

2014-06-28 Thread Chris Nauroth
that its client will continue to support JDK6, then it wouldn't be practical for them to link to a JDK7 version of hadoop-common.) +1 for the whole plan though. We can work through these details. Chris Nauroth Hortonworks http://hortonworks.com/ On Fri, Jun 27, 2014 at 3:10 PM, Karthik Kambatla

Re: Anyone know how to mock a secured hdfs for unit test?

2014-06-27 Thread Chris Nauroth
. It would be great to get more regular test coverage with something that more closely approximates a secured deployment. Chris Nauroth Hortonworks http://hortonworks.com/ On Thu, Jun 26, 2014 at 7:27 AM, Zheng, Kai kai.zh...@intel.com wrote: Hi David, Quite some time ago I opened HADOOP-9952

Re: Moving to JDK7, JDK8 and new major releases

2014-06-25 Thread Chris Nauroth
the move? Would we switch to JDK7, but run javac -target 1.6 to maintain compatibility for downstream projects during an interim period? Chris Nauroth Hortonworks http://hortonworks.com/ On Wed, Jun 25, 2014 at 9:48 AM, Owen O'Malley omal...@apache.org wrote: On Tue, Jun 24, 2014 at 4:44 PM

Re: Moving to JDK7, JDK8 and new major releases

2014-06-25 Thread Chris Nauroth
to JDK7. I don't know the status of that off the top of my head. Maybe someone else out there knows? If not, then I expect I can free up enough in a few weeks to volunteer for tracking down that information. Chris Nauroth Hortonworks http://hortonworks.com/ On Wed, Jun 25, 2014 at 3:12 PM

Re: [DISCUSS] Change by-laws on release votes: 5 days instead of 7

2014-06-22 Thread Chris Nauroth
+1 binding. Thanks, Arun. Chris Nauroth Hortonworks http://hortonworks.com/ On Sat, Jun 21, 2014 at 10:36 AM, Arun C. Murthy a...@hortonworks.com wrote: Uma, Voting periods are defined in *minimum* terms, so it already covers what you'd like to see i.e. the vote can continue longer

[jira] [Created] (YARN-1970) Prepare YARN codebase for JUnit 4.11.

2014-04-21 Thread Chris Nauroth (JIRA)
Chris Nauroth created YARN-1970: --- Summary: Prepare YARN codebase for JUnit 4.11. Key: YARN-1970 URL: https://issues.apache.org/jira/browse/YARN-1970 Project: Hadoop YARN Issue Type: Test

Re: Policy on adding timeouts to tests

2014-04-15 Thread Chris Nauroth
timeout too. Chris Nauroth Hortonworks http://hortonworks.com/ On Mon, Apr 14, 2014 at 9:41 AM, Karthik Kambatla ka...@cloudera.comwrote: Hi folks Just wanted to check what our policy for adding timeouts to tests is. Do we encourage/discourage using timeouts for tests? If we discourage using

Re: Thinking ahead

2014-04-12 Thread Chris Nauroth
+1 The proposed content for 2.5 in the roadmap wiki looks good to me. On Apr 12, 2014 7:26 AM, Arun C Murthy a...@hortonworks.com wrote: Gang, With hadoop-2.4 out, it's time to think ahead. In the short-term hadoop-2.4.1 is in order; particularly with

[jira] [Created] (YARN-1905) TestProcfsBasedProcessTree must only run on Linux.

2014-04-06 Thread Chris Nauroth (JIRA)
Chris Nauroth created YARN-1905: --- Summary: TestProcfsBasedProcessTree must only run on Linux. Key: YARN-1905 URL: https://issues.apache.org/jira/browse/YARN-1905 Project: Hadoop YARN Issue

Re: very old dependencies

2014-03-28 Thread Chris Nauroth
. For compatibility, I think this effectively means that Hadoop, HDFS, YARN and MapReduce have to wait until after all downstream ecosystem projects finish their upgrades to JDK7. Chris Nauroth Hortonworks http://hortonworks.com/ On Fri, Mar 28, 2014 at 11:04 AM, Steve Loughran ste

Re: [DISCUSS] Clarification on Compatibility Policy: Upgraded Client + Old Server

2014-03-24 Thread Chris Nauroth
Adding back all *-dev lists to make sure everyone is covered. Chris Nauroth Hortonworks http://hortonworks.com/ On Mon, Mar 24, 2014 at 2:02 PM, Chris Nauroth cnaur...@hortonworks.comwrote: Thank you, everyone, for the discussion. There is general agreement, so I have filed HADOOP-10423

Re: [DISCUSS] Clarification on Compatibility Policy: Upgraded Client + Old Server

2014-03-20 Thread Chris Nauroth
with mixed versions? I agree that we need to make it clear in the language that upgrading client alone is insufficient to get access to new server-side features, including new YARN APIs. Thanks for the suggestions, Steve. Chris Nauroth Hortonworks http://hortonworks.com/ On Thu, Mar 20, 2014

[DISCUSS] Clarification on Compatibility Policy: Upgraded Client + Old Server

2014-03-19 Thread Chris Nauroth
NodeManager, thus preserving compatibility. We wanted to open the policy question for wider discussion though. Thanks, everyone. Chris Nauroth Hortonworks http://hortonworks.com/ -- CONFIDENTIALITY NOTICE NOTICE: This message is intended for the use of the individual or entity to which

Re: [DISCUSS] Clarification on Compatibility Policy: Upgraded Client + Old Server

2014-03-19 Thread Chris Nauroth
of different versions could result in a 2.4.0 client calling a 2.3.0 NameNode. Someone could potentially pick up the 2.4.0 WebHDFS client as a dependency and try to use it to make HTTP calls to a 2.3.0 HDFS cluster. Chris Nauroth Hortonworks http://hortonworks.com/ On Wed, Mar 19, 2014 at 4:28 PM, Vinod

Re: Help : Source Code for Map and Reduce task spawning

2014-02-25 Thread Chris Nauroth
(either map or reduce). MapReduceChildJVM is also significant as a helper class. TaskAttemptImpl calls this to do things like setting up the task's environment variables and the exact launch command. Hope this helps! Chris Nauroth Hortonworks http://hortonworks.com/ On Thu, Feb 20, 2014 at 9

Re: Is there any alternative solution thinking on the event model of YARN

2014-02-21 Thread Chris Nauroth
The event model is so much simpler and mvn -Pvisualize draws out a beautiful state diagram. Oh my goodness. How have I gone so long without knowing about this? This is so awesome! Thanks for the tip, Ravi! Chris Nauroth Hortonworks http://hortonworks.com/ On Thu, Feb 20, 2014 at 7:47 PM

[jira] [Resolved] (YARN-191) Enhancements to YARN for Windows Server and Windows Azure development and runtime environments

2014-02-11 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth resolved YARN-191. Resolution: Fixed We've completed the intended scope of this issue, so I'm resolving it. Thank you

Re: branch development for HADOOP-9639

2013-12-06 Thread Chris Nauroth
+1 for the idea. The branch committership clause was added for exactly this kind of scenario. From the phrasing in the bylaws, it looks like we'll need assistance from PMC to get the ball rolling. Is there a PMC member out there who could volunteer to help start the process with Sangjin? Chris

Re: Next releases

2013-11-08 Thread Chris Nauroth
Arun, what are your thoughts on test-only patches? I know I've been merging a lot of Windows test stabilization patches down to branch-2.2. These can't rightly be called blockers, but they do improve dev experience, and there is no risk to product code. Chris Nauroth Hortonworks http

[jira] [Resolved] (YARN-1219) FSDownload changes file suffix making FileUtil.unTar() throw exception

2013-10-04 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth resolved YARN-1219. - Resolution: Fixed I've committed this to trunk, branch-2, and branch-2.1-beta. Shanyu, thank you

Re: [VOTE] Release Apache Hadoop 2.1.1-beta

2013-09-19 Thread Chris Nauroth
I suspect that HDFS-5228 needs to be a blocker for the RC, considering the impact on client code. Existing working client code can now get a NullPointerException as a result of this bug. Chris Nauroth Hortonworks http://hortonworks.com/ On Wed, Sep 18, 2013 at 3:41 PM, Roman Shaposhnik r

Re: [VOTE] Plan to create release candidate for 0.23.8

2013-05-19 Thread Chris Nauroth
+1 (non-binding) BTW, I left a comment on HDFS-4835 suggesting that you include HDFS-3180 for WebHDFS socket connect/read timeouts. It's up to you. (I'm voting +1 for the release plan either way.) Chris Nauroth Hortonworks http://hortonworks.com/ On Fri, May 17, 2013 at 7:25 PM, Eli Collins

[jira] [Created] (YARN-593) container launch on Windows does not correctly populate classpath with new process's environment variables and localized resources

2013-04-19 Thread Chris Nauroth (JIRA)
Chris Nauroth created YARN-593: -- Summary: container launch on Windows does not correctly populate classpath with new process's environment variables and localized resources Key: YARN-593 URL: https

Re: [VOTE] Release Apache Hadoop 0.23.7

2013-04-17 Thread Chris Nauroth
+1 (non-binding) - downloaded binary tarball - verified signatures and checksums - deployed to 3 Ubuntu VMs: 1xNN, 1xRM, 2xDN, 2xNM, 1x2NN - tested multiple HDFS operations - ran wordcount MR job - verified that 2NN can take a checkpoint On Wed, Apr 17, 2013 at 1:17 AM, Chris Douglas

Re: [VOTE] Release Apache Hadoop 2.0.4-alpha

2013-04-17 Thread Chris Nauroth
+1 (non-binding) - downloaded binary tarball - verified signatures and checksums - deployed to 3 Ubuntu VMs: 1xNN, 1xRM, 2xDN, 2xNM, 1x2NN - tested multiple HDFS operations - ran wordcount MR job - verified that 2NN can take a checkpoint On Wed, Apr 17, 2013 at 1:24 AM, Chris Douglas

Re: Maven build YARN ResourceManager only

2013-04-13 Thread Chris Nauroth
compile hadoop-yarn-server-resourcemanager independently. I have to use mvn package -Pdist -DskipTests -Dtar to compile the whole project. What command is appropriate to this scenario? Thanks, oxhead On Sat, Apr 13, 2013 at 12:41 AM, Chris Nauroth cnaur...@hortonworks.comwrote: I

Re: Maven build YARN ResourceManager only

2013-04-12 Thread Chris Nauroth
I don't have an answer to your exact question, but I do have a different suggestion that prevents the need to do frequent rebuilds of the whole Hadoop source tree. First, do a full build of the distribution tar.gz. Extract it and set up a custom hadoop-env.sh for yourself. Inside the

[jira] [Created] (YARN-557) TestUnmanagedAMLauncher fails on Windows

2013-04-08 Thread Chris Nauroth (JIRA)
Chris Nauroth created YARN-557: -- Summary: TestUnmanagedAMLauncher fails on Windows Key: YARN-557 URL: https://issues.apache.org/jira/browse/YARN-557 Project: Hadoop YARN Issue Type: Bug

  1   2   >