Re: [DISCUSS] hadoop branch-3.3+ going to java11 only

2023-03-28 Thread Chris Nauroth
[2] https://github.com/apache/spark/blob/v3.3.2/pom.xml#L109 Chris Nauroth On Tue, Mar 28, 2023 at 11:10 AM Ayush Saxena wrote: > > > > it's already hard to migrate from JDK8 why not retarget JDK17. > > > > +1, makes sense to me, sounds like a win-win situation to

Re: [VOTE] Release Apache Hadoop 3.3.5 (RC3)

2023-03-20 Thread Chris Nauroth
* Ran a MapReduce job with the native bzip2 codec for compression, and it worked fine. * Ran a MapReduce job with YARN configured to use LinuxContainerExecutor and verified launching the containers through container-executor worked. Chris Nauroth On Mon, Mar 20, 2023 at 3:45 AM Ayush Sax

Re: [VOTE] Release Apache Hadoop 3.3.5 (RC3)

2023-03-18 Thread Chris Nauroth
Yes, I'm in progress on verification, so you can expect to get a vote from me. Thank you, Steve! Chris Nauroth On Sat, Mar 18, 2023 at 9:19 AM Ashutosh Gupta wrote: > Hi Steve > > I will also do it by today/tomorrow. > > Thanks, > Ashutosh > > On Sat, 18 Mar, 2023

[jira] [Resolved] (MAPREDUCE-7375) JobSubmissionFiles don't set right permission after mkdirs

2023-01-12 Thread Chris Nauroth (Jira)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth resolved MAPREDUCE-7375. -- Fix Version/s: 3.4.0 3.2.5 3.3.9

Re: [VOTE] Release Apache Hadoop 3.3.5

2023-01-04 Thread Chris Nauroth
to MiniDFSCluster and restarts within a single JVM, then I agree the impact is smaller. Then, we'd want to consider what downstream projects have tests that do restarts on a MiniDFSCluster. Chris Nauroth On Wed, Jan 4, 2023 at 4:22 PM Ayush Saxena wrote: > Hmm I'm looking at HADOOP-11867 related st

Re: [VOTE] Release Apache Hadoop 3.3.5

2023-01-03 Thread Chris Nauroth
timing out. Regarding Hive and Bouncy Castle, there is an existing issue and pull request tracking an upgrade attempt. It's looking like some amount of code changes are required: https://issues.apache.org/jira/browse/HIVE-26648 https://github.com/apache/hive/pull/3744 Chris Nauroth On Tue, Jan 3, 2023

Re: [VOTE] Release Apache Hadoop 3.3.5

2022-12-27 Thread Chris Nauroth
red to use LinuxContainerExecutor and verified launching the containers through container-executor worked. Chris Nauroth On Wed, Dec 21, 2022 at 11:29 AM Steve Loughran wrote: > Mukund and I have put together a release candidate (RC0) for Hadoop 3.3.5. > > Given the time of year it's a bit unrealistic

[jira] [Resolved] (MAPREDUCE-7425) Document Fix for yarn.app.mapreduce.client-am.ipc.max-retries

2022-11-01 Thread Chris Nauroth (Jira)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth resolved MAPREDUCE-7425. -- Fix Version/s: 3.4.0 3.3.5 3.2.5

Re: [VOTE] Release Apache Hadoop 3.3.4

2022-08-03 Thread Chris Nauroth
it's something flaky that's already tracked in a JIRA issue. The release looks good. Steve, thank you for driving this. Chris Nauroth On Wed, Aug 3, 2022 at 11:27 AM Steve Loughran wrote: > my vote for this is +1, binding. > > obviously I`m biased, but i do not want to have to issue

[jira] [Resolved] (MAPREDUCE-7372) MapReduce set permission too late in copyJar method

2022-07-25 Thread Chris Nauroth (Jira)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth resolved MAPREDUCE-7372. -- Fix Version/s: 3.4.0 3.3.9 3.2.5 Hadoop

Re: [VOTE] Release Apache Hadoop 3.2.4 - RC0

2022-07-21 Thread Chris Nauroth
for TestFsck, where the failure was caused by missing audit log entries. This test works by toggling global logging state, so I can see why multi-threaded execution might confuse the test. Chris Nauroth On Thu, Jul 21, 2022 at 12:01 AM Ashutosh Gupta wrote: > +1(non-binding) > > * Bu

Re: [VOTE] Release Apache Hadoop 3.2.4 - RC0

2022-07-19 Thread Chris Nauroth
analysis on these new test failures. I don't know if it's a quirk to my environment, though I'm using the start-build-env.sh Docker container, so any build dependencies should be consistent. I'd be comfortable moving ahead if others are seeing these tests pass. Chris Nauroth On Thu, Jul 14, 2022 at 7

Re: [VOTE] Release Apache Hadoop 2.10.2 - RC0

2022-05-29 Thread Chris Nauroth
enough to hold up a release, so I'm still voting +1. Chris Nauroth On Sun, May 29, 2022 at 2:35 AM Masatake Iwasaki < iwasak...@oss.nttdata.co.jp> wrote: > Thanks for the help, Ayush. > > I committed HADOOP-16663/HADOOP-16664 and cherry-picked HADOOP-16985 to > branch-2.

Re: [VOTE] Release Apache Hadoop 3.3.3 (RC1)

2022-05-16 Thread Chris Nauroth
+1 (binding) - Verified all checksums. - Verified all signatures. - Built from source, including native code on Linux. - Ran several examples successfully. Chris Nauroth On Mon, May 16, 2022 at 10:06 AM Chao Sun wrote: > +1 > > - Compiled from source > - Verified checksums

Re: [DISCUSS] Hadoop 3.3.2 release?

2021-09-08 Thread Chris Nauroth
+1 Chao, thank you very much for volunteering on the release. Chris Nauroth On Tue, Sep 7, 2021 at 10:00 PM Igor Dvorzhak wrote: > +1 > > On Tue, Sep 7, 2021 at 10:06 AM Chao Sun wrote: > >> Hi all, >> >> It has been almost 3 months since the 3.3.1 release and

Re: [VOTE] Release Apache Hadoop 2.7.3 RC1

2016-08-18 Thread Chris Nauroth
getting a patch on the compatibility doc that addresses the HDFS audit log specifically. --Chris Nauroth On 8/18/16, 8:47 AM, "Andrew Purtell" <andrew.purt...@gmail.com> wrote: An incompatible APIs change is developer unfriendly. An incompatible behavioral ch

Apache MSDN Offer is Back

2016-07-19 Thread Chris Nauroth
-licenses/msdn.txt. --Chris Nauroth

Re: ASF OS X Build Infrastructure

2016-05-21 Thread Chris Nauroth
. I'll send another update when I have something more specific to share. --Chris Nauroth From: Ravi Prakash <ravihad...@gmail.com<mailto:ravihad...@gmail.com>> Date: Friday, May 20, 2016 at 4:56 PM To: Sean Busbey <bus...@cloudera.com<mailto:bus...@cloudera.com>>

Re: ASF OS X Build Infrastructure

2016-05-20 Thread Chris Nauroth
It's very disappointing to see that vanish. I'm following up to see if I can learn more about what happened or if I can do anything to help reinstate it. --Chris Nauroth On 5/20/16, 6:11 AM, "Steve Loughran" <ste...@hortonworks.com> wrote: > >> On 20 May 201

Re: ASF OS X Build Infrastructure

2016-05-19 Thread Chris Nauroth
, but it keeps slipping. I'll try once again to bump up priority. --Chris Nauroth On 5/19/16, 9:41 AM, "Allen Wittenauer" <a...@apache.org> wrote: > > Some of you may not know that the ASF actually does have an OS X machine >(a Mac mini, so it¹s not a

Re: [VOTE] Merge feature branch HADOOP-12930

2016-05-16 Thread Chris Nauroth
Understood about the tests. --Chris Nauroth On 5/15/16, 7:30 AM, "Allen Wittenauer" <a...@apache.org> wrote: > >> On May 14, 2016, at 3:11 PM, Chris Nauroth <cnaur...@hortonworks.com> >>wrote: >> >> +1 (binding) >> >> -Tried a d

Re: [VOTE] Merge feature branch HADOOP-12930

2016-05-14 Thread Chris Nauroth
attach a full patch to HADOOP-12930 to check pre-commit results? While testing this, I discovered a bug in the distro build for Windows. Could someone please code review my patch on HADOOP-13149? --Chris Nauroth On 5/9/16, 1:26 PM, "Allen Wittenauer" <a...@apache.org> wrote

Re: [DISCUSS] Treating LimitedPrivate({"MapReduce"}) as Public APIs for YARN applications

2016-05-10 Thread Chris Nauroth
of its API like Credentials. I'm in the camp that generally questions the usefulness of LimitedPrivate, but I agree that transitions to Public need case-by-case consideration. --Chris Nauroth From: Andrew Wang <andrew.w...@cloudera.com<mailto:andrew.w...@cloudera.com>> Date: Tuesday,

Re: [DISCUSS] Treating LimitedPrivate({"MapReduce"}) as Public APIs for YARN applications

2016-05-10 Thread Chris Nauroth
that want to integrate with a secured Hadoop cluster. There is prior discussion of this topic on HADOOP-10776 and HADOOP-12913. HADOOP-10776 is a blocker for 2.8.0 to make the transition to Public. --Chris Nauroth On 5/10/16, 11:34 AM, "Hitesh Shah" <hit...@apache.org> wrot

Re: [Release thread] 2.8.0 release activities

2016-02-04 Thread Chris Nauroth
FYI, I've just needed to raise HDFS-9761 to blocker status for the 2.8.0 release. --Chris Nauroth On 2/3/16, 6:19 PM, "Karthik Kambatla" <ka...@cloudera.com> wrote: >Thanks Vinod. Not labeling 2.8.0 stable sounds perfectly reasonable to me. >Let us not call i

[jira] [Created] (MAPREDUCE-6563) Streaming documentation contains a stray '%' character.

2015-12-04 Thread Chris Nauroth (JIRA)
Chris Nauroth created MAPREDUCE-6563: Summary: Streaming documentation contains a stray '%' character. Key: MAPREDUCE-6563 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6563 Project: Hadoop

[jira] [Created] (MAPREDUCE-6565) Configuration to use host name in delegation token service is not read from job.xml during MapReduce job execution.

2015-12-04 Thread Chris Nauroth (JIRA)
Chris Nauroth created MAPREDUCE-6565: Summary: Configuration to use host name in delegation token service is not read from job.xml during MapReduce job execution. Key: MAPREDUCE-6565 URL: https

Re: [DISCUSS] Looking to a 2.8.0 release

2015-11-25 Thread Chris Nauroth
+1. Thanks, Vinod. --Chris Nauroth On 11/25/15, 1:45 PM, "Vinod Kumar Vavilapalli" <vino...@apache.org> wrote: >Okay, tx for this clarification Chris! I dug more into this and now >realized the actual scope of this. Given the the limited nature of this >

Re: [DISCUSS] Looking to a 2.8.0 release

2015-11-25 Thread Chris Nauroth
wanted to prevent any mistaken assumptions for people only reading this thread. --Chris Nauroth On 11/25/15, 11:08 AM, "Vinod Kumar Vavilapalli" <vino...@apache.org> wrote: >This is the current state from the feedback I gathered. > - Support priorities across applic

Re: Hadoop 2.6.1 Release process thread

2015-08-14 Thread Chris Nauroth
, Allen Wittenauer wrote: I hope someone tests this against JDK6, otherwise this is an incompatible change. On Aug 12, 2015, at 2:21 PM, Chris Nauroth cnaur...@hortonworks.com wrote: I've just applied the 2.6.1-candidate label to HADOOP-10786. Since this is somewhat late in the process, I

Re: Hadoop 2.6.1 Release process thread

2015-08-12 Thread Chris Nauroth
HADOOP-10786 is justified for inclusion in a patch release. --Chris Nauroth On 8/11/15, 7:48 PM, Sangjin Lee sjl...@gmail.com wrote: It might have been because we thought that HDFS-7704 was going to make it. It's both make it or neither does. Now that we know HDFS-7704 is out, HDFS-7916 should

Re: 2.7.2 release plan

2015-07-16 Thread Chris Nauroth
I'd be comfortable with inclusion of any doc-only patch in minor releases. There is a lot of value to end users in pushing documentation fixes as quickly as possible, and they don't bear the same risk of regressions or incompatibilities as code changes. --Chris Nauroth On 7/16/15, 12:38 AM

Re: IMPORTANT: automatic changelog creation

2015-07-02 Thread Chris Nauroth
+1 Thank you to Allen for the script, and thank you to Andrew for volunteering to drive the conversion. --Chris Nauroth On 7/2/15, 2:01 PM, Andrew Wang andrew.w...@cloudera.com wrote: Hi all, I want to revive the discussion on this thread, since the overhead of CHANGES.txt came up again

F 6/19: Jenkins clogged up

2015-06-19 Thread Chris Nauroth
. --Chris Nauroth

Reminder: Apache committers have access to a free MSDN license

2015-06-06 Thread Chris Nauroth
it in a VirtualBox VM (or your hypervisor of choice). Instructions for setting up a Windows development environment have been in BUILDING.txt for a few years. This would prevent situations where patches are blocked from getting committed while waiting for me or any other individual to test. --Chris Nauroth

Re: 2.7.1 status

2015-05-27 Thread Chris Nauroth
Thanks, Larry. I have marked HADOOP-11934 as a blocker for 2.7.1. I have reviewed and +1'd it. I can commit it after we get feedback from Jenkins. --Chris Nauroth On 5/26/15, 12:41 PM, larry mccay lmc...@apache.org wrote: Hi Vinod - I think that https://issues.apache.org/jira/browse

Re: [DISCUSS] branch-1

2015-05-08 Thread Chris Nauroth
that no one is actively developing for the branch, but there would still be the option of filing new critical bugs if someone decides that they want a new 1.x release. --Chris Nauroth On 5/8/15, 10:50 AM, Karthik Kambatla ka...@cloudera.com wrote: I would be -1 to declaring the branch dead just yet

Re: Planning Hadoop 2.6.1 release

2015-04-30 Thread Chris Nauroth
believe finally fixes the root cause of this issue. --Chris Nauroth On 4/30/15, 3:55 PM, Arpit Agarwal aagar...@hortonworks.com wrote: HDFS candidates for back-porting to Hadoop 2.6.1. The first two were requested in [1]. HADOOP-11674. oneByteBuf in CryptoInputStream and CryptoOutputStream

Re: Set minimum version of Hadoop 3 to JDK 8

2015-04-21 Thread Chris Nauroth
? I'd prefer to avoid executing duplicate builds for different JDK versions. Pre-commit already takes a long time, and I suspect doubling the amount of builds will make us starved for executors in Jenkins. Chris Nauroth Hortonworks http://hortonworks.com/ On 4/21/15, 8:38 PM, Sean Busbey bus

Re: Patch failed to build with eclipse:eclipse.

2015-04-20 Thread Chris Nauroth
automation in HADOOP-11746. Let's see if the problems subside after that. For now, I don't think it's worthwhile to investigate this failure any further. Thank you for following up! Chris Nauroth Hortonworks http://hortonworks.com/ On 4/20/15, 12:28 PM, Jens Rabe rabe-j...@t-online.de wrote

committing HADOOP-11746 test-patch improvements

2015-04-16 Thread Chris Nauroth
the pre-commit process. I have +1'd the patch, but since this is a tool that we all use frequently, I'd like to delay a day before committing. Please comment on the jira if you have any additional feedback. We're aiming to commit on Friday, 4/17. Chris Nauroth Hortonworks http://hortonworks.com/

Re: [VOTE] Release Apache Hadoop 2.7.0 RC0

2015-04-15 Thread Chris Nauroth
of the JCarder build with Java 7 classes. (2.7.0 is our first release compiling as Java 7.) This is not a problem that needs to hold up the release. Vinod, thank you for putting together the release. Chris Nauroth Hortonworks http://hortonworks.com/ On 4/15/15, 7:07 AM, Mit Desai mitde...@yahoo

Re: A 2.7.1 release to follow up 2.7.0

2015-04-09 Thread Chris Nauroth
+1, full agreement with both Vinod and Karthik. Thanks! Chris Nauroth Hortonworks http://hortonworks.com/ On 4/9/15, 12:07 PM, Karthik Kambatla ka...@cloudera.com wrote: Inline. On Thu, Apr 9, 2015 at 11:48 AM, Vinod Kumar Vavilapalli vino...@apache.org wrote: Hi all, I feel like we

Re: map() function call related

2015-04-07 Thread Chris Nauroth
FileInputFormat and TextInputFormat, which you can then find in the source code. I hope this helps. Chris Nauroth Hortonworks http://hortonworks.com/ On 4/7/15, 6:09 AM, Shahil Varshney shahilvarsh...@gmail.com wrote: Sir , i want to know that which class in hadoop (internal source class

[jira] [Resolved] (MAPREDUCE-6212) UnsatisfiedLinkError: org.apache.hadoop.security.JniBasedUnixGroupsMapping.anchorNative() happened when starting MRAppMaster

2015-01-08 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth resolved MAPREDUCE-6212. -- Resolution: Invalid UnsatisfiedLinkError

Re: [VOTE] Release Apache Hadoop 2.6.0

2014-11-14 Thread Chris Nauroth
-7385, the recent blocker related to incorrect ACLs serialized to the edit log. Thank you to Arun as release manager, and thank you to all of the contributors for their hard work on this release. Chris Nauroth Hortonworks http://hortonworks.com/ On Fri, Nov 14, 2014 at 10:57 AM, Yongjun Zhang yzh

Re: [VOTE] Release Apache Hadoop 2.6.0

2014-11-14 Thread Chris Nauroth
Hi Eric, There was a second release candidate created (named rc1), and voting started fresh in a new thread. You might want to join in on that second thread to make sure that your vote gets counted. Thanks! Chris Nauroth Hortonworks http://hortonworks.com/ On Fri, Nov 14, 2014 at 3:08 PM

Re: [VOTE] Release Apache Hadoop 2.6.0

2014-11-13 Thread Chris Nauroth
I'm helping to expedite a complete, approved patch for HDFS-7385 now. Then, we can make a final decision on its inclusion in 2.6.0. Thank you for bringing it up, Yi. Chris Nauroth Hortonworks http://hortonworks.com/ On Wed, Nov 12, 2014 at 7:31 PM, Liu, Yi A yi.a@intel.com wrote: Arun

Re: [VOTE] Release Apache Hadoop 2.6.0

2014-11-13 Thread Chris Nauroth
I have committed HDFS-7385 down through branch-2.6.0. Thank you! Chris Nauroth Hortonworks http://hortonworks.com/ On Thu, Nov 13, 2014 at 9:14 AM, Chris Nauroth cnaur...@hortonworks.com wrote: I'm helping to expedite a complete, approved patch for HDFS-7385 now. Then, we can make a final

[jira] [Created] (MAPREDUCE-6123) TestCombineFileInputFormat incorrectly starts 2 MiniDFSCluster instances.

2014-10-06 Thread Chris Nauroth (JIRA)
Chris Nauroth created MAPREDUCE-6123: Summary: TestCombineFileInputFormat incorrectly starts 2 MiniDFSCluster instances. Key: MAPREDUCE-6123 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6123

HDFS-573: Windows builds will require CMake

2014-08-03 Thread Chris Nauroth
convenience. I'll hold off committing for a few more days to give everyone time to react. Chris Nauroth Hortonworks http://hortonworks.com/ -- CONFIDENTIALITY NOTICE NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information

Re: [DISCUSS] Assume Private-Unstable for classes that are not annotated

2014-07-24 Thread Chris Nauroth
+1 for the proposal. I believe stating that classes without annotations are implicitly private is consistent with what we publish for our JavaDocs. IncludePublicAnnotationsStandardDoclet, used in the root pom.xml, filters out classes that don't explicitly have the Public annotation. Chris

Re: Jenkins Build Slaves

2014-07-10 Thread Chris Nauroth
the issue in case someone else gets an opportunity to look. Chris Nauroth Hortonworks http://hortonworks.com/ On Wed, Jul 9, 2014 at 10:33 AM, Giridharan Kesavan gkesa...@hortonworks.com wrote: I dont think so, let me fix that. Thanks Chris for pointing that out. -giri On Wed, Jul 9

Re: Jenkins Build Slaves

2014-07-09 Thread Chris Nauroth
/cmake-2.8/Modules/FindPackageHandleStandardArgs.cmake:108 (message): [exec] Could NOT find PkgConfig (missing: PKG_CONFIG_EXECUTABLE) Chris Nauroth Hortonworks http://hortonworks.com/ On Wed, Jul 9, 2014 at 7:08 AM, Giridharan Kesavan gkesa...@hortonworks.com wrote: Build jobs are now

Re: Moving to JDK7, JDK8 and new major releases

2014-06-28 Thread Chris Nauroth
that its client will continue to support JDK6, then it wouldn't be practical for them to link to a JDK7 version of hadoop-common.) +1 for the whole plan though. We can work through these details. Chris Nauroth Hortonworks http://hortonworks.com/ On Fri, Jun 27, 2014 at 3:10 PM, Karthik Kambatla

Re: Anyone know how to mock a secured hdfs for unit test?

2014-06-27 Thread Chris Nauroth
. It would be great to get more regular test coverage with something that more closely approximates a secured deployment. Chris Nauroth Hortonworks http://hortonworks.com/ On Thu, Jun 26, 2014 at 7:27 AM, Zheng, Kai kai.zh...@intel.com wrote: Hi David, Quite some time ago I opened HADOOP-9952

Re: Moving to JDK7, JDK8 and new major releases

2014-06-25 Thread Chris Nauroth
the move? Would we switch to JDK7, but run javac -target 1.6 to maintain compatibility for downstream projects during an interim period? Chris Nauroth Hortonworks http://hortonworks.com/ On Wed, Jun 25, 2014 at 9:48 AM, Owen O'Malley omal...@apache.org wrote: On Tue, Jun 24, 2014 at 4:44 PM

Re: [VOTE] Change by-laws on release votes: 5 days instead of 7

2014-06-24 Thread Chris Nauroth
+1 (binding) Chris Nauroth Hortonworks http://hortonworks.com/ On Tue, Jun 24, 2014 at 10:58 AM, Jakob Homan jgho...@gmail.com wrote: +1 (binding) On Tue, Jun 24, 2014 at 10:33 AM, Zhijie Shen zs...@hortonworks.com wrote: +1 (non-binding) On Wed, Jun 25, 2014 at 1:26 AM, Aaron T

Re: SIMPLE authentication is not enabled error for secured hdfs read

2014-06-24 Thread Chris Nauroth
UserGroupInformation directly from your code. Hope this helps. Chris Nauroth Hortonworks http://hortonworks.com/ On Tue, Jun 24, 2014 at 6:29 AM, Liu, David liujion...@gmail.com wrote: Hi experts, After kinit hadoop, When I run this java file on a secured hadoop cluster, I met the following

Re: [DISCUSS] Change by-laws on release votes: 5 days instead of 7

2014-06-22 Thread Chris Nauroth
+1 binding. Thanks, Arun. Chris Nauroth Hortonworks http://hortonworks.com/ On Sat, Jun 21, 2014 at 10:36 AM, Arun C. Murthy a...@hortonworks.com wrote: Uma, Voting periods are defined in *minimum* terms, so it already covers what you'd like to see i.e. the vote can continue longer

[jira] [Created] (MAPREDUCE-5922) Update distcp documentation to mention option for preserving xattrs.

2014-06-11 Thread Chris Nauroth (JIRA)
Chris Nauroth created MAPREDUCE-5922: Summary: Update distcp documentation to mention option for preserving xattrs. Key: MAPREDUCE-5922 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5922

[jira] [Created] (MAPREDUCE-5886) Allow wordcount example job to accept multiple input paths.

2014-05-11 Thread Chris Nauroth (JIRA)
Chris Nauroth created MAPREDUCE-5886: Summary: Allow wordcount example job to accept multiple input paths. Key: MAPREDUCE-5886 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5886 Project

[jira] [Created] (MAPREDUCE-5852) Prepare MapReduce codebase for JUnit 4.11.

2014-04-21 Thread Chris Nauroth (JIRA)
Chris Nauroth created MAPREDUCE-5852: Summary: Prepare MapReduce codebase for JUnit 4.11. Key: MAPREDUCE-5852 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5852 Project: Hadoop Map/Reduce

[jira] [Created] (MAPREDUCE-5850) PATH environment variable contains duplicate values in map and reduce tasks on Windows.

2014-04-18 Thread Chris Nauroth (JIRA)
Chris Nauroth created MAPREDUCE-5850: Summary: PATH environment variable contains duplicate values in map and reduce tasks on Windows. Key: MAPREDUCE-5850 URL: https://issues.apache.org/jira/browse/MAPREDUCE

[jira] [Created] (MAPREDUCE-5840) Update MapReduce calls to ProxyUsers#authorize.

2014-04-16 Thread Chris Nauroth (JIRA)
Chris Nauroth created MAPREDUCE-5840: Summary: Update MapReduce calls to ProxyUsers#authorize. Key: MAPREDUCE-5840 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5840 Project: Hadoop Map

Re: Policy on adding timeouts to tests

2014-04-15 Thread Chris Nauroth
timeout too. Chris Nauroth Hortonworks http://hortonworks.com/ On Mon, Apr 14, 2014 at 9:41 AM, Karthik Kambatla ka...@cloudera.comwrote: Hi folks Just wanted to check what our policy for adding timeouts to tests is. Do we encourage/discourage using timeouts for tests? If we discourage using

Re: Thinking ahead

2014-04-12 Thread Chris Nauroth
+1 The proposed content for 2.5 in the roadmap wiki looks good to me. On Apr 12, 2014 7:26 AM, Arun C Murthy a...@hortonworks.com wrote: Gang, With hadoop-2.4 out, it's time to think ahead. In the short-term hadoop-2.4.1 is in order; particularly with

[jira] [Resolved] (MAPREDUCE-5808) Port output replication factor configurable for terasort to Hadoop 1.x

2014-03-24 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth resolved MAPREDUCE-5808. -- Resolution: Fixed Fix Version/s: 1.3.0 1-win I committed

Re: [DISCUSS] Clarification on Compatibility Policy: Upgraded Client + Old Server

2014-03-24 Thread Chris Nauroth
Adding back all *-dev lists to make sure everyone is covered. Chris Nauroth Hortonworks http://hortonworks.com/ On Mon, Mar 24, 2014 at 2:02 PM, Chris Nauroth cnaur...@hortonworks.comwrote: Thank you, everyone, for the discussion. There is general agreement, so I have filed HADOOP-10423

Re: [DISCUSS] Clarification on Compatibility Policy: Upgraded Client + Old Server

2014-03-20 Thread Chris Nauroth
with mixed versions? I agree that we need to make it clear in the language that upgrading client alone is insufficient to get access to new server-side features, including new YARN APIs. Thanks for the suggestions, Steve. Chris Nauroth Hortonworks http://hortonworks.com/ On Thu, Mar 20, 2014

[DISCUSS] Clarification on Compatibility Policy: Upgraded Client + Old Server

2014-03-19 Thread Chris Nauroth
NodeManager, thus preserving compatibility. We wanted to open the policy question for wider discussion though. Thanks, everyone. Chris Nauroth Hortonworks http://hortonworks.com/ -- CONFIDENTIALITY NOTICE NOTICE: This message is intended for the use of the individual or entity to which

Re: [DISCUSS] Clarification on Compatibility Policy: Upgraded Client + Old Server

2014-03-19 Thread Chris Nauroth
of different versions could result in a 2.4.0 client calling a 2.3.0 NameNode. Someone could potentially pick up the 2.4.0 WebHDFS client as a dependency and try to use it to make HTTP calls to a 2.3.0 HDFS cluster. Chris Nauroth Hortonworks http://hortonworks.com/ On Wed, Mar 19, 2014 at 4:28 PM, Vinod

[jira] [Resolved] (MAPREDUCE-4401) Enhancements to MapReduce for Windows Server and Windows Azure development and runtime environments

2014-02-11 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth resolved MAPREDUCE-4401. -- Resolution: Fixed We've completed the intended scope of this issue, so I'm

Re: branch development for HADOOP-9639

2013-12-06 Thread Chris Nauroth
+1 for the idea. The branch committership clause was added for exactly this kind of scenario. From the phrasing in the bylaws, it looks like we'll need assistance from PMC to get the ball rolling. Is there a PMC member out there who could volunteer to help start the process with Sangjin? Chris

[jira] [Resolved] (MAPREDUCE-5655) Remote job submit from windows to a linux hadoop cluster fails due to wrong classpath

2013-12-02 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth resolved MAPREDUCE-5655. -- Resolution: Duplicate Hi, [~padisah]. Thanks for the bug report. I do think

[jira] [Reopened] (MAPREDUCE-5606) JobTracker blocked for DFSClient: Failed recovery attempt

2013-11-19 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth reopened MAPREDUCE-5606: -- Assignee: (was: firegun) I'm reopening this. There is an actual bug here

[jira] [Created] (MAPREDUCE-5616) MR Client-AppMaster RPC max retries on socket timeout is too high.

2013-11-08 Thread Chris Nauroth (JIRA)
Chris Nauroth created MAPREDUCE-5616: Summary: MR Client-AppMaster RPC max retries on socket timeout is too high. Key: MAPREDUCE-5616 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5616

Re: Next releases

2013-11-08 Thread Chris Nauroth
Arun, what are your thoughts on test-only patches? I know I've been merging a lot of Windows test stabilization patches down to branch-2.2. These can't rightly be called blockers, but they do improve dev experience, and there is no risk to product code. Chris Nauroth Hortonworks http

[jira] [Created] (MAPREDUCE-5604) TestMRAMWithNonNormalizedCapabilities fails on Windows due to exceeding max path length

2013-10-31 Thread Chris Nauroth (JIRA)
Chris Nauroth created MAPREDUCE-5604: Summary: TestMRAMWithNonNormalizedCapabilities fails on Windows due to exceeding max path length Key: MAPREDUCE-5604 URL: https://issues.apache.org/jira/browse/MAPREDUCE

Re: About documentation in apache hadoop site

2013-10-25 Thread Chris Nauroth
is sourced from the following file in the codebase: hadoop-common-project/hadoop-common/src/site/apt/ClusterSetup.apt.vm Chris Nauroth Hortonworks http://hortonworks.com/ On Thu, Oct 24, 2013 at 9:31 AM, Yoonmin Nam rony...@dgist.ac.kr wrote: Hi, I am Yoonmin from DGIST, South Korea. I found some

[jira] [Resolved] (MAPREDUCE-5588) TaskTrackers get killed by JettyBugMonitor because of incredibly high cpu usage

2013-10-17 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth resolved MAPREDUCE-5588. -- Resolution: Duplicate Assignee: Chris Nauroth Hello, [~moian

[jira] [Resolved] (MAPREDUCE-5546) mapred.cmd on Windows set HADOOP_OPTS incorrectly

2013-10-14 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth resolved MAPREDUCE-5546. -- Resolution: Fixed Fix Version/s: 2.2.1 3.0.0 I've

Re: [VOTE] Release Apache Hadoop 2.2.0

2013-10-10 Thread Chris Nauroth
cluster. It threw UnsupportedOperationException, which is the expected behavior. Chris Nauroth Hortonworks http://hortonworks.com/ On Thu, Oct 10, 2013 at 10:18 AM, Bikas Saha bi...@hortonworks.com wrote: +1 (non binding) -Original Message- From: Arpit Gupta [mailto:ar...@hortonworks.com

Re: [VOTE] Release Apache Hadoop 2.1.1-beta

2013-09-24 Thread Chris Nauroth
Update: HDFS-5228 has been resolved. It was committed to branch-2.1-beta, so I think there was an assumption that this would warrant a new RC. (If that's not the case, then we ought to pull HDFS-5228 back out of branch-2.1-beta to avoid confusion.) Chris Nauroth Hortonworks http

[jira] [Resolved] (MAPREDUCE-5508) JobTracker memory leak caused by unreleased FileSystem objects in JobInProgress#cleanupJob

2013-09-23 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth resolved MAPREDUCE-5508. -- Resolution: Fixed Fix Version/s: 1.3.0 1-win

[jira] [Resolved] (MAPREDUCE-5498) maven Junit dependency should be test only

2013-09-14 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth resolved MAPREDUCE-5498. -- Resolution: Duplicate maven Junit dependency should be test only

[jira] [Reopened] (MAPREDUCE-5498) maven Junit dependency should be test only

2013-09-14 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth reopened MAPREDUCE-5498: -- maven Junit dependency should be test only

[jira] [Resolved] (MAPREDUCE-5470) LocalJobRunner does not work on Windows.

2013-08-23 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth resolved MAPREDUCE-5470. -- Resolution: Fixed Fix Version/s: 2.1.1-beta 3.0.0 I

[jira] [Created] (MAPREDUCE-5470) LocalJobRunner does not work on Windows.

2013-08-20 Thread Chris Nauroth (JIRA)
Chris Nauroth created MAPREDUCE-5470: Summary: LocalJobRunner does not work on Windows. Key: MAPREDUCE-5470 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5470 Project: Hadoop Map/Reduce

[jira] [Created] (MAPREDUCE-5460) MR AppMaster command options does not replace @taskid@ with the current task ID.

2013-08-14 Thread Chris Nauroth (JIRA)
Chris Nauroth created MAPREDUCE-5460: Summary: MR AppMaster command options does not replace @taskid@ with the current task ID. Key: MAPREDUCE-5460 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5460

[jira] [Resolved] (MAPREDUCE-5405) Job recovery can fail if task log directory symlink from prior run still exists

2013-07-22 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth resolved MAPREDUCE-5405. -- Resolution: Fixed Fix Version/s: 1.3.0 1-win Hadoop

[jira] [Resolved] (MAPREDUCE-5406) Improve logging around Task Tracker exiting with JVM manager inconsistent state

2013-07-20 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth resolved MAPREDUCE-5406. -- Resolution: Fixed Fix Version/s: 1.3.0 1-win I committed

[jira] [Created] (MAPREDUCE-5405) Job recovery can fail if task log directory symlink from prior run still exists

2013-07-19 Thread Chris Nauroth (JIRA)
Chris Nauroth created MAPREDUCE-5405: Summary: Job recovery can fail if task log directory symlink from prior run still exists Key: MAPREDUCE-5405 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5405

[jira] [Resolved] (MAPREDUCE-5391) TestNonLocalJobJarSubmission fails on Windows due to missing classpath entries

2013-07-17 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth resolved MAPREDUCE-5391. -- Resolution: Fixed Fix Version/s: 1-win I committed this to branch-1-win

[jira] [Created] (MAPREDUCE-5391) TestNonLocalJobJarSubmission fails on Windows due to missing classpath entries

2013-07-15 Thread Chris Nauroth (JIRA)
Chris Nauroth created MAPREDUCE-5391: Summary: TestNonLocalJobJarSubmission fails on Windows due to missing classpath entries Key: MAPREDUCE-5391 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5391

[jira] [Resolved] (MAPREDUCE-5371) TestProxyUserFromEnv#testProxyUserFromEnvironment failed caused by domains of windows users

2013-07-08 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth resolved MAPREDUCE-5371. -- Resolution: Fixed +1 for the patch. I committed this to branch-1-win. Thank you

[jira] [Resolved] (MAPREDUCE-5349) TestClusterMapReduceTestCase and TestJobName fail on Windows in branch-2

2013-06-30 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth resolved MAPREDUCE-5349. -- Resolution: Fixed Fix Version/s: 2.1.0-beta Target Version/s

Re: Visual debugging tools for hadoop

2013-06-14 Thread Chris Nauroth
Hi Saikat, You might want to investigate contributing on Apache Ambari, which has features for visualization of jobs and end-to-end flows consisting of multiple dependent jobs. http://incubator.apache.org/ambari/ Chris Nauroth Hortonworks http://hortonworks.com/ On Fri, Jun 14, 2013 at 8:20

Re: Clarifications on MAPREDUCE-5183

2013-05-21 Thread Chris Nauroth
BTW, there is a handy helper function in Hadoop Common that can help you with this: org.apache.hadoop.util.StringUtils.formatPercent. Chris Nauroth Hortonworks http://hortonworks.com/ On Tue, May 21, 2013 at 11:06 AM, maisnam ns maisnam...@gmail.com wrote: Hi Sandy, Sure, I would do

Re: [VOTE] Plan to create release candidate for 0.23.8

2013-05-19 Thread Chris Nauroth
+1 (non-binding) BTW, I left a comment on HDFS-4835 suggesting that you include HDFS-3180 for WebHDFS socket connect/read timeouts. It's up to you. (I'm voting +1 for the release plan either way.) Chris Nauroth Hortonworks http://hortonworks.com/ On Fri, May 17, 2013 at 7:25 PM, Eli Collins

  1   2   >