Re: Branching 2.5

I looked in the log, it also looks like findbugs is OOMing: [java] Exception in thread main java.lang.OutOfMemoryError: GC overhead limit exceeded [java] at edu.umd.cs.findbugs.ba.Path.grow(Path.java:263) [java] at edu.umd.cs.findbugs.ba.Path.copyFrom(Path.java:113)

Re: Branching 2.5

Alright, dug around some more and I think it's that FINDBUGS_HOME is not being set correctly. I downloaded and extracted Findbugs 1.3.9, pointed FINDBUGS_HOME at it, and the build worked after that. I don't know what's up with the default maven build, it'd be great if someone could check. Can

Re: Change proposal for FileInputFormat isSplitable

Hi, I talked to some people and they agreed with me that really the situation where this problem occurs is when they build a FileInputFormat derivative that also uses a LineRecordReader derivative. This is exactly the scenario that occurs if someone follows the Yahoo Hadoop tutorial. Instead of

Re: Branching 2.5

Adding bui...@apache.org Cheers On Jul 30, 2014, at 12:52 AM, Andrew Wang andrew.w...@cloudera.com wrote: Alright, dug around some more and I think it's that FINDBUGS_HOME is not being set correctly. I downloaded and extracted Findbugs 1.3.9, pointed FINDBUGS_HOME at it, and the build worked

Build failed in Jenkins: Hadoop-Common-0.23-Build #1026

See https://builds.apache.org/job/Hadoop-Common-0.23-Build/1026/ -- [...truncated 8263 lines...] Running org.apache.hadoop.fs.TestFileSystemTokens Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.499 sec Running

Re: Code guidelines and bash

one argument in favour of 80 is that it's easier to side-by-side diff even so, I find it restrictive in Java code; once you go for long env vars in bash-land then you are in trouble. As for python, you have to indent according to your code flow. were we to have a special getout of 120 chars in

Re: Hadoop Code of Incompatible Changes

On 29 July 2014 22:14, Sandy Ryza sandy.r...@cloudera.com wrote: http://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-common/Compatibility.html Sandy is correct is a semantic compatibility issue. Back then the notion of interface was defined in the early 1970s by D.L Parnas (see:

[jira] [Resolved] (HADOOP-6659) Switch RPC to use Avro

[ https://issues.apache.org/jira/browse/HADOOP-6659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-6659. -- Resolution: Won't Fix Closing this as Won't Fix. We've already switched to protobuf.

[jira] [Resolved] (HADOOP-6909) Umbrella ticket for reducing the number of libraries in Common

[ https://issues.apache.org/jira/browse/HADOOP-6909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-6909. -- Resolution: Incomplete Resolved? Won't Fix? You decide. But with the 3 or 4

[jira] [Created] (HADOOP-10903) Enhance hadoop classpath command to expand wildcards or write classpath into jar manifest.

Chris Nauroth created HADOOP-10903: -- Summary: Enhance hadoop classpath command to expand wildcards or write classpath into jar manifest. Key: HADOOP-10903 URL: https://issues.apache.org/jira/browse/HADOOP-10903

[jira] [Resolved] (HADOOP-6673) nightly builds have incorrect VersionInfo

[ https://issues.apache.org/jira/browse/HADOOP-6673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-6673. -- Resolution: Incomplete Likely stale. nightly builds have incorrect VersionInfo

[jira] [Resolved] (HADOOP-6685) Change the generic serialization framework API to use serialization-specific bytes instead of MapString,String for configuration

[ https://issues.apache.org/jira/browse/HADOOP-6685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-6685. -- Resolution: Won't Fix Closing this as Won't Fix since consensus will clearly never be

[jira] [Resolved] (HADOOP-6695) Job Tracker should be able to refresh classpath without restarting

[ https://issues.apache.org/jira/browse/HADOOP-6695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-6695. -- Resolution: Won't Fix Closing as Won't Fix. Job Tracker should be able to refresh

[jira] [Resolved] (HADOOP-6697) script to that would let us checkout code from different repos

[ https://issues.apache.org/jira/browse/HADOOP-6697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-6697. -- Resolution: Won't Fix Closing as Won't Fix. Can we move to git or mercurial yet?

RE: [jira] [Resolved] (HADOOP-6697) script to that would let us checkout code from different repos

Who can actually help me to unsubscribe me from this hadoop mailing list. I am just patience of all these and my mail box is populated inspite of sending repeated mails -Original Message- From: Allen Wittenauer (JIRA) [mailto:j...@apache.org] Sent: Wednesday, July 30, 2014 11:11 PM To:

[jira] [Resolved] (HADOOP-7266) Deprecate metrics v1

[ https://issues.apache.org/jira/browse/HADOOP-7266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-7266. -- Resolution: Fixed Fixed. I think. Deprecate metrics v1

[jira] [Resolved] (HADOOP-6728) Overhaul metrics framework

[ https://issues.apache.org/jira/browse/HADOOP-6728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-6728. -- Resolution: Fixed Closing as fixed! Overhaul metrics framework

[jira] [Resolved] (HADOOP-6729) serializer.JavaSerialization should be added to io.serializations by default

[ https://issues.apache.org/jira/browse/HADOOP-6729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-6729. -- Resolution: Won't Fix Closing as won't fix based upon Tom's comments. So it's all his

[jira] [Resolved] (HADOOP-6732) Improve FsShell's heap consumption by switching to listStatus that returns an iterator

[ https://issues.apache.org/jira/browse/HADOOP-6732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-6732. -- Resolution: Incomplete I know FsShell has undergone several revisions since this JIRA

[jira] [Resolved] (HADOOP-6733) Create a test for FileSystem API compatibility between releases

[ https://issues.apache.org/jira/browse/HADOOP-6733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-6733. -- Resolution: Won't Fix Hi Big Top. Closing. Create a test for FileSystem API

[jira] [Created] (HADOOP-10904) Provider Alt to Clear Text Passwords through Cred Provider API

Larry McCay created HADOOP-10904: Summary: Provider Alt to Clear Text Passwords through Cred Provider API Key: HADOOP-10904 URL: https://issues.apache.org/jira/browse/HADOOP-10904 Project: Hadoop

[jira] [Resolved] (HADOOP-8984) S3 File Permissions

[ https://issues.apache.org/jira/browse/HADOOP-8984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-8984. -- Resolution: Incomplete Likely stale. S3 File Permissions ---

[jira] [Resolved] (HADOOP-6744) Pull out FS_DEFAULT_NAME definition from FileSystem and move it to CommonConfigurationKeys

[ https://issues.apache.org/jira/browse/HADOOP-6744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-6744. -- Resolution: Won't Fix fs.default.name was deprecated. Pull out FS_DEFAULT_NAME

[jira] [Resolved] (HADOOP-6751) hadoop daemonlog does not work from command line with security enabled

[ https://issues.apache.org/jira/browse/HADOOP-6751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-6751. -- Resolution: Fixed hadoop daemonlog does not work from command line with security

[jira] [Resolved] (HADOOP-6753) MetricsServlet does not show shuffleInput metrics

[ https://issues.apache.org/jira/browse/HADOOP-6753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-6753. -- Resolution: Fixed MetricsServlet does not show shuffleInput metrics

[jira] [Resolved] (HADOOP-6759) Contrib Streaming.jar for hadoop-0.20.2

[ https://issues.apache.org/jira/browse/HADOOP-6759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-6759. -- Resolution: Cannot Reproduce Contrib Streaming.jar for hadoop-0.20.2

[jira] [Resolved] (HADOOP-6765) Duplicate commons-net in published POM

[ https://issues.apache.org/jira/browse/HADOOP-6765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-6765. -- Resolution: Fixed Duplicate commons-net in published POM

[jira] [Resolved] (HADOOP-6795) FsShell 'hadoop fs -text' does not work with other file systems

[ https://issues.apache.org/jira/browse/HADOOP-6795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-6795. -- Resolution: Fixed FsShell 'hadoop fs -text' does not work with other file systems

[jira] [Resolved] (HADOOP-6797) DNS#getHosts() fallback leads to mix of network-interface addresse in case reverse lookup fails

[ https://issues.apache.org/jira/browse/HADOOP-6797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-6797. -- Resolution: Incomplete I'm going to close this as stale at this point.

[jira] [Resolved] (HADOOP-6804) allow FileSystem.copyFromLocalFile() to execute under specified username

[ https://issues.apache.org/jira/browse/HADOOP-6804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-6804. -- Resolution: Not a Problem allow FileSystem.copyFromLocalFile() to execute under

[jira] [Resolved] (HADOOP-6806) While running HADOOP Exception in thread main java.lang.NullPointerException occurs

[ https://issues.apache.org/jira/browse/HADOOP-6806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-6806. -- Resolution: Cannot Reproduce While running HADOOP Exception in thread main

[jira] [Resolved] (HADOOP-6820) RunJar fails executing thousands JARs within single JVM with error Too many open files

[ https://issues.apache.org/jira/browse/HADOOP-6820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-6820. -- Resolution: Fixed This is a system tuning and/or JVM bug. Closing as won't fix.

[jira] [Resolved] (HADOOP-6829) Deprecated scripts shouldn't be used by Herriot

[ https://issues.apache.org/jira/browse/HADOOP-6829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-6829. -- Resolution: Fixed Deprecated scripts shouldn't be used by Herriot

[jira] [Resolved] (HADOOP-6808) Document steps to enable {File|Ganglia}Context for kerberos metrics

[ https://issues.apache.org/jira/browse/HADOOP-6808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-6808. -- Resolution: Fixed Document steps to enable {File|Ganglia}Context for kerberos

[jira] [Resolved] (HADOOP-6830) Javadoc warnings in trunk.

[ https://issues.apache.org/jira/browse/HADOOP-6830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-6830. -- Resolution: Fixed Stale. Javadoc warnings in trunk. --

[jira] [Resolved] (HADOOP-6838) Investigate Eclipse API Tools for enforcing or reporting on API compatibility

[ https://issues.apache.org/jira/browse/HADOOP-6838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-6838. -- Resolution: Incomplete Better handled by Big Top. Closing. Investigate Eclipse API

[jira] [Created] (HADOOP-10907) Single Node Setup uses JDK 1.6 and bin/*-all.sh scripts

Allen Wittenauer created HADOOP-10907: - Summary: Single Node Setup uses JDK 1.6 and bin/*-all.sh scripts Key: HADOOP-10907 URL: https://issues.apache.org/jira/browse/HADOOP-10907 Project: Hadoop

[jira] [Created] (HADOOP-10908) Cluster Node Setup needs updating post-9902

Allen Wittenauer created HADOOP-10908: - Summary: Cluster Node Setup needs updating post-9902 Key: HADOOP-10908 URL: https://issues.apache.org/jira/browse/HADOOP-10908 Project: Hadoop Common

[jira] [Resolved] (HADOOP-6841) In Quick Start, mention requirement that HADOOP_HOME needs to be set

[ https://issues.apache.org/jira/browse/HADOOP-6841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-6841. -- Resolution: Fixed In Quick Start, mention requirement that HADOOP_HOME needs to be

[jira] [Resolved] (HADOOP-6849) Have LocalDirAllocator.AllocatorPerContext.getLocalPathForWrite fail more meaningfully

[ https://issues.apache.org/jira/browse/HADOOP-6849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-6849. -- Resolution: Fixed A lot of this has been changed. Closing this as stale. Have

[jira] [Resolved] (HADOOP-6848) FsShell have resource leak

[ https://issues.apache.org/jira/browse/HADOOP-6848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-6848. -- Resolution: Incomplete FsShell got reworked. Closing as Stale. FsShell have

[jira] [Resolved] (HADOOP-6101) CDPATH environment variable causes bin scripts to fail.

[ https://issues.apache.org/jira/browse/HADOOP-6101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-6101. -- Resolution: Duplicate Next version of HADOOP-9902 will include this fix. Closing as a

[jira] [Resolved] (HADOOP-6851) Fix '$bin' path duplication in setup scripts

[ https://issues.apache.org/jira/browse/HADOOP-6851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-6851. -- Resolution: Duplicate next patch version of HADOOP-9902 will include this fix.

[jira] [Resolved] (HADOOP-6997) 'hadoop' script should set LANG or LC_COLLATE explicitly for classpath order

[ https://issues.apache.org/jira/browse/HADOOP-6997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-6997. -- Resolution: Not a Problem Closing this as 'not a problem'. Classes should conflict

[jira] [Resolved] (HADOOP-7906) haoop-daemon.sh unconditionnally try to chown its log directory

[ https://issues.apache.org/jira/browse/HADOOP-7906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-7906. -- Resolution: Won't Fix This has been fixed as part of HADOOP-9902. haoop-daemon.sh

RE: [jira] [Resolved] (HADOOP-6697) script to that would let us checkout code from different repos

Please unsubscribe me... -Original Message- From: Maity, Debashish [mailto:debashish.ma...@softwareag.com] Sent: Wednesday, July 30, 2014 1:45 PM To: common-dev@hadoop.apache.org Subject: RE: [jira] [Resolved] (HADOOP-6697) script to that would let us checkout code from different repos

[jira] [Created] (HADOOP-10911) hadoop.auth cookie after HADOOP-10710 still not proper according to RFC2109

Gregory Chanan created HADOOP-10911: --- Summary: hadoop.auth cookie after HADOOP-10710 still not proper according to RFC2109 Key: HADOOP-10911 URL: https://issues.apache.org/jira/browse/HADOOP-10911

[jira] [Resolved] (HADOOP-6863) Compile-native still fails on Mac OS X.

[ https://issues.apache.org/jira/browse/HADOOP-6863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-6863. -- Resolution: Won't Fix lots has changed here. closing as stale. Compile-native still

[jira] [Resolved] (HADOOP-6865) there will be ant error if ant ran without network connected

[ https://issues.apache.org/jira/browse/HADOOP-6865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-6865. -- Resolution: Won't Fix mavenization makes this stale. closing. there will be ant

[jira] [Resolved] (HADOOP-6874) JvmMetrics can't distinguish between jvms with same processName

[ https://issues.apache.org/jira/browse/HADOOP-6874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-6874. -- Resolution: Incomplete I'm going to close this as stale, given metrics has been

[jira] [Created] (HADOOP-10912) Modify scripts to use relative paths

Owen O'Malley created HADOOP-10912: -- Summary: Modify scripts to use relative paths Key: HADOOP-10912 URL: https://issues.apache.org/jira/browse/HADOOP-10912 Project: Hadoop Common Issue

Re: Branching 2.5

Thanks to Andrew's patch on HADOOP-10910, I am able to build an RC. On Wed, Jul 30, 2014 at 1:59 AM, Ted Yu yuzhih...@gmail.com wrote: Adding bui...@apache.org Cheers On Jul 30, 2014, at 12:52 AM, Andrew Wang andrew.w...@cloudera.com wrote: Alright, dug around some more and I think

[jira] [Resolved] (HADOOP-6918) Make metrics naming consistent

[ https://issues.apache.org/jira/browse/HADOOP-6918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-6918. -- Resolution: Fixed From comments, this appears to be fixed in 2.x, so closing. Make

[jira] [Resolved] (HADOOP-6937) Invalid Entry for JSP JARs in Hadoop CLASSPATH

[ https://issues.apache.org/jira/browse/HADOOP-6937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-6937. -- Resolution: Incomplete Likely stale. Invalid Entry for JSP JARs in Hadoop

[jira] [Resolved] (HADOOP-6959) Provisioning of long running Services via HOD

[ https://issues.apache.org/jira/browse/HADOOP-6959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-6959. -- Resolution: Fixed Closing as Won't Fix. YARN-896 and associated JIRAs for a more

[jira] [Resolved] (HADOOP-6961) Integration of Virtualization (such as Xen) with Hadoop tools

[ https://issues.apache.org/jira/browse/HADOOP-6961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-6961. -- Resolution: Won't Fix I'm going to close this as Won't Fix. Here's why: With YARN

[jira] [Resolved] (HADOOP-6981) Provide a way to run system tests outside of source tree and Ant build environment

[ https://issues.apache.org/jira/browse/HADOOP-6981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-6981. -- Resolution: Incomplete Closing as stale. Provide a way to run system tests outside

[jira] [Resolved] (HADOOP-6983) Update balancer docs

[ https://issues.apache.org/jira/browse/HADOOP-6983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-6983. -- Resolution: Incomplete Closing as stale. Update balancer docs