[jira] [Created] (HADOOP-16537) Add ZStandard support for log aggregation
Jonathan Eagles created HADOOP-16537: Summary: Add ZStandard support for log aggregation Key: HADOOP-16537 URL: https://issues.apache.org/jira/browse/HADOOP-16537 Project: Hadoop Common Issue Type: Improvement Reporter: Jonathan Eagles Assignee: Jonathan Eagles Now that ZStandardCodec is available as an optional component for hadoop, we can add support for this codec to TFile which is the file format for log aggregation. -- This message was sent by Atlassian Jira (v8.3.2#803003) - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org
[jira] [Created] (HADOOP-16369) Fix zstandard shortname misspelled as zts
Jonathan Eagles created HADOOP-16369: Summary: Fix zstandard shortname misspelled as zts Key: HADOOP-16369 URL: https://issues.apache.org/jira/browse/HADOOP-16369 Project: Hadoop Common Issue Type: Improvement Reporter: Jonathan Eagles Assignee: Jonathan Eagles A few times in the code base zstd was misspelled as ztsd. zts is another library https://github.com/yahoo/athenz/tree/master/clients/java/zts and has caused some grief. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org
[jira] [Created] (HADOOP-16119) KMS on Hadoop RPC Engine
Jonathan Eagles created HADOOP-16119:
Summary: KMS on Hadoop RPC Engine
Key: HADOOP-16119
URL: https://issues.apache.org/jira/browse/HADOOP-16119
Project: Hadoop Common
Issue Type: Bug
Reporter: Jonathan Eagles
Per discussion on common-dev and text copied here for ease of reference.
https://lists.apache.org/thread.html/0e2eeaf07b013f17fad6d362393f53d52041828feec53dcddff04808@%3Ccommon-dev.hadoop.apache.org%3E
{noformat}
Thanks all for the inputs,
To offer additional information (while Daryn is working on his stuff),
optimizing RPC encryption opens up another possibility: migrating KMS
service to use Hadoop RPC.
Today's KMS uses HTTPS + REST API, much like webhdfs. It has very
undesirable performance (a few thousand ops per second) compared to
NameNode. Unfortunately for each NameNode namespace operation you also need
to access KMS too.
Migrating KMS to Hadoop RPC greatly improves its performance (if
implemented correctly), and RPC encryption would be a prerequisite. So
please keep that in mind when discussing the Hadoop RPC encryption
improvements. Cloudera is very interested to help with the Hadoop RPC
encryption project because a lot of our customers are using at-rest
encryption, and some of them are starting to hit KMS performance limit.
This whole "migrating KMS to Hadoop RPC" was Daryn's idea. I heard this
idea in the meetup and I am very thrilled to see this happening because it
is a real issue bothering some of our customers, and I suspect it is the
right solution to address this tech debt.
{noformat}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org
[jira] [Created] (HADOOP-15835) Reuse Object Mapper in KMSJSONWriter
Jonathan Eagles created HADOOP-15835: Summary: Reuse Object Mapper in KMSJSONWriter Key: HADOOP-15835 URL: https://issues.apache.org/jira/browse/HADOOP-15835 Project: Hadoop Common Issue Type: Bug Reporter: Jonathan Eagles Assignee: Jonathan Eagles In lie of HADOOP-15550 in branch-3.0, branch-2.9, branch-2.8. This patch will provide some benefit of MapperObject reuse though not as complete as the JsonSerialization util lazy loading fix. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org
[jira] [Created] (HADOOP-15817) Reuse Object Mapper in KMSJSONReader
Jonathan Eagles created HADOOP-15817:
Summary: Reuse Object Mapper in KMSJSONReader
Key: HADOOP-15817
URL: https://issues.apache.org/jira/browse/HADOOP-15817
Project: Hadoop Common
Issue Type: Bug
Components: kms
Reporter: Jonathan Eagles
Paying an expensive cost to construct object mapper deserializer cache.
{code:title=KMS Server Stack Trace}
"qtp1926764753-117" #117 prio=5 os_prio=0 tid=0x0321c000 nid=0x1f0bd
runnable [0x2b4caabf7000]
java.lang.Thread.State: RUNNABLE
at
java.lang.reflect.Executable.sharedGetParameterAnnotations(Executable.java:553)
at
java.lang.reflect.Constructor.getParameterAnnotations(Constructor.java:523)
at
org.codehaus.jackson.map.introspect.AnnotatedClass._constructConstructor(AnnotatedClass.java:784)
at
org.codehaus.jackson.map.introspect.AnnotatedClass.resolveCreators(AnnotatedClass.java:327)
at
org.codehaus.jackson.map.introspect.BasicClassIntrospector.classWithCreators(BasicClassIntrospector.java:187)
at
org.codehaus.jackson.map.introspect.BasicClassIntrospector.collectProperties(BasicClassIntrospector.java:157)
at
org.codehaus.jackson.map.introspect.BasicClassIntrospector.forCreation(BasicClassIntrospector.java:119)
at
org.codehaus.jackson.map.introspect.BasicClassIntrospector.forCreation(BasicClassIntrospector.java:16)
at
org.codehaus.jackson.map.DeserializationConfig.introspectForCreation(DeserializationConfig.java:877)
at
org.codehaus.jackson.map.deser.BasicDeserializerFactory.createMapDeserializer(BasicDeserializerFactory.java:430)
at
org.codehaus.jackson.map.deser.StdDeserializerProvider._createDeserializer(StdDeserializerProvider.java:380)
at
org.codehaus.jackson.map.deser.StdDeserializerProvider._createAndCache2(StdDeserializerProvider.java:310)
at
org.codehaus.jackson.map.deser.StdDeserializerProvider._createAndCacheValueDeserializer(StdDeserializerProvider.java:290)
- locked <0x000752fbbc28> (a java.util.HashMap)
at
org.codehaus.jackson.map.deser.StdDeserializerProvider.findValueDeserializer(StdDeserializerProvider.java:159)
at
org.codehaus.jackson.map.deser.StdDeserializerProvider.findTypedValueDeserializer(StdDeserializerProvider.java:180)
at
org.codehaus.jackson.map.ObjectMapper._findRootDeserializer(ObjectMapper.java:2829)
at
org.codehaus.jackson.map.ObjectMapper._readMapAndClose(ObjectMapper.java:2728)
at
org.codehaus.jackson.map.ObjectMapper.readValue(ObjectMapper.java:1909)
at
org.apache.hadoop.crypto.key.kms.server.KMSJSONReader.readFrom(KMSJSONReader.java:52)
at
org.apache.hadoop.crypto.key.kms.server.KMSJSONReader.readFrom(KMSJSONReader.java:35)
at
com.sun.jersey.spi.container.ContainerRequest.getEntity(ContainerRequest.java:474)
at
com.sun.jersey.server.impl.model.method.dispatch.EntityParamDispatchProvider$EntityInjectable.getValue(EntityParamDispatchProvider.java:123)
at
com.sun.jersey.server.impl.inject.InjectableValuesProvider.getInjectableValues(InjectableValuesProvider.java:46)
at
com.sun.jersey.server.impl.model.method.dispatch.AbstractResourceMethodDispatchProvider$EntityParamInInvoker.getParams(AbstractResourceMethodDispatchProvider.java:153)
at
com.sun.jersey.server.impl.model.method.dispatch.AbstractResourceMethodDispatchProvider$ResponseOutInvoker._dispatch(AbstractResourceMethodDispatchProvider.java:203)
at
com.sun.jersey.server.impl.model.method.dispatch.ResourceJavaMethodDispatcher.dispatch(ResourceJavaMethodDispatcher.java:75)
at
com.sun.jersey.server.impl.uri.rules.HttpMethodRule.accept(HttpMethodRule.java:288)
at
com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147)
at
com.sun.jersey.server.impl.uri.rules.ResourceClassRule.accept(ResourceClassRule.java:108)
at
com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147)
at
com.sun.jersey.server.impl.uri.rules.RootResourceClassesRule.accept(RootResourceClassesRule.java:84)
at
com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1469)
at
com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1400)
at
com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1349)
at
com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1339)
at
com.sun.jersey.spi.container.servlet.WebComponent.service(WebComponent.java:416)
at
com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:537)
at
[jira] [Created] (HADOOP-15337) RawLocalFileSystem file status permissions can avoid shelling out in some cases
Jonathan Eagles created HADOOP-15337: Summary: RawLocalFileSystem file status permissions can avoid shelling out in some cases Key: HADOOP-15337 URL: https://issues.apache.org/jira/browse/HADOOP-15337 Project: Hadoop Common Issue Type: Bug Reporter: Jonathan Eagles Assignee: Jonathan Eagles While investigating YARN-8054, it was noticed that getting file permissions for RawLocalFileSystem can fail by having too many files open. Upon inspection this happens when getting permissions by launching a shell program (ls -ld on linux) and parsing the results. With the introduction of java 7 posix file systems can accurately get file permissions without launching a shell program. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org
[jira] [Created] (HADOOP-14891) Guava 21.0+ libraries not compatible with user jobs
Jonathan Eagles created HADOOP-14891:
Summary: Guava 21.0+ libraries not compatible with user jobs
Key: HADOOP-14891
URL: https://issues.apache.org/jira/browse/HADOOP-14891
Project: Hadoop Common
Issue Type: Bug
Affects Versions: 2.8.1
Reporter: Jonathan Eagles
Assignee: Jonathan Eagles
Use provided a guava 23.0 jar as part of the job submission.
{code}
2017-09-20 16:10:42,897 [INFO] [main] |service.AbstractService|: Service
org.apache.tez.dag.app.DAGAppMaster failed in state STARTED; cause:
org.apache.hadoop.service.ServiceStateException: java.lang.NoSuchMethodError:
com.google.common.base.Objects.toStringHelper(Ljava/lang/Object;)Lcom/google/common/base/Objects$ToStringHelper;
org.apache.hadoop.service.ServiceStateException: java.lang.NoSuchMethodError:
com.google.common.base.Objects.toStringHelper(Ljava/lang/Object;)Lcom/google/common/base/Objects$ToStringHelper;
at
org.apache.hadoop.service.ServiceStateException.convert(ServiceStateException.java:59)
at
org.apache.tez.dag.app.DAGAppMaster.startServices(DAGAppMaster.java:1989)
at
org.apache.tez.dag.app.DAGAppMaster.serviceStart(DAGAppMaster.java:2056)
at
org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
at org.apache.tez.dag.app.DAGAppMaster$9.run(DAGAppMaster.java:2707)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1936)
at
org.apache.tez.dag.app.DAGAppMaster.initAndStartAppMaster(DAGAppMaster.java:2703)
at org.apache.tez.dag.app.DAGAppMaster.main(DAGAppMaster.java:2508)
Caused by: java.lang.NoSuchMethodError:
com.google.common.base.Objects.toStringHelper(Ljava/lang/Object;)Lcom/google/common/base/Objects$ToStringHelper;
at
org.apache.hadoop.metrics2.lib.MetricsRegistry.toString(MetricsRegistry.java:419)
at java.lang.String.valueOf(String.java:2994)
at java.lang.StringBuilder.append(StringBuilder.java:131)
at org.apache.hadoop.ipc.metrics.RpcMetrics.(RpcMetrics.java:74)
at org.apache.hadoop.ipc.metrics.RpcMetrics.create(RpcMetrics.java:80)
at org.apache.hadoop.ipc.Server.(Server.java:2658)
at org.apache.hadoop.ipc.RPC$Server.(RPC.java:968)
at
org.apache.hadoop.ipc.ProtobufRpcEngine$Server.(ProtobufRpcEngine.java:367)
at
org.apache.hadoop.ipc.ProtobufRpcEngine.getServer(ProtobufRpcEngine.java:342)
at org.apache.hadoop.ipc.RPC$Builder.build(RPC.java:810)
at
org.apache.tez.dag.api.client.DAGClientServer.createServer(DAGClientServer.java:134)
at
org.apache.tez.dag.api.client.DAGClientServer.serviceStart(DAGClientServer.java:82)
at
org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
at
org.apache.tez.dag.app.DAGAppMaster$ServiceWithDependency.start(DAGAppMaster.java:1909)
at
org.apache.tez.dag.app.DAGAppMaster$ServiceThread.run(DAGAppMaster.java:1930)
2017-09-20 16:10:42,898 [ERROR] [main] |rm.TaskSchedulerManager|: Failed to do
a clean initiateStop for Scheduler: [0:TezYarn]
{code}
Metrics2 has been relying on deprecated toStringHelper for some time now which
was finally removed in guava 21.0. Removing the dependency on this method will
free up the user to supplying their own guava jar again.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org
[jira] [Created] (HADOOP-14328) Hadoop build double jars some artifacts
Jonathan Eagles created HADOOP-14328: Summary: Hadoop build double jars some artifacts Key: HADOOP-14328 URL: https://issues.apache.org/jira/browse/HADOOP-14328 Project: Hadoop Common Issue Type: Bug Reporter: Jonathan Eagles Assignee: Jonathan Eagles -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org
[jira] [Resolved] (HADOOP-14216) Improve Configuration XML Parsing Performance
[ https://issues.apache.org/jira/browse/HADOOP-14216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles resolved HADOOP-14216. -- Resolution: Fixed Fix Version/s: 3.0.0-alpha3 2.9.0 Thanks to everyone ([~chris.douglas], [~arpitagarwal]) who helped to resolve this patch. Committed to trunk and branch-2 > Improve Configuration XML Parsing Performance > - > > Key: HADOOP-14216 > URL: https://issues.apache.org/jira/browse/HADOOP-14216 > Project: Hadoop Common > Issue Type: Improvement >Reporter: Jonathan Eagles >Assignee: Jonathan Eagles > Fix For: 2.9.0, 3.0.0-alpha3 > > Attachments: HADOOP-14216.1.patch, HADOOP-14216.2-branch-2.patch, > HADOOP-14216.2.patch > > > JIRA is to improve XML parsing performance through reuse and a change in XML > parser (STAX) -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org
[jira] [Created] (HADOOP-14240) Configuration#get return value optimization
Jonathan Eagles created HADOOP-14240: Summary: Configuration#get return value optimization Key: HADOOP-14240 URL: https://issues.apache.org/jira/browse/HADOOP-14240 Project: Hadoop Common Issue Type: Improvement Reporter: Jonathan Eagles Assignee: Jonathan Eagles The string array return value can be more efficiently determined and some general redundancies can be removed to improve the speed for Configuration.get. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org
[jira] [Created] (HADOOP-14233) Don't pre-construct PreCondition.check failure message in Configuration#set
Jonathan Eagles created HADOOP-14233: Summary: Don't pre-construct PreCondition.check failure message in Configuration#set Key: HADOOP-14233 URL: https://issues.apache.org/jira/browse/HADOOP-14233 Project: Hadoop Common Issue Type: Improvement Reporter: Jonathan Eagles -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org
[jira] [Created] (HADOOP-14216) Improve Configuration XML Parsing Performance
Jonathan Eagles created HADOOP-14216: Summary: Improve Configuration XML Parsing Performance Key: HADOOP-14216 URL: https://issues.apache.org/jira/browse/HADOOP-14216 Project: Hadoop Common Issue Type: Improvement Reporter: Jonathan Eagles -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org
[jira] [Created] (HADOOP-14213) Move Configuration runtime check for hadoop-site.xml to initialization
Jonathan Eagles created HADOOP-14213: Summary: Move Configuration runtime check for hadoop-site.xml to initialization Key: HADOOP-14213 URL: https://issues.apache.org/jira/browse/HADOOP-14213 Project: Hadoop Common Issue Type: Improvement Reporter: Jonathan Eagles Assignee: Jonathan Eagles Each Configuration object that loads defaults checks for hadoop-site.xml. It has been long deprecated and is not present in most if not nearly all installations. The getResource check for hadoop-site.xml has to check the entire classpath since it is not found. This jira proposes to 1) either remove hadoop-site.xml as a default resource or 2) move the check to static initialization of the class so the performance hit is only taken once. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org
[jira] [Created] (HADOOP-11883) Checkstyle Results are Different Between Command Line and Eclipse
Jonathan Eagles created HADOOP-11883: Summary: Checkstyle Results are Different Between Command Line and Eclipse Key: HADOOP-11883 URL: https://issues.apache.org/jira/browse/HADOOP-11883 Project: Hadoop Common Issue Type: Bug Reporter: Jonathan Eagles -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Resolved] (HADOOP-9219) coverage fixing for org.apache.hadoop.tools.rumen
[ https://issues.apache.org/jira/browse/HADOOP-9219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles resolved HADOOP-9219. - Resolution: Fixed Duping this issue to MAPREDUCE-3860 as per Andrey's comment. coverage fixing for org.apache.hadoop.tools.rumen - Key: HADOOP-9219 URL: https://issues.apache.org/jira/browse/HADOOP-9219 Project: Hadoop Common Issue Type: Test Components: tools Affects Versions: 3.0.0, 2.0.3-alpha, 0.23.6 Reporter: Aleksey Gorshkov Assignee: Aleksey Gorshkov Attachments: HADOOP-9219-trunk-a.patch, HADOOP-9219-trunk-b.patch, HADOOP-9219-trunk.patch Original Estimate: 168h Remaining Estimate: 168h coverage fixing for org.apache.hadoop.tools.rumen HADOOP-9219-trunk.patch for trunk, brunch-2 and branch-0.23 -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Resolved] (HADOOP-9990) TestMetricsSystemImpl fails
[
https://issues.apache.org/jira/browse/HADOOP-9990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jonathan Eagles resolved HADOOP-9990.
-
Resolution: Duplicate
TestMetricsSystemImpl fails
---
Key: HADOOP-9990
URL: https://issues.apache.org/jira/browse/HADOOP-9990
Project: Hadoop Common
Issue Type: Bug
Components: metrics, test
Affects Versions: 2.1.1-beta
Environment: Ubuntu 13.04
Reporter: Tsuyoshi OZAWA
Priority: Minor
TestMetricsSystemImpl#testMultiThreadedPublish and
testInitFirstVerifyStopInvokedImmediately fails occasionally.
{code}
Running org.apache.hadoop.metrics2.impl.TestMetricsSystemImpl
Tests run: 6, Failures: 2, Errors: 0, Skipped: 0, Time elapsed: 2.787 sec
FAILURE! - in org.apache.hadoop.metrics2.impl.TestMetricsSystemImpl
testMultiThreadedPublish(org.apache.hadoop.metrics2.impl.TestMetricsSystemImpl)
Time elapsed: 0.078 sec FAILURE!
java.lang.AssertionError: expected:0 but was:2
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:472)
at org.junit.Assert.assertEquals(Assert.java:456)
at
org.apache.hadoop.metrics2.impl.TestMetricsSystemImpl.testMultiThreadedPublish(TestMetricsSystemImpl.java:231)
{code}
{code}
testInitFirstVerifyStopInvokedImmediately(org.apache.hadoop.metrics2.impl.TestMetricsSystemImpl)
Time elapsed: 0.05 sec FAILURE!
org.mockito.exceptions.base.MockitoAssertionError:
Wanted at most 2 times but was 3
at
org.apache.hadoop.metrics2.impl.TestMetricsSystemImpl.testInitFirstVerifyStopInvokedImmediately(TestMetricsSystemImpl.java:114)
{code}
--
This message was sent by Atlassian JIRA
(v6.1#6144)
[jira] [Created] (HADOOP-9940) Make http jetty request logger NCSARequestLog fully configurable through log4j
Jonathan Eagles created HADOOP-9940: --- Summary: Make http jetty request logger NCSARequestLog fully configurable through log4j Key: HADOOP-9940 URL: https://issues.apache.org/jira/browse/HADOOP-9940 Project: Hadoop Common Issue Type: Improvement Reporter: Jonathan Eagles Some options such a log date format are not available http://grepcode.com/file/repo1.maven.org/maven2/org.mortbay.jetty/jetty/6.1.26/org/mortbay/jetty/NCSARequestLog.java?av=f -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (HADOOP-8523) test-patch.sh doesn't validate patches before building
[ https://issues.apache.org/jira/browse/HADOOP-8523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles resolved HADOOP-8523. - Resolution: Fixed Fix Version/s: 3.0.0 2.0.1-alpha test-patch.sh doesn't validate patches before building -- Key: HADOOP-8523 URL: https://issues.apache.org/jira/browse/HADOOP-8523 Project: Hadoop Common Issue Type: Improvement Components: build Affects Versions: 0.23.3, 2.0.1-alpha Reporter: Jack Dintruff Priority: Minor Labels: newbie Fix For: 2.0.1-alpha, 3.0.0 Attachments: HADOOP-8523.patch, HADOOP-8523.patch, Hadoop-8523.patch, Hadoop-8523.patch When running test-patch.sh with an invalid patch (not formatted properly) or one that doesn't compile, the script spends a lot of time building Hadoop before checking to see if the patch is invalid. It would help devs if it checked first just in case we run test-patch.sh with a bad patch file. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HADOOP-8535) Cut hadoop build times in half (upgrade maven-compiler-plugin to 2.5.1)
Jonathan Eagles created HADOOP-8535: --- Summary: Cut hadoop build times in half (upgrade maven-compiler-plugin to 2.5.1) Key: HADOOP-8535 URL: https://issues.apache.org/jira/browse/HADOOP-8535 Project: Hadoop Common Issue Type: Improvement Components: build Affects Versions: 0.23.3, 2.0.1-alpha Reporter: Jonathan Eagles Assignee: Jonathan Eagles starting with 2.4.0 maven-compiler-plugin started caching the class loader for the javac compiler. This patch upgrades the compiler to 2.5.1. On my box, build times are reduced from 5 minutes to 2 minutes. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HADOOP-7575) Support fully qualified paths as part of LocalDirAllocator
Support fully qualified paths as part of LocalDirAllocator -- Key: HADOOP-7575 URL: https://issues.apache.org/jira/browse/HADOOP-7575 Project: Hadoop Common Issue Type: Bug Components: fs Affects Versions: 0.23.0 Reporter: Jonathan Eagles Assignee: Jonathan Eagles Priority: Minor Fix For: 0.23.0 Contexts with configuration path strings using fully qualified paths (e.g. file:///tmp instead of /tmp) mistakenly creates a directory named 'file:' and sub-directories in the current local file system working directory. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HADOOP-7274) CLONE - IOUtils.readFully and IOUtils.skipFully have typo in exception creation's message
CLONE - IOUtils.readFully and IOUtils.skipFully have typo in exception
creation's message
-
Key: HADOOP-7274
URL: https://issues.apache.org/jira/browse/HADOOP-7274
Project: Hadoop Common
Issue Type: Bug
Components: util
Affects Versions: 0.22.0, 0.23.0
Reporter: Jonathan Eagles
Assignee: Konstantin Boudnik
Priority: Minor
Fix For: 0.22.0, 0.23.0
{noformat}
throw new IOException( Premeture EOF from inputStream);
{noformat}
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
