[jira] [Created] (HADOOP-10457) S3N NPEs if you do a read() after a seek()
Steve Loughran created HADOOP-10457: --- Summary: S3N NPEs if you do a read() after a seek() Key: HADOOP-10457 URL: https://issues.apache.org/jira/browse/HADOOP-10457 Project: Hadoop Common Issue Type: Bug Components: fs/s3 Affects Versions: 3.0.0, 2.4.0 Reporter: Steve Loughran Priority: Minor if you do a seek past the EOF of an S3n file # it doesn't throw any exception # on the next read, you get to see a stack trace -- This message was sent by Atlassian JIRA (v6.2#6252)
Build failed in Jenkins: Hadoop-Common-trunk #1087
See https://builds.apache.org/job/Hadoop-Common-trunk/1087/changes
Changes:
[wang] HDFS-5591. Checkpointing should use monotonic time when calculating
period. Contributed by Charles Lamb.
[szetszwo] HDFS-6167. Relocate the non-public API classes in the hdfs.client
package.
[szetszwo] HADOOP-10455. When there is an exception, ipc.Server should first
check whether it is an terse exception.
[zjshen] YARN-1898. Made Standby RM links conf, stacks, logLevel, metrics, jmx,
logs and static not be redirected to Active RM. Contributed by Xuan Gong.
[atm] HADOOP-10414. Incorrect property name for RefreshUserMappingProtocol in
hadoop-policy.xml. Contributed by Joey Echeverria.
--
[...truncated 61828 lines...]
Adding reference: maven.local.repository
[DEBUG] Initialize Maven Ant Tasks
parsing buildfile
jar:file:/home/jenkins/.m2/repository/org/apache/maven/plugins/maven-antrun-plugin/1.7/maven-antrun-plugin-1.7.jar!/org/apache/maven/ant/tasks/antlib.xml
with URI =
jar:file:/home/jenkins/.m2/repository/org/apache/maven/plugins/maven-antrun-plugin/1.7/maven-antrun-plugin-1.7.jar!/org/apache/maven/ant/tasks/antlib.xml
from a zip file
parsing buildfile
jar:file:/home/jenkins/.m2/repository/org/apache/ant/ant/1.8.2/ant-1.8.2.jar!/org/apache/tools/ant/antlib.xml
with URI =
jar:file:/home/jenkins/.m2/repository/org/apache/ant/ant/1.8.2/ant-1.8.2.jar!/org/apache/tools/ant/antlib.xml
from a zip file
Class org.apache.maven.ant.tasks.AttachArtifactTask loaded from parent loader
(parentFirst)
+Datatype attachartifact org.apache.maven.ant.tasks.AttachArtifactTask
Class org.apache.maven.ant.tasks.DependencyFilesetsTask loaded from parent
loader (parentFirst)
+Datatype dependencyfilesets org.apache.maven.ant.tasks.DependencyFilesetsTask
Setting project property: test.build.dir -
https://builds.apache.org/job/Hadoop-Common-trunk/ws/trunk/hadoop-common-project/target/test-dir
Setting project property: test.exclude.pattern - _
Setting project property: hadoop.assemblies.version - 3.0.0-SNAPSHOT
Setting project property: test.exclude - _
Setting project property: distMgmtSnapshotsId - apache.snapshots.https
Setting project property: project.build.sourceEncoding - UTF-8
Setting project property: java.security.egd - file:///dev/urandom
Setting project property: distMgmtSnapshotsUrl -
https://repository.apache.org/content/repositories/snapshots
Setting project property: distMgmtStagingUrl -
https://repository.apache.org/service/local/staging/deploy/maven2
Setting project property: avro.version - 1.7.4
Setting project property: test.build.data -
https://builds.apache.org/job/Hadoop-Common-trunk/ws/trunk/hadoop-common-project/target/test-dir
Setting project property: commons-daemon.version - 1.0.13
Setting project property: hadoop.common.build.dir -
https://builds.apache.org/job/Hadoop-Common-trunk/ws/trunk/hadoop-common-project/../../hadoop-common-project/hadoop-common/target
Setting project property: testsThreadCount - 4
Setting project property: maven.test.redirectTestOutputToFile - true
Setting project property: jdiff.version - 1.0.9
Setting project property: build.platform - Linux-i386-32
Setting project property: project.reporting.outputEncoding - UTF-8
Setting project property: distMgmtStagingName - Apache Release Distribution
Repository
Setting project property: protobuf.version - 2.5.0
Setting project property: failIfNoTests - false
Setting project property: protoc.path - ${env.HADOOP_PROTOC_PATH}
Setting project property: jersey.version - 1.9
Setting project property: distMgmtStagingId - apache.staging.https
Setting project property: distMgmtSnapshotsName - Apache Development Snapshot
Repository
Setting project property: ant.file -
https://builds.apache.org/job/Hadoop-Common-trunk/ws/trunk/hadoop-common-project/pom.xml
[DEBUG] Setting properties with prefix:
Setting project property: project.groupId - org.apache.hadoop
Setting project property: project.artifactId - hadoop-common-project
Setting project property: project.name - Apache Hadoop Common Project
Setting project property: project.description - Apache Hadoop Common Project
Setting project property: project.version - 3.0.0-SNAPSHOT
Setting project property: project.packaging - pom
Setting project property: project.build.directory -
https://builds.apache.org/job/Hadoop-Common-trunk/ws/trunk/hadoop-common-project/target
Setting project property: project.build.outputDirectory -
https://builds.apache.org/job/Hadoop-Common-trunk/ws/trunk/hadoop-common-project/target/classes
Setting project property: project.build.testOutputDirectory -
https://builds.apache.org/job/Hadoop-Common-trunk/ws/trunk/hadoop-common-project/target/test-classes
Setting project property: project.build.sourceDirectory -
https://builds.apache.org/job/Hadoop-Common-trunk/ws/trunk/hadoop-common-project/src/main/java
Setting project property: project.build.testSourceDirectory -
[jira] [Created] (HADOOP-10458) swifts should throw FileAlreadyExistsException on attempt to overwrite file
Steve Loughran created HADOOP-10458:
---
Summary: swifts should throw FileAlreadyExistsException on attempt
to overwrite file
Key: HADOOP-10458
URL: https://issues.apache.org/jira/browse/HADOOP-10458
Project: Hadoop Common
Issue Type: Improvement
Components: fs
Affects Versions: 2.4.0
Reporter: Steve Loughran
Assignee: Steve Loughran
Priority: Minor
the swift:// filesystem checks for and rejects {{create()}} calls over an
existing file if overwrite = false, but it throws a custom exception.
{{SwiftPathExistsException}}
If it threw a {{org.apache.hadoop.fs.FileAlreadyExistsException}} it would
match HDFS
--
This message was sent by Atlassian JIRA
(v6.2#6252)
Re: [VOTE] Release Apache Hadoop 2.4.0
+1 non-binding Chen On Wed, Apr 2, 2014 at 12:27 AM, Jean-Baptiste Onofré j...@nanthrax.netwrote: +1 (non binding) Regards JB On 03/31/2014 11:22 AM, Arun C Murthy wrote: Folks, I've created a release candidate (rc0) for hadoop-2.4.0 that I would like to get released. The RC is available at: http://people.apache.org/~ acmurthy/hadoop-2.4.0-rc0 The RC tag in svn is here: https://svn.apache.org/repos/ asf/hadoop/common/tags/release-2.4.0-rc0 The maven artifacts are available via repository.apache.org. Please try the release and vote; the vote will run for the usual 7 days. thanks, Arun -- Arun C. Murthy Hortonworks Inc. http://hortonworks.com/ -- Jean-Baptiste Onofré jbono...@apache.org http://blog.nanthrax.net Talend - http://www.talend.com
[jira] [Resolved] (HADOOP-10403) Hadoop2.2 is not fully transfer hostname to IP address on WEB UI
[ https://issues.apache.org/jira/browse/HADOOP-10403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hawin resolved HADOOP-10403. Resolution: Done Hadoop2.2 is not fully transfer hostname to IP address on WEB UI Key: HADOOP-10403 URL: https://issues.apache.org/jira/browse/HADOOP-10403 Project: Hadoop Common Issue Type: Bug Components: conf, fs, util Affects Versions: 2.2.0 Environment: OS: Linux 2.6.32-431.el6.x86_64 #1 SMP Fri Nov 22 03:15:09 UTC 2013 x86_64 x86_64 x86_64 GNU/Linux master: hostname1 slave1: hostname2 slave2: hostname3 Reporter: hawin Labels: patch I could not get access when I was trying to click links which are include hostname in the URL. For example: My master ip address is 192.168.1.110 and hostname is hostname1 http://192.168.1.110:50070/ works fine but http://hostname1:50070/ does not work. My slave servers also have the same issues. some links only display http://hostname:port. and some links used IP address replace of hostname. I can ping hostname1, hostname2 and hostname3 and also ssh slave servers without password from master server. cat /etc/hosts 127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4 ::1 localhost localhost.localdomain localhost6 localhost6.localdomain6 192.168.1.110 hostname1 192.168.1.111 hostname2 192.168.1.112 hostname3 * Please help me to check this issue. I don't know whether I am missing some configuration. Your hands will be appreciated. -- This message was sent by Atlassian JIRA (v6.2#6252)
Re: [VOTE] Release Apache Hadoop 2.4.0
+1 (non binding) - Verified signature - Successfully built native and non native - Deployed on my single node cluster and ran sleep and word count jobs - UI looks good - M!T On 3/31/14, 4:22 AM, Arun C Murthy a...@hortonworks.com wrote: Folks, I've created a release candidate (rc0) for hadoop-2.4.0 that I would like to get released. The RC is available at: http://people.apache.org/~acmurthy/hadoop-2.4.0-rc0 The RC tag in svn is here: https://svn.apache.org/repos/asf/hadoop/common/tags/release-2.4.0-rc0 The maven artifacts are available via repository.apache.org. Please try the release and vote; the vote will run for the usual 7 days. thanks, Arun -- Arun C. Murthy Hortonworks Inc. http://hortonworks.com/ -- CONFIDENTIALITY NOTICE NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You.
Re: [VOTE] Release Apache Hadoop 2.4.0
+1 non-binding I built from source code, and setup a single node non-secure cluster with almost the default configurations and ran a number of MR example jobs and distributedshell jobs. I verified the generic and the per-framework (DS job only) historic information has been persisted, and such information is accessible via webUI, RESTful APIs and CLI. Thanks, Zhijie On Wed, Apr 2, 2014 at 1:26 PM, Jian He j...@hortonworks.com wrote: +1 non-binding Built from source code, tested on a single node cluster. Successfully ran a few MR sample jobs. Tested RM restart while job is running. Thanks, Jian On Tue, Apr 1, 2014 at 5:42 PM, Travis Thompson tthomp...@linkedin.com wrote: +1 non-binding Built from git. Started with 120 node 2.3.0 cluster with security and non HA, ran upgrade (non rolling) to 2.4.0. Confirmed fsimage is OK and HDFS successfully upgraded. Also successfully ran some pig jobs and mapreduce examples. Haven't found any issues yet but will continue testing. Did not test Timeline Server since I'm using security. Thanks, Travis On 03/31/2014 02:24 AM, Arun C Murthy wrote: Folks, I've created a release candidate (rc0) for hadoop-2.4.0 that I would like to get released. The RC is available at: http://people.apache.org/~acmurthy/hadoop-2.4.0-rc0 The RC tag in svn is here: https://svn.apache.org/repos/asf/hadoop/common/tags/release-2.4.0-rc0 The maven artifacts are available via repository.apache.org. Please try the release and vote; the vote will run for the usual 7 days. thanks, Arun -- Arun C. Murthy Hortonworks Inc. http://hortonworks.com/ -- CONFIDENTIALITY NOTICE NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You. -- Zhijie Shen Hortonworks Inc. http://hortonworks.com/ -- CONFIDENTIALITY NOTICE NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You.
