Re: H9 build slave is bad

2017-03-07 Thread Andrew Wang
A little ping that H9 hit the same error again, and I'm again going to
clean it out. One more time and I'll ask infra about either removing or
reimaging this node.

On Mon, Mar 6, 2017 at 2:12 PM, Allen Wittenauer 
wrote:

>
> > On Mar 6, 2017, at 1:57 PM, Andrew Wang 
> wrote:
> >
> > I'll leave it there so it's ready for next time. If this keeps happening
> on H9, then I'm going to ask infra to reimage it. FWIW I haven't seen this
> on our internal unit test runs, so it points to an H9-specific issue.
>
> I’ve seen test data cause failures on quite a few nodes over the
> past year or two.  I just usually fixed it without telling anyone since
> there never seemed to be much interest in the problems.  That said, I’ve
> mostly stopped babysitting the hadoop builds on the ASF infra.


[jira] [Created] (HADOOP-14154) Set isAuthoritative flag when creating DirListingMetadata in DynamoDBMetaStore

2017-03-07 Thread Rajesh Balamohan (JIRA)
Rajesh Balamohan created HADOOP-14154:
-

 Summary: Set isAuthoritative flag when creating DirListingMetadata 
in DynamoDBMetaStore
 Key: HADOOP-14154
 URL: https://issues.apache.org/jira/browse/HADOOP-14154
 Project: Hadoop Common
  Issue Type: Sub-task
  Components: fs/s3
Reporter: Rajesh Balamohan
Priority: Minor



Currently {{DynamoDBMetaStore::listChildren}} does not populate 
{{isAuthoritative}} flag when creating {{DirListingMetadata}}. 

This causes additional S3 lookups even when users have enabled 
{{fs.s3a.metadatastore.authoritative}}.




--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org



Re: About 2.7.4 Release

2017-03-07 Thread Allen Wittenauer

> On Mar 7, 2017, at 2:51 PM, Andrew Wang  wrote:
> I think it'd be nice to
> have a nightly Jenkins job that builds an RC,

Just a reminder that any such build cannot be used for an actual 
release:

http://www.apache.org/legal/release-policy.html#owned-controlled-hardware



-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org



[jira] [Created] (HADOOP-14153) ADL module has messed doc structure

2017-03-07 Thread Mingliang Liu (JIRA)
Mingliang Liu created HADOOP-14153:
--

 Summary: ADL module has messed doc structure
 Key: HADOOP-14153
 URL: https://issues.apache.org/jira/browse/HADOOP-14153
 Project: Hadoop Common
  Issue Type: Bug
  Components: fs/adl
Reporter: Mingliang Liu
Assignee: Mingliang Liu






--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org



Re: About 2.7.4 Release

2017-03-07 Thread Andrew Wang
Our release steps are documented on the wiki:

2.6/2.7:

https://wiki.apache.org/hadoop/HowToReleasePreDSBCR

2.8+:
https://wiki.apache.org/hadoop/HowToRelease

I think given the push toward 2.8 and 3.0, there's less interest in
streamlining the 2.6 and 2.7 release processes. CHANGES.txt is the biggest
pain, and that's fixed in 2.8+.

Current pain points for 2.8+ include:

# fixing up JIRA versions and the release notes, though I somewhat
addressed this with the versions script for 3.x
# making and staging an RC and sending the vote email still requires a lot
of manual steps
# publishing the release is also quite manual

I think the RC issues can be attacked with enough scripting. Steve had an
ant file that automated a lot of this for slider. I think it'd be nice to
have a nightly Jenkins job that builds an RC, since I've spent a day or two
for each 3.x alpha fixing build issues.

Publishing can be attacked via a mix of scripting and revamping the darned
website. Forrest is pretty bad compared to the newer static site generators
out there (e.g. need to write XML instead of markdown, it's hard to review
a staging site because of all the absolute links, hard to customize, did I
mention XML?), and the look and feel of the site is from the 00s. We don't
actually have that much site content, so it should be possible to migrate
to a new system.

On Tue, Mar 7, 2017 at 9:13 AM, Sangjin Lee  wrote:

> I don't think there should be any linkage between releasing 2.8.0 and
> 2.7.4. If we have a volunteer for releasing 2.7.4, we should go full speed
> ahead. We still need a volunteer from a PMC member or a committer as some
> tasks may require certain privileges, but I don't think it precludes
> working with others to close down the release.
>
> I for one would like to see more frequent releases, and being able to
> automate release steps more would go a long way.
>
> On Tue, Mar 7, 2017 at 2:16 AM, Marton Elek  wrote:
>
> > Is there any reason to wait for 2.8 with 2.7.4?
> >
> > Unfortunately the previous  thread about release cadence has been ended
> > without final decision. But if I understood well, there was more or less
> an
> > agreement about that it would be great to achieve more frequent releases,
> > if possible (with or without written rules and EOL policy).
> >
> > I personally prefer to be more closer to the scheduling part of the
> > proposal:
> >
> > "A minor release on the latest major line should be every 6 months, and a
> > maintenance release on a minor release (as there may be concurrently
> > maintained minor releases) every 2 months".
> >
> > I don't know what is the hardest part of creating new minor/maintenance
> > releases. But if the problems are technical (smoketesting, unit tests,
> old
> > release script, anything else) I would be happy to do any task for new
> > maintenance releases (or more frequent releases).
> >
> > Regards,
> > Marton
> >
> >
> > 
> > From: Akira Ajisaka 
> > Sent: Tuesday, March 07, 2017 7:34 AM
> > To: Brahma Reddy Battula; Hadoop Common; yarn-...@hadoop.apache.org;
> > Hdfs-dev; mapreduce-...@hadoop.apache.org
> > Subject: Re: About 2.7.4 Release
> >
> > Probably 2.8.0 will be released soon.
> > https://issues.apache.org/jira/browse/HADOOP-13866?
> > focusedCommentId=15898379&page=com.atlassian.jira.
> > plugin.system.issuetabpanels:comment-tabpanel#comment-15898379
> >
> > I'm thinking 2.7.4 release process starts after 2.8.0 release,
> > so 2.7.4 will be released in April or May. (hopefully)
> >
> > Thoughts?
> >
> > Regards,
> > Akira
> >
> > On 2017/03/01 21:01, Brahma Reddy Battula wrote:
> > > Hi All
> > >
> > > It has been six months for branch-2.7 release.. is there any near plan
> > for 2.7.4..?
> > >
> > >
> > > Thanks&Regards
> > > Brahma Reddy Battula
> > >
> > >
> >
> > -
> > To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
> > For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
> >
> >
> >
> > -
> > To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
> > For additional commands, e-mail: common-dev-h...@hadoop.apache.org
> >
> >
>


Re: About 2.7.4 Release

2017-03-07 Thread Vinod Kumar Vavilapalli
I was planning to take this up, celebrating my return from my paternity leave 
of absence for quite a while.

Marton, let me know if you do want to take this up instead and we can work 
together.

Thanks
+Vinod

> On Mar 7, 2017, at 9:13 AM, Sangjin Lee  wrote:
> 
> If we have a volunteer for releasing 2.7.4, we should go full speed
> ahead. We still need a volunteer from a PMC member or a committer as some
> tasks may require certain privileges, but I don't think it precludes
> working with others to close down the release.



[jira] [Created] (HADOOP-14152) Operation not authorized in swift unit test

2017-03-07 Thread John Zhuge (JIRA)
John Zhuge created HADOOP-14152:
---

 Summary: Operation not authorized in swift unit test
 Key: HADOOP-14152
 URL: https://issues.apache.org/jira/browse/HADOOP-14152
 Project: Hadoop Common
  Issue Type: Bug
  Components: fs/swift
Affects Versions: 3.0.0-alpha3
Reporter: John Zhuge


Got this error during a full live unit tests. The tests lasted 63 minutes. This 
failure occurred at about 47 minute mark.

{noformat}
testWriteReadAndDeleteTwoBlocks(org.apache.hadoop.fs.swift.TestSwiftFileSystemContract)
  Time elapsed: 1.888 sec  <<< ERROR!
org.apache.hadoop.fs.swift.exceptions.SwiftAuthenticationFailedException: 
Operation not authorized- current access token 
=AccessToken{id='AABYbCCD_cnfiEgeb-_8HEmFJMChOVX7mw-YmJyyB1aCVXdEAv7l4y58dM-TqOzD1zP6bjNTeVYx5GPRSuxzzEpSnDGFgjd1U9kLgL7LvQazirjoI9ggRq5Q4ZfWEWphJjjh2grC6Z3XAA',
 tenant=org.apache.hadoop.fs.swift.auth.entities.Tenant@42bc14c1, 
expires='2017-03-08T16:50:24.078Z'}
at 
org.apache.hadoop.fs.swift.http.SwiftRestClient.buildException(SwiftRestClient.java:1466)
at 
org.apache.hadoop.fs.swift.http.SwiftRestClient.perform(SwiftRestClient.java:1384)
at 
org.apache.hadoop.fs.swift.http.SwiftRestClient.headRequest(SwiftRestClient.java:999)
at 
org.apache.hadoop.fs.swift.http.SwiftRestClient.createContainer(SwiftRestClient.java:1236)
at 
org.apache.hadoop.fs.swift.http.SwiftRestClient.createDefaultContainer(SwiftRestClient.java:1221)
at 
org.apache.hadoop.fs.swift.http.SwiftRestClient.access$1600(SwiftRestClient.java:94)
at 
org.apache.hadoop.fs.swift.http.SwiftRestClient$AuthenticationPost.extractResult(SwiftRestClient.java:1199)
at 
org.apache.hadoop.fs.swift.http.SwiftRestClient$AuthenticationPost.extractResult(SwiftRestClient.java:1067)
at 
org.apache.hadoop.fs.swift.http.SwiftRestClient.perform(SwiftRestClient.java:1388)
at 
org.apache.hadoop.fs.swift.http.SwiftRestClient.authenticate(SwiftRestClient.java:1062)
at 
org.apache.hadoop.fs.swift.http.SwiftRestClient.authIfNeeded(SwiftRestClient.java:1280)
at 
org.apache.hadoop.fs.swift.http.SwiftRestClient.preRemoteCommand(SwiftRestClient.java:1296)
at 
org.apache.hadoop.fs.swift.http.SwiftRestClient.headRequest(SwiftRestClient.java:998)
at 
org.apache.hadoop.fs.swift.snative.SwiftNativeFileSystemStore.stat(SwiftNativeFileSystemStore.java:259)
at 
org.apache.hadoop.fs.swift.snative.SwiftNativeFileSystemStore.getObjectMetadata(SwiftNativeFileSystemStore.java:214)
at 
org.apache.hadoop.fs.swift.snative.SwiftNativeFileSystemStore.getObjectMetadata(SwiftNativeFileSystemStore.java:183)
at 
org.apache.hadoop.fs.swift.snative.SwiftNativeFileSystem.getFileStatus(SwiftNativeFileSystem.java:173)
at 
org.apache.hadoop.fs.swift.snative.SwiftNativeFileSystem.shouldCreate(SwiftNativeFileSystem.java:398)
at 
org.apache.hadoop.fs.swift.snative.SwiftNativeFileSystem.mkdirs(SwiftNativeFileSystem.java:333)
at org.apache.hadoop.fs.FileSystem.mkdirs(FileSystem.java:2229)
at 
org.apache.hadoop.fs.FileSystemContractBaseTest.writeAndRead(FileSystemContractBaseTest.java:826)
at 
org.apache.hadoop.fs.FileSystemContractBaseTest.writeReadAndDelete(FileSystemContractBaseTest.java:298)
at 
org.apache.hadoop.fs.FileSystemContractBaseTest.testWriteReadAndDeleteTwoBlocks(FileSystemContractBaseTest.java:287)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at junit.framework.TestCase.runTest(TestCase.java:176)
at junit.framework.TestCase.runBare(TestCase.java:141)
at junit.framework.TestResult$1.protect(TestResult.java:122)
at junit.framework.TestResult.runProtected(TestResult.java:142)
at junit.framework.TestResult.run(TestResult.java:125)
at junit.framework.TestCase.run(TestCase.java:129)
at junit.framework.TestSuite.runTest(TestSuite.java:255)
at junit.framework.TestSuite.run(TestSuite.java:250)
at 
org.junit.internal.runners.JUnit38ClassRunner.run(JUnit38ClassRunner.java:84)
at 
org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:264)
at 
org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:153)
at 
org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:124)
at 
org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:200)
at 
org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:153)
at 
org.apache.maven.surefire.boo

[jira] [Created] (HADOOP-14151) Swift treats 0-len file as directory

2017-03-07 Thread John Zhuge (JIRA)
John Zhuge created HADOOP-14151:
---

 Summary: Swift treats 0-len file as directory
 Key: HADOOP-14151
 URL: https://issues.apache.org/jira/browse/HADOOP-14151
 Project: Hadoop Common
  Issue Type: Bug
  Components: fs/swift
Affects Versions: 3.0.0-alpha3
Reporter: John Zhuge


Unit test {{TestSwiftContractRootDir#testRmNonEmptyRootDirNonRecursive}} fails 
at {{assertIsFile(file)}}. This leads me to suspect swift treats 0-len file as 
directory. Confirmed by the following experiment:
{noformat}
$ ls -l /tmp/zero /tmp/abc
-rw-rw-r--  1 jzhuge  wheel  4 Mar  7 13:19 /tmp/abc
-rw-rw-r--  1 jzhuge  wheel  0 Mar  7 13:19 /tmp/zero

$ bin/hadoop fs -put /tmp/zero /tmp/abc swift://jzswift.rackspace/
2017-03-07 13:24:09,321 INFO snative.SwiftNativeFileSystemStore: mv  
jzswift/zero._COPYING_ swift://jzswift.rackspace/zero

$ bin/hadoop fs -touchz swift://jzswift.rackspace/touchz

$ bin/hadoop fs -ls swift://jzswift.rackspace/
Found 3 items
-rw-rw-rw-   1  4 2017-03-07 13:36 swift://jzswift.rackspace/abc
drwxrwxrwx   -  0 2017-03-07 13:28 swift://jzswift.rackspace/touchz
drwxrwxrwx   -  0 2017-03-07 13:32 swift://jzswift.rackspace/zero
{noformat}



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org



Apache Hadoop qbt Report: trunk+JDK8 on Linux/ppc64le

2017-03-07 Thread Apache Jenkins Server
For more details, see 
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/250/

[Mar 6, 2017 4:34:51 PM] (aajisaka) HADOOP-14108. CLI MiniCluster: add an 
option to specify NameNode HTTP
[Mar 6, 2017 6:47:15 PM] (wang) HDFS-11441. Add escaping to error message in 
KMS web UI. Contributed by
[Mar 6, 2017 10:02:49 PM] (rchiang) YARN-5665. Enhance documentation for
[Mar 6, 2017 11:04:13 PM] (wang) HDFS-11498. Make RestCsrfPreventionHandler and 
WebHdfsHandler compatible
[Mar 7, 2017 12:39:53 AM] (arp) HDFS-10838. Last full block report received 
time for each DN should be
[Mar 7, 2017 1:00:13 AM] (liuml07) HADOOP-14048. REDO operation of 
WASB#AtomicRename should create
[Mar 7, 2017 1:10:11 AM] (liuml07) Revert "HADOOP-13930. Azure: Add 
Authorization support to WASB.
[Mar 7, 2017 1:16:36 AM] (liuml07) HADOOP-13930. Azure: Add Authorization 
support to WASB. Contributed by
[Mar 7, 2017 4:10:59 AM] (aajisaka) MAPREDUCE-6855. Specify charset when create 
String in
[Mar 7, 2017 4:22:11 AM] (aajisaka) Treat encrypted files as private. 
Contributed by Daniel Templeton.
[Mar 7, 2017 6:14:55 AM] (aajisaka) HADOOP-14087. S3A typo in pom.xml test 
exclusions. Contributed by Aaron




-1 overall


The following subsystems voted -1:
compile unit


The following subsystems voted -1 but
were configured to be filtered/ignored:
cc javac


The following subsystems are considered long running:
(runtime bigger than 1h  0m  0s)
unit


Specific tests:

Failed junit tests :

   hadoop.security.TestRaceWhenRelogin 
   hadoop.hdfs.TestDFSRemove 
   hadoop.hdfs.TestReconstructStripedFile 
   hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewer 
   
hadoop.hdfs.server.datanode.metrics.TestDataNodeOutlierDetectionViaMetrics 
   hadoop.hdfs.server.datanode.checker.TestThrottledAsyncChecker 
   hadoop.hdfs.server.datanode.TestDataNodeVolumeFailure 
   hadoop.hdfs.server.datanode.TestDataNodeVolumeFailureReporting 
   hadoop.hdfs.web.TestWebHdfsTimeouts 
   hadoop.yarn.server.timeline.TestRollingLevelDB 
   hadoop.yarn.server.timeline.TestTimelineDataManager 
   hadoop.yarn.server.timeline.TestLeveldbTimelineStore 
   hadoop.yarn.server.timeline.webapp.TestTimelineWebServices 
   hadoop.yarn.server.timeline.recovery.TestLeveldbTimelineStateStore 
   hadoop.yarn.server.timeline.TestRollingLevelDBTimelineStore 
   
hadoop.yarn.server.applicationhistoryservice.TestApplicationHistoryServer 
   hadoop.yarn.server.resourcemanager.recovery.TestLeveldbRMStateStore 
   hadoop.yarn.server.resourcemanager.TestRMRestart 
   hadoop.yarn.server.TestMiniYarnClusterNodeUtilization 
   hadoop.yarn.server.TestContainerManagerSecurity 
   hadoop.yarn.server.timeline.TestLevelDBCacheTimelineStore 
   hadoop.yarn.server.timeline.TestOverrideTimelineStoreYarnClient 
   hadoop.yarn.server.timeline.TestEntityGroupFSTimelineStore 
   hadoop.yarn.applications.distributedshell.TestDistributedShell 
   hadoop.mapred.TestShuffleHandler 
   hadoop.mapreduce.v2.hs.TestHistoryServerLeveldbStateStoreService 

Timed out junit tests :

   org.apache.hadoop.hdfs.server.datanode.TestFsDatasetCache 
  

   compile:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/250/artifact/out/patch-compile-root.txt
  [132K]

   cc:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/250/artifact/out/patch-compile-root.txt
  [132K]

   javac:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/250/artifact/out/patch-compile-root.txt
  [132K]

   unit:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/250/artifact/out/patch-unit-hadoop-common-project_hadoop-common.txt
  [136K]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/250/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt
  [384K]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/250/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-nodemanager.txt
  [16K]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/250/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-applicationhistoryservice.txt
  [52K]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/250/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt
  [72K]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/250/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-tests.txt
  [324K]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/250/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-timeline-pluginstorage.txt
  [28K]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

2017-03-07 Thread Apache Jenkins Server
For more details, see 
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/338/

[Mar 6, 2017 11:04:03 AM] (yqlin) HDFS-8741. Proper error msg to be printed 
when invalid operation type is
[Mar 6, 2017 4:34:51 PM] (aajisaka) HADOOP-14108. CLI MiniCluster: add an 
option to specify NameNode HTTP
[Mar 6, 2017 6:47:15 PM] (wang) HDFS-11441. Add escaping to error message in 
KMS web UI. Contributed by
[Mar 6, 2017 10:02:49 PM] (rchiang) YARN-5665. Enhance documentation for
[Mar 6, 2017 11:04:13 PM] (wang) HDFS-11498. Make RestCsrfPreventionHandler and 
WebHdfsHandler compatible
[Mar 7, 2017 12:39:53 AM] (arp) HDFS-10838. Last full block report received 
time for each DN should be
[Mar 7, 2017 1:00:13 AM] (liuml07) HADOOP-14048. REDO operation of 
WASB#AtomicRename should create
[Mar 7, 2017 1:10:11 AM] (liuml07) Revert "HADOOP-13930. Azure: Add 
Authorization support to WASB.
[Mar 7, 2017 1:16:36 AM] (liuml07) HADOOP-13930. Azure: Add Authorization 
support to WASB. Contributed by
[Mar 7, 2017 4:10:59 AM] (aajisaka) MAPREDUCE-6855. Specify charset when create 
String in
[Mar 7, 2017 4:22:11 AM] (aajisaka) Treat encrypted files as private. 
Contributed by Daniel Templeton.
[Mar 7, 2017 6:14:55 AM] (aajisaka) HADOOP-14087. S3A typo in pom.xml test 
exclusions. Contributed by Aaron




-1 overall


The following subsystems voted -1:
asflicense unit


The following subsystems voted -1 but
were configured to be filtered/ignored:
cc checkstyle javac javadoc pylint shellcheck shelldocs whitespace


The following subsystems are considered long running:
(runtime bigger than 1h  0m  0s)
unit


Specific tests:

Failed junit tests :

   hadoop.hdfs.server.datanode.TestDataNodeMultipleRegistrations 
   hadoop.hdfs.server.datanode.TestDataNodeVolumeFailureReporting 
   hadoop.hdfs.server.datanode.TestDataNodeVolumeFailure 
   hadoop.hdfs.server.datanode.TestDirectoryScanner 
   hadoop.hdfs.server.datanode.fsdataset.impl.TestSpaceReservation 
   
hadoop.yarn.server.nodemanager.containermanager.scheduler.TestContainerSchedulerQueuing
 
   hadoop.yarn.server.timeline.webapp.TestTimelineWebServices 
   hadoop.yarn.server.TestContainerManagerSecurity 
   hadoop.yarn.server.TestMiniYarnClusterNodeUtilization 
   hadoop.yarn.server.TestDiskFailures 
   hadoop.mapred.TestMRTimelineEventHandling 

Timed out junit tests :

   org.apache.hadoop.hdfs.server.blockmanagement.TestBlockStatsMXBean 
  

   cc:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/338/artifact/out/diff-compile-cc-root.txt
  [4.0K]

   javac:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/338/artifact/out/diff-compile-javac-root.txt
  [176K]

   checkstyle:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/338/artifact/out/diff-checkstyle-root.txt
  [17M]

   pylint:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/338/artifact/out/diff-patch-pylint.txt
  [20K]

   shellcheck:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/338/artifact/out/diff-patch-shellcheck.txt
  [24K]

   shelldocs:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/338/artifact/out/diff-patch-shelldocs.txt
  [12K]

   whitespace:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/338/artifact/out/whitespace-eol.txt
  [11M]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/338/artifact/out/whitespace-tabs.txt
  [1.3M]

   javadoc:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/338/artifact/out/diff-javadoc-javadoc-root.txt
  [2.2M]

   unit:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/338/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt
  [420K]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/338/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-nodemanager.txt
  [36K]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/338/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-applicationhistoryservice.txt
  [12K]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/338/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-tests.txt
  [324K]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/338/artifact/out/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient.txt
  [88K]

   asflicense:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/338/artifact/out/patch-asflicense-problems.txt
  [4.0K]

Powered by Apache Yetus 0.5.0-SNAPSHOT   http://yetus.apache.org



-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional co

Re: About 2.7.4 Release

2017-03-07 Thread Sangjin Lee
I don't think there should be any linkage between releasing 2.8.0 and
2.7.4. If we have a volunteer for releasing 2.7.4, we should go full speed
ahead. We still need a volunteer from a PMC member or a committer as some
tasks may require certain privileges, but I don't think it precludes
working with others to close down the release.

I for one would like to see more frequent releases, and being able to
automate release steps more would go a long way.

On Tue, Mar 7, 2017 at 2:16 AM, Marton Elek  wrote:

> Is there any reason to wait for 2.8 with 2.7.4?
>
> Unfortunately the previous  thread about release cadence has been ended
> without final decision. But if I understood well, there was more or less an
> agreement about that it would be great to achieve more frequent releases,
> if possible (with or without written rules and EOL policy).
>
> I personally prefer to be more closer to the scheduling part of the
> proposal:
>
> "A minor release on the latest major line should be every 6 months, and a
> maintenance release on a minor release (as there may be concurrently
> maintained minor releases) every 2 months".
>
> I don't know what is the hardest part of creating new minor/maintenance
> releases. But if the problems are technical (smoketesting, unit tests, old
> release script, anything else) I would be happy to do any task for new
> maintenance releases (or more frequent releases).
>
> Regards,
> Marton
>
>
> 
> From: Akira Ajisaka 
> Sent: Tuesday, March 07, 2017 7:34 AM
> To: Brahma Reddy Battula; Hadoop Common; yarn-...@hadoop.apache.org;
> Hdfs-dev; mapreduce-...@hadoop.apache.org
> Subject: Re: About 2.7.4 Release
>
> Probably 2.8.0 will be released soon.
> https://issues.apache.org/jira/browse/HADOOP-13866?
> focusedCommentId=15898379&page=com.atlassian.jira.
> plugin.system.issuetabpanels:comment-tabpanel#comment-15898379
>
> I'm thinking 2.7.4 release process starts after 2.8.0 release,
> so 2.7.4 will be released in April or May. (hopefully)
>
> Thoughts?
>
> Regards,
> Akira
>
> On 2017/03/01 21:01, Brahma Reddy Battula wrote:
> > Hi All
> >
> > It has been six months for branch-2.7 release.. is there any near plan
> for 2.7.4..?
> >
> >
> > Thanks&Regards
> > Brahma Reddy Battula
> >
> >
>
> -
> To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
> For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
>
>
>
> -
> To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
> For additional commands, e-mail: common-dev-h...@hadoop.apache.org
>
>


Re: About 2.7.4 Release

2017-03-07 Thread Marton Elek
Is there any reason to wait for 2.8 with 2.7.4?

Unfortunately the previous  thread about release cadence has been ended without 
final decision. But if I understood well, there was more or less an agreement 
about that it would be great to achieve more frequent releases, if possible 
(with or without written rules and EOL policy).

I personally prefer to be more closer to the scheduling part of the proposal:

"A minor release on the latest major line should be every 6 months, and a 
maintenance release on a minor release (as there may be concurrently
maintained minor releases) every 2 months".

I don't know what is the hardest part of creating new minor/maintenance 
releases. But if the problems are technical (smoketesting, unit tests, old 
release script, anything else) I would be happy to do any task for new 
maintenance releases (or more frequent releases).

Regards,
Marton

 

From: Akira Ajisaka 
Sent: Tuesday, March 07, 2017 7:34 AM
To: Brahma Reddy Battula; Hadoop Common; yarn-...@hadoop.apache.org; Hdfs-dev; 
mapreduce-...@hadoop.apache.org
Subject: Re: About 2.7.4 Release

Probably 2.8.0 will be released soon.
https://issues.apache.org/jira/browse/HADOOP-13866?focusedCommentId=15898379&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-15898379

I'm thinking 2.7.4 release process starts after 2.8.0 release,
so 2.7.4 will be released in April or May. (hopefully)

Thoughts?

Regards,
Akira

On 2017/03/01 21:01, Brahma Reddy Battula wrote:
> Hi All
>
> It has been six months for branch-2.7 release.. is there any near plan for 
> 2.7.4..?
>
>
> Thanks&Regards
> Brahma Reddy Battula
>
>

-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org



-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org