[jira] [Created] (HDFS-13627) TestErasureCodingExerciseAPIs fails on Windows

2018-05-27 Thread Anbang Hu (JIRA) 
Anbang Hu created HDFS-13627:


 Summary: TestErasureCodingExerciseAPIs fails on Windows
 Key: HDFS-13627
 URL: https://issues.apache.org/jira/browse/HDFS-13627
 Project: Hadoop HDFS
  Issue Type: Test
Reporter: Anbang Hu
Assignee: Anbang Hu






--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org

[jira] [Created] (HDFS-13626) When the setOwner operation was denied,The logging username is not appropriate

2018-05-27 Thread luhuachao (JIRA) 
luhuachao created HDFS-13626:


 Summary: When the setOwner operation was denied,The logging 
username is not appropriate
 Key: HDFS-13626
 URL: https://issues.apache.org/jira/browse/HDFS-13626
 Project: Hadoop HDFS
  Issue Type: Bug
  Components: namenode
Affects Versions: 3.0.0-alpha2, 2.7.4, 2.8.0
 Environment: hadoop 2.8.2
Reporter: luhuachao


when do the chown operation on target file /tmp/test with user 'root' to user 
'hive', the log displays 'User hive is not a super user' ;This appropriate log 
here should be 'User root is not a super user'

[root@lhccmh1 ~]# hdfs dfs -ls /tmp/test
 -rw-r--r-- 3 root hdfs 0 2018-05-28 10:33 /tmp/test
 [root@lhccmh1 ~]# hdfs dfs -chown hive /tmp/test
 chown: changing ownership of '/tmp/test': User hive is not a super user 
(non-super user cannot change owner).

The last version patch of issue HDFS-10455 use username but not pc.getUser() in 
logs;

   if (!pc.isSuperUser()) {
 if (username != null && !pc.getUser().equals(username)) {
-  throw new AccessControlException("Non-super user cannot change 
owner");
+  throw new AccessControlException("User " + *username*
+  + " is not a super user (non-super user cannot change owner).");
 }
 if (group != null && !pc.isMemberOfGroup(group)) {
-  throw new AccessControlException("User does not belong to " + group);
+  throw new AccessControlException(
+  "User " + username + " does not belong to " + group);
 }
   }
 

 

 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

2018-05-27 Thread Apache Jenkins Server 
For more details, see 
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/793/

[May 26, 2018 2:43:33 AM] (inigoiri) HDFS-13620. Randomize the test directory 
path for
[May 26, 2018 4:53:20 AM] (wangda) YARN-8213. Add Capacity Scheduler 
performance metrics. (Weiwei Yang via
[May 26, 2018 6:11:14 PM] (aengineer) HDDS-78. Add per volume level storage 
stats in SCM. Contributed by 




-1 overall


The following subsystems voted -1:
asflicense findbugs pathlen unit xml


The following subsystems voted -1 but
were configured to be filtered/ignored:
cc checkstyle javac javadoc pylint shellcheck shelldocs whitespace


The following subsystems are considered long running:
(runtime bigger than 1h  0m  0s)
unit


Specific tests:

FindBugs :

   module:hadoop-hdds/common 
   Found reliance on default encoding in 
org.apache.hadoop.utils.MetadataKeyFilters$KeyPrefixFilter.filterKey(byte[], 
byte[], byte[]):in 
org.apache.hadoop.utils.MetadataKeyFilters$KeyPrefixFilter.filterKey(byte[], 
byte[], byte[]): String.getBytes() At MetadataKeyFilters.java:[line 97] 

Failed junit tests :

   hadoop.security.TestRaceWhenRelogin 
   hadoop.hdfs.TestRollingUpgrade 
   hadoop.hdfs.TestDFSStripedOutputStreamWithRandomECPolicy 
   hadoop.hdfs.web.TestWebHdfsTimeouts 
   
hadoop.yarn.server.timelineservice.storage.TestHBaseTimelineStorageEntities 
   
hadoop.yarn.server.timelineservice.storage.flow.TestHBaseStorageFlowActivity 
   hadoop.yarn.server.timelineservice.storage.flow.TestHBaseStorageFlowRun 
   hadoop.yarn.server.timelineservice.storage.TestHBaseTimelineStorageApps 
   
hadoop.yarn.server.timelineservice.storage.flow.TestHBaseStorageFlowRunCompaction
 
   
hadoop.yarn.server.timelineservice.storage.TestHBaseTimelineStorageSchema 
   
hadoop.yarn.server.timelineservice.storage.TestHBaseTimelineStorageDomain 
   
hadoop.yarn.server.timelineservice.reader.TestTimelineReaderWebServicesHBaseStorage
 
  

   cc:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/793/artifact/out/diff-compile-cc-root.txt
  [4.0K]

   javac:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/793/artifact/out/diff-compile-javac-root.txt
  [332K]

   checkstyle:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/793/artifact/out/diff-checkstyle-root.txt
  [17M]

   pathlen:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/793/artifact/out/pathlen.txt
  [12K]

   pylint:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/793/artifact/out/diff-patch-pylint.txt
  [24K]

   shellcheck:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/793/artifact/out/diff-patch-shellcheck.txt
  [20K]

   shelldocs:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/793/artifact/out/diff-patch-shelldocs.txt
  [16K]

   whitespace:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/793/artifact/out/whitespace-eol.txt
  [9.4M]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/793/artifact/out/whitespace-tabs.txt
  [1.1M]

   xml:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/793/artifact/out/xml.txt
  [4.0K]

   findbugs:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/793/artifact/out/branch-findbugs-hadoop-hdds_client.txt
  [56K]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/793/artifact/out/branch-findbugs-hadoop-hdds_common-warnings.html
  [8.0K]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/793/artifact/out/branch-findbugs-hadoop-hdds_container-service.txt
  [52K]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/793/artifact/out/branch-findbugs-hadoop-hdds_server-scm.txt
  [32K]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/793/artifact/out/branch-findbugs-hadoop-hdds_tools.txt
  [16K]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/793/artifact/out/branch-findbugs-hadoop-ozone_client.txt
  [8.0K]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/793/artifact/out/branch-findbugs-hadoop-ozone_common.txt
  [24K]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/793/artifact/out/branch-findbugs-hadoop-ozone_objectstore-service.txt
  [4.0K]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/793/artifact/out/branch-findbugs-hadoop-ozone_ozone-manager.txt
  [4.0K]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/793/artifact/out/branch-findbugs-hadoop-ozone_tools.txt
  [4.0K]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/793/artifact/out/branch-findbugs-hadoop-tools_hadoop-ozone.txt
  [8.0K]

   javadoc:

Apache Hadoop qbt Report: trunk+JDK8 on Windows/x64

2018-05-27 Thread Apache Jenkins Server 
For more details, see https://builds.apache.org/job/hadoop-trunk-win/480/

[May 26, 2018 6:11:14 PM] (aengineer) HDDS-78. Add per volume level storage 
stats in SCM. Contributed by 


[Error replacing 'FILE' - Workspace is not accessible]

-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org

Re: Apache Hadoop 3.0.3 Release plan

2018-05-27 Thread Yongjun Zhang 
HI,

I did build before cut branch and hit some issues, have not got to the
bottom, will cut branch after the build issues are resolved.

Thanks.

--Yongjun

On Sat, May 26, 2018 at 1:46 PM, Yongjun Zhang  wrote:

> Hi All,
>
> I will be working on cutting the 3.0.3 branch and trying a build today.
>
> Thanks.
>
> --Yongjun
>
>
>
> On Wed, May 23, 2018 at 3:31 PM, Yongjun Zhang 
> wrote:
>
>> Thanks Eric. Sounds good. I may try to see if I can do the branching/RC
>> sooner.
>>
>> --Yongjun
>>
>>
>> On Wed, May 23, 2018 at 2:18 PM, Eric Badger  wrote:
>>
>>> My thinking is to cut the branch in next couple of days and create RC for
>>> vote at the end of month.
>>>   >  We plan to cut branch-3.0.3 by the coming Wednesday (May 9th) and
>>> vote for RC on May 30th
>>>   I much prefer to wait to cut the branch until just before the
>>> production of the release and the vote. With so many branches, we sometimes
>>> miss putting critical bug fixes in unreleased branches if thebranch is
>>> cut too early.
>>>
>>> Echoing Eric Payne, I think we should wait to cut the branch until we
>>> are actually creating the RC to vote on (i.e. on May 29 or 30 if the vote
>>> is to be on May 30).
>>>
>>> Eric
>>>
>>>
>>>
>>> On Wed, May 23, 2018 at 4:11 PM, Yongjun Zhang 
>>> wrote:
>>>
 Hi,

 I have gardened the jiras for 3.0.3, and have the following open issues:

 https://issues.apache.org/jira/issues/?filter=12343970

 Two of them are blockers, one of them (YARN-8346) has already got +1 for
 patch, the other (YARN-8108) will take longer time to resolve and it
 seems
 we can possibly push it to next release given 3.0.2 also has the issue.

 My thinking is to cut the branch in next couple of days and create RC
 for
 vote at the end of month.

 Comments are welcome.

 Thanks,

 --Yongjun

 On Tue, May 8, 2018 at 11:40 AM, Vrushali C 
 wrote:

 > +1 for including the YARN-7190 patch in 3.0.3 release. This is a fix
 that
 > will enable HBase to use Hadoop 3.0.x in the production line.
 >
 > thanks
 > Vrushali
 >
 >
 > On Tue, May 8, 2018 at 10:24 AM, Yongjun Zhang 
 > wrote:
 >
 >> Thanks Wei-Chiu and Haibo for the feedback!
 >>
 >> Good thing is that I have made the following note couple of days ago
 when
 >> I
 >> looked the at branch diff, so we are on the same page:
 >>
 >>  496dc57 Revert "YARN-7190. Ensure only NM classpath in 2.x gets
 TSv2
 >> related hbase jars, not the user classpath. Contributed by Varun
 Saxena."
 >>
 >> *YARN-7190 is not in 3.0.2,  I will include it in 3.0.3 per* the
 comment
 >> below:
 >> https://issues.apache.org/jira/browse/YARN-7190?focusedComme
 >> ntId=16457649&
 >> page=com.atlassian.jira.plugin.system.issuetabpanels
 >> 

 >> :
 >> comment-tabpanel#comment-16457649
 >>
 >>
 >> In addition, I will revert   https://issues.apache.org/
 >> jira/browse/HADOOP-13055 from 3.0.3 since it's a feature.
 >>
 >>
 >> Best,
 >>
 >> --Yongjun
 >>
 >> On Tue, May 8, 2018 at 8:57 AM, Haibo Chen 
 >> wrote:
 >>
 >> > +1 on adding YARN-7190 to Hadoop 3.0.x despite the fact that it is
 >> > technically incompatible.
 >> > It is critical enough to justify being an exception, IMO.
 >> >
 >> > Added Rohith and Vrushali
 >> >
 >> > On Tue, May 8, 2018 at 6:20 AM, Wei-Chiu Chuang <
 weic...@apache.org>
 >> > wrote:
 >> >
 >> >> Thanks Yongjun for driving 3.0.3 release!
 >> >>
 >> >> IMHO, could we consider adding YARN-7190
 >> >>  into the list?
 >> >> I understand that it is listed as an incompatible change, however,
 >> because
 >> >> of this bug, HBase considers the entire Hadoop 3.0.x line not
 >> production
 >> >> ready. I feel there's not much point releasing any more 3.0.x
 releases
 >> if
 >> >> downstream projects can't pick it up (after the fact that HBase
 is one
 >> of
 >> >> the most important projects around Hadoop).
 >> >>
 >> >> On Mon, May 7, 2018 at 1:19 PM, Yongjun Zhang <
 yzh...@cloudera.com>
 >> >> wrote:
 >> >>
 >> >> > Hi Eric,
 >> >> >
 >> >> > Thanks for the feedback, good point. I will try to clean up
 things,
 >> then
 >> >> > cut branch before the release production and vote.
 >> >> >
 >> >> > Best,
 >> >> >
 >> >> > --Yongjun
 >> >> >
 >> >> > On Mon, May 7, 2018 at 8:39 AM, Eric Payne <