[jira] [Created] (HDDS-243) Update docs to reflect the new name for Ozone Manager

2018-07-09 Thread Anu Engineer (JIRA)
Anu Engineer created HDDS-243:
-

 Summary: Update docs to reflect the new name for Ozone Manager
 Key: HDDS-243
 URL: https://issues.apache.org/jira/browse/HDDS-243
 Project: Hadoop Distributed Data Store
  Issue Type: Improvement
  Components: Ozone Manager
Reporter: Anu Engineer


KSM has been renamed to Ozone Manager. The docs still refer to KSM. This JIRA 
is to track that docs issue.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org



Re: [VOTE] Release Apache Hadoop 3.0.3 (RC0)

2018-07-09 Thread Jonathan Eagles
Thank you, Yongjun Zhang for resolving this issue for me. I have verified
the 3.0.3 build is now working for me for tez to specify as a hadoop
dependency.

As for release procedure, can someone comment on what to do now that the
artifacts published to maven are different than the voted on artifacts. I
believe the source code is what is voted on and the maven artifacts are
just for convenience, but would like an "official" answer.

Reference:
https://issues.apache.org/jira/browse/TEZ-3955

Regards,
jeagles

On Mon, Jul 9, 2018 at 12:26 PM, Yongjun Zhang  wrote:

> HI Jonathan,
>
> I have updated the artifacts, so now
>
> https://repository.apache.org/#nexus-search;gav~org.apache.hadoop~~3.0.2~~
> https://repository.apache.org/#nexus-search;gav~org.apache.hadoop~~3.0.3~~
>
> are more consistent, except that 3.0.3 has an extra entry for rbf. Would
> you please try again?
>
> The propagation to
> https://mvnrepository.com/artifact/org.apache.hadoop/hadoop-project
> will take some time. I did nothing different than last time, so keep
> finger crossed that it will propagate there.
>
> Thanks Sammi Chen and Andrew Wang for info and advice, and sorry for the
> inconvenience again.
>
> Best,
>
> --Yongjun
>
> On Mon, Jul 2, 2018 at 9:30 AM, Jonathan Eagles  wrote:
>
>> Release 3.0.3 is still broken due to the missing artifacts. Any update on
>> when these artifacts will be published?
>>
>> On Wed, Jun 27, 2018 at 8:25 PM, Chen, Sammi 
>> wrote:
>>
>>> Hi Yongjun,
>>>
>>>
>>>
>>>
>>>
>>> The artifacts will be pushed to https://mvnrepository.com/arti
>>> fact/org.apache.hadoop/hadoop-project after step 6 of Publishing steps.
>>>
>>>
>>> For 2.9.1, I remember I absolutely did the step before. I redo the step
>>> 6 today and now 2.9.1 is pushed to the mvn repo.
>>>
>>> You can double check it. I suspect sometimes Nexus may fail to notify
>>> user when this is unexpected failures.
>>>
>>>
>>>
>>>
>>>
>>> Bests,
>>>
>>> Sammi
>>>
>>> *From:* Yongjun Zhang [mailto:yzh...@cloudera.com]
>>> *Sent:* Sunday, June 17, 2018 12:17 PM
>>> *To:* Jonathan Eagles ; Chen, Sammi <
>>> sammi.c...@intel.com>
>>> *Cc:* Eric Payne ; Hadoop Common <
>>> common-...@hadoop.apache.org>; Hdfs-dev ;
>>> mapreduce-...@hadoop.apache.org; yarn-...@hadoop.apache.org
>>> *Subject:* Re: [VOTE] Release Apache Hadoop 3.0.3 (RC0)
>>>
>>>
>>>
>>> + Junping, Sammi
>>>
>>>
>>>
>>> Hi Jonathan,
>>>
>>>
>>>
>>> Many thanks for reporting the issues and sorry for the inconvenience.
>>>
>>>
>>>
>>> 1. Shouldn't the build be looking for artifacts in
>>>
>>>
>>>
>>> https://repository.apache.org/content/repositories/releases
>>>
>>> rather than
>>>
>>>
>>>
>>> https://repository.apache.org/content/repositories/snapshots
>>>
>>> ?
>>>
>>>
>>>
>>> 2.
>>>
>>> Not seeing the artifact published here as well.
>>>
>>> https://mvnrepository.com/artifact/org.apache.hadoop/hadoop-project
>>>
>>>
>>>
>>> Indeed, I did not see 2.9.1 there too. So included Sammi Chen.
>>>
>>>
>>>
>>> Hi Junping, would you please share which step in
>>>
>>> https://wiki.apache.org/hadoop/HowToRelease
>>>
>>> should have done this?
>>>
>>>
>>>
>>> Thanks a lot.
>>>
>>>
>>>
>>> --Yongjun
>>>
>>>
>>>
>>> On Fri, Jun 15, 2018 at 10:52 PM, Jonathan Eagles 
>>> wrote:
>>>
>>> Upgraded Tez dependency to hadoop 3.0.3 and found this issue. Anyone
>>> else seeing this issue?
>>>
>>>
>>>
>>> [ERROR] Failed to execute goal on project hadoop-shim: Could not resolve
>>> dependencies for project org.apache.tez:hadoop-shim:jar:0.10.0-SNAPSHOT:
>>> Failed to collect dependencies at 
>>> org.apache.hadoop:hadoop-yarn-api:jar:3.0.3:
>>> Failed to read artifact descriptor for 
>>> org.apache.hadoop:hadoop-yarn-api:jar:3.0.3:
>>> Could not find artifact org.apache.hadoop:hadoop-project:pom:3.0.3 in
>>> apache.snapshots.https (https://repository.apache.org
>>> /content/repositories/snapshots) -> [Help 1]
>>>
>>> [ERROR]
>>>
>>> [ERROR] To see the full stack trace of the errors, re-run Maven with the
>>> -e switch.
>>>
>>> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
>>>
>>> [ERROR]
>>>
>>> [ERROR] For more information about the errors and possible solutions,
>>> please read the following articles:
>>>
>>> [ERROR] [Help 1] http://cwiki.apache.org/conflu
>>> ence/display/MAVEN/DependencyResolutionException
>>>
>>> [ERROR]
>>>
>>> [ERROR] After correcting the problems, you can resume the build with the
>>> command
>>>
>>> [ERROR]   mvn  -rf :hadoop-shim
>>>
>>>
>>>
>>> Not seeing the artifact published here as well.
>>>
>>> https://mvnrepository.com/artifact/org.apache.hadoop/hadoop-project
>>>
>>>
>>>
>>> On Tue, Jun 12, 2018 at 6:44 PM, Yongjun Zhang 
>>> wrote:
>>>
>>> Thanks Eric!
>>>
>>> --Yongjun
>>>
>>>
>>> On Mon, Jun 11, 2018 at 8:05 AM, Eric Payne 
>>> wrote:
>>>
>>> > Sorry, Yongjun. My +1 is also binding
>>> > +1 (binding)
>>> > -Eric Payne
>>> >
>>> > On Friday, June 1, 2018, 12:25:36 PM CDT, Eric Payne <
>>> > eric.payne1...@yahoo.com> wrote:
>>> >
>>> >
>>> >
>>> >
>>> > 

Apache Hadoop qbt Report: trunk+JDK8 on Windows/x64

2018-07-09 Thread Apache Jenkins Server
For more details, see https://builds.apache.org/job/hadoop-trunk-win/523/

[Jul 8, 2018 6:11:21 PM] (aengineer) HDDS-217. Move all SCMEvents to a package. 
Contributed by Anu Engineer.
[Jul 8, 2018 6:27:54 PM] (aengineer) HDDS-235. Fix 
TestOzoneAuditLogger#verifyDefaultLogLevel. Contributed by
[Jul 9, 2018 6:27:34 AM] (yqlin) HDFS-13674. Improve documentation on Metrics. 
Contributed by Chao Sun.
[Jul 9, 2018 7:06:07 AM] (yqlin) HDFS-13710. RBF: setQuota and getQuotaUsage 
should check the




-1 overall


The following subsystems voted -1:
compile mvninstall pathlen unit


The following subsystems voted -1 but
were configured to be filtered/ignored:
cc javac


The following subsystems are considered long running:
(runtime bigger than 1h 00m 00s)
unit


Specific tests:

Failed junit tests :

   hadoop.crypto.key.kms.server.TestKMS 
   hadoop.cli.TestAclCLI 
   hadoop.cli.TestAclCLIWithPosixAclInheritance 
   hadoop.cli.TestCacheAdminCLI 
   hadoop.cli.TestCryptoAdminCLI 
   hadoop.cli.TestDeleteCLI 
   hadoop.cli.TestErasureCodingCLI 
   hadoop.cli.TestHDFSCLI 
   hadoop.cli.TestXAttrCLI 
   hadoop.fs.contract.hdfs.TestHDFSContractAppend 
   hadoop.fs.contract.hdfs.TestHDFSContractConcat 
   hadoop.fs.contract.hdfs.TestHDFSContractCreate 
   hadoop.fs.contract.hdfs.TestHDFSContractDelete 
   hadoop.fs.contract.hdfs.TestHDFSContractGetFileStatus 
   hadoop.fs.contract.hdfs.TestHDFSContractMkdir 
   hadoop.fs.contract.hdfs.TestHDFSContractOpen 
   hadoop.fs.contract.hdfs.TestHDFSContractPathHandle 
   hadoop.fs.contract.hdfs.TestHDFSContractRename 
   hadoop.fs.contract.hdfs.TestHDFSContractRootDirectory 
   hadoop.fs.contract.hdfs.TestHDFSContractSeek 
   hadoop.fs.contract.hdfs.TestHDFSContractSetTimes 
   hadoop.fs.loadGenerator.TestLoadGenerator 
   hadoop.fs.permission.TestStickyBit 
   hadoop.fs.shell.TestHdfsTextCommand 
   hadoop.fs.TestEnhancedByteBufferAccess 
   hadoop.fs.TestFcHdfsCreateMkdir 
   hadoop.fs.TestFcHdfsPermission 
   hadoop.fs.TestFcHdfsSetUMask 
   hadoop.fs.TestGlobPaths 
   hadoop.fs.TestHDFSFileContextMainOperations 
   hadoop.fs.TestHDFSMultipartUploader 
   hadoop.fs.TestHdfsNativeCodeLoader 
   hadoop.fs.TestResolveHdfsSymlink 
   hadoop.fs.TestSWebHdfsFileContextMainOperations 
   hadoop.fs.TestSymlinkHdfsDisable 
   hadoop.fs.TestSymlinkHdfsFileContext 
   hadoop.fs.TestSymlinkHdfsFileSystem 
   hadoop.fs.TestUnbuffer 
   hadoop.fs.TestUrlStreamHandler 
   hadoop.fs.TestWebHdfsFileContextMainOperations 
   hadoop.fs.viewfs.TestViewFileSystemAtHdfsRoot 
   hadoop.fs.viewfs.TestViewFileSystemHdfs 
   hadoop.fs.viewfs.TestViewFileSystemLinkFallback 
   hadoop.fs.viewfs.TestViewFileSystemLinkMergeSlash 
   hadoop.fs.viewfs.TestViewFileSystemWithAcls 
   hadoop.fs.viewfs.TestViewFileSystemWithTruncate 
   hadoop.fs.viewfs.TestViewFileSystemWithXAttrs 
   hadoop.fs.viewfs.TestViewFsAtHdfsRoot 
   hadoop.fs.viewfs.TestViewFsDefaultValue 
   hadoop.fs.viewfs.TestViewFsFileStatusHdfs 
   hadoop.fs.viewfs.TestViewFsHdfs 
   hadoop.fs.viewfs.TestViewFsWithAcls 
   hadoop.fs.viewfs.TestViewFsWithXAttrs 
   hadoop.hdfs.client.impl.TestBlockReaderLocal 
   hadoop.hdfs.client.impl.TestBlockReaderLocalLegacy 
   hadoop.hdfs.client.impl.TestBlockReaderRemote 
   hadoop.hdfs.client.impl.TestClientBlockVerification 
   hadoop.hdfs.crypto.TestHdfsCryptoStreams 
   hadoop.hdfs.protocol.datatransfer.sasl.TestSaslDataTransfer 
   hadoop.hdfs.qjournal.client.TestEpochsAreUnique 
   hadoop.hdfs.qjournal.client.TestQJMWithFaults 
   hadoop.hdfs.qjournal.client.TestQuorumJournalManager 
   hadoop.hdfs.qjournal.server.TestJournal 
   hadoop.hdfs.qjournal.server.TestJournalNode 
   hadoop.hdfs.qjournal.server.TestJournalNodeMXBean 
   hadoop.hdfs.qjournal.server.TestJournalNodeRespectsBindHostKeys 
   hadoop.hdfs.qjournal.server.TestJournalNodeSync 
   hadoop.hdfs.qjournal.TestMiniJournalCluster 
   hadoop.hdfs.qjournal.TestNNWithQJM 
   hadoop.hdfs.qjournal.TestSecureNNWithQJM 
   hadoop.hdfs.security.TestDelegationToken 
   hadoop.hdfs.security.TestDelegationTokenForProxyUser 
   hadoop.hdfs.security.token.block.TestBlockToken 
   hadoop.hdfs.server.balancer.TestBalancer 
   hadoop.hdfs.server.balancer.TestBalancerRPCDelay 
   hadoop.hdfs.server.balancer.TestBalancerWithEncryptedTransfer 
   hadoop.hdfs.server.balancer.TestBalancerWithHANameNodes 
   hadoop.hdfs.server.balancer.TestBalancerWithMultipleNameNodes 
   hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup 
   hadoop.hdfs.server.balancer.TestBalancerWithSaslDataTransfer 
   
hadoop.hdfs.server.blockmanagement.TestAvailableSpaceBlockPlacementPolicy 
   

[jira] [Created] (HDDS-242) Introduce NEW_NODE, STALE_NODE and DEAD_NODE event and corresponding event handlers in SCM

2018-07-09 Thread Nanda kumar (JIRA)
Nanda kumar created HDDS-242:


 Summary: Introduce NEW_NODE, STALE_NODE and DEAD_NODE event and 
corresponding event handlers in SCM
 Key: HDDS-242
 URL: https://issues.apache.org/jira/browse/HDDS-242
 Project: Hadoop Distributed Data Store
  Issue Type: Improvement
  Components: SCM
Reporter: Nanda kumar
Assignee: Nanda kumar
 Fix For: 0.2.1


With event queue in place, we can now fire events when there is a node state 
change and the corresponding handles in SCM can handle those events. This jira 
adds support for Node Events in EventQueue and respective event handlers.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org



[jira] [Created] (HDDS-241) Handle Volume in inconsistent state

2018-07-09 Thread Hanisha Koneru (JIRA)
Hanisha Koneru created HDDS-241:
---

 Summary: Handle Volume in inconsistent state
 Key: HDDS-241
 URL: https://issues.apache.org/jira/browse/HDDS-241
 Project: Hadoop Distributed Data Store
  Issue Type: Bug
Reporter: Hanisha Koneru
Assignee: Hanisha Koneru
 Fix For: 0.2.1


During startup, a volume can be in an inconsistent state if 
 # Volume Root path is a file and not a directory
 # Volume Root is non empty but VERSION file does not exist

If a volume is detected to be in an inconsistent state, we should skip loading 
it during startup.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org



[jira] [Created] (HDFS-13725) Randomize MiniDFSCluster base directory in AdminStatesBaseTest

2018-07-09 Thread Anbang Hu (JIRA)
Anbang Hu created HDFS-13725:


 Summary: Randomize MiniDFSCluster base directory in 
AdminStatesBaseTest
 Key: HDFS-13725
 URL: https://issues.apache.org/jira/browse/HDFS-13725
 Project: Hadoop HDFS
  Issue Type: Improvement
Reporter: Anbang Hu
Assignee: Anbang Hu






--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org



Re: [VOTE] Release Apache Hadoop 3.0.3 (RC0)

2018-07-09 Thread Yongjun Zhang
HI Jonathan,

I have updated the artifacts, so now

https://repository.apache.org/#nexus-search;gav~org.apache.hadoop~~3.0.2~~
https://repository.apache.org/#nexus-search;gav~org.apache.hadoop~~3.0.3~~

are more consistent, except that 3.0.3 has an extra entry for rbf. Would
you please try again?

The propagation to
https://mvnrepository.com/artifact/org.apache.hadoop/hadoop-project
will take some time. I did nothing different than last time, so keep finger
crossed that it will propagate there.

Thanks Sammi Chen and Andrew Wang for info and advice, and sorry for the
inconvenience again.

Best,

--Yongjun

On Mon, Jul 2, 2018 at 9:30 AM, Jonathan Eagles  wrote:

> Release 3.0.3 is still broken due to the missing artifacts. Any update on
> when these artifacts will be published?
>
> On Wed, Jun 27, 2018 at 8:25 PM, Chen, Sammi  wrote:
>
>> Hi Yongjun,
>>
>>
>>
>>
>>
>> The artifacts will be pushed to https://mvnrepository.com/arti
>> fact/org.apache.hadoop/hadoop-project after step 6 of Publishing steps.
>>
>>
>> For 2.9.1, I remember I absolutely did the step before. I redo the step 6
>> today and now 2.9.1 is pushed to the mvn repo.
>>
>> You can double check it. I suspect sometimes Nexus may fail to notify
>> user when this is unexpected failures.
>>
>>
>>
>>
>>
>> Bests,
>>
>> Sammi
>>
>> *From:* Yongjun Zhang [mailto:yzh...@cloudera.com]
>> *Sent:* Sunday, June 17, 2018 12:17 PM
>> *To:* Jonathan Eagles ; Chen, Sammi <
>> sammi.c...@intel.com>
>> *Cc:* Eric Payne ; Hadoop Common <
>> common-...@hadoop.apache.org>; Hdfs-dev ;
>> mapreduce-...@hadoop.apache.org; yarn-...@hadoop.apache.org
>> *Subject:* Re: [VOTE] Release Apache Hadoop 3.0.3 (RC0)
>>
>>
>>
>> + Junping, Sammi
>>
>>
>>
>> Hi Jonathan,
>>
>>
>>
>> Many thanks for reporting the issues and sorry for the inconvenience.
>>
>>
>>
>> 1. Shouldn't the build be looking for artifacts in
>>
>>
>>
>> https://repository.apache.org/content/repositories/releases
>>
>> rather than
>>
>>
>>
>> https://repository.apache.org/content/repositories/snapshots
>>
>> ?
>>
>>
>>
>> 2.
>>
>> Not seeing the artifact published here as well.
>>
>> https://mvnrepository.com/artifact/org.apache.hadoop/hadoop-project
>>
>>
>>
>> Indeed, I did not see 2.9.1 there too. So included Sammi Chen.
>>
>>
>>
>> Hi Junping, would you please share which step in
>>
>> https://wiki.apache.org/hadoop/HowToRelease
>>
>> should have done this?
>>
>>
>>
>> Thanks a lot.
>>
>>
>>
>> --Yongjun
>>
>>
>>
>> On Fri, Jun 15, 2018 at 10:52 PM, Jonathan Eagles 
>> wrote:
>>
>> Upgraded Tez dependency to hadoop 3.0.3 and found this issue. Anyone else
>> seeing this issue?
>>
>>
>>
>> [ERROR] Failed to execute goal on project hadoop-shim: Could not resolve
>> dependencies for project org.apache.tez:hadoop-shim:jar:0.10.0-SNAPSHOT:
>> Failed to collect dependencies at 
>> org.apache.hadoop:hadoop-yarn-api:jar:3.0.3:
>> Failed to read artifact descriptor for 
>> org.apache.hadoop:hadoop-yarn-api:jar:3.0.3:
>> Could not find artifact org.apache.hadoop:hadoop-project:pom:3.0.3 in
>> apache.snapshots.https (https://repository.apache.org
>> /content/repositories/snapshots) -> [Help 1]
>>
>> [ERROR]
>>
>> [ERROR] To see the full stack trace of the errors, re-run Maven with the
>> -e switch.
>>
>> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
>>
>> [ERROR]
>>
>> [ERROR] For more information about the errors and possible solutions,
>> please read the following articles:
>>
>> [ERROR] [Help 1] http://cwiki.apache.org/conflu
>> ence/display/MAVEN/DependencyResolutionException
>>
>> [ERROR]
>>
>> [ERROR] After correcting the problems, you can resume the build with the
>> command
>>
>> [ERROR]   mvn  -rf :hadoop-shim
>>
>>
>>
>> Not seeing the artifact published here as well.
>>
>> https://mvnrepository.com/artifact/org.apache.hadoop/hadoop-project
>>
>>
>>
>> On Tue, Jun 12, 2018 at 6:44 PM, Yongjun Zhang 
>> wrote:
>>
>> Thanks Eric!
>>
>> --Yongjun
>>
>>
>> On Mon, Jun 11, 2018 at 8:05 AM, Eric Payne 
>> wrote:
>>
>> > Sorry, Yongjun. My +1 is also binding
>> > +1 (binding)
>> > -Eric Payne
>> >
>> > On Friday, June 1, 2018, 12:25:36 PM CDT, Eric Payne <
>> > eric.payne1...@yahoo.com> wrote:
>> >
>> >
>> >
>> >
>> > Thanks a lot, Yongjun, for your hard work on this release.
>> >
>> > +1
>> > - Built from source
>> > - Installed on 6 node pseudo cluster
>> >
>> >
>> > Tested the following in the Capacity Scheduler:
>> > - Verified that running apps in labelled queues restricts tasks to the
>> > labelled nodes.
>> > - Verified that various queue config properties for CS are refreshable
>> > - Verified streaming jobs work as expected
>> > - Verified that user weights work as expected
>> > - Verified that FairOrderingPolicy in a CS queue will evenly assign
>> > resources
>> > - Verified running yarn shell application runs as expected
>> >
>> >
>> >
>> >
>> >
>> >
>> >
>> > On Friday, June 1, 2018, 12:48:26 AM CDT, Yongjun Zhang <
>> > yjzhan...@apache.org> wrote:
>> >
>> >
>> >
>> >
>> 

Register now for ApacheCon and save $250

2018-07-09 Thread Rich Bowen

Greetings, Apache software enthusiasts!

(You’re getting this because you’re on one or more dev@ or users@ lists 
for some Apache Software Foundation project.)


ApacheCon North America, in Montreal, is now just 80 days away, and 
early bird prices end in just two weeks - on July 21. Prices will be 
going up from $550 to $800 so register NOW to save $250, at 
http://apachecon.com/acna18


And don’t forget to reserve your hotel room. We have negotiated a 
special rate and the room block closes August 24. 
http://www.apachecon.com/acna18/venue.html


Our schedule includes over 100 talks and we’ll be featuring talks from 
dozens of ASF projects.,  We have inspiring keynotes from some of the 
brilliant members of our community and the wider tech space, including:


 * Myrle Krantz, PMC chair for Apache Fineract, and leader in the open 
source financing space
 * Cliff Schmidt, founder of Literacy Bridge (now Amplio) and creator 
of the Talking Book project

 * Bridget Kromhout, principal cloud developer advocate at Microsoft
 * Euan McLeod, Comcast engineer, and pioneer in streaming video

We’ll also be featuring tracks for Geospatial science, Tomcat, 
Cloudstack, and Big Data, as well as numerous other fields where Apache 
software is leading the way. See the full schedule at 
http://apachecon.com/acna18/schedule.html


As usual we’ll be running our Apache BarCamp, the traditional ApacheCon 
Hackathon, and the Wednesday evening Lighting Talks, too, so you’ll want 
to be there.


Register today at http://apachecon.com/acna18 and we’ll see you in Montreal!

--
Rich Bowen
VP, Conferences, The Apache Software Foundation
h...@apachecon.com
@ApacheCon

-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org



[jira] [Created] (HDDS-240) Implement metrics for EventQueue

2018-07-09 Thread Elek, Marton (JIRA)
Elek, Marton created HDDS-240:
-

 Summary: Implement metrics for EventQueue
 Key: HDDS-240
 URL: https://issues.apache.org/jira/browse/HDDS-240
 Project: Hadoop Distributed Data Store
  Issue Type: Bug
  Components: SCM
Reporter: Elek, Marton
Assignee: Elek, Marton
 Fix For: 0.2.1


The heart of the SCM is the lightweight EventQueue which is implemented in 
HDDS-25.

The main advantage to use a centralized EventQueue API is that all the thread 
handling could be implemented in one central place (with unified the 
monitoring, thread naming, lifecycle management).

In this jira I propose to create basic metrics for EventQueue. As (in the 
current implementation) each handler has an own executor which has already some 
metrics (for check when the unit tests could be stoped), it's quite easy to 
convert the atomic counters to real hadoop metrics.

For the sake of simplicity I also propose to remove the addHandlerGroup. The 
method supported the case when the Executor was shared between multiple 
handlers. It's a special case, it's more harder to monitor (we need tricky 
naming convention) and can't see real demand. We can restore it when we will 
see the requirements.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org



Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

2018-07-09 Thread Apache Jenkins Server
For more details, see 
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/832/

[Jul 8, 2018 6:11:21 PM] (aengineer) HDDS-217. Move all SCMEvents to a package. 
Contributed by Anu Engineer.
[Jul 8, 2018 6:27:54 PM] (aengineer) HDDS-235. Fix 
TestOzoneAuditLogger#verifyDefaultLogLevel. Contributed by
[Jul 9, 2018 6:27:34 AM] (yqlin) HDFS-13674. Improve documentation on Metrics. 
Contributed by Chao Sun.
[Jul 9, 2018 7:06:07 AM] (yqlin) HDFS-13710. RBF: setQuota and getQuotaUsage 
should check the


[Error replacing 'FILE' - Workspace is not accessible]

-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

2018-07-09 Thread Apache Jenkins Server
For more details, see 
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/831/

[Jul 6, 2018 6:03:48 PM] (sunilg) YARN-7556. Fair scheduler configuration 
should allow resource types in
[Jul 6, 2018 6:04:00 PM] (sunilg) YARN-7451. Add missing tests to verify the 
presence of custom resources
[Jul 6, 2018 6:56:09 PM] (xyao) HADOOP-15571. Multiple FileContexts created 
with the same configuration
[Jul 6, 2018 7:05:32 PM] (sunilg) YARN-8492. ATSv2 HBase tests are failing with 
ClassNotFoundException.
[Jul 6, 2018 7:09:05 PM] (arp) HDDS-167. Rename KeySpaceManager to 
OzoneManager. Contributed by Arpit
[Jul 6, 2018 9:59:49 PM] (weichiu) HDFS-13121. NPE when request file 
descriptors when SC read. Contributed
[Jul 6, 2018 10:19:01 PM] (rohithsharmaks) YARN-8302. ATS v2 should handle 
HBase connection issue properly.
[Jul 7, 2018 4:00:32 AM] (xiao) HDFS-13721. NPE in DataNode due to 
uninitialized DiskBalancer.


[Error replacing 'FILE' - Workspace is not accessible]

-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org