[jira] [Created] (HDFS-14162) Balancer should work with ObserverNode
Konstantin Shvachko created HDFS-14162:
--
Summary: Balancer should work with ObserverNode
Key: HDFS-14162
URL: https://issues.apache.org/jira/browse/HDFS-14162
Project: Hadoop HDFS
Issue Type: Sub-task
Reporter: Konstantin Shvachko
Balancer provides a substantial RPC load on NameNode. It would be good to
divert Balancer RPCs {{getBlocks()}}, etc. to ObserverNode. The main problem is
that Balancer uses {{NamenodeProtocol}}, while ORPP currently supports only
{{ClientProtocol}}.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDDS-946) AuditParser - insert audit to database in batches
Dinesh Chitlangia created HDDS-946: -- Summary: AuditParser - insert audit to database in batches Key: HDDS-946 URL: https://issues.apache.org/jira/browse/HDDS-946 Project: Hadoop Distributed Data Store Issue Type: Improvement Components: Tools Reporter: Dinesh Chitlangia Assignee: Dinesh Chitlangia Currently, the DatabaseHelper#insertAudit inserts one row at a time into to the database. This approach is inefficient and won't work at scale. This jira aims to optimize this process and perform batch inserts. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDDS-945) Fix generics warnings in delegation token
Ajay Kumar created HDDS-945:
---
Summary: Fix generics warnings in delegation token
Key: HDDS-945
URL: https://issues.apache.org/jira/browse/HDDS-945
Project: Hadoop Distributed Data Store
Issue Type: New Feature
Reporter: Ajay Kumar
Assignee: Ajay Kumar
There are warnings in genrics related code in
{{OzoneDelegationTokenSecretManager}} and {{OzoneSecretStore}}. Since we
already have base class which can be used for other kind of identifiers we can
remove this generics related code as fixing it will make it bit more
complicated (also looks unnecessary for current use cases)
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Resolved] (HDFS-14160) ObserverReadInvocationHandler should implement RpcInvocationHandler
[ https://issues.apache.org/jira/browse/HDFS-14160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko resolved HDFS-14160. Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-12943 I just committed this. Thanks for the review Chao. > ObserverReadInvocationHandler should implement RpcInvocationHandler > --- > > Key: HDFS-14160 > URL: https://issues.apache.org/jira/browse/HDFS-14160 > Project: Hadoop HDFS > Issue Type: Sub-task >Reporter: Konstantin Shvachko >Assignee: Konstantin Shvachko >Priority: Major > Fix For: HDFS-12943 > > Attachments: HDFS-14160-HDFS-12943.001.patch, > HDFS-14160-HDFS-12943.002.patch > > > Currently ObserverReadInvocationHandler implements InvocationHandler. > [As > mentioned|https://issues.apache.org/jira/browse/HDFS-14116?focusedCommentId=16710596=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-16710596] > in HDFS-14116 this is the cause of Fsck failing with Observer. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Resolved] (HDDS-928) Document ozone.max.key.len usage
[ https://issues.apache.org/jira/browse/HDDS-928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao resolved HDDS-928. - Resolution: Not A Problem Fix Version/s: 0.4.0 This will not be an issue after HDDS-929. > Document ozone.max.key.len usage > > > Key: HDDS-928 > URL: https://issues.apache.org/jira/browse/HDDS-928 > Project: Hadoop Distributed Data Store > Issue Type: Sub-task >Reporter: Xiaoyu Yao >Assignee: Ajay Kumar >Priority: Major > Fix For: 0.4.0 > > > This key was added to OzoneConfigKeys and SecurityConfig with HDDS-8, let's > add some document(comment) to it. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Resolved] (HDDS-944) [JDK11] Annotation javax.annotation.Generated has moved
[
https://issues.apache.org/jira/browse/HDDS-944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dinesh Chitlangia resolved HDDS-944.
Resolution: Invalid
> [JDK11] Annotation javax.annotation.Generated has moved
> ---
>
> Key: HDDS-944
> URL: https://issues.apache.org/jira/browse/HDDS-944
> Project: Hadoop Distributed Data Store
> Issue Type: Improvement
>Reporter: Dinesh Chitlangia
>Assignee: Dinesh Chitlangia
>Priority: Major
>
> With Java 11, the annotation {{javax.annotation.Generated}} has moved to
> {{javax.annotation.processing.Generated}}. A simple substitution will break
> compilation with older JDK, so it seems best to remove the annotations, which
> are only documentation not functional.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDDS-944) [JDK11] Annotation javax.annotation.Generated has moved
Dinesh Chitlangia created HDDS-944:
--
Summary: [JDK11] Annotation javax.annotation.Generated has moved
Key: HDDS-944
URL: https://issues.apache.org/jira/browse/HDDS-944
Project: Hadoop Distributed Data Store
Issue Type: Improvement
Reporter: Dinesh Chitlangia
Assignee: Dinesh Chitlangia
With Java 11, the annotation {{javax.annotation.Generated}} has moved to
{{javax.annotation.processing.Generated}}. A simple substitution will break
compilation with older JDK, so it seems best to remove the annotations, which
are only documentation not functional.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDDS-943) Changes in HddsDispatcher/XceiverServer to handle block token validation
Ajay Kumar created HDDS-943:
---
Summary: Changes in HddsDispatcher/XceiverServer to handle block
token validation
Key: HDDS-943
URL: https://issues.apache.org/jira/browse/HDDS-943
Project: Hadoop Distributed Data Store
Issue Type: New Feature
Reporter: Ajay Kumar
[HDDS-805] embeds an encoded token in {{ContainerCommandRequestProto}}. This
token should be validated at HddsDispatcher or XceiverServer.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDDS-942) Fix TestOzoneConfigrationFields
Anu Engineer created HDDS-942: - Summary: Fix TestOzoneConfigrationFields Key: HDDS-942 URL: https://issues.apache.org/jira/browse/HDDS-942 Project: Hadoop Distributed Data Store Issue Type: Sub-task Components: Ozone Manager Reporter: Anu Engineer Assignee: Anu Engineer A bunch of fields is missing in the ozone-default.xml in the HDDS-4 branch. We need to fix these before the merge. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/992/ [Dec 18, 2018 10:40:27 AM] (shashikant) HDDS-539. Ozone datanode command ignores the invalid options. [Dec 18, 2018 12:33:46 PM] (shashikant) HDDS-925. Rename ChunkGroupOutputStream to KeyOutputStream and [Dec 18, 2018 12:51:17 PM] (shashikant) HDDS-912. Update ozone to latest ratis snapshot build [Dec 18, 2018 5:59:13 PM] (bharat) HDDS-914. Add Grafana support to ozoneperf docker container. Contributed [Dec 18, 2018 6:06:33 PM] (billie) YARN-9072. Send exit command to terminate docker exec on connection [Dec 18, 2018 6:52:29 PM] (bharat) HDDS-911. Make TestOzoneManager unit tests independent. Contributed by [Dec 18, 2018 7:40:32 PM] (bharat) HDDS-933. Add documentation for genconf tool under Tools section. [Dec 18, 2018 8:49:10 PM] (billie) YARN-9117. Add a check for insecure setup for container terminal. [Dec 18, 2018 10:05:51 PM] (eyang) YARN-9075. Add ability to register/remove auxiliary service without [Dec 18, 2018 11:02:03 PM] (eyang) YARN-9084. Reset container state and defer readiness check for upgrade. -1 overall The following subsystems voted -1: asflicense findbugs hadolint pathlen unit The following subsystems voted -1 but were configured to be filtered/ignored: cc checkstyle javac javadoc pylint shellcheck shelldocs whitespace The following subsystems are considered long running: (runtime bigger than 1h 0m 0s) unit Specific tests: Failed junit tests : hadoop.registry.secure.TestSecureLogins hadoop.hdfs.TestReconstructStripedFile hadoop.hdfs.web.TestWebHdfsTimeouts hadoop.yarn.server.resourcemanager.recovery.TestFSRMStateStore cc: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/992/artifact/out/diff-compile-cc-root.txt [4.0K] javac: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/992/artifact/out/diff-compile-javac-root.txt [336K] checkstyle: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/992/artifact/out/diff-checkstyle-root.txt [17M] hadolint: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/992/artifact/out/diff-patch-hadolint.txt [4.0K] pathlen: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/992/artifact/out/pathlen.txt [12K] pylint: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/992/artifact/out/diff-patch-pylint.txt [60K] shellcheck: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/992/artifact/out/diff-patch-shellcheck.txt [20K] shelldocs: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/992/artifact/out/diff-patch-shelldocs.txt [12K] whitespace: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/992/artifact/out/whitespace-eol.txt [9.3M] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/992/artifact/out/whitespace-tabs.txt [1.1M] findbugs: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/992/artifact/out/branch-findbugs-hadoop-hdds_client.txt [8.0K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/992/artifact/out/branch-findbugs-hadoop-hdds_container-service.txt [4.0K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/992/artifact/out/branch-findbugs-hadoop-hdds_framework.txt [4.0K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/992/artifact/out/branch-findbugs-hadoop-hdds_server-scm.txt [8.0K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/992/artifact/out/branch-findbugs-hadoop-hdds_tools.txt [4.0K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/992/artifact/out/branch-findbugs-hadoop-ozone_client.txt [8.0K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/992/artifact/out/branch-findbugs-hadoop-ozone_common.txt [4.0K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/992/artifact/out/branch-findbugs-hadoop-ozone_objectstore-service.txt [8.0K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/992/artifact/out/branch-findbugs-hadoop-ozone_ozone-manager.txt [4.0K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/992/artifact/out/branch-findbugs-hadoop-ozone_ozonefs.txt [12K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/992/artifact/out/branch-findbugs-hadoop-ozone_s3gateway.txt [4.0K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/992/artifact/out/branch-findbugs-hadoop-ozone_tools.txt [8.0K] javadoc: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/992/artifact/out/diff-javadoc-javadoc-root.txt [752K] unit:
