[jira] [Work logged] (HDDS-1805) Implement S3 Initiate MPU request to use Cache and DoubleBuffer
[ https://issues.apache.org/jira/browse/HDDS-1805?focusedWorklogId=280097=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-280097 ] ASF GitHub Bot logged work on HDDS-1805: Author: ASF GitHub Bot Created on: 20/Jul/19 15:11 Start Date: 20/Jul/19 15:11 Worklog Time Spent: 10m Work Description: bharatviswa504 commented on pull request #1108: HDDS-1805. Implement S3 Initiate MPU request to use Cache and DoubleBuffer. URL: https://github.com/apache/hadoop/pull/1108 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 280097) Time Spent: 2.5h (was: 2h 20m) > Implement S3 Initiate MPU request to use Cache and DoubleBuffer > --- > > Key: HDDS-1805 > URL: https://issues.apache.org/jira/browse/HDDS-1805 > Project: Hadoop Distributed Data Store > Issue Type: Sub-task > Components: Ozone Manager >Reporter: Bharat Viswanadham >Assignee: Bharat Viswanadham >Priority: Major > Labels: pull-request-available > Time Spent: 2.5h > Remaining Estimate: 0h > > Implement S3 Initiate MPU request to use OM Cache, double buffer. > > In this Jira will add the changes to implement S3 bucket operations, and > HA/Non-HA will have a different code path, but once all requests are > implemented will have a single code path. -- This message was sent by Atlassian JIRA (v7.6.14#76016) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Work logged] (HDDS-1805) Implement S3 Initiate MPU request to use Cache and DoubleBuffer
[ https://issues.apache.org/jira/browse/HDDS-1805?focusedWorklogId=280096=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-280096 ] ASF GitHub Bot logged work on HDDS-1805: Author: ASF GitHub Bot Created on: 20/Jul/19 15:11 Start Date: 20/Jul/19 15:11 Worklog Time Spent: 10m Work Description: bharatviswa504 commented on issue #1108: HDDS-1805. Implement S3 Initiate MPU request to use Cache and DoubleBuffer. URL: https://github.com/apache/hadoop/pull/1108#issuecomment-513475425 Test failures are not related to this patch. Thank You @arp7 for the review. I will commit this to the trunk. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 280096) Time Spent: 2h 20m (was: 2h 10m) > Implement S3 Initiate MPU request to use Cache and DoubleBuffer > --- > > Key: HDDS-1805 > URL: https://issues.apache.org/jira/browse/HDDS-1805 > Project: Hadoop Distributed Data Store > Issue Type: Sub-task > Components: Ozone Manager >Reporter: Bharat Viswanadham >Assignee: Bharat Viswanadham >Priority: Major > Labels: pull-request-available > Time Spent: 2h 20m > Remaining Estimate: 0h > > Implement S3 Initiate MPU request to use OM Cache, double buffer. > > In this Jira will add the changes to implement S3 bucket operations, and > HA/Non-HA will have a different code path, but once all requests are > implemented will have a single code path. -- This message was sent by Atlassian JIRA (v7.6.14#76016) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Work logged] (HDDS-1805) Implement S3 Initiate MPU request to use Cache and DoubleBuffer
[ https://issues.apache.org/jira/browse/HDDS-1805?focusedWorklogId=280031=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-280031 ] ASF GitHub Bot logged work on HDDS-1805: Author: ASF GitHub Bot Created on: 20/Jul/19 04:22 Start Date: 20/Jul/19 04:22 Worklog Time Spent: 10m Work Description: hadoop-yetus commented on issue #1108: HDDS-1805. Implement S3 Initiate MPU request to use Cache and DoubleBuffer. URL: https://github.com/apache/hadoop/pull/1108#issuecomment-513434533 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | 0 | reexec | 36 | Docker mode activated. | ||| _ Prechecks _ | | +1 | dupname | 1 | No case conflicting files found. | | +1 | @author | 0 | The patch does not contain any @author tags. | | +1 | test4tests | 1 | The patch appears to include 7 new or modified test files. | ||| _ trunk Compile Tests _ | | 0 | mvndep | 26 | Maven dependency ordering for branch | | +1 | mvninstall | 466 | trunk passed | | +1 | compile | 250 | trunk passed | | +1 | checkstyle | 66 | trunk passed | | +1 | mvnsite | 0 | trunk passed | | +1 | shadedclient | 840 | branch has no errors when building and testing our client artifacts. | | +1 | javadoc | 157 | trunk passed | | 0 | spotbugs | 332 | Used deprecated FindBugs config; considering switching to SpotBugs. | | +1 | findbugs | 531 | trunk passed | ||| _ Patch Compile Tests _ | | 0 | mvndep | 22 | Maven dependency ordering for patch | | +1 | mvninstall | 459 | the patch passed | | +1 | compile | 268 | the patch passed | | +1 | cc | 268 | the patch passed | | +1 | javac | 268 | the patch passed | | +1 | checkstyle | 69 | the patch passed | | +1 | mvnsite | 0 | the patch passed | | +1 | whitespace | 0 | The patch has no whitespace issues. | | +1 | shadedclient | 633 | patch has no errors when building and testing our client artifacts. | | +1 | javadoc | 167 | the patch passed | | +1 | findbugs | 596 | the patch passed | ||| _ Other Tests _ | | +1 | unit | 315 | hadoop-hdds in the patch passed. | | -1 | unit | 2689 | hadoop-ozone in the patch failed. | | +1 | asflicense | 46 | The patch does not generate ASF License warnings. | | | | 7795 | | | Reason | Tests | |---:|:--| | Failed junit tests | hadoop.ozone.TestStorageContainerManager | | | hadoop.ozone.client.rpc.TestOzoneAtRestEncryption | | | hadoop.ozone.client.rpc.TestCommitWatcher | | | hadoop.ozone.client.rpc.TestOzoneRpcClientWithRatis | | | hadoop.ozone.client.rpc.TestOzoneRpcClient | | | hadoop.ozone.client.rpc.TestReadRetries | | | hadoop.ozone.container.ozoneimpl.TestSecureOzoneContainer | | | hadoop.ozone.client.rpc.TestMultiBlockWritesWithDnFailures | | | hadoop.ozone.client.rpc.TestSecureOzoneRpcClient | | | hadoop.ozone.container.server.TestSecureContainerServer | | Subsystem | Report/Notes | |--:|:-| | Docker | Client=18.09.8 Server=18.09.8 base: https://builds.apache.org/job/hadoop-multibranch/job/PR-1108/5/artifact/out/Dockerfile | | GITHUB PR | https://github.com/apache/hadoop/pull/1108 | | Optional Tests | dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient findbugs checkstyle cc | | uname | Linux 43eca5e4b0f8 4.4.0-138-generic #164-Ubuntu SMP Tue Oct 2 17:16:02 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | personality/hadoop.sh | | git revision | trunk / f5b2f75 | | Default Java | 1.8.0_212 | | unit | https://builds.apache.org/job/hadoop-multibranch/job/PR-1108/5/artifact/out/patch-unit-hadoop-ozone.txt | | Test Results | https://builds.apache.org/job/hadoop-multibranch/job/PR-1108/5/testReport/ | | Max. process+thread count | 4215 (vs. ulimit of 5500) | | modules | C: hadoop-ozone/common hadoop-ozone/ozone-manager U: hadoop-ozone | | Console output | https://builds.apache.org/job/hadoop-multibranch/job/PR-1108/5/console | | versions | git=2.7.4 maven=3.3.9 findbugs=3.1.0-RC1 | | Powered by | Apache Yetus 0.10.0 http://yetus.apache.org | This message was automatically generated. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 280031) Time Spent: 2h 10m (was: 2h) > Implement S3 Initiate MPU request to use Cache and DoubleBuffer > --- >
[jira] [Work logged] (HDDS-1805) Implement S3 Initiate MPU request to use Cache and DoubleBuffer
[ https://issues.apache.org/jira/browse/HDDS-1805?focusedWorklogId=280014=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-280014 ] ASF GitHub Bot logged work on HDDS-1805: Author: ASF GitHub Bot Created on: 20/Jul/19 00:49 Start Date: 20/Jul/19 00:49 Worklog Time Spent: 10m Work Description: bharatviswa504 commented on issue #1108: HDDS-1805. Implement S3 Initiate MPU request to use Cache and DoubleBuffer. URL: https://github.com/apache/hadoop/pull/1108#issuecomment-513420360 /retest This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 280014) Time Spent: 2h (was: 1h 50m) > Implement S3 Initiate MPU request to use Cache and DoubleBuffer > --- > > Key: HDDS-1805 > URL: https://issues.apache.org/jira/browse/HDDS-1805 > Project: Hadoop Distributed Data Store > Issue Type: Sub-task > Components: Ozone Manager >Reporter: Bharat Viswanadham >Assignee: Bharat Viswanadham >Priority: Major > Labels: pull-request-available > Time Spent: 2h > Remaining Estimate: 0h > > Implement S3 Initiate MPU request to use OM Cache, double buffer. > > In this Jira will add the changes to implement S3 bucket operations, and > HA/Non-HA will have a different code path, but once all requests are > implemented will have a single code path. -- This message was sent by Atlassian JIRA (v7.6.14#76016) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Work logged] (HDDS-1805) Implement S3 Initiate MPU request to use Cache and DoubleBuffer
[ https://issues.apache.org/jira/browse/HDDS-1805?focusedWorklogId=280012=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-280012 ] ASF GitHub Bot logged work on HDDS-1805: Author: ASF GitHub Bot Created on: 20/Jul/19 00:49 Start Date: 20/Jul/19 00:49 Worklog Time Spent: 10m Work Description: bharatviswa504 commented on issue #1108: HDDS-1805. Implement S3 Initiate MPU request to use Cache and DoubleBuffer. URL: https://github.com/apache/hadoop/pull/1108#issuecomment-513420293 Rebased it with the latest trunk. Will commit this after CI. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 280012) Time Spent: 1h 50m (was: 1h 40m) > Implement S3 Initiate MPU request to use Cache and DoubleBuffer > --- > > Key: HDDS-1805 > URL: https://issues.apache.org/jira/browse/HDDS-1805 > Project: Hadoop Distributed Data Store > Issue Type: Sub-task > Components: Ozone Manager >Reporter: Bharat Viswanadham >Assignee: Bharat Viswanadham >Priority: Major > Labels: pull-request-available > Time Spent: 1h 50m > Remaining Estimate: 0h > > Implement S3 Initiate MPU request to use OM Cache, double buffer. > > In this Jira will add the changes to implement S3 bucket operations, and > HA/Non-HA will have a different code path, but once all requests are > implemented will have a single code path. -- This message was sent by Atlassian JIRA (v7.6.14#76016) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Work logged] (HDDS-1805) Implement S3 Initiate MPU request to use Cache and DoubleBuffer
[ https://issues.apache.org/jira/browse/HDDS-1805?focusedWorklogId=279953=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-279953 ] ASF GitHub Bot logged work on HDDS-1805: Author: ASF GitHub Bot Created on: 19/Jul/19 21:06 Start Date: 19/Jul/19 21:06 Worklog Time Spent: 10m Work Description: bharatviswa504 commented on issue #1108: HDDS-1805. Implement S3 Initiate MPU request to use Cache and DoubleBuffer. URL: https://github.com/apache/hadoop/pull/1108#issuecomment-513378046 Thank You @arp7 for the review. Test failures are not related to this patch. I will commit this shortly. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 279953) Time Spent: 1h 40m (was: 1.5h) > Implement S3 Initiate MPU request to use Cache and DoubleBuffer > --- > > Key: HDDS-1805 > URL: https://issues.apache.org/jira/browse/HDDS-1805 > Project: Hadoop Distributed Data Store > Issue Type: Sub-task > Components: Ozone Manager >Reporter: Bharat Viswanadham >Assignee: Bharat Viswanadham >Priority: Major > Labels: pull-request-available > Time Spent: 1h 40m > Remaining Estimate: 0h > > Implement S3 Initiate MPU request to use OM Cache, double buffer. > > In this Jira will add the changes to implement S3 bucket operations, and > HA/Non-HA will have a different code path, but once all requests are > implemented will have a single code path. -- This message was sent by Atlassian JIRA (v7.6.14#76016) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Work logged] (HDDS-1805) Implement S3 Initiate MPU request to use Cache and DoubleBuffer
[ https://issues.apache.org/jira/browse/HDDS-1805?focusedWorklogId=279952=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-279952 ] ASF GitHub Bot logged work on HDDS-1805: Author: ASF GitHub Bot Created on: 19/Jul/19 21:05 Start Date: 19/Jul/19 21:05 Worklog Time Spent: 10m Work Description: bharatviswa504 commented on issue #1108: HDDS-1805. Implement S3 Initiate MPU request to use Cache and DoubleBuffer. URL: https://github.com/apache/hadoop/pull/1108#issuecomment-513378046 Test failures are not related to this patch. I will commit this shortly. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 279952) Time Spent: 1.5h (was: 1h 20m) > Implement S3 Initiate MPU request to use Cache and DoubleBuffer > --- > > Key: HDDS-1805 > URL: https://issues.apache.org/jira/browse/HDDS-1805 > Project: Hadoop Distributed Data Store > Issue Type: Sub-task > Components: Ozone Manager >Reporter: Bharat Viswanadham >Assignee: Bharat Viswanadham >Priority: Major > Labels: pull-request-available > Time Spent: 1.5h > Remaining Estimate: 0h > > Implement S3 Initiate MPU request to use OM Cache, double buffer. > > In this Jira will add the changes to implement S3 bucket operations, and > HA/Non-HA will have a different code path, but once all requests are > implemented will have a single code path. -- This message was sent by Atlassian JIRA (v7.6.14#76016) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Work logged] (HDDS-1805) Implement S3 Initiate MPU request to use Cache and DoubleBuffer
[
https://issues.apache.org/jira/browse/HDDS-1805?focusedWorklogId=279948=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-279948
]
ASF GitHub Bot logged work on HDDS-1805:
Author: ASF GitHub Bot
Created on: 19/Jul/19 20:41
Start Date: 19/Jul/19 20:41
Worklog Time Spent: 10m
Work Description: bharatviswa504 commented on pull request #1108:
HDDS-1805. Implement S3 Initiate MPU request to use Cache and DoubleBuffer.
URL: https://github.com/apache/hadoop/pull/1108#discussion_r305517722
##
File path:
hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/request/s3/multipart/S3InitiateMultipartUploadRequest.java
##
@@ -0,0 +1,214 @@
+/**
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hadoop.ozone.om.request.s3.multipart;
+
+import com.google.common.base.Optional;
+import com.google.common.base.Preconditions;
+import org.apache.hadoop.ozone.audit.OMAction;
+import org.apache.hadoop.ozone.om.OMMetadataManager;
+import org.apache.hadoop.ozone.om.OzoneManager;
+import org.apache.hadoop.ozone.om.helpers.OmKeyInfo;
+import org.apache.hadoop.ozone.om.helpers.OmKeyLocationInfoGroup;
+import org.apache.hadoop.ozone.om.helpers.OmMultipartKeyInfo;
+import org.apache.hadoop.ozone.om.request.key.OMKeyRequest;
+import org.apache.hadoop.ozone.om.response.OMClientResponse;
+import
org.apache.hadoop.ozone.om.response.s3.multipart.S3InitiateMultipartUploadResponse;
+import org.apache.hadoop.ozone.protocol.proto.OzoneManagerProtocolProtos;
+import
org.apache.hadoop.ozone.protocol.proto.OzoneManagerProtocolProtos.MultipartInfoInitiateRequest;
+import
org.apache.hadoop.ozone.protocol.proto.OzoneManagerProtocolProtos.MultipartInfoInitiateResponse;
+import
org.apache.hadoop.ozone.protocol.proto.OzoneManagerProtocolProtos.OMRequest;
+import
org.apache.hadoop.ozone.protocol.proto.OzoneManagerProtocolProtos.OMResponse;
+import org.apache.hadoop.ozone.security.acl.IAccessAuthorizer;
+import org.apache.hadoop.ozone.security.acl.OzoneObj;
+import org.apache.hadoop.util.Time;
+import org.apache.hadoop.utils.UniqueId;
+import org.apache.hadoop.utils.db.cache.CacheKey;
+import org.apache.hadoop.utils.db.cache.CacheValue;
+import org.slf4j.Logger;
+import org.slf4j.LoggerFactory;
+
+import java.io.IOException;
+import java.util.ArrayList;
+import java.util.Collections;
+import java.util.HashMap;
+import java.util.UUID;
+
+import static
org.apache.hadoop.ozone.om.lock.OzoneManagerLock.Resource.BUCKET_LOCK;
+
+/**
+ * Handles initiate multipart upload request.
+ */
+public class S3InitiateMultipartUploadRequest extends OMKeyRequest {
+
+
+ private static final Logger LOG =
+ LoggerFactory.getLogger(S3InitiateMultipartUploadRequest.class);
+
+ public S3InitiateMultipartUploadRequest(OMRequest omRequest) {
+super(omRequest);
+ }
+
+ @Override
+ public OMRequest preExecute(OzoneManager ozoneManager) {
+MultipartInfoInitiateRequest multipartInfoInitiateRequest =
+getOmRequest().getInitiateMultiPartUploadRequest();
+Preconditions.checkNotNull(multipartInfoInitiateRequest);
+
+OzoneManagerProtocolProtos.KeyArgs.Builder newKeyArgs =
+multipartInfoInitiateRequest.getKeyArgs().toBuilder()
+.setMultipartUploadID(UUID.randomUUID().toString() + "-" +
+UniqueId.next()).setModificationTime(Time.now());
+
+return getOmRequest().toBuilder()
+.setUserInfo(getUserInfo())
+.setInitiateMultiPartUploadRequest(
+multipartInfoInitiateRequest.toBuilder().setKeyArgs(newKeyArgs))
+.build();
+ }
+
+ @Override
+ public OMClientResponse validateAndUpdateCache(OzoneManager ozoneManager,
+ long transactionLogIndex) {
+MultipartInfoInitiateRequest multipartInfoInitiateRequest =
+getOmRequest().getInitiateMultiPartUploadRequest();
+
+OzoneManagerProtocolProtos.KeyArgs keyArgs =
+multipartInfoInitiateRequest.getKeyArgs();
+
+Preconditions.checkNotNull(keyArgs.getMultipartUploadID());
+
+String volumeName = keyArgs.getVolumeName();
+String bucketName = keyArgs.getBucketName();
+
[jira] [Work logged] (HDDS-1805) Implement S3 Initiate MPU request to use Cache and DoubleBuffer
[
https://issues.apache.org/jira/browse/HDDS-1805?focusedWorklogId=279947=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-279947
]
ASF GitHub Bot logged work on HDDS-1805:
Author: ASF GitHub Bot
Created on: 19/Jul/19 20:37
Start Date: 19/Jul/19 20:37
Worklog Time Spent: 10m
Work Description: arp7 commented on pull request #1108: HDDS-1805.
Implement S3 Initiate MPU request to use Cache and DoubleBuffer.
URL: https://github.com/apache/hadoop/pull/1108#discussion_r305516630
##
File path:
hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/request/s3/multipart/S3InitiateMultipartUploadRequest.java
##
@@ -0,0 +1,214 @@
+/**
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hadoop.ozone.om.request.s3.multipart;
+
+import com.google.common.base.Optional;
+import com.google.common.base.Preconditions;
+import org.apache.hadoop.ozone.audit.OMAction;
+import org.apache.hadoop.ozone.om.OMMetadataManager;
+import org.apache.hadoop.ozone.om.OzoneManager;
+import org.apache.hadoop.ozone.om.helpers.OmKeyInfo;
+import org.apache.hadoop.ozone.om.helpers.OmKeyLocationInfoGroup;
+import org.apache.hadoop.ozone.om.helpers.OmMultipartKeyInfo;
+import org.apache.hadoop.ozone.om.request.key.OMKeyRequest;
+import org.apache.hadoop.ozone.om.response.OMClientResponse;
+import
org.apache.hadoop.ozone.om.response.s3.multipart.S3InitiateMultipartUploadResponse;
+import org.apache.hadoop.ozone.protocol.proto.OzoneManagerProtocolProtos;
+import
org.apache.hadoop.ozone.protocol.proto.OzoneManagerProtocolProtos.MultipartInfoInitiateRequest;
+import
org.apache.hadoop.ozone.protocol.proto.OzoneManagerProtocolProtos.MultipartInfoInitiateResponse;
+import
org.apache.hadoop.ozone.protocol.proto.OzoneManagerProtocolProtos.OMRequest;
+import
org.apache.hadoop.ozone.protocol.proto.OzoneManagerProtocolProtos.OMResponse;
+import org.apache.hadoop.ozone.security.acl.IAccessAuthorizer;
+import org.apache.hadoop.ozone.security.acl.OzoneObj;
+import org.apache.hadoop.util.Time;
+import org.apache.hadoop.utils.UniqueId;
+import org.apache.hadoop.utils.db.cache.CacheKey;
+import org.apache.hadoop.utils.db.cache.CacheValue;
+import org.slf4j.Logger;
+import org.slf4j.LoggerFactory;
+
+import java.io.IOException;
+import java.util.ArrayList;
+import java.util.Collections;
+import java.util.HashMap;
+import java.util.UUID;
+
+import static
org.apache.hadoop.ozone.om.lock.OzoneManagerLock.Resource.BUCKET_LOCK;
+
+/**
+ * Handles initiate multipart upload request.
+ */
+public class S3InitiateMultipartUploadRequest extends OMKeyRequest {
+
+
+ private static final Logger LOG =
+ LoggerFactory.getLogger(S3InitiateMultipartUploadRequest.class);
+
+ public S3InitiateMultipartUploadRequest(OMRequest omRequest) {
+super(omRequest);
+ }
+
+ @Override
+ public OMRequest preExecute(OzoneManager ozoneManager) {
+MultipartInfoInitiateRequest multipartInfoInitiateRequest =
+getOmRequest().getInitiateMultiPartUploadRequest();
+Preconditions.checkNotNull(multipartInfoInitiateRequest);
+
+OzoneManagerProtocolProtos.KeyArgs.Builder newKeyArgs =
+multipartInfoInitiateRequest.getKeyArgs().toBuilder()
+.setMultipartUploadID(UUID.randomUUID().toString() + "-" +
+UniqueId.next()).setModificationTime(Time.now());
+
+return getOmRequest().toBuilder()
+.setUserInfo(getUserInfo())
+.setInitiateMultiPartUploadRequest(
+multipartInfoInitiateRequest.toBuilder().setKeyArgs(newKeyArgs))
+.build();
+ }
+
+ @Override
+ public OMClientResponse validateAndUpdateCache(OzoneManager ozoneManager,
+ long transactionLogIndex) {
+MultipartInfoInitiateRequest multipartInfoInitiateRequest =
+getOmRequest().getInitiateMultiPartUploadRequest();
+
+OzoneManagerProtocolProtos.KeyArgs keyArgs =
+multipartInfoInitiateRequest.getKeyArgs();
+
+Preconditions.checkNotNull(keyArgs.getMultipartUploadID());
+
+String volumeName = keyArgs.getVolumeName();
+String bucketName = keyArgs.getBucketName();
+String
[jira] [Work logged] (HDDS-1805) Implement S3 Initiate MPU request to use Cache and DoubleBuffer
[ https://issues.apache.org/jira/browse/HDDS-1805?focusedWorklogId=279940=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-279940 ] ASF GitHub Bot logged work on HDDS-1805: Author: ASF GitHub Bot Created on: 19/Jul/19 20:05 Start Date: 19/Jul/19 20:05 Worklog Time Spent: 10m Work Description: arp7 commented on pull request #1108: HDDS-1805. Implement S3 Initiate MPU request to use Cache and DoubleBuffer. URL: https://github.com/apache/hadoop/pull/1108#discussion_r305506924 ## File path: hadoop-ozone/common/src/main/java/org/apache/hadoop/ozone/OmUtils.java ## @@ -221,7 +221,6 @@ public static boolean isReadOnly( case GetDelegationToken: case RenewDelegationToken: case CancelDelegationToken: -case ApplyInitiateMultiPartUpload: Review comment: Why are we removing it from here? Is this intentional? This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 279940) Time Spent: 1h (was: 50m) > Implement S3 Initiate MPU request to use Cache and DoubleBuffer > --- > > Key: HDDS-1805 > URL: https://issues.apache.org/jira/browse/HDDS-1805 > Project: Hadoop Distributed Data Store > Issue Type: Sub-task > Components: Ozone Manager >Reporter: Bharat Viswanadham >Assignee: Bharat Viswanadham >Priority: Major > Labels: pull-request-available > Time Spent: 1h > Remaining Estimate: 0h > > Implement S3 Initiate MPU request to use OM Cache, double buffer. > > In this Jira will add the changes to implement S3 bucket operations, and > HA/Non-HA will have a different code path, but once all requests are > implemented will have a single code path. -- This message was sent by Atlassian JIRA (v7.6.14#76016) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Work logged] (HDDS-1805) Implement S3 Initiate MPU request to use Cache and DoubleBuffer
[ https://issues.apache.org/jira/browse/HDDS-1805?focusedWorklogId=279688=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-279688 ] ASF GitHub Bot logged work on HDDS-1805: Author: ASF GitHub Bot Created on: 19/Jul/19 11:48 Start Date: 19/Jul/19 11:48 Worklog Time Spent: 10m Work Description: hadoop-yetus commented on issue #1108: HDDS-1805. Implement S3 Initiate MPU request to use Cache and DoubleBuffer. URL: https://github.com/apache/hadoop/pull/1108#issuecomment-513199934 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | 0 | reexec | 36 | Docker mode activated. | ||| _ Prechecks _ | | +1 | dupname | 1 | No case conflicting files found. | | +1 | @author | 0 | The patch does not contain any @author tags. | | +1 | test4tests | 0 | The patch appears to include 11 new or modified test files. | ||| _ trunk Compile Tests _ | | 0 | mvndep | 27 | Maven dependency ordering for branch | | +1 | mvninstall | 462 | trunk passed | | +1 | compile | 254 | trunk passed | | +1 | checkstyle | 69 | trunk passed | | +1 | mvnsite | 0 | trunk passed | | +1 | shadedclient | 785 | branch has no errors when building and testing our client artifacts. | | +1 | javadoc | 160 | trunk passed | | 0 | spotbugs | 312 | Used deprecated FindBugs config; considering switching to SpotBugs. | | +1 | findbugs | 500 | trunk passed | ||| _ Patch Compile Tests _ | | 0 | mvndep | 26 | Maven dependency ordering for patch | | +1 | mvninstall | 434 | the patch passed | | +1 | compile | 268 | the patch passed | | +1 | cc | 268 | the patch passed | | +1 | javac | 268 | the patch passed | | +1 | checkstyle | 66 | the patch passed | | +1 | mvnsite | 0 | the patch passed | | +1 | whitespace | 0 | The patch has no whitespace issues. | | +1 | shadedclient | 614 | patch has no errors when building and testing our client artifacts. | | +1 | javadoc | 146 | the patch passed | | +1 | findbugs | 521 | the patch passed | ||| _ Other Tests _ | | -1 | unit | 276 | hadoop-hdds in the patch failed. | | -1 | unit | 1459 | hadoop-ozone in the patch failed. | | +1 | asflicense | 38 | The patch does not generate ASF License warnings. | | | | 6294 | | | Reason | Tests | |---:|:--| | Failed junit tests | hadoop.hdds.scm.container.placement.algorithms.TestSCMContainerPlacementRackAware | | | hadoop.ozone.container.ozoneimpl.TestSecureOzoneContainer | | | hadoop.ozone.client.rpc.TestOzoneRpcClient | | | hadoop.ozone.client.rpc.TestOzoneClientRetriesOnException | | | hadoop.ozone.client.rpc.TestOzoneAtRestEncryption | | | hadoop.ozone.client.rpc.TestFailureHandlingByClient | | | hadoop.ozone.client.rpc.TestSecureOzoneRpcClient | | | hadoop.ozone.client.rpc.TestBlockOutputStreamWithFailures | | | hadoop.ozone.client.rpc.TestMultiBlockWritesWithDnFailures | | | hadoop.ozone.client.rpc.TestOzoneRpcClientWithRatis | | | hadoop.hdds.scm.pipeline.TestRatisPipelineCreateAndDestory | | | hadoop.ozone.client.rpc.TestCloseContainerHandlingByClient | | | hadoop.ozone.container.server.TestSecureContainerServer | | Subsystem | Report/Notes | |--:|:-| | Docker | Client=18.09.8 Server=18.09.8 base: https://builds.apache.org/job/hadoop-multibranch/job/PR-1108/4/artifact/out/Dockerfile | | GITHUB PR | https://github.com/apache/hadoop/pull/1108 | | Optional Tests | dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient findbugs checkstyle cc | | uname | Linux 60075cfa943e 4.4.0-139-generic #165-Ubuntu SMP Wed Oct 24 10:58:50 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | personality/hadoop.sh | | git revision | trunk / 4e66cb9 | | Default Java | 1.8.0_212 | | unit | https://builds.apache.org/job/hadoop-multibranch/job/PR-1108/4/artifact/out/patch-unit-hadoop-hdds.txt | | unit | https://builds.apache.org/job/hadoop-multibranch/job/PR-1108/4/artifact/out/patch-unit-hadoop-ozone.txt | | Test Results | https://builds.apache.org/job/hadoop-multibranch/job/PR-1108/4/testReport/ | | Max. process+thread count | 5283 (vs. ulimit of 5500) | | modules | C: hadoop-ozone/common hadoop-ozone/ozone-manager U: hadoop-ozone | | Console output | https://builds.apache.org/job/hadoop-multibranch/job/PR-1108/4/console | | versions | git=2.7.4 maven=3.3.9 findbugs=3.1.0-RC1 | | Powered by | Apache Yetus 0.10.0 http://yetus.apache.org | This message was automatically generated. This is an automated message from the Apache Git Service. To respond to the message, please log on
[jira] [Work logged] (HDDS-1805) Implement S3 Initiate MPU request to use Cache and DoubleBuffer
[ https://issues.apache.org/jira/browse/HDDS-1805?focusedWorklogId=279382=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-279382 ] ASF GitHub Bot logged work on HDDS-1805: Author: ASF GitHub Bot Created on: 18/Jul/19 22:46 Start Date: 18/Jul/19 22:46 Worklog Time Spent: 10m Work Description: hadoop-yetus commented on issue #1108: HDDS-1805. Implement S3 Initiate MPU request to use Cache and DoubleBuffer. URL: https://github.com/apache/hadoop/pull/1108#issuecomment-513019346 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | 0 | reexec | 39 | Docker mode activated. | ||| _ Prechecks _ | | +1 | dupname | 1 | No case conflicting files found. | | +1 | @author | 0 | The patch does not contain any @author tags. | | +1 | test4tests | 0 | The patch appears to include 11 new or modified test files. | ||| _ trunk Compile Tests _ | | 0 | mvndep | 16 | Maven dependency ordering for branch | | +1 | mvninstall | 483 | trunk passed | | +1 | compile | 269 | trunk passed | | +1 | checkstyle | 79 | trunk passed | | +1 | mvnsite | 0 | trunk passed | | +1 | shadedclient | 863 | branch has no errors when building and testing our client artifacts. | | +1 | javadoc | 166 | trunk passed | | 0 | spotbugs | 321 | Used deprecated FindBugs config; considering switching to SpotBugs. | | +1 | findbugs | 503 | trunk passed | ||| _ Patch Compile Tests _ | | 0 | mvndep | 26 | Maven dependency ordering for patch | | +1 | mvninstall | 451 | the patch passed | | +1 | compile | 269 | the patch passed | | +1 | cc | 269 | the patch passed | | +1 | javac | 269 | the patch passed | | +1 | checkstyle | 87 | the patch passed | | +1 | mvnsite | 0 | the patch passed | | +1 | whitespace | 0 | The patch has no whitespace issues. | | +1 | shadedclient | 692 | patch has no errors when building and testing our client artifacts. | | +1 | javadoc | 166 | the patch passed | | +1 | findbugs | 527 | the patch passed | ||| _ Other Tests _ | | +1 | unit | 294 | hadoop-hdds in the patch passed. | | -1 | unit | 1616 | hadoop-ozone in the patch failed. | | +1 | asflicense | 56 | The patch does not generate ASF License warnings. | | | | 6791 | | | Reason | Tests | |---:|:--| | Failed junit tests | hadoop.ozone.container.server.TestSecureContainerServer | | | hadoop.ozone.client.rpc.TestOzoneClientRetriesOnException | | | hadoop.ozone.client.rpc.TestFailureHandlingByClient | | | hadoop.ozone.client.rpc.TestOzoneRpcClient | | | hadoop.ozone.client.rpc.TestSecureOzoneRpcClient | | | hadoop.ozone.client.rpc.TestCloseContainerHandlingByClient | | | hadoop.ozone.client.rpc.TestOzoneAtRestEncryption | | | hadoop.hdds.scm.pipeline.TestRatisPipelineProvider | | | hadoop.ozone.client.rpc.TestBlockOutputStreamWithFailures | | | hadoop.ozone.container.ozoneimpl.TestSecureOzoneContainer | | | hadoop.ozone.client.rpc.TestOzoneRpcClientWithRatis | | Subsystem | Report/Notes | |--:|:-| | Docker | Client=18.09.8 Server=18.09.8 base: https://builds.apache.org/job/hadoop-multibranch/job/PR-1108/3/artifact/out/Dockerfile | | GITHUB PR | https://github.com/apache/hadoop/pull/1108 | | Optional Tests | dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient findbugs checkstyle cc | | uname | Linux cb07dd5ad9f5 4.4.0-138-generic #164-Ubuntu SMP Tue Oct 2 17:16:02 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | personality/hadoop.sh | | git revision | trunk / d5ef38b | | Default Java | 1.8.0_212 | | unit | https://builds.apache.org/job/hadoop-multibranch/job/PR-1108/3/artifact/out/patch-unit-hadoop-ozone.txt | | Test Results | https://builds.apache.org/job/hadoop-multibranch/job/PR-1108/3/testReport/ | | Max. process+thread count | 5157 (vs. ulimit of 5500) | | modules | C: hadoop-ozone/common hadoop-ozone/ozone-manager U: hadoop-ozone | | Console output | https://builds.apache.org/job/hadoop-multibranch/job/PR-1108/3/console | | versions | git=2.7.4 maven=3.3.9 findbugs=3.1.0-RC1 | | Powered by | Apache Yetus 0.10.0 http://yetus.apache.org | This message was automatically generated. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 279382) Time Spent: 40m (was: 0.5h) > Implement S3 Initiate
[jira] [Work logged] (HDDS-1805) Implement S3 Initiate MPU request to use Cache and DoubleBuffer
[ https://issues.apache.org/jira/browse/HDDS-1805?focusedWorklogId=277850=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-277850 ] ASF GitHub Bot logged work on HDDS-1805: Author: ASF GitHub Bot Created on: 16/Jul/19 23:45 Start Date: 16/Jul/19 23:45 Worklog Time Spent: 10m Work Description: hadoop-yetus commented on issue #1108: HDDS-1805. Implement S3 Initiate MPU request to use Cache and DoubleBuffer. URL: https://github.com/apache/hadoop/pull/1108#issuecomment-512043093 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | 0 | reexec | 37 | Docker mode activated. | ||| _ Prechecks _ | | +1 | dupname | 1 | No case conflicting files found. | | +1 | @author | 0 | The patch does not contain any @author tags. | | +1 | test4tests | 0 | The patch appears to include 7 new or modified test files. | ||| _ trunk Compile Tests _ | | 0 | mvndep | 10 | Maven dependency ordering for branch | | +1 | mvninstall | 466 | trunk passed | | +1 | compile | 247 | trunk passed | | +1 | checkstyle | 59 | trunk passed | | +1 | mvnsite | 0 | trunk passed | | +1 | shadedclient | 784 | branch has no errors when building and testing our client artifacts. | | +1 | javadoc | 164 | trunk passed | | 0 | spotbugs | 314 | Used deprecated FindBugs config; considering switching to SpotBugs. | | +1 | findbugs | 508 | trunk passed | ||| _ Patch Compile Tests _ | | 0 | mvndep | 28 | Maven dependency ordering for patch | | +1 | mvninstall | 450 | the patch passed | | +1 | compile | 278 | the patch passed | | +1 | cc | 278 | the patch passed | | +1 | javac | 278 | the patch passed | | +1 | checkstyle | 85 | the patch passed | | +1 | mvnsite | 0 | the patch passed | | +1 | whitespace | 0 | The patch has no whitespace issues. | | +1 | shadedclient | 683 | patch has no errors when building and testing our client artifacts. | | +1 | javadoc | 164 | the patch passed | | +1 | findbugs | 525 | the patch passed | ||| _ Other Tests _ | | -1 | unit | 194 | hadoop-hdds in the patch failed. | | -1 | unit | 1777 | hadoop-ozone in the patch failed. | | +1 | asflicense | 53 | The patch does not generate ASF License warnings. | | | | 6713 | | | Reason | Tests | |---:|:--| | Failed junit tests | hadoop.ozone.container.ozoneimpl.TestOzoneContainer | | | hadoop.ozone.client.rpc.TestBlockOutputStreamWithFailures | | | hadoop.ozone.client.rpc.TestCommitWatcher | | | hadoop.ozone.client.rpc.TestOzoneRpcClientWithRatis | | | hadoop.ozone.client.rpc.TestOzoneRpcClient | | | hadoop.ozone.client.rpc.TestOzoneClientRetriesOnException | | | hadoop.ozone.client.rpc.TestCloseContainerHandlingByClient | | | hadoop.ozone.client.rpc.TestSecureOzoneRpcClient | | | hadoop.ozone.client.rpc.TestWatchForCommit | | Subsystem | Report/Notes | |--:|:-| | Docker | Client=18.09.7 Server=18.09.7 base: https://builds.apache.org/job/hadoop-multibranch/job/PR-1108/2/artifact/out/Dockerfile | | GITHUB PR | https://github.com/apache/hadoop/pull/1108 | | Optional Tests | dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient findbugs checkstyle cc | | uname | Linux 20a26e73c615 4.4.0-138-generic #164-Ubuntu SMP Tue Oct 2 17:16:02 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | personality/hadoop.sh | | git revision | trunk / 71c21f0 | | Default Java | 1.8.0_212 | | unit | https://builds.apache.org/job/hadoop-multibranch/job/PR-1108/2/artifact/out/patch-unit-hadoop-hdds.txt | | unit | https://builds.apache.org/job/hadoop-multibranch/job/PR-1108/2/artifact/out/patch-unit-hadoop-ozone.txt | | Test Results | https://builds.apache.org/job/hadoop-multibranch/job/PR-1108/2/testReport/ | | Max. process+thread count | 5386 (vs. ulimit of 5500) | | modules | C: hadoop-ozone/common hadoop-ozone/ozone-manager U: hadoop-ozone | | Console output | https://builds.apache.org/job/hadoop-multibranch/job/PR-1108/2/console | | versions | git=2.7.4 maven=3.3.9 findbugs=3.1.0-RC1 | | Powered by | Apache Yetus 0.10.0 http://yetus.apache.org | This message was automatically generated. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 277850) Time Spent: 0.5h (was: 20m) > Implement S3 Initiate MPU request to use Cache and
[jira] [Work logged] (HDDS-1805) Implement S3 Initiate MPU request to use Cache and DoubleBuffer
[ https://issues.apache.org/jira/browse/HDDS-1805?focusedWorklogId=277842=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-277842 ] ASF GitHub Bot logged work on HDDS-1805: Author: ASF GitHub Bot Created on: 16/Jul/19 23:31 Start Date: 16/Jul/19 23:31 Worklog Time Spent: 10m Work Description: hadoop-yetus commented on issue #1108: HDDS-1805. Implement S3 Initiate MPU request to use Cache and DoubleBuffer. URL: https://github.com/apache/hadoop/pull/1108#issuecomment-512040420 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | 0 | reexec | 35 | Docker mode activated. | ||| _ Prechecks _ | | +1 | dupname | 0 | No case conflicting files found. | | +1 | @author | 0 | The patch does not contain any @author tags. | | +1 | test4tests | 0 | The patch appears to include 7 new or modified test files. | ||| _ trunk Compile Tests _ | | 0 | mvndep | 11 | Maven dependency ordering for branch | | +1 | mvninstall | 454 | trunk passed | | +1 | compile | 255 | trunk passed | | +1 | checkstyle | 65 | trunk passed | | +1 | mvnsite | 0 | trunk passed | | +1 | shadedclient | 797 | branch has no errors when building and testing our client artifacts. | | +1 | javadoc | 151 | trunk passed | | 0 | spotbugs | 319 | Used deprecated FindBugs config; considering switching to SpotBugs. | | +1 | findbugs | 507 | trunk passed | ||| _ Patch Compile Tests _ | | 0 | mvndep | 25 | Maven dependency ordering for patch | | -1 | mvninstall | 42 | hadoop-hdds in the patch failed. | | +1 | compile | 253 | the patch passed | | +1 | cc | 253 | the patch passed | | +1 | javac | 253 | the patch passed | | +1 | checkstyle | 73 | the patch passed | | +1 | mvnsite | 0 | the patch passed | | +1 | whitespace | 0 | The patch has no whitespace issues. | | +1 | shadedclient | 675 | patch has no errors when building and testing our client artifacts. | | +1 | javadoc | 162 | the patch passed | | +1 | findbugs | 523 | the patch passed | ||| _ Other Tests _ | | +1 | unit | 284 | hadoop-hdds in the patch passed. | | -1 | unit | 1771 | hadoop-ozone in the patch failed. | | +1 | asflicense | 50 | The patch does not generate ASF License warnings. | | | | 6636 | | | Reason | Tests | |---:|:--| | Failed junit tests | hadoop.ozone.client.rpc.TestOzoneRpcClientWithRatis | | | hadoop.ozone.client.rpc.TestOzoneAtRestEncryption | | | hadoop.ozone.client.rpc.TestCloseContainerHandlingByClient | | | hadoop.ozone.client.rpc.TestOzoneRpcClient | | | hadoop.ozone.client.rpc.TestWatchForCommit | | | hadoop.ozone.client.rpc.TestSecureOzoneRpcClient | | Subsystem | Report/Notes | |--:|:-| | Docker | Client=18.09.7 Server=18.09.7 base: https://builds.apache.org/job/hadoop-multibranch/job/PR-1108/1/artifact/out/Dockerfile | | GITHUB PR | https://github.com/apache/hadoop/pull/1108 | | Optional Tests | dupname asflicense compile cc mvnsite javac unit javadoc mvninstall shadedclient findbugs checkstyle | | uname | Linux 7c942938bb42 4.4.0-138-generic #164-Ubuntu SMP Tue Oct 2 17:16:02 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | personality/hadoop.sh | | git revision | trunk / 71c21f0 | | Default Java | 1.8.0_212 | | mvninstall | https://builds.apache.org/job/hadoop-multibranch/job/PR-1108/1/artifact/out/patch-mvninstall-hadoop-hdds.txt | | unit | https://builds.apache.org/job/hadoop-multibranch/job/PR-1108/1/artifact/out/patch-unit-hadoop-ozone.txt | | Test Results | https://builds.apache.org/job/hadoop-multibranch/job/PR-1108/1/testReport/ | | Max. process+thread count | 5386 (vs. ulimit of 5500) | | modules | C: hadoop-ozone/common hadoop-ozone/ozone-manager U: hadoop-ozone | | Console output | https://builds.apache.org/job/hadoop-multibranch/job/PR-1108/1/console | | versions | git=2.7.4 maven=3.3.9 findbugs=3.1.0-RC1 | | Powered by | Apache Yetus 0.10.0 http://yetus.apache.org | This message was automatically generated. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 277842) Time Spent: 20m (was: 10m) > Implement S3 Initiate MPU request to use Cache and DoubleBuffer > --- > > Key: HDDS-1805 > URL:
[jira] [Work logged] (HDDS-1805) Implement S3 Initiate MPU request to use Cache and DoubleBuffer
[ https://issues.apache.org/jira/browse/HDDS-1805?focusedWorklogId=20=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-20 ] ASF GitHub Bot logged work on HDDS-1805: Author: ASF GitHub Bot Created on: 16/Jul/19 21:27 Start Date: 16/Jul/19 21:27 Worklog Time Spent: 10m Work Description: bharatviswa504 commented on pull request #1108: HDDS-1805. Implement S3 Initiate MPU request to use Cache and DoubleBuffer. URL: https://github.com/apache/hadoop/pull/1108 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 20) Time Spent: 10m Remaining Estimate: 0h > Implement S3 Initiate MPU request to use Cache and DoubleBuffer > --- > > Key: HDDS-1805 > URL: https://issues.apache.org/jira/browse/HDDS-1805 > Project: Hadoop Distributed Data Store > Issue Type: Sub-task > Components: Ozone Manager >Reporter: Bharat Viswanadham >Assignee: Bharat Viswanadham >Priority: Major > Labels: pull-request-available > Time Spent: 10m > Remaining Estimate: 0h > > Implement S3 Initiate MPU request to use OM Cache, double buffer. > > In this Jira will add the changes to implement S3 bucket operations, and > HA/Non-HA will have a different code path, but once all requests are > implemented will have a single code path. -- This message was sent by Atlassian JIRA (v7.6.14#76016) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
