neils-dev opened a new pull request #2259:
URL: https://github.com/apache/ozone/pull/2259


   ## What changes were proposed in this pull request?
   Initial commit for s3g gRPC for command OmRequest and OmResponses.  Creates:
   
   1.  a gRPC service for existing Om protocol - _protoc 2.5_ 
`hadoop-ozone/interface-client/pom.xml`, 
`hadoop-ozone/interface-client/target/generated-sources/protobuf/java/org/apache/hadoop/ozone/protocol/proto/OzoneManagerServiceGrpc.java`
 - _**HDDS-5210**_
   2.  starts OM gRPC server as part of OM bootstrap - 
`hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/GrpcOzoneManagerServer.java`,
 `OzoneManager.java` - _**HDDS-5211**_
   3. creates implementation of OmTransport for gRPC - ` 
hadoop-ozone/interface-client/pom.xml` - _**HDDS-5212**_
   4. Create specific OmTransportFactory for GrpcOmTransport - 
`hadoop-ozone/common/src/main/java/org/apache/hadoop/ozone/om/protocolPB/GrpcOmTransportFactory.java`;
 dynamically selected ServiceProvider loaded class for s3g 
`hadoop-ozone/s3gateway/src/main/resources/META-INF/services/org.apache.hadoop.ozone.om.protocolPB.OmTransportFactory`
 - _**HDDS-5213**_
   
   Currently requires ratis _**disabled**_ for Om : set 
`ozone.om.ratis.enable=false` in _ozone-site.xml_; use _intellij_ 
`hadoop-ozone/dev-support/intellij/ozone-site.xml` and _intellij s3g_ together 
with invoke _s3g_ for simple bucket commands through _s3 cli_.
   
   ## What is the link to the Apache JIRA
   https://issues.apache.org/jira/browse/HDDS-5210 - (see 1. previous section)
   https://issues.apache.org/jira/browse/HDDS-5211 - (see 2. previous section)
   https://issues.apache.org/jira/browse/HDDS-5212 - (see 3. previous section)
   https://issues.apache.org/jira/browse/HDDS-5213 - (see 4. previous section)
   
   
   ## How was this patch tested?
   
   Patch is initial POC for s3g gRPC OmRequest/OmResponse.  Currently requires 
_**ratis disabled**_ for Om - (when invoking ratis server through 
_OzoneManagerRatisServer_ _submitRequest_, 
`createWriteRaftClientRequest(omRequest)` fails when checking preconditions due 
to _hadoop class Server.Call_ is _**null**_; requires attention from 
propagating the om _SubmitRequest_ through the _GrpcServer_).
   
   To test - use  intellij ozone development cluster running through 
runConfigurations for invoking SCM, OM, Recon, Datanodes and S3Gateway.  Commit 
includes modified ozone-site.xml 
(`hadoop-ozone/dev-support/intellij/ozone-site.xml`) to disable ratis for om 
(`<property><name>ozone.om.ratis.enable</name><value>false</value></property>`).
  Run simple s3 file operations through aws cli:
   
![end_to_end_s3Om_gRPC_](https://user-images.githubusercontent.com/81126310/118610000-90e7c900-b778-11eb-8fc9-aac568ee98a1.png)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
[email protected]



---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to