[ 
https://issues.apache.org/jira/browse/HDDS-1972?focusedWorklogId=295771&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-295771
 ]

ASF GitHub Bot logged work on HDDS-1972:
----------------------------------------

                Author: ASF GitHub Bot
            Created on: 15/Aug/19 21:25
            Start Date: 15/Aug/19 21:25
    Worklog Time Spent: 10m 
      Work Description: bharatviswa504 commented on pull request #1304: 
HDDS-1972. Provide example ha proxy with multiple s3 servers back end.
URL: https://github.com/apache/hadoop/pull/1304
 
 
   Tested it on my laptop:
   ```
   $ docker-compose up
   Creating network "ozones3-haproxy_default" with the default driver
   Creating ozones3-haproxy_s3-proxy_1 ... done
   Creating ozones3-haproxy_s3g3_1     ... done
   Creating ozones3-haproxy_scm_1      ... done
   Creating ozones3-haproxy_s3g1_1     ... done
   Creating ozones3-haproxy_om_1       ... done
   Creating ozones3-haproxy_s3g2_1     ... done
   Creating ozones3-haproxy_datanode_1 ... done
   Attaching to ozones3-haproxy_s3-proxy_1, ozones3-haproxy_om_1, 
ozones3-haproxy_datanode_1, ozones3-haproxy_s3g3_1, ozones3-haproxy_s3g1_1, 
ozones3-haproxy_scm_1, ozones3-haproxy_s3g2_1
   s3-proxy_1  | [NOTICE] 226/212303 (1) : New worker #1 (6) forked
   ```
   
   ```
   $ aws s3api --endpoint http://localhost:8081 create-bucket --bucket b12346
   {
       "Location": "http://localhost:8081/b12346";
   }
   HW13865:ozones3-haproxy bviswanadham$ aws s3api --endpoint 
http://localhost:8081 create-bucket --bucket b1234
   {
       "Location": "http://localhost:8081/b1234";
   }
   HW13865:ozones3-haproxy bviswanadham$ aws s3api --endpoint 
http://localhost:8081 create-bucket --bucket b123
   {
       "Location": "http://localhost:8081/b123";
   }
   HW13865:ozones3-haproxy bviswanadham$ aws s3api --endpoint 
http://localhost:8081 list-buckets
   {
       "Buckets": [
           {
               "CreationDate": "2019-08-15T21:23:49.643Z", 
               "Name": "b123"
           }, 
           {
               "CreationDate": "2019-08-15T21:23:45.330Z", 
               "Name": "b1234"
           }, 
           {
               "CreationDate": "2019-08-15T21:23:42.629Z", 
               "Name": "b12346"
           }
       ]
   }
   ```
   
   docker logs:
   
   ```
   s3g1_1      | 2019-08-15 21:23:42 INFO  BucketEndpoint:206 - Location is 
/b12346
   s3g2_1      | 2019-08-15 21:23:45 INFO  BucketEndpoint:206 - Location is 
/b1234
   s3g3_1      | 2019-08-15 21:23:49 INFO  BucketEndpoint:206 - Location is 
/b123
   ```
   
 
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
-------------------

            Worklog Id:     (was: 295771)
            Time Spent: 10m
    Remaining Estimate: 0h

> Provide example ha proxy with multiple s3 servers back end.
> -----------------------------------------------------------
>
>                 Key: HDDS-1972
>                 URL: https://issues.apache.org/jira/browse/HDDS-1972
>             Project: Hadoop Distributed Data Store
>          Issue Type: Bug
>            Reporter: Bharat Viswanadham
>            Assignee: Bharat Viswanadham
>            Priority: Major
>              Labels: pull-request-available
>          Time Spent: 10m
>  Remaining Estimate: 0h
>
> In this Jira, we shall provide docker-compose files where we start 3 s3 
> gateway servers, and ha-proxy is used to load balance these S3 Gateway 
> Servers.
>  
> In this Jira, all are proxy configurations are hardcoded, we can make 
> improvements to scale and automatically configure with environment variables 
> as a future improvement. This is just a starter example.
>  



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org

Reply via email to