[GitHub] [dolphinscheduler] rickchengx opened a new pull request, #13332: [Feature-13331][Remote Logging] Add support for writing task logs to OSS

[GitBox]

rickchengx opened a new pull request, #13332:
URL: https://github.com/apache/dolphinscheduler/pull/13332

   <!--Thanks very much for contributing to Apache DolphinScheduler. Please 
review 
https://dolphinscheduler.apache.org/en-us/community/development/pull-request.html
 before opening a pull request.-->
   
   ## Purpose of the pull request
   
   * close: #13331 
   * A sub-task of #13017 
   
   Add support for writing task logs to OSS
   
   ## Brief change log
   
   <!--*(for example:)*
   - *Add maven-checkstyle-plugin to root pom.xml*
   -->
   
   ## Verify this pull request
   
   manually tested
   
   1. Configure related variables in `common.properties`
   ```
   # remote logging
   remote.logging.enable=false
   # if remote.logging.enable = true, set the target of remote logging
   remote.logging.target=OSS
   # oss access key id, required if you set remote.logging.target=OSS
   remote.logging.oss.access.key.id=<access.key.id>
   # oss access key secret, required if you set remote.logging.target=OSS
   remote.logging.oss.access.key.secret=<access.key.secret>
   # oss bucket name, required if you set remote.logging.target=OSS
   remote.logging.oss.bucket.name=<bucket.name>
   # oss endpoint, required if you set remote.logging.target=OSS
   remote.logging.oss.endpoint=<endpoint>
   # oss base directory, required if you set remote.logging.target=OSS
   remote.logging.oss.base.dir=logs
   ```
   
   2. Create a shell task
   
   3. View the task log
   <img width="1111" alt="截屏2023-01-04 11 08 23" 
src="https://user-images.githubusercontent.com/38122586/210497740-31f39baa-f047-45f9-a3d6-39d81fe6e32c.png";>
   
   4. Check that the task log is sent to OSS
   <img width="1323" alt="截屏2023-01-04 11 22 02" 
src="https://user-images.githubusercontent.com/38122586/210497835-1e652962-1c4a-47d4-acfa-5937d7f679f2.png";>
   
   5. delete the local task log file
   
   6. View the task log again. The task log will be download from OSS.
   
   <img width="1089" alt="截屏2023-01-04 11 10 36" 
src="https://user-images.githubusercontent.com/38122586/210498445-8af121a6-abc1-4755-9b53-f7455dca6d23.png";>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@dolphinscheduler.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org