[
https://issues.apache.org/jira/browse/HADOOP-13327?focusedWorklogId=549544&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-549544
]
ASF GitHub Bot logged work on HADOOP-13327:
-------------------------------------------
Author: ASF GitHub Bot
Created on: 08/Feb/21 12:30
Start Date: 08/Feb/21 12:30
Worklog Time Spent: 10m
Work Description: steveloughran commented on pull request #2587:
URL: https://github.com/apache/hadoop/pull/2587#issuecomment-775113631
FWIW, here are the IOStats logged on the runs
ABFS (which supports hsync)
```
.dfs.core.windows.net/stevel-testing/test/testSyncable?action=flush&retainUncommittedData=false&position=2&close=true&timeout=90
2021-02-08 12:27:48,642 INFO [JUnit-testSyncable]:
contract.AbstractContractCreateTest
(AbstractContractCreateTest.java:validateSyncableSemantics(586)) - IOStatistics
counters=((queue_shrunk_ops=1) (time_spent_task_wait.failures=0)
(write_current_buffer_ops=2) (bytes_upload_failed=0) (bytes_upload=2)
(time_spent_on_put_request.failures=0) (time_spent_on_put_request=2)
(time_spent_task_wait=0) (bytes_upload_successfully=2));
gauges=();
minimums=((time_spent_task_wait.failures.min=-1)
(time_spent_on_put_request.min=28) (time_spent_task_wait.min=-1)
(time_spent_on_put_request.failures.min=-1));
maximums=((time_spent_on_put_request.failures.max=-1)
(time_spent_task_wait.max=-1) (time_spent_on_put_request.max=36)
(time_spent_task_wait.failures.max=-1));
means=((time_spent_task_wait.mean=(samples=0, sum=0, mean=0.0000))
(time_spent_on_put_request.failures.mean=(samples=0, sum=0, mean=0.0000))
(time_spent_task_wait.failures.mean=(samples=0, sum=0, mean=0.0000))
(time_spent_on_put_request.mean=(samples=2, sum=64, mean=32.0000)));
```
s3a
```
2021-02-08 12:29:05,294 [JUnit-testSyncable] WARN
contract.AbstractContractCreateTest
(AbstractContractCreateTest.java:validateSyncableSemantics(575)) - Output file
was not created; this is an object store with different visibility semantics
2021-02-08 12:29:05,500 [JUnit-testSyncable] INFO
contract.AbstractContractCreateTest
(AbstractContractCreateTest.java:validateSyncableSemantics(586)) - IOStatistics
counters=((stream_write_bytes=2) (stream_write_queue_duration=0)
(action_executor_acquired=1) (stream_write_block_uploads=1)
(stream_write_exceptions=0) (stream_write_exceptions_completing_upload=0)
(stream_write_total_time=0) (stream_write_total_data=2)
(action_executor_acquired.failures=0));
gauges=((stream_write_block_uploads_data_pending=0)
(stream_write_block_uploads_pending=1));
minimums=((action_executor_acquired.failures.min=-1)
(action_executor_acquired.min=0));
maximums=((action_executor_acquired.max=0)
(action_executor_acquired.failures.max=-1));
means=((action_executor_acquired.failures.mean=(samples=0, sum=0,
mean=0.0000)) (action_executor_acquired.mean=(samples=1, sum=0, mean=0.0000)));
```
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 549544)
Time Spent: 9h 20m (was: 9h 10m)
> Add OutputStream + Syncable to the Filesystem Specification
> -----------------------------------------------------------
>
> Key: HADOOP-13327
> URL: https://issues.apache.org/jira/browse/HADOOP-13327
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs
> Affects Versions: 2.8.0
> Reporter: Steve Loughran
> Assignee: Steve Loughran
> Priority: Major
> Labels: pull-request-available
> Attachments: HADOOP-13327-002.patch, HADOOP-13327-003.patch,
> HADOOP-13327-branch-2-001.patch
>
> Time Spent: 9h 20m
> Remaining Estimate: 0h
>
> Write down what a Filesystem output stream should do. While core the API is
> defined in Java, that doesn't say what's expected about visibility,
> durability, etc —and Hadoop Syncable interface is entirely ours to define.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
