[ 
https://issues.apache.org/jira/browse/HDDS-870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16708596#comment-16708596
 ] 

Nilotpal Nandi commented on HDDS-870:
-------------------------------------

[~shashikant] , could you please change INFO level logs to DEBUG as the logs 
are printed on STDOUT when client operation run ?

e.g -
{noformat}
[root@ctr-e139-1542663976389-22144-01-000002 test_files]# ozone fs 
-copyFromLocal 20GB /20GB_1
2018-12-04 10:43:08,396 INFO storage.ChunkOutputStream: Adding index 1623 
commitMap size 0
2018-12-04 10:43:09,246 INFO storage.ChunkOutputStream: Adding index 1632 
commitMap size 1
2018-12-04 10:43:09,252 INFO storage.ChunkOutputStream: Total data successfully 
replicated: 67108864
2018-12-04 10:43:10,491 INFO storage.ChunkOutputStream: Adding index 1644 
commitMap size 1
2018-12-04 10:43:10,491 INFO storage.ChunkOutputStream: Total data successfully 
replicated: 134217728
2018-12-04 10:43:12,204 INFO storage.ChunkOutputStream: Adding index 1652 
commitMap size 1
2018-12-04 10:43:12,205 INFO storage.ChunkOutputStream: Total data successfully 
replicated: 201326592
2018-12-04 10:43:12,207 INFO storage.ChunkOutputStream: waiting for last flush 
Index 1652 to catch up
2018-12-04 10:43:12,747 INFO storage.ChunkOutputStream: Total data successfully 
replicated: 268435456
2018-12-04 10:43:14,088 INFO storage.ChunkOutputStream: Adding index 1630 
commitMap size 0
2018-12-04 10:43:14,959 INFO storage.ChunkOutputStream: Adding index 1640 
commitMap size 1
2018-12-04 10:43:14,959 INFO storage.ChunkOutputStream: Total data successfully 
replicated: 67108864
2018-12-04 10:43:16,208 INFO storage.ChunkOutputStream: Adding index 1650 
commitMap size 1
2018-12-04 10:43:16,208 INFO storage.ChunkOutputStream: Total data successfully 
replicated: 134217728
2018-12-04 10:43:17,479 INFO storage.ChunkOutputStream: Adding index 1660 
commitMap size 1
2018-12-04 10:43:17,480 INFO storage.ChunkOutputStream: Total data successfully 
replicated: 201326592
2018-12-04 10:43:17,480 INFO storage.ChunkOutputStream: waiting for last flush 
Index 1660 to catch up
2018-12-04 10:43:17,598 INFO storage.ChunkOutputStream: Total data successfully 
replicated: 268435456
2018-12-04 10:43:19,081 INFO storage.ChunkOutputStream: Adding index 1663 
commitMap size 0
2018-12-04 10:43:19,957 INFO storage.ChunkOutputStream: Adding index 1673 
commitMap size 1
2018-12-04 10:43:19,957 INFO storage.ChunkOutputStream: Total data successfully 
replicated: 67108864
2018-12-04 10:43:21,053 INFO storage.ChunkOutputStream: Adding index 1683 
commitMap size 1
2018-12-04 10:43:21,054 INFO storage.ChunkOutputStream: Total data successfully 
replicated: 134217728
2018-12-04 10:43:22,262 INFO storage.ChunkOutputStream: Adding index 1693 
commitMap size 1{noformat}

> Avoid creating block sized buffer in ChunkGroupOutputStream
> -----------------------------------------------------------
>
>                 Key: HDDS-870
>                 URL: https://issues.apache.org/jira/browse/HDDS-870
>             Project: Hadoop Distributed Data Store
>          Issue Type: Improvement
>          Components: Ozone Client
>    Affects Versions: 0.4.0
>            Reporter: Shashikant Banerjee
>            Assignee: Shashikant Banerjee
>            Priority: Major
>             Fix For: 0.4.0
>
>         Attachments: HDDS-870.000.patch, HDDS-870.001.patch, 
> HDDS-870.002.patch, HDDS-870.003.patch, HDDS-870.004.patch
>
>
> Currently, for a key, we create a block size byteBuffer in order for caching 
> data. This can be replaced with an array of buffers of size flush buffer size 
> configured for handling 2 node failures as well.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org

Reply via email to