[jira] [Updated] (HDFS-12853) Ozone: Optimize chunk writes for Ratis by avoiding double writes

2018-01-08 Thread Tsz Wo Nicholas Sze (JIRA)

 [ 
https://issues.apache.org/jira/browse/HDFS-12853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Tsz Wo Nicholas Sze updated HDFS-12853:
---
Resolution: Fixed
Status: Resolved  (was: Patch Available)

I have committed this.  Thanks, Mukul!

> Ozone: Optimize chunk writes for Ratis by avoiding double writes
> 
>
> Key: HDFS-12853
> URL: https://issues.apache.org/jira/browse/HDFS-12853
> Project: Hadoop HDFS
>  Issue Type: Sub-task
>  Components: ozone
>Affects Versions: HDFS-7240
>Reporter: Mukul Kumar Singh
>Assignee: Mukul Kumar Singh
> Fix For: HDFS-7240
>
> Attachments: HDFS-12853-HDFS-7240.001.patch, 
> HDFS-12853-HDFS-7240.002.patch
>
>
> Ozone, in replicated mode writes the data twice, once to the raft log and 
> then to the statemachine.
> This results in the data being written twice during a particular chunk write, 
> this is subobtimal. With RATIS-122 the statemachine in Ozone can be optimized 
> by writing the data to the statemachine only once.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Updated] (HDFS-12853) Ozone: Optimize chunk writes for Ratis by avoiding double writes

2018-01-08 Thread Tsz Wo Nicholas Sze (JIRA)

 [ 
https://issues.apache.org/jira/browse/HDFS-12853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Tsz Wo Nicholas Sze updated HDFS-12853:
---
Hadoop Flags: Reviewed

+1 patch looks good.

> Ozone: Optimize chunk writes for Ratis by avoiding double writes
> 
>
> Key: HDFS-12853
> URL: https://issues.apache.org/jira/browse/HDFS-12853
> Project: Hadoop HDFS
>  Issue Type: Sub-task
>  Components: ozone
>Affects Versions: HDFS-7240
>Reporter: Mukul Kumar Singh
>Assignee: Mukul Kumar Singh
> Fix For: HDFS-7240
>
> Attachments: HDFS-12853-HDFS-7240.001.patch, 
> HDFS-12853-HDFS-7240.002.patch
>
>
> Ozone, in replicated mode writes the data twice, once to the raft log and 
> then to the statemachine.
> This results in the data being written twice during a particular chunk write, 
> this is subobtimal. With RATIS-122 the statemachine in Ozone can be optimized 
> by writing the data to the statemachine only once.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Updated] (HDFS-12853) Ozone: Optimize chunk writes for Ratis by avoiding double writes

2018-01-06 Thread Mukul Kumar Singh (JIRA)

 [ 
https://issues.apache.org/jira/browse/HDFS-12853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Mukul Kumar Singh updated HDFS-12853:
-
Attachment: HDFS-12853-HDFS-7240.002.patch

Hi [~szetszwo], I have addressed the first set of review comments which were 
related to this patch. I will address the other comments as part of another bug.

> Ozone: Optimize chunk writes for Ratis by avoiding double writes
> 
>
> Key: HDFS-12853
> URL: https://issues.apache.org/jira/browse/HDFS-12853
> Project: Hadoop HDFS
>  Issue Type: Sub-task
>  Components: ozone
>Affects Versions: HDFS-7240
>Reporter: Mukul Kumar Singh
>Assignee: Mukul Kumar Singh
> Fix For: HDFS-7240
>
> Attachments: HDFS-12853-HDFS-7240.001.patch, 
> HDFS-12853-HDFS-7240.002.patch
>
>
> Ozone, in replicated mode writes the data twice, once to the raft log and 
> then to the statemachine.
> This results in the data being written twice during a particular chunk write, 
> this is subobtimal. With RATIS-122 the statemachine in Ozone can be optimized 
> by writing the data to the statemachine only once.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Updated] (HDFS-12853) Ozone: Optimize chunk writes for Ratis by avoiding double writes

2017-12-11 Thread Mukul Kumar Singh (JIRA)

 [ 
https://issues.apache.org/jira/browse/HDFS-12853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Mukul Kumar Singh updated HDFS-12853:
-
Status: Patch Available  (was: Open)

> Ozone: Optimize chunk writes for Ratis by avoiding double writes
> 
>
> Key: HDFS-12853
> URL: https://issues.apache.org/jira/browse/HDFS-12853
> Project: Hadoop HDFS
>  Issue Type: Sub-task
>  Components: ozone
>Affects Versions: HDFS-7240
>Reporter: Mukul Kumar Singh
>Assignee: Mukul Kumar Singh
> Fix For: HDFS-7240
>
> Attachments: HDFS-12853-HDFS-7240.001.patch
>
>
> Ozone, in replicated mode writes the data twice, once to the raft log and 
> then to the statemachine.
> This results in the data being written twice during a particular chunk write, 
> this is subobtimal. With RATIS-122 the statemachine in Ozone can be optimized 
> by writing the data to the statemachine only once.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Updated] (HDFS-12853) Ozone: Optimize chunk writes for Ratis by avoiding double writes

2017-12-11 Thread Mukul Kumar Singh (JIRA)

 [ 
https://issues.apache.org/jira/browse/HDFS-12853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Mukul Kumar Singh updated HDFS-12853:
-
Attachment: HDFS-12853-HDFS-7240.001.patch

> Ozone: Optimize chunk writes for Ratis by avoiding double writes
> 
>
> Key: HDFS-12853
> URL: https://issues.apache.org/jira/browse/HDFS-12853
> Project: Hadoop HDFS
>  Issue Type: Sub-task
>  Components: ozone
>Affects Versions: HDFS-7240
>Reporter: Mukul Kumar Singh
>Assignee: Mukul Kumar Singh
> Fix For: HDFS-7240
>
> Attachments: HDFS-12853-HDFS-7240.001.patch
>
>
> Ozone, in replicated mode writes the data twice, once to the raft log and 
> then to the statemachine.
> This results in the data being written twice during a particular chunk write, 
> this is subobtimal. With RATIS-122 the statemachine in Ozone can be optimized 
> by writing the data to the statemachine only once.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Updated] (HDFS-12853) Ozone: Optimize chunk writes for Ratis by avoiding double writes

2017-11-30 Thread Mukul Kumar Singh (JIRA)

 [ 
https://issues.apache.org/jira/browse/HDFS-12853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Mukul Kumar Singh updated HDFS-12853:
-
Issue Type: Sub-task  (was: Bug)
Parent: HDFS-7240

> Ozone: Optimize chunk writes for Ratis by avoiding double writes
> 
>
> Key: HDFS-12853
> URL: https://issues.apache.org/jira/browse/HDFS-12853
> Project: Hadoop HDFS
>  Issue Type: Sub-task
>  Components: ozone
>Affects Versions: HDFS-7240
>Reporter: Mukul Kumar Singh
>Assignee: Mukul Kumar Singh
> Fix For: HDFS-7240
>
>
> Ozone, in replicated mode writes the data twice, once to the raft log and 
> then to the statemachine.
> This results in the data being written twice during a particular chunk write, 
> this is subobtimal. With RATIS-122 the statemachine in Ozone can be optimized 
> by writing the data to the statemachine only once.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Updated] (HDFS-12853) Ozone: Optimize chunk writes for Ratis by avoiding double writes

2017-11-22 Thread Mukul Kumar Singh (JIRA)

 [ 
https://issues.apache.org/jira/browse/HDFS-12853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Mukul Kumar Singh updated HDFS-12853:
-
Description: 
Ozone, in replicated mode writes the data twice, once to the raft log and then 
to the statemachine.
This results in the data being written twice during a particular chunk write, 
this is subobtimal. With RATIS-122 the statemachine in Ozone can be optimized 
by writing the data to the statemachine only once.

  was:
Ozone, in replicated mode writes the data twice, once to the raft log and then 
to the statemachine.
This results in the data being written twice during a particular chunk write, 
this is subobtimal. With Ratis-122 the statemachine in Ozone can be optimized 
by writing the data to the statemachine only once.


> Ozone: Optimize chunk writes for Ratis by avoiding double writes
> 
>
> Key: HDFS-12853
> URL: https://issues.apache.org/jira/browse/HDFS-12853
> Project: Hadoop HDFS
>  Issue Type: Bug
>  Components: ozone
>Affects Versions: HDFS-7240
>Reporter: Mukul Kumar Singh
>Assignee: Mukul Kumar Singh
> Fix For: HDFS-7240
>
>
> Ozone, in replicated mode writes the data twice, once to the raft log and 
> then to the statemachine.
> This results in the data being written twice during a particular chunk write, 
> this is subobtimal. With RATIS-122 the statemachine in Ozone can be optimized 
> by writing the data to the statemachine only once.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org