[jira] [Updated] (HDDS-2653) Improve executor memory usage in new Freon tests

2019-12-05 Thread Anu Engineer (Jira) 


 [ 
https://issues.apache.org/jira/browse/HDDS-2653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Anu Engineer updated HDDS-2653:
---
Fix Version/s: 0.5.0
   Resolution: Fixed
   Status: Resolved  (was: Patch Available)

[~xyao] Thanks for the commit. [~adoroszlai] Thank you for the contribution.

> Improve executor memory usage in new Freon tests
> 
>
> Key: HDDS-2653
> URL: https://issues.apache.org/jira/browse/HDDS-2653
> Project: Hadoop Distributed Data Store
>  Issue Type: Improvement
>  Components: freon
>Affects Versions: 0.5.0
>Reporter: Attila Doroszlai
>Assignee: Attila Doroszlai
>Priority: Major
>  Labels: pull-request-available
> Fix For: 0.5.0
>
>  Time Spent: 20m
>  Remaining Estimate: 0h
>
> New Freon tests (descendants of {{BaseFreonGenerator}}) suffer from a similar 
> memory issue due to concurrency handling as HDDS-1785.
> Steps to reproduce:
> {code}
> export HADOOP_OPTS='-Xmx256M -XX:+HeapDumpOnOutOfMemoryError'
> ozone freon omkg -F ONE -n 33554432 -t 10 -p omkg
> {code}
> Freon attempts to submit 32M tasks to the executor, requiring at least 1.5GB 
> memory.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: ozone-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: ozone-issues-h...@hadoop.apache.org

[jira] [Updated] (HDDS-2653) Improve executor memory usage in new Freon tests

2019-11-30 Thread Attila Doroszlai (Jira) 


 [ 
https://issues.apache.org/jira/browse/HDDS-2653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Attila Doroszlai updated HDDS-2653:
---
Status: Patch Available  (was: In Progress)

> Improve executor memory usage in new Freon tests
> 
>
> Key: HDDS-2653
> URL: https://issues.apache.org/jira/browse/HDDS-2653
> Project: Hadoop Distributed Data Store
>  Issue Type: Improvement
>  Components: freon
>Affects Versions: 0.5.0
>Reporter: Attila Doroszlai
>Assignee: Attila Doroszlai
>Priority: Major
>  Labels: pull-request-available
>  Time Spent: 10m
>  Remaining Estimate: 0h
>
> New Freon tests (descendants of {{BaseFreonGenerator}}) suffer from a similar 
> memory issue due to concurrency handling as HDDS-1785.
> Steps to reproduce:
> {code}
> export HADOOP_OPTS='-Xmx256M -XX:+HeapDumpOnOutOfMemoryError'
> ozone freon omkg -F ONE -n 33554432 -t 10 -p omkg
> {code}
> Freon attempts to submit 32M tasks to the executor, requiring at least 1.5GB 
> memory.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: ozone-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: ozone-issues-h...@hadoop.apache.org

[jira] [Updated] (HDDS-2653) Improve executor memory usage in new Freon tests

2019-11-30 Thread ASF GitHub Bot (Jira) 


 [ 
https://issues.apache.org/jira/browse/HDDS-2653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

ASF GitHub Bot updated HDDS-2653:
-
Labels: pull-request-available  (was: )

> Improve executor memory usage in new Freon tests
> 
>
> Key: HDDS-2653
> URL: https://issues.apache.org/jira/browse/HDDS-2653
> Project: Hadoop Distributed Data Store
>  Issue Type: Improvement
>  Components: freon
>Affects Versions: 0.5.0
>Reporter: Attila Doroszlai
>Assignee: Attila Doroszlai
>Priority: Major
>  Labels: pull-request-available
>
> New Freon tests (descendants of {{BaseFreonGenerator}}) suffer from a similar 
> memory issue due to concurrency handling as HDDS-1785.
> Steps to reproduce:
> {code}
> export HADOOP_OPTS='-Xmx256M -XX:+HeapDumpOnOutOfMemoryError'
> ozone freon omkg -F ONE -n 33554432 -t 10 -p omkg
> {code}
> Freon attempts to submit 32M tasks to the executor, requiring at least 1.5GB 
> memory.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: ozone-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: ozone-issues-h...@hadoop.apache.org

[jira] [Updated] (HDDS-2653) Improve executor memory usage in new Freon tests

2019-11-30 Thread Attila Doroszlai (Jira) 


 [ 
https://issues.apache.org/jira/browse/HDDS-2653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Attila Doroszlai updated HDDS-2653:
---
Description: 
New Freon tests (descendants of {{BaseFreonGenerator}}) suffer from a similar 
memory issue due to concurrency handling as HDDS-1785.

Steps to reproduce:

{code}
export HADOOP_OPTS='-Xmx256M -XX:+HeapDumpOnOutOfMemoryError'
ozone freon omkg -F ONE -n 33554432 -t 10 -p omkg
{code}

Freon attempts to submit 32M tasks to the executor, requiring at least 1.5GB 
memory.

  was:
New Freon tests (descendants of {{BaseFreonGenerator}}) suffer from a similar 
memory issue due to concurrency handling as HDDS-1785.

Steps to reproduce:

{{code}}
export HADOOP_OPTS='-Xmx256M -XX:+HeapDumpOnOutOfMemoryError'
ozone freon omkg -F ONE -n 33554432 -t 10 -p omkg
{code}

Freon attempts to submit 32M tasks to the executor, requiring at least 1.5GB 
memory.


> Improve executor memory usage in new Freon tests
> 
>
> Key: HDDS-2653
> URL: https://issues.apache.org/jira/browse/HDDS-2653
> Project: Hadoop Distributed Data Store
>  Issue Type: Improvement
>  Components: freon
>Affects Versions: 0.5.0
>Reporter: Attila Doroszlai
>Assignee: Attila Doroszlai
>Priority: Major
>
> New Freon tests (descendants of {{BaseFreonGenerator}}) suffer from a similar 
> memory issue due to concurrency handling as HDDS-1785.
> Steps to reproduce:
> {code}
> export HADOOP_OPTS='-Xmx256M -XX:+HeapDumpOnOutOfMemoryError'
> ozone freon omkg -F ONE -n 33554432 -t 10 -p omkg
> {code}
> Freon attempts to submit 32M tasks to the executor, requiring at least 1.5GB 
> memory.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: ozone-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: ozone-issues-h...@hadoop.apache.org