[jira] [Commented] (HADOOP-13057) Async IPC server support

2016-04-26 Thread Siddharth Seth (JIRA)

[ 
https://issues.apache.org/jira/browse/HADOOP-13057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15257619#comment-15257619
 ] 

Siddharth Seth commented on HADOOP-13057:
-

It would - this is long pending. I don't think I'll be able to update the patch 
for the next several weeks. If anyone want to take a shot meanwhile, feel free 
to.

> Async IPC server support
> 
>
> Key: HADOOP-13057
> URL: https://issues.apache.org/jira/browse/HADOOP-13057
> Project: Hadoop Common
>  Issue Type: Improvement
>  Components: ipc
>Affects Versions: 2.6.0
>Reporter: He Tianyi
>
> On some application, server may run out of handlers when performing many 
> blocking I/O operations during processing of each call (e.g. calling another 
> service, etc.). A viable solution is increasing number of handlers. 
> But this faces the problem that large amount of threads will consume much 
> memory (stack, etc.), and performance issues either.
> After HADOOP-12909, work on asynchronization has been done on caller-side. 
> This is a similar proposal on server-side.
> Suggesting the ability to handle requests asynchronously.
> For example, in such server, calls may return a Future object instead of 
> immediate value. Then sends response to client in {{onSuccess}} or 
> {{onFailed}} callbacks.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HADOOP-13057) Async IPC server support

2016-04-24 Thread He Tianyi (JIRA)

[ 
https://issues.apache.org/jira/browse/HADOOP-13057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15255911#comment-15255911
 ] 

He Tianyi commented on HADOOP-13057:


BTW, would be really appreciate to see further updates on HADOOP-11552. 

> Async IPC server support
> 
>
> Key: HADOOP-13057
> URL: https://issues.apache.org/jira/browse/HADOOP-13057
> Project: Hadoop Common
>  Issue Type: Improvement
>  Components: ipc
>Affects Versions: 2.6.0
>Reporter: He Tianyi
>
> On some application, server may run out of handlers when performing many 
> blocking I/O operations during processing of each call (e.g. calling another 
> service, etc.). A viable solution is increasing number of handlers. 
> But this faces the problem that large amount of threads will consume much 
> memory (stack, etc.), and performance issues either.
> After HADOOP-12909, work on asynchronization has been done on caller-side. 
> This is a similar proposal on server-side.
> Suggesting the ability to handle requests asynchronously.
> For example, in such server, calls may return a Future object instead of 
> immediate value. Then sends response to client in {{onSuccess}} or 
> {{onFailed}} callbacks.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HADOOP-13057) Async IPC server support

2016-04-24 Thread He Tianyi (JIRA)

[ 
https://issues.apache.org/jira/browse/HADOOP-13057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15255907#comment-15255907
 ] 

He Tianyi commented on HADOOP-13057:


Thanks, [~sseth].
Marked as duplicate.

> Async IPC server support
> 
>
> Key: HADOOP-13057
> URL: https://issues.apache.org/jira/browse/HADOOP-13057
> Project: Hadoop Common
>  Issue Type: Improvement
>  Components: ipc
>Affects Versions: 2.6.0
>Reporter: He Tianyi
>
> On some application, server may run out of handlers when performing many 
> blocking I/O operations during processing of each call (e.g. calling another 
> service, etc.). A viable solution is increasing number of handlers. 
> But this faces the problem that large amount of threads will consume much 
> memory (stack, etc.), and performance issues either.
> After HADOOP-12909, work on asynchronization has been done on caller-side. 
> This is a similar proposal on server-side.
> Suggesting the ability to handle requests asynchronously.
> For example, in such server, calls may return a Future object instead of 
> immediate value. Then sends response to client in {{onSuccess}} or 
> {{onFailed}} callbacks.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HADOOP-13057) Async IPC server support

2016-04-24 Thread Siddharth Seth (JIRA)

[ 
https://issues.apache.org/jira/browse/HADOOP-13057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15255896#comment-15255896
 ] 

Siddharth Seth commented on HADOOP-13057:
-

HADOOP-11552 targets the same.

> Async IPC server support
> 
>
> Key: HADOOP-13057
> URL: https://issues.apache.org/jira/browse/HADOOP-13057
> Project: Hadoop Common
>  Issue Type: Improvement
>  Components: ipc
>Affects Versions: 2.6.0
>Reporter: He Tianyi
>
> On some application, server may run out of handlers when performing many 
> blocking I/O operations during processing of each call (e.g. calling another 
> service, etc.). A viable solution is increasing number of handlers. 
> But this faces the problem that large amount of threads will consume much 
> memory (stack, etc.), and performance issues either.
> After HADOOP-12909, work on asynchronization has been done on caller-side. 
> This is a similar proposal on server-side.
> Suggesting the ability to handle requests asynchronously.
> For example, in such server, calls may return a Future object instead of 
> immediate value. Then sends response to client in {{onSuccess}} or 
> {{onFailed}} callbacks.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HADOOP-13057) Async IPC server support

2016-04-24 Thread He Tianyi (JIRA)

[ 
https://issues.apache.org/jira/browse/HADOOP-13057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15255868#comment-15255868
 ] 

He Tianyi commented on HADOOP-13057:


Sure, added links and description.

> Async IPC server support
> 
>
> Key: HADOOP-13057
> URL: https://issues.apache.org/jira/browse/HADOOP-13057
> Project: Hadoop Common
>  Issue Type: Improvement
>  Components: ipc
>Affects Versions: 2.6.0
>Reporter: He Tianyi
>
> On some application, server may run out of handlers when performing many 
> blocking I/O operations during processing of each call (e.g. calling another 
> service, etc.). A viable solution is increasing number of handlers. 
> But this faces the problem that large amount of threads will consume much 
> memory (stack, etc.), and performance issues either.
> After HADOOP-12909, work on asynchronization has been done on caller-side. 
> This is a similar proposal on server-side.
> Suggesting the ability to handle requests asynchronously.
> For example, in such server, calls may return a Future object instead of 
> immediate value. Then sends response to client in {{onSuccess}} or 
> {{onFailed}} callbacks.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HADOOP-13057) Async IPC server support

2016-04-24 Thread Mingliang Liu (JIRA)

[ 
https://issues.apache.org/jira/browse/HADOOP-13057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15255864#comment-15255864
 ] 

Mingliang Liu commented on HADOOP-13057:


Can you refer to [HDFS-9924] and [ HADOOP-12909] and describe the difference 
from here? Thanks.

> Async IPC server support
> 
>
> Key: HADOOP-13057
> URL: https://issues.apache.org/jira/browse/HADOOP-13057
> Project: Hadoop Common
>  Issue Type: Improvement
>  Components: ipc
>Affects Versions: 2.6.0
>Reporter: He Tianyi
>
> On some application, server may run out of handlers when performing many 
> blocking I/O operations during processing of each call (e.g. calling another 
> service, etc.). A viable solution is increasing number of handlers. 
> But this faces the problem that large amount of threads will consume much 
> memory (stack, etc.), and performance issues either.
> Suggesting the ability to handle requests asynchronously.
> For example, in such server, calls may return a Future object instead of 
> immediate value. Then sends response to client in {{onSuccess}} or 
> {{onFailed}} callbacks.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)