[ 
https://issues.apache.org/jira/browse/HTTPCLIENT-1809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Oleg Kalnichevski resolved HTTPCLIENT-1809.
-------------------------------------------
    Resolution: Duplicate

Duplicate of HTTPCORE-390.

Oleg

> Thread contention in PoolingHttpClientConnectionManager
> -------------------------------------------------------
>
>                 Key: HTTPCLIENT-1809
>                 URL: https://issues.apache.org/jira/browse/HTTPCLIENT-1809
>             Project: HttpComponents HttpClient
>          Issue Type: Bug
>          Components: HttpClient (classic)
>    Affects Versions: 4.5
>            Reporter: Andrew Shore
>            Priority: Minor
>              Labels: perfomance
>
> We (AWS SDK for Java) have been investigating reports of poor performance in 
> the SDK and have narrowed it down to thread contention issues in 
> PoolingHttpClientConnectionManager. Up to a certain TPS, performance is great 
> and their is no issue. After a certain TPS (approx 8000 in our load tests), 
> performance tanks hard and most threads end up stuck waiting on a lock in 
> AbstractConnPool (in either lease or releaseConnection).
> https://github.com/apache/httpcore/blob/4.4.x/httpcore/src/main/java/org/apache/http/pool/AbstractConnPool.java#L403
> This quickly locks up the application as it tries to meet the incoming TPS. 
> We have been able to workaround this and achieve much higher throughput but 
> having multiple SDK clients and round robin selecting them to hand off to 
> threads. This allowed us to easily scale up to 16, 000 TPS. We wanted to open 
> up a dialog with the maintainers of the Apache HTTP client to see if this is 
> a known issue/limitation and what options we have for getting around it. We 
> aren’t opposed to re-implementing the connection manager to be more 
> performant but since it’s a pretty sizable chunk of work we wanted to ensure 
> that’s the best path forward before proceeding. 



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@hc.apache.org
For additional commands, e-mail: dev-h...@hc.apache.org

Reply via email to