Github user geomacy commented on the issue:
https://github.com/apache/brooklyn-server/pull/466
hi @aledsage
the test does pass; I didn't see a huge amount of rate limiting - for a
single run it only hit about thirty 503s:
```
grep -E "JavaUrlHttpCommandExecutorService.*Receiving.* 503 Service
Unavailable" brooklyn.debug.log
2016-11-25 16:02:50,265 DEBUG o.j.h.i.JavaUrlHttpCommandExecutorService
[pool-3-thread-39]: Receiving response -1710323565: HTTP/1.1 503 Service
Unavailable
2016-11-25 16:02:50,269 DEBUG o.j.h.i.JavaUrlHttpCommandExecutorService
[pool-3-thread-28]: Receiving response -148597983: HTTP/1.1 503 Service
Unavailable
2016-11-25 16:02:50,378 DEBUG o.j.h.i.JavaUrlHttpCommandExecutorService
[pool-3-thread-21]: Receiving response -1594595467: HTTP/1.1 503 Service
Unavailable
2016-11-25 16:02:50,447 DEBUG o.j.h.i.JavaUrlHttpCommandExecutorService
[pool-3-thread-29]: Receiving response -1960727640: HTTP/1.1 503 Service
Unavailable
2016-11-25 16:02:50,526 DEBUG o.j.h.i.JavaUrlHttpCommandExecutorService
[pool-3-thread-10]: Receiving response -52423542: HTTP/1.1 503 Service
Unavailable
2016-11-25 16:02:51,446 DEBUG o.j.h.i.JavaUrlHttpCommandExecutorService
[pool-3-thread-21]: Receiving response -548854774: HTTP/1.1 503 Service
Unavailable
2016-11-25 16:02:51,557 DEBUG o.j.h.i.JavaUrlHttpCommandExecutorService
[pool-3-thread-10]: Receiving response -510226563: HTTP/1.1 503 Service
Unavailable
2016-11-25 16:03:03,035 DEBUG o.j.h.i.JavaUrlHttpCommandExecutorService
[pool-3-thread-38]: Receiving response 346995024: HTTP/1.1 503 Service
Unavailable
2016-11-25 16:03:03,143 DEBUG o.j.h.i.JavaUrlHttpCommandExecutorService
[pool-3-thread-15]: Receiving response 346995024: HTTP/1.1 503 Service
Unavailable
2016-11-25 16:03:03,179 DEBUG o.j.h.i.JavaUrlHttpCommandExecutorService
[pool-3-thread-20]: Receiving response 346995024: HTTP/1.1 503 Service
Unavailable
2016-11-25 16:03:03,182 DEBUG o.j.h.i.JavaUrlHttpCommandExecutorService
[pool-3-thread-37]: Receiving response 346995024: HTTP/1.1 503 Service
Unavailable
2016-11-25 16:03:03,200 DEBUG o.j.h.i.JavaUrlHttpCommandExecutorService
[pool-3-thread-21]: Receiving response 346995024: HTTP/1.1 503 Service
Unavailable
2016-11-25 16:03:03,245 DEBUG o.j.h.i.JavaUrlHttpCommandExecutorService
[pool-3-thread-17]: Receiving response 346995024: HTTP/1.1 503 Service
Unavailable
2016-11-25 16:03:03,287 DEBUG o.j.h.i.JavaUrlHttpCommandExecutorService
[pool-3-thread-19]: Receiving response 346995024: HTTP/1.1 503 Service
Unavailable
2016-11-25 16:03:03,321 DEBUG o.j.h.i.JavaUrlHttpCommandExecutorService
[pool-3-thread-42]: Receiving response 346995024: HTTP/1.1 503 Service
Unavailable
2016-11-25 16:03:03,337 DEBUG o.j.h.i.JavaUrlHttpCommandExecutorService
[pool-3-thread-14]: Receiving response 346995024: HTTP/1.1 503 Service
Unavailable
2016-11-25 16:03:03,384 DEBUG o.j.h.i.JavaUrlHttpCommandExecutorService
[pool-3-thread-31]: Receiving response 346995024: HTTP/1.1 503 Service
Unavailable
2016-11-25 16:03:03,474 DEBUG o.j.h.i.JavaUrlHttpCommandExecutorService
[pool-3-thread-1]: Receiving response 549339730: HTTP/1.1 503 Service
Unavailable
2016-11-25 16:03:04,047 DEBUG o.j.h.i.JavaUrlHttpCommandExecutorService
[pool-3-thread-38]: Receiving response 549339730: HTTP/1.1 503 Service
Unavailable
2016-11-25 16:03:04,169 DEBUG o.j.h.i.JavaUrlHttpCommandExecutorService
[pool-3-thread-37]: Receiving response 549339730: HTTP/1.1 503 Service
Unavailable
2016-11-25 16:03:04,184 DEBUG o.j.h.i.JavaUrlHttpCommandExecutorService
[pool-3-thread-15]: Receiving response 549339730: HTTP/1.1 503 Service
Unavailable
2016-11-25 16:03:04,191 DEBUG o.j.h.i.JavaUrlHttpCommandExecutorService
[pool-3-thread-20]: Receiving response 549339730: HTTP/1.1 503 Service
Unavailable
2016-11-25 16:03:04,219 DEBUG o.j.h.i.JavaUrlHttpCommandExecutorService
[pool-3-thread-21]: Receiving response 549339730: HTTP/1.1 503 Service
Unavailable
2016-11-25 16:03:04,276 DEBUG o.j.h.i.JavaUrlHttpCommandExecutorService
[pool-3-thread-19]: Receiving response 549339730: HTTP/1.1 503 Service
Unavailable
2016-11-25 16:03:04,290 DEBUG o.j.h.i.JavaUrlHttpCommandExecutorService
[pool-3-thread-17]: Receiving response 549339730: HTTP/1.1 503 Service
Unavailable
2016-11-25 16:03:04,314 DEBUG o.j.h.i.JavaUrlHttpCommandExecutorService
[pool-3-thread-42]: Receiving response 549339730: HTTP/1.1 503 Service
Unavailable
2016-11-25 16:03:04,354 DEBUG o.j.h.i.JavaUrlHttpCommandExecutorService
[pool-3-thread-14]: Receiving response 549339730: HTTP/1.1 503 Service
Unavailable
2016-11-25 16:03:04,399 DEBUG o.j.h.i.JavaUrlHttpCommandExecutorService
[pool-3-thread-31]: Receiving response 549339730: HTTP/1.1 503 Service
Unavailable
```
And nothing got rate limited more than twice - most were about one retry.
Here's one of the two retries:
```
2016-11-25 16:02:49,902 DEBUG jclouds.headers [pool-3-thread-21]: >> POST
https://ec2.us-east-1.amazonaws.com/ HTTP/1.1
2016-11-25 16:02:49,902 DEBUG jclouds.headers [pool-3-thread-21]: >> Host:
ec2.us-east-1.amazonaws.com
2016-11-25 16:02:49,902 DEBUG jclouds.headers [pool-3-thread-21]: >>
X-Amz-Date: 20161125T160249Z
2016-11-25 16:02:49,902 DEBUG jclouds.headers [pool-3-thread-21]: >>
Authorization: AWS4-HMAC-SHA256
Credential=AKIAJFSHK76WFRK77BDA/20161125/us-east-1/ec2/aws4_request,
SignedHeaders=content-type;host;x-amz-date,
Signature=754c36af532069aecbdbbde9024648078fa530fee78169287b64373a68474359
2016-11-25 16:02:49,902 DEBUG jclouds.headers [pool-3-thread-21]: >>
Content-Type: application/x-www-form-urlencoded
2016-11-25 16:02:49,902 DEBUG jclouds.headers [pool-3-thread-21]: >>
Content-Length: 70
2016-11-25 16:02:50,378 DEBUG o.j.h.i.JavaUrlHttpCommandExecutorService
[pool-3-thread-21]: Receiving response -1594595467: HTTP/1.1 503 Service
Unavailable
2016-11-25 16:02:50,378 DEBUG jclouds.headers [pool-3-thread-21]: <<
HTTP/1.1 503 Service Unavailable
2016-11-25 16:02:50,378 DEBUG jclouds.headers [pool-3-thread-21]: <<
Transfer-Encoding: chunked
2016-11-25 16:02:50,378 DEBUG jclouds.headers [pool-3-thread-21]: <<
Server: AmazonEC2
2016-11-25 16:02:50,378 DEBUG jclouds.headers [pool-3-thread-21]: <<
Connection: close
2016-11-25 16:02:50,378 DEBUG jclouds.headers [pool-3-thread-21]: << Date:
Fri, 25 Nov 2016 16:02:49 GMT
2016-11-25 16:02:50,378 DEBUG jclouds.headers [pool-3-thread-21]: <<
Content-Type: application/unknown
2016-11-25 16:02:50,382 DEBUG o.j.a.h.AWSServerErrorRetryHandler
[pool-3-thread-21]: Retry 1/6: delaying for 516 ms: server error:
[method=org.jclouds.aws.ec2.features.AWSSecurityGroupApi.public abstract
java.util.Set
org.jclouds.aws.ec2.features.AWSSecurityGroupApi.describeSecurityGroupsInRegionById(java.lang.String,java.lang.String[])[us-east-1,
[Ljava.lang.String;@532271c2], request=POST
https://ec2.us-east-1.amazonaws.com/ HTTP/1.1]
2016-11-25 16:02:50,903 DEBUG o.j.h.i.JavaUrlHttpCommandExecutorService
[pool-3-thread-21]: Sending request -548854774: POST
https://ec2.us-east-1.amazonaws.com/ HTTP/1.1
2016-11-25 16:02:50,903 DEBUG jclouds.headers [pool-3-thread-21]: >> POST
https://ec2.us-east-1.amazonaws.com/ HTTP/1.1
2016-11-25 16:02:50,903 DEBUG jclouds.headers [pool-3-thread-21]: >> Host:
ec2.us-east-1.amazonaws.com
2016-11-25 16:02:50,903 DEBUG jclouds.headers [pool-3-thread-21]: >>
X-Amz-Date: 20161125T160250Z
2016-11-25 16:02:50,903 DEBUG jclouds.headers [pool-3-thread-21]: >>
Authorization: AWS4-HMAC-SHA256
Credential=AKIAJFSHK76WFRK77BDA/20161125/us-east-1/ec2/aws4_request,
SignedHeaders=content-type;host;x-amz-date,
Signature=fb0750c2037bd17f46d52e37ed4d9eed093ad6137271bd464fcf7f534e6bd235
2016-11-25 16:02:50,903 DEBUG jclouds.headers [pool-3-thread-21]: >>
Content-Type: application/x-www-form-urlencoded
2016-11-25 16:02:50,903 DEBUG jclouds.headers [pool-3-thread-21]: >>
Content-Length: 70
2016-11-25 16:02:51,446 DEBUG o.j.h.i.JavaUrlHttpCommandExecutorService
[pool-3-thread-21]: Receiving response -548854774: HTTP/1.1 503 Service
Unavailable
2016-11-25 16:02:51,447 DEBUG jclouds.headers [pool-3-thread-21]: <<
HTTP/1.1 503 Service Unavailable
2016-11-25 16:02:51,447 DEBUG jclouds.headers [pool-3-thread-21]: <<
Transfer-Encoding: chunked
2016-11-25 16:02:51,447 DEBUG jclouds.headers [pool-3-thread-21]: <<
Server: AmazonEC2
2016-11-25 16:02:51,447 DEBUG jclouds.headers [pool-3-thread-21]: <<
Connection: close
2016-11-25 16:02:51,447 DEBUG jclouds.headers [pool-3-thread-21]: << Date:
Fri, 25 Nov 2016 16:02:50 GMT
2016-11-25 16:02:51,447 DEBUG jclouds.headers [pool-3-thread-21]: <<
Content-Type: application/unknown
2016-11-25 16:02:51,447 DEBUG o.j.a.h.AWSServerErrorRetryHandler
[pool-3-thread-21]: Retry 2/6: delaying for 2095 ms: server error:
[method=org.jclouds.aws.ec2.features.AWSSecurityGroupApi.public abstract
java.util.Set
org.jclouds.aws.ec2.features.AWSSecurityGroupApi.describeSecurityGroupsInRegionById(java.lang.String,java.lang.String[])[us-east-1,
[Ljava.lang.String;@532271c2], request=POST
https://ec2.us-east-1.amazonaws.com/ HTTP/1.1]
2016-11-25 16:02:53,545 DEBUG o.j.h.i.JavaUrlHttpCommandExecutorService
[pool-3-thread-21]: Sending request 250468421: POST
https://ec2.us-east-1.amazonaws.com/ HTTP/1.1
2016-11-25 16:02:53,545 DEBUG jclouds.headers [pool-3-thread-21]: >> POST
https://ec2.us-east-1.amazonaws.com/ HTTP/1.1
2016-11-25 16:02:53,545 DEBUG jclouds.headers [pool-3-thread-21]: >> Host:
ec2.us-east-1.amazonaws.com
2016-11-25 16:02:53,545 DEBUG jclouds.headers [pool-3-thread-21]: >>
X-Amz-Date: 20161125T160253Z
2016-11-25 16:02:53,545 DEBUG jclouds.headers [pool-3-thread-21]: >>
Authorization: AWS4-HMAC-SHA256
Credential=AKIAJFSHK76WFRK77BDA/20161125/us-east-1/ec2/aws4_request,
SignedHeaders=content-type;host;x-amz-date,
Signature=26fb227ef12f22c2a95ee42cb5b1d673532eb3dc9a186858294710f0e91c7890
2016-11-25 16:02:53,545 DEBUG jclouds.headers [pool-3-thread-21]: >>
Content-Type: application/x-www-form-urlencoded
2016-11-25 16:02:53,545 DEBUG jclouds.headers [pool-3-thread-21]: >>
Content-Length: 70
2016-11-25 16:02:54,053 DEBUG o.j.h.i.JavaUrlHttpCommandExecutorService
[pool-3-thread-21]: Receiving response 250468421: HTTP/1.1 200 OK
2016-11-25 16:02:54,053 DEBUG jclouds.headers [pool-3-thread-21]: <<
HTTP/1.1 200 OK
2016-11-25 16:02:54,053 DEBUG jclouds.headers [pool-3-thread-21]: <<
Transfer-Encoding: chunked
2016-11-25 16:02:54,053 DEBUG jclouds.headers [pool-3-thread-21]: <<
Server: AmazonEC2
2016-11-25 16:02:54,053 DEBUG jclouds.headers [pool-3-thread-21]: << Vary:
Accept-Encoding
2016-11-25 16:02:54,053 DEBUG jclouds.headers [pool-3-thread-21]: << Date:
Fri, 25 Nov 2016 16:02:53 GMT
2016-11-25 16:02:54,053 DEBUG jclouds.headers [pool-3-thread-21]: <<
Content-Type: text/xml;charset=UTF-8
```
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
