[
https://issues.apache.org/jira/browse/LIBCLOUD-991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16431708#comment-16431708
]
Quentin Pradet commented on LIBCLOUD-991:
-----------------------------------------
Ah, you're right! So this functionality exists in two places: Ansible and
Libcloud itself, and we were about to add it in a third place!
I think you need to use driver.ex_list(driver.list_nodes) instead of calling
driver.list_nodes() directly. Then you get an iterator that you can use (no
need to call page()). See
https://github.com/apache/libcloud/blob/9702f72b57f9b1372c289146a20cf201a0d6ea5d/libcloud/compute/drivers/gce.py#L241-L247.
I think Ansible should have done that too, but they probably did not see the
GCEList feature, just like me. Sorry, even if I can approve pull requests, I'm
still quite new to libcloud.
Feel free to close the issue if your problem is solved.
> Can not retrieve more than 500VM on Google cloud
> ------------------------------------------------
>
> Key: LIBCLOUD-991
> URL: https://issues.apache.org/jira/browse/LIBCLOUD-991
> Project: Libcloud
> Issue Type: Bug
> Components: Compute
> Environment: Google cloud project with more than 500VMs (python 3 and
> last libcloud version AVL on pip)
> Reporter: charles walker
> Priority: Minor
>
> Today I notice that some of our VMs were not retrieve by our internal
> toolings. After some investigation it seems that libcloud "list_nodes()"
> method on google can only retrieve max 500VMs:
>
> [root@stackviewer-5cbcd8695-x964t /]# grep -o Vm response.log | wc -l
> 500
>
> when we have in reality around 750 VMs. So i had a quick look and my first
> guess is that it comes from the call made by liblcoud using this REST API:
> [https://cloud.google.com/compute/docs/reference/rest/v1/instances/aggregatedList]
> with an optional argument "maxResults" that has a default value of 500 (which
> seems also to be the max value BTW). I think i m on the good lead due to this
> 500 limit mentioned in the doc and also observe on my side.
> I will have a deeper look but just quickly open this ticket in case other
> people already saw this limit
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
