[ 
https://issues.apache.org/jira/browse/NIFI-14355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17935257#comment-17935257
 ] 

ASF subversion and git services commented on NIFI-14355:
--------------------------------------------------------

Commit baa35628b0d2e4f839bc355caa0702a63d939bc7 in nifi's branch 
refs/heads/main from Pierre Villard
[ https://gitbox.apache.org/repos/asf?p=nifi.git;h=baa35628b0 ]

NIFI-14355 Changed Flow Registry sync frequency from 1 minute to 30 minutes 
(#9797)

Signed-off-by: David Handermann <exceptionfact...@apache.org>

> Authenticated GitHub Registry Client hitting rate limit (5000 reqs per hour)
> ----------------------------------------------------------------------------
>
>                 Key: NIFI-14355
>                 URL: https://issues.apache.org/jira/browse/NIFI-14355
>             Project: Apache NiFi
>          Issue Type: Improvement
>          Components: Flow Versioning, NiFi Registry
>    Affects Versions: 2.2.0
>         Environment: Not relevant
>            Reporter: Andrea Di Stefano
>            Assignee: Pierre Villard
>            Priority: Major
>         Attachments: image-2025-03-11-16-47-39-522.png
>
>          Time Spent: 20m
>  Remaining Estimate: 0h
>
> Hello.
> We are using the GitHub Registry Client with a Personal Authentication Token 
> (PAT) and constantly hitting the API rate limit. The rate limit, [as stated 
> in the GitHub 
> docs|https://docs.github.com/en/rest/using-the-rest-api/rate-limits-for-the-rest-api?apiVersion=2022-11-28#primary-rate-limit-for-authenticated-users],
>  is 5000 requests per hour. 
> We have a pipeline with 53 instances of 3 versioned process groups, which are 
> part of a bigger pipeline (~1.1k components).
> I uploaded a related stack trace [here|https://pastebin.com/R0tTw4bP].
> Calling the GitHub API with Postman, we saw that the response headers include 
> data about the rate limit, current usage, and reset time in Unix epoch 
> format, see the attached screenshot for an example:
> !image-2025-03-11-16-47-39-522.png!
> Is NiFi periodically polling the GitHub API in background? 
> Can we somehow limit the number of calls?
>  



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to