edw1nzhao opened a new pull request, #9248: URL: https://github.com/apache/devlake/pull/9248
### Summary `Collect Releases` asks GitHub for `descriptionHTML` on every release, but `release_extractor.go` never reads it: it fills `DescriptionHTML` from `release.Description`. Rendering release notes to HTML for a page of 100 releases can exceed GitHub's GraphQL time limit when the notes are long. GitHub then returns 502/504, all three retries hit the same limit, and the subtask fails with `fetchPagesDetermined got pageInfo is nil`, leaving the pipeline `TASK_PARTIAL`. This removes the field from the query. Stored data is unchanged, because the extractor already sets the column from `description`. Measured on a repository with 86 releases and about 437 KB of release notes, using the collector's exact query at page size 100: | Query | Result | |---|---| | with `descriptionHTML` | 502 after ~11s | | without `descriptionHTML` | 200 in ~2.2s (3 of 3 runs) | ### Does this close any open issues? No existing issue. ### Other Information No new test. The extractor is unchanged, and the github_graphql e2e suite has no release fixtures. `go build`, `go vet` and `go test ./plugins/github_graphql/tasks/...` pass. Suggested label: `pr-type/bug-fix` (I can't set labels on this repo). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
