jackwills-op commented on issue #8634: URL: https://github.com/apache/incubator-devlake/issues/8634#issuecomment-3496952004
Ok so there's no issue with permissions from CircleCI side. From a DB point of view: I had to manually insert the projects into the `_tool_circleci_projects` table and then i was able to select the projects when adding the connection otherwise it would say no data found so i create the connection and then add the project and then the scope config and currently all circleci tool tables show: select * from _tool_circleci_accounts; Empty set (0.01 sec) select * from _tool_circleci_connections; +----+-------------------------+-------------------------+------+---------------------------+-------+---------------------+--------------------------------------------------------------------------------------------------------------+ | id | created_at | updated_at | name | endpoint | proxy | rate_limit_per_hour | token | +----+-------------------------+-------------------------+------+---------------------------+-------+---------------------+--------------------------------------------------------------------------------------------------------------+ | 1 | 2025-11-06 10:52:39.186 | 2025-11-06 10:52:39.186 | CCI | https://circleci.com/api/ | | 0 | aySg3xAv+2F1RhDrVzG2yYbnm6CFYHkjfrf14swPqIOW7x8LcZqPyQjN+rCi5Ru+1qsxz0mlwTcpktxxAURdLb/cJnb1jEQdXTSPlfyWkKk= | +----+-------------------------+-------------------------+------+---------------------------+-------+---------------------+-------------------------------------------------------------------------------------------------------- ------+ 1 row in set (0.00 sec) select * from _tool_circleci_jobs; Empty set (0.01 sec) select * from _tool_circleci_pipelines; Empty set (0.00 sec) select * from _tool_circleci_projects; +---------------+--------------------------------------+--------------------------------------------------------+-------------+--------------------------------------+-----------------+-------------------------+-------------------------+-------------------------------------------------------------------------------------------+----------------------+--------------+------------------+ | connection_id | id | slug | name | organization_id | scope_config_id | created_at | updated_at | _raw_data_params | _raw_data_table | _raw_data_id | _raw_data_remark | +---------------+--------------------------------------+--------------------------------------------------------+-------------+--------------------------------------+-----------------+-------------------------+-------------------------+-------------------------------------------------------------------------------------------+----------------------+--------------+------------------+ | 1 | 4f1a0be6-04b4-4274-a60e-22ea5c7f69ea | circleci /6tYeV1TQWvfmi1b9cxs1mm/AmXx1aZQ9FPmEwAmoogY6u | eir-backend | 2fb020d6-367d-43bf-b9a6-b52340681a44 | 1 | 2025-11-06 10:53:22.031 | 2025-11-06 10:53:56.929 | {"ConnectionId":1,"ProjectSlug":"circleci/6tYeV1TQWvfmi1b9cxs1mm/AmXx1aZQ9FPmEwAmoogY6u"} | _raw_circleci_scopes | 0 | | +---------------+--------------------------------------+--------------------------------------------------------+-------------+--------------------------------------+-----------------+-------------------------+-------------------------+-------------------------------------------------------------------------------------------+----------------------+--------------+------------------+ 1 row in set (0.00 sec) select * from _tool_circleci_scope_configs; +----+-------------------------+-------------------------+----------+---------------+-------------------+-----------------------------+--------------------+ | id | created_at | updated_at | entities | connection_id | name | deployment_pattern | production_pattern | +----+-------------------------+-------------------------+----------+---------------+-------------------+-----------------------------+--------------------+ | 1 | 2025-11-06 10:53:55.624 | 2025-11-06 10:53:55.624 | ["CICD"] | 1 | shared-config-<0> | (?i)^code_build_and_deploy$ | .* | +----+-------------------------+-------------------------+----------+---------------+-------------------+-----------------------------+--------------------+ 1 row in set (0.00 sec) select * from _tool_circleci_workflows; Empty set (0.01 sec) Also the cicd deployment tables are currently empty with no data - select * from cicd_deployments; Empty set (0.00 sec) select * from cicd_deployment_commits; Empty set (0.00 sec) Then i go and collect data and now the tables data have changed as follows: _tool_circleci_accounts; is still empty _tool_circleci_connections; is the same with the cci connection _tool_circleci_jobs; is now populated with 1589 rows _tool_circleci_pipelines; is now populated with 140 rows _tool_circleci_projects; is the same with the project present there _tool_circleci_scope_configs; is the same with the scope config from before _tool_circleci_workflows; is now populated with 139 rows cicd_deployments; is now populated with 105 rows cicd_deployment_commits; is EMPTY What are we missing to get the `cicd_deployment_commits` table populated correctly in this case? It's frustrating that we have a circleci connection option but it just doesn't work it feels half done. I will work with the webhook old approach for now but it'd be amazing if the circleci connection option can be fixed. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
