klesh opened a new pull request, #4911: URL: https://github.com/apache/incubator-devlake/pull/4911
### Summary 1. fix: bitbucket repo_convertor missed cicd_scope conversion 2. fix: bitbucket pipeline convertor scoping / missed cicd_scope_id 3. feat: dora generate deployments from cicd pipelines/tasks ### Does this close any open issues? Part of #4869 ### Screenshots data source: https://bitbucket.org/zhenmianws/helloworldrepo/pipelines/results/page/1 input: _tool_bitbucket_pipelines ``` |connection_id|bitbucket_id |status |result |ref_name |web_url |duration_in_seconds|bitbucket_created_on |bitbucket_complete_on |created_at |updated_at |_raw_data_params |_raw_data_table |_raw_data_id|_raw_data_remark|repo_id |commit_sha |type|environment| |-------------|--------------------------------------|---------|----------|----------|------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|-------------------|-----------------------|-----------------------|-----------------------|-----------------------|---------------------------------------------------------|----------------------------|------------|----------------|-------------------------|----------------------------------------|----|-----------| |1 |{312ab723-f0b8-4435-95a5-69902e91aaab}|COMPLETED|FAILED |production|http://bitbucket-pipelines.prod.public.atl-paas.net//rest/1.0/accounts/{c73db91f-7e1f-40b1-808c-6a045a76028d}/repositories/{2fa17da2-1643-4a79-9948-934bbcef9481}/pipelines/{312ab723-f0b8-4435-95a5-69902e91aaab}|0 |2023-04-10 06:53:03.804|2023-04-10 06:53:03.788|2023-04-12 08:53:27.096|2023-04-12 08:53:27.096|{"ConnectionId":1,"FullName":"zhenmianws/helloworldrepo"}|_raw_bitbucket_api_pipelines|778 | |zhenmianws/helloworldrepo|ef4e9bdfa4259eb201ac8088410923bb04c04873| |PRODUCTION | |1 |{36e9e1d4-33c1-4321-9112-09e15ce57f00}|COMPLETED|SUCCESSFUL|master |http://bitbucket-pipelines.prod.public.atl-paas.net//rest/1.0/accounts/{c73db91f-7e1f-40b1-808c-6a045a76028d}/repositories/{2fa17da2-1643-4a79-9948-934bbcef9481}/pipelines/{36e9e1d4-33c1-4321-9112-09e15ce57f00}|14 |2023-04-10 06:51:08.154|2023-04-10 06:52:01.450|2023-04-12 08:53:27.096|2023-04-12 08:53:27.096|{"ConnectionId":1,"FullName":"zhenmianws/helloworldrepo"}|_raw_bitbucket_api_pipelines|776 | |zhenmianws/helloworldrepo|cb83612227bde32d9cf8b02b598b806f15ede7ec| | | |1 |{5a4ae573-8723-4ef5-9949-a8ff333fdfe4}|COMPLETED|FAILED |production|http://bitbucket-pipelines.prod.public.atl-paas.net//rest/1.0/accounts/{c73db91f-7e1f-40b1-808c-6a045a76028d}/repositories/{2fa17da2-1643-4a79-9948-934bbcef9481}/pipelines/{5a4ae573-8723-4ef5-9949-a8ff333fdfe4}|0 |2023-04-10 06:51:54.583|2023-04-10 06:51:54.558|2023-04-12 08:53:27.096|2023-04-12 08:53:27.096|{"ConnectionId":1,"FullName":"zhenmianws/helloworldrepo"}|_raw_bitbucket_api_pipelines|777 | |zhenmianws/helloworldrepo|498721b2def757482b289469c24d606cdf4f166f| |PRODUCTION | |1 |{b9ff0087-7621-4259-82de-37cd8a2e6f03}|COMPLETED|SUCCESSFUL|production|http://bitbucket-pipelines.prod.public.atl-paas.net//rest/1.0/accounts/{c73db91f-7e1f-40b1-808c-6a045a76028d}/repositories/{2fa17da2-1643-4a79-9948-934bbcef9481}/pipelines/{b9ff0087-7621-4259-82de-37cd8a2e6f03}|12 |2023-04-10 06:53:15.843|2023-04-10 06:54:03.299|2023-04-12 08:53:27.096|2023-04-12 08:53:27.096|{"ConnectionId":1,"FullName":"zhenmianws/helloworldrepo"}|_raw_bitbucket_api_pipelines|779 | |zhenmianws/helloworldrepo|cb83612227bde32d9cf8b02b598b806f15ede7ec| |PRODUCTION | ``` input: _tool_bitbucket_pipeline_steps ``` |pipeline_id |created_at |updated_at |_raw_data_params |_raw_data_table |_raw_data_id|_raw_data_remark|commit_sha |branch |repo_url |repo_id |pipeline_name |result |status|duration_sec|created_date |finished_date |environment|has_staging_tasks|has_production_tasks| |--------------------------------------------------------------------|-----------------------|-----------------------|---------------------------------------------------------|----------------------------|------------|----------------|----------------------------------------|----------|-----------------------------------------------|---------------------------------------------------|----------------------------------------|-------|------|------------|-----------------------|-----------------------|-----------|-----------------|--------------------| |bitbucket:BitbucketPipeline:1:{36e9e1d4-33c1-4321-9112-09e15ce57f00}|2023-04-12 08:53:27.789|2023-04-12 08:53:27.789|{"ConnectionId":1,"FullName":"zhenmianws/helloworldrepo"}|_raw_bitbucket_api_pipelines|776 | |cb83612227bde32d9cf8b02b598b806f15ede7ec|master |https://bitbucket.org/zhenmianws/helloworldrepo|bitbucket:BitbucketRepo:1:zhenmianws/helloworldrepo|bitbucket:BitbucketPipeline:1:master |SUCCESS|DONE |14 |2023-04-10 06:51:08.154|2023-04-10 06:52:01.450| |0 |0 | |bitbucket:BitbucketPipeline:1:{b9ff0087-7621-4259-82de-37cd8a2e6f03}|2023-04-12 08:53:27.789|2023-04-12 08:53:27.789|{"ConnectionId":1,"FullName":"zhenmianws/helloworldrepo"}|_raw_bitbucket_api_pipelines|779 | |cb83612227bde32d9cf8b02b598b806f15ede7ec|production|https://bitbucket.org/zhenmianws/helloworldrepo|bitbucket:BitbucketRepo:1:zhenmianws/helloworldrepo|bitbucket:BitbucketPipeline:1:production|SUCCESS|DONE |12 |2023-04-10 06:53:15.843|2023-04-10 06:54:03.299|PRODUCTION |0 |0 | ``` output: cicd_deployment_commits ``` |id |created_at |updated_at |_raw_data_params |_raw_data_table |_raw_data_id|_raw_data_remark|cicd_scope_id |cicd_pipeline_id |name |result |status|environment|created_date |started_date |duration_sec|commit_sha |ref_name |repo_id |repo_url |prev_success_deployment_commit_id| |--------------------------------------------------------------------------------------------------------------------|-----------------------|-----------------------|---------------------------------------------------------|----------------------------|------------|----------------|---------------------------------------------------|--------------------------------------------------------------------|----------------------------------------|-------|------|-----------|-----------------------|-----------------------|------------|----------------------------------------|----------|---------------------------------------------------|-----------------------------------------------|---------------------------------| |bitbucket:BitbucketPipeline:1:{36e9e1d4-33c1-4321-9112-09e15ce57f00}:https://bitbucket.org/zhenmianws/helloworldrepo|2023-04-12 08:41:54.584|2023-04-12 09:28:09.305|{"ConnectionId":1,"FullName":"zhenmianws/helloworldrepo"}|_raw_bitbucket_api_pipelines|776 | |bitbucket:BitbucketRepo:1:zhenmianws/helloworldrepo|bitbucket:BitbucketPipeline:1:{36e9e1d4-33c1-4321-9112-09e15ce57f00}|bitbucket:BitbucketPipeline:1:master |SUCCESS|DONE |TESTING |2023-04-10 06:51:08.154|2023-04-10 06:51:47.450|14 |cb83612227bde32d9cf8b02b598b806f15ede7ec|master |bitbucket:BitbucketRepo:1:zhenmianws/helloworldrepo|https://bitbucket.org/zhenmianws/helloworldrepo| | |bitbucket:BitbucketPipeline:1:{b9ff0087-7621-4259-82de-37cd8a2e6f03}:https://bitbucket.org/zhenmianws/helloworldrepo|2023-04-12 08:41:54.584|2023-04-12 09:28:09.305|{"ConnectionId":1,"FullName":"zhenmianws/helloworldrepo"}|_raw_bitbucket_api_pipelines|779 | |bitbucket:BitbucketRepo:1:zhenmianws/helloworldrepo|bitbucket:BitbucketPipeline:1:{b9ff0087-7621-4259-82de-37cd8a2e6f03}|bitbucket:BitbucketPipeline:1:production|SUCCESS|DONE |PRODUCTION |2023-04-10 06:53:15.843|2023-04-10 06:53:51.299|12 |cb83612227bde32d9cf8b02b598b806f15ede7ec|production|bitbucket:BitbucketRepo:1:zhenmianws/helloworldrepo|https://bitbucket.org/zhenmianws/helloworldrepo| | ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
