[
https://issues.apache.org/jira/browse/AIRFLOW-6981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17129723#comment-17129723
]
ASF GitHub Bot commented on AIRFLOW-6981:
-----------------------------------------
mik-laj commented on pull request #8575:
URL: https://github.com/apache/airflow/pull/8575#issuecomment-641510720
I saw that a new DAG was not added to the system tests. I prepared change -
https://termbin.com/7ezm
To add to your branch, run the following command:
```bash
curl https://termbin.com/7ezm | git am
```
When I did bug, I saw that there was a bug. One of the tasks ends with the
following error.
```
logs/previous_runs/2020-06-09_19_00_50/example_gcp_cloud_build_trigger/create_build_trigger/2020-06-08T00:00:00+00:00/1.log
```
```
[2020-06-09 19:00:33,927] {taskinstance.py:719} INFO - Dependencies all met
for <TaskInstance: example_gcp_cloud_build_trigger.create_build_trigger
2020-06-08T00:00:00+00:00 [queued]>
[2020-06-09 19:00:33,944] {taskinstance.py:719} INFO - Dependencies all met
for <TaskInstance: example_gcp_cloud_build_trigger.create_build_trigger
2020-06-08T00:00:00+00:00 [queued]>
[2020-06-09 19:00:33,945] {taskinstance.py:908} INFO -
--------------------------------------------------------------------------------
[2020-06-09 19:00:33,945] {taskinstance.py:909} INFO - Starting attempt 1 of
1
[2020-06-09 19:00:33,946] {taskinstance.py:910} INFO -
--------------------------------------------------------------------------------
[2020-06-09 19:00:33,953] {taskinstance.py:929} INFO - Executing
<Task(CloudBuildCreateBuildTriggerOperator): create_build_trigger> on
2020-06-08T00:00:00+00:00
[2020-06-09 19:00:33,957] {standard_task_runner.py:53} INFO - Started
process 9042 to run task
[2020-06-09 19:00:34,039] {logging_mixin.py:91} INFO - Running
<TaskInstance: example_gcp_cloud_build_trigger.create_build_trigger
2020-06-08T00:00:00+00:00 [None]> on host 70cf9669db62
[2020-06-09 19:00:34,067] {taskinstance.py:1001} INFO - Exporting the
following env vars:
AIRFLOW_CTX_DAG_OWNER=airflow
AIRFLOW_CTX_DAG_ID=example_gcp_cloud_build_trigger
AIRFLOW_CTX_TASK_ID=create_build_trigger
AIRFLOW_CTX_EXECUTION_DATE=2020-06-08T00:00:00+00:00
AIRFLOW_CTX_DAG_RUN_ID=backfill__2020-06-08T00:00:00+00:00
[2020-06-09 19:00:35,144] {taskinstance.py:1194} ERROR - 409 trigger
(198907790164, test-cloud-build-trigger) already exists
Traceback (most recent call last):
File
"/usr/local/lib/python3.8/site-packages/google/api_core/grpc_helpers.py", line
57, in error_remapped_callable
return callable_(*args, **kwargs)
File "/usr/local/lib/python3.8/site-packages/grpc/_channel.py", line 826,
in __call__
return _end_unary_response_blocking(state, call, False, None)
File "/usr/local/lib/python3.8/site-packages/grpc/_channel.py", line 729,
in _end_unary_response_blocking
raise _InactiveRpcError(state)
grpc._channel._InactiveRpcError: <_InactiveRpcError of RPC that terminated
with:
status = StatusCode.ALREADY_EXISTS
details = "trigger (198907790164, test-cloud-build-trigger) already
exists"
debug_error_string =
"{"created":"@1591729235.142798800","description":"Error received from peer
ipv4:216.58.215.74:443","file":"src/core/lib/surface/call.cc","file_line":1056,"grpc_message":"trigger
(198907790164, test-cloud-build-trigger) already exists","grpc_status":6}"
>
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/opt/airflow/airflow/models/taskinstance.py", line 1026, in
_run_raw_task
result = task_copy.execute(context=context)
File
"/opt/airflow/airflow/providers/google/cloud/operators/cloud_build.py", line
239, in execute
result = hook.create_build_trigger(
File "/opt/airflow/airflow/providers/google/common/hooks/base_google.py",
line 356, in inner_wrapper
return func(self, *args, **kwargs)
File "/opt/airflow/airflow/providers/google/cloud/hooks/cloud_build.py",
line 188, in create_build_trigger
return client.create_build_trigger(
File
"/usr/local/lib/python3.8/site-packages/google/cloud/devtools/cloudbuild_v1/gapic/cloud_build_client.py",
line 595, in create_build_trigger
return self._inner_api_calls["create_build_trigger"](
File
"/usr/local/lib/python3.8/site-packages/google/api_core/gapic_v1/method.py",
line 143, in __call__
return wrapped_func(*args, **kwargs)
File
"/usr/local/lib/python3.8/site-packages/google/api_core/grpc_helpers.py", line
59, in error_remapped_callable
six.raise_from(exceptions.from_grpc_error(exc), exc)
File "<string>", line 3, in raise_from
google.api_core.exceptions.AlreadyExists: 409 trigger (198907790164,
test-cloud-build-trigger) already exists
[2020-06-09 19:00:35,158] {taskinstance.py:1231} INFO - Marking task as
FAILED. dag_id=example_gcp_cloud_build_trigger, task_id=create_build_trigger,
execution_date=20200608T000000, start_date=20200609T190033,
end_date=20200609T190035
[2020-06-09 19:00:35,917] {logging_mixin.py:91} INFO - [2020-06-09
19:00:35,917] {local_task_job.py:103} INFO - Task exited with return code 1
```
Do you have an idea how to solve it?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
> Move Google Cloud Build from Discovery API to Python Library
> ------------------------------------------------------------
>
> Key: AIRFLOW-6981
> URL: https://issues.apache.org/jira/browse/AIRFLOW-6981
> Project: Apache Airflow
> Issue Type: Improvement
> Components: gcp
> Affects Versions: 2.0.0
> Reporter: Ryan Yuan
> Assignee: Ryan Yuan
> Priority: Major
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)