Joel Croteau created AIRFLOW-5104:
-------------------------------------
Summary: "Schedule was not specified." error from GCS API when
using gcp_transfer_operator.S3ToGoogleCloudStorageTransferOperator without
specifying a schedule
Key: AIRFLOW-5104
URL: https://issues.apache.org/jira/browse/AIRFLOW-5104
Project: Apache Airflow
Issue Type: Bug
Components: contrib, gcp
Affects Versions: 1.10.3
Reporter: Joel Croteau
The docstring for
`airflow.contrib.operators.gcp_transfer_operator.S3ToGoogleCloudStorageTransferOperator`
says of the `schedule` parameter:
{{Optional transfer service schedule;
If not set, run transfer job once as soon as the operator runs}}
This isn't the way the operator is actually implemented though. If `schedule`
is unset, the operator provides to `schedule` parameter in the REST API call,
which causes the API to return this error:
{{HttpError 400 when requesting
[https://storagetransfer.googleapis.com/v1/transferJobs?alt=json] returned
"Schedule was not specified."}}
It's not well-described in [the official
documentation|https://cloud.google.com/storage-transfer/docs/reference/rest/v1/transferJobs],
but it seems the REST API actually does require a `schedule` parameter to be
provided, and fails if it isn't.
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)
