[
https://issues.apache.org/jira/browse/AIRFLOW-2902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16891301#comment-16891301
]
jack commented on AIRFLOW-2902:
-------------------------------
[~fbidu] By direct I meant Mongo to Google Storage and then you can use the
existed GoogleStorageToBigQueryOperator.
There is no need to S3 nor any AWS service for what you want to do.
Don't forget that no any one that uses Mongo and BigQuery has AWS account so
you can not have AWS in the middle.
> Add S3ToBigQuery operator
> -------------------------
>
> Key: AIRFLOW-2902
> URL: https://issues.apache.org/jira/browse/AIRFLOW-2902
> Project: Apache Airflow
> Issue Type: Wish
> Components: gcp, operators
> Affects Versions: 1.10.0
> Reporter: jack
> Priority: Major
>
> Please add operators that allow to move data between Amazon and Google
> services.
> I saw there is
> [S3ToHiveTransfer|https://airflow.apache.org/integration.html#s3tohivetransfer]
> operator... It described as:
> "Moves data from S3 to Hive. The operator downloads a file from S3, stores
> the file locally before loading it into a Hive table."
>
> So what I'm asking here is very similar.
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)
