[
https://issues.apache.org/jira/browse/AIRFLOW-3114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16825042#comment-16825042
]
jack commented on AIRFLOW-3114:
-------------------------------
[~dariusz.aniszewski] Your PR [https://github.com/apache/airflow/pull/4354]
added the BigtableTableCreateOperator. However the operator doesn't allow to
create external table. Is the idea in this PR doable? The reference you
mentioned in the docs
[https://googleapis.github.io/google-cloud-python/latest/bigtable/table.html#google.cloud.bigtable.table.Table.create]
doesn't specify any info about external table.
> Add feature to create External BigQuery Table for querying Cloud Bigtable data
> ------------------------------------------------------------------------------
>
> Key: AIRFLOW-3114
> URL: https://issues.apache.org/jira/browse/AIRFLOW-3114
> Project: Apache Airflow
> Issue Type: Improvement
> Components: contrib, gcp, hooks
> Affects Versions: 1.10.0, 2.0.0
> Reporter: Akshar Dave
> Priority: Minor
>
> Currently using the BigQuery operator and the bq hook we can create an
> external BQ table but there is no way to create a permanent external table on
> Cloud Bigtable data.
> * For
> [externalDataConfiguration.sourceUris|https://cloud.google.com/bigquery/docs/reference/v2/tables#externalDataConfiguration.sourceUris],
> you can specify exactly one [Cloud Bigtable
> URI|https://cloud.google.com/bigquery/external-data-bigtable#bigtable-uri],
> and it must be a fully specified, valid HTTPS URL.
> * Specify the data format properties by setting the
> [externalDataConfiguration.sourceFormat|https://cloud.google.com/bigquery/docs/reference/v2/tables#externalDataConfiguration.sourceFormat]
> property. For Google Cloud Bigtable, specify {{"BIGTABLE"}}.
> Below are the links to Doc, Python Api and the JSON Rest API that can be
> helpful:
> [https://cloud.google.com/bigquery/external-data-bigtable]
> [https://cloud.google.com/bigquery/docs/reference/rest/v2/tables#externalDataConfiguration.sourceFormat]
> [https://cloud.google.com/bigquery/docs/reference/rest/v2/tables#externalDataConfiguration.sourceUris]
> [https://github.com/GoogleCloudPlatform/google-cloud-python/blob/38080c8920d20b01f06c1eaef79eb527525de552/bigquery/google/cloud/bigquery/external_config.py]
>
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
