[jira] [Assigned] (AIRFLOW-3326) High Sierra Complaining 'in progress in another thread when fork() was called'

2019-01-15 Thread Ryan Yuan (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Yuan reassigned AIRFLOW-3326: -- Assignee: (was: Ryan Yuan) > High Sierra Complaining 'in progress in another thread

[jira] [Assigned] (AIRFLOW-4236) Operators uploading to GCS needs to handle googleapiclient.errors

2019-04-04 Thread Ryan Yuan (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Yuan reassigned AIRFLOW-4236: -- Assignee: Ryan Yuan > Operators uploading to GCS needs to handle googleapiclient.errors >

[jira] [Commented] (AIRFLOW-3326) High Sierra Complaining 'in progress in another thread when fork() was called'

2019-03-03 Thread Ryan Yuan (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16782914#comment-16782914 ] Ryan Yuan commented on AIRFLOW-3326: [~AetherUnbound] It's v2.7.15 > High Sierra Complaining 'in

[jira] [Closed] (AIRFLOW-3966) Correct default bigquery_conn_id in BigQueryTableSensor

2019-03-03 Thread Ryan Yuan (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Yuan closed AIRFLOW-3966. -- Resolution: Won't Fix This will be fixed as part of 

[jira] [Updated] (AIRFLOW-3987) Unify GCP's Connection IDs

2019-03-02 Thread Ryan Yuan (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Yuan updated AIRFLOW-3987: --- Description: Current Airflow uses 4 different connections, `google_cloud_default`, 

[jira] [Work started] (AIRFLOW-3933) Fix various typos

2019-02-20 Thread Ryan Yuan (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on AIRFLOW-3933 started by Ryan Yuan. -- > Fix various typos > - > > Key: AIRFLOW-3933 >

[jira] [Created] (AIRFLOW-3933) Fix various typos

2019-02-20 Thread Ryan Yuan (JIRA)
Ryan Yuan created AIRFLOW-3933: -- Summary: Fix various typos Key: AIRFLOW-3933 URL: https://issues.apache.org/jira/browse/AIRFLOW-3933 Project: Apache Airflow Issue Type: Improvement

[jira] [Work started] (AIRFLOW-3966) Correct default bigquery_conn_id in BigQueryTableSensor

2019-02-26 Thread Ryan Yuan (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on AIRFLOW-3966 started by Ryan Yuan. -- > Correct default bigquery_conn_id in BigQueryTableSensor >

[jira] [Created] (AIRFLOW-3966) Correct default bigquery_conn_id in BigQueryTableSensor

2019-02-26 Thread Ryan Yuan (JIRA)
Ryan Yuan created AIRFLOW-3966: -- Summary: Correct default bigquery_conn_id in BigQueryTableSensor Key: AIRFLOW-3966 URL: https://issues.apache.org/jira/browse/AIRFLOW-3966 Project: Apache Airflow

[jira] [Assigned] (AIRFLOW-3326) High Sierra Complaining 'in progress in another thread when fork() was called'

2019-03-04 Thread Ryan Yuan (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Yuan reassigned AIRFLOW-3326: -- Assignee: (was: Ryan Yuan) > High Sierra Complaining 'in progress in another thread

[jira] [Work started] (AIRFLOW-4009) Fix docstring issue in GoogleCloudStorageToBigQueryOperator

2019-03-04 Thread Ryan Yuan (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on AIRFLOW-4009 started by Ryan Yuan. -- > Fix docstring issue in GoogleCloudStorageToBigQueryOperator >

[jira] [Work stopped] (AIRFLOW-3326) High Sierra Complaining 'in progress in another thread when fork() was called'

2019-03-04 Thread Ryan Yuan (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on AIRFLOW-3326 stopped by Ryan Yuan. -- > High Sierra Complaining 'in progress in another thread when fork() was called'

[jira] [Work started] (AIRFLOW-3326) High Sierra Complaining 'in progress in another thread when fork() was called'

2019-03-04 Thread Ryan Yuan (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on AIRFLOW-3326 started by Ryan Yuan. -- > High Sierra Complaining 'in progress in another thread when fork() was called'

[jira] [Updated] (AIRFLOW-4009) Fix docstring issue in GoogleCloudStorageToBigQueryOperator

2019-03-04 Thread Ryan Yuan (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Yuan updated AIRFLOW-4009: --- Description: The description for parameter destination_project_dataset_table is incorrect as the

[jira] [Created] (AIRFLOW-4009) Fix docstring issue in GoogleCloudStorageToBigQueryOperator

2019-03-04 Thread Ryan Yuan (JIRA)
Ryan Yuan created AIRFLOW-4009: -- Summary: Fix docstring issue in GoogleCloudStorageToBigQueryOperator Key: AIRFLOW-4009 URL: https://issues.apache.org/jira/browse/AIRFLOW-4009 Project: Apache Airflow

[jira] [Updated] (AIRFLOW-3948) Operator list as templated field issue

2019-03-05 Thread Ryan Yuan (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Yuan updated AIRFLOW-3948: --- Description: Fixing issue with operators' list as templated field issue   For example, with

[jira] [Work started] (AIRFLOW-3948) GCSToBQOperator list as templating field issue

2019-02-24 Thread Ryan Yuan (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on AIRFLOW-3948 started by Ryan Yuan. -- > GCSToBQOperator list as templating field issue >

[jira] [Created] (AIRFLOW-3948) GCSToBQOperator list as templating field issue

2019-02-24 Thread Ryan Yuan (JIRA)
Ryan Yuan created AIRFLOW-3948: -- Summary: GCSToBQOperator list as templating field issue Key: AIRFLOW-3948 URL: https://issues.apache.org/jira/browse/AIRFLOW-3948 Project: Apache Airflow Issue

[jira] [Created] (AIRFLOW-4023) Fix DataProcOperator templating field names

2019-03-05 Thread Ryan Yuan (JIRA)
Ryan Yuan created AIRFLOW-4023: -- Summary: Fix DataProcOperator templating field names Key: AIRFLOW-4023 URL: https://issues.apache.org/jira/browse/AIRFLOW-4023 Project: Apache Airflow Issue

[jira] [Work started] (AIRFLOW-4023) Fix DataProcOperator templating field names

2019-03-05 Thread Ryan Yuan (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on AIRFLOW-4023 started by Ryan Yuan. -- > Fix DataProcOperator templating field names >

[jira] [Created] (AIRFLOW-3987) Unify GCP's Connection IDs

2019-03-01 Thread Ryan Yuan (JIRA)
Ryan Yuan created AIRFLOW-3987: -- Summary: Unify GCP's Connection IDs Key: AIRFLOW-3987 URL: https://issues.apache.org/jira/browse/AIRFLOW-3987 Project: Apache Airflow Issue Type: Improvement

[jira] [Work started] (AIRFLOW-3987) Unify GCP's Connection IDs

2019-03-01 Thread Ryan Yuan (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on AIRFLOW-3987 started by Ryan Yuan. -- > Unify GCP's Connection IDs > -- > >

[jira] [Assigned] (AIRFLOW-4074) Cannot put labels on Cloud Dataproc jobs

2019-03-12 Thread Ryan Yuan (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Yuan reassigned AIRFLOW-4074: -- Assignee: Ryan Yuan > Cannot put labels on Cloud Dataproc jobs >

[jira] [Commented] (AIRFLOW-3362) Template to support jinja2 native python types

2019-03-07 Thread Ryan Yuan (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16786655#comment-16786655 ] Ryan Yuan commented on AIRFLOW-3362: [~duanshiqiang] Are you working on this ticket? If not, can I

[jira] [Closed] (AIRFLOW-4023) Fix DataProcOperator templating field names

2019-03-05 Thread Ryan Yuan (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Yuan closed AIRFLOW-4023. -- Resolution: Not A Problem > Fix DataProcOperator templating field names >

[jira] [Assigned] (AIRFLOW-3362) Template to support jinja2 native python types

2019-03-07 Thread Ryan Yuan (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Yuan reassigned AIRFLOW-3362: -- Assignee: Ryan Yuan > Template to support jinja2 native python types >

[jira] [Resolved] (AIRFLOW-4009) Fix docstring issue in GoogleCloudStorageToBigQueryOperator

2019-03-09 Thread Ryan Yuan (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Yuan resolved AIRFLOW-4009. Resolution: Fixed > Fix docstring issue in GoogleCloudStorageToBigQueryOperator >

[jira] [Resolved] (AIRFLOW-3762) Add list_jobs to CLI

2019-02-13 Thread Ryan Yuan (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Yuan resolved AIRFLOW-3762. Resolution: Done > Add list_jobs to CLI > > > Key:

[jira] [Updated] (AIRFLOW-3874) Improve BigQueryHook.run_with_configuration's location support

2019-02-11 Thread Ryan Yuan (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Yuan updated AIRFLOW-3874: --- Issue Type: Improvement (was: New Feature) > Improve BigQueryHook.run_with_configuration's

[jira] [Work started] (AIRFLOW-3874) Improve BigQueryHook.run_with_configuration's location support

2019-02-11 Thread Ryan Yuan (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on AIRFLOW-3874 started by Ryan Yuan. -- > Improve BigQueryHook.run_with_configuration's location support >

[jira] [Created] (AIRFLOW-3874) Improve BigQueryHook.run_with_configuration's location support

2019-02-11 Thread Ryan Yuan (JIRA)
Ryan Yuan created AIRFLOW-3874: -- Summary: Improve BigQueryHook.run_with_configuration's location support Key: AIRFLOW-3874 URL: https://issues.apache.org/jira/browse/AIRFLOW-3874 Project: Apache Airflow

[jira] [Created] (AIRFLOW-3896) Add running command logging back to SSHOperator

2019-02-15 Thread Ryan Yuan (JIRA)
Ryan Yuan created AIRFLOW-3896: -- Summary: Add running command logging back to SSHOperator Key: AIRFLOW-3896 URL: https://issues.apache.org/jira/browse/AIRFLOW-3896 Project: Apache Airflow Issue

[jira] [Work started] (AIRFLOW-3896) Add running command logging back to SSHOperator

2019-02-15 Thread Ryan Yuan (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on AIRFLOW-3896 started by Ryan Yuan. -- > Add running command logging back to SSHOperator >

[jira] [Assigned] (AIRFLOW-3754) Google Cloud Storage Hook to take in Stream/String from an URL

2019-01-29 Thread Ryan Yuan (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Yuan reassigned AIRFLOW-3754: -- Assignee: (was: Ryan Yuan) > Google Cloud Storage Hook to take in Stream/String from an

[jira] [Created] (AIRFLOW-3762) Add list_jobs to CLI

2019-01-24 Thread Ryan Yuan (JIRA)
Ryan Yuan created AIRFLOW-3762: -- Summary: Add list_jobs to CLI Key: AIRFLOW-3762 URL: https://issues.apache.org/jira/browse/AIRFLOW-3762 Project: Apache Airflow Issue Type: New Feature

[jira] [Created] (AIRFLOW-3799) Add compose to GoogleCloudStorageHook

2019-02-01 Thread Ryan Yuan (JIRA)
Ryan Yuan created AIRFLOW-3799: -- Summary: Add compose to GoogleCloudStorageHook Key: AIRFLOW-3799 URL: https://issues.apache.org/jira/browse/AIRFLOW-3799 Project: Apache Airflow Issue Type: New

[jira] [Work started] (AIRFLOW-3799) Add compose to GoogleCloudStorageHook

2019-02-01 Thread Ryan Yuan (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on AIRFLOW-3799 started by Ryan Yuan. -- > Add compose to GoogleCloudStorageHook > - >

[jira] [Created] (AIRFLOW-3808) Add cluster_fields to BigQueryHook's create_empty_table

2019-02-05 Thread Ryan Yuan (JIRA)
Ryan Yuan created AIRFLOW-3808: -- Summary: Add cluster_fields to BigQueryHook's create_empty_table Key: AIRFLOW-3808 URL: https://issues.apache.org/jira/browse/AIRFLOW-3808 Project: Apache Airflow

[jira] [Work started] (AIRFLOW-3808) Add cluster_fields to BigQueryHook's create_empty_table

2019-02-05 Thread Ryan Yuan (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on AIRFLOW-3808 started by Ryan Yuan. -- > Add cluster_fields to BigQueryHook's create_empty_table >

[jira] [Created] (AIRFLOW-4335) Add default num_retries to GCP connection

2019-04-16 Thread Ryan Yuan (JIRA)
Ryan Yuan created AIRFLOW-4335: -- Summary: Add default num_retries to GCP connection Key: AIRFLOW-4335 URL: https://issues.apache.org/jira/browse/AIRFLOW-4335 Project: Apache Airflow Issue Type:

[jira] [Work started] (AIRFLOW-4356) Add numWorkers and additionalUserLabels to DataFlowHook

2019-04-18 Thread Ryan Yuan (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on AIRFLOW-4356 started by Ryan Yuan. -- > Add numWorkers and additionalUserLabels to DataFlowHook >

[jira] [Created] (AIRFLOW-4356) Add numWorkers and additionalUserLabels to DataFlowHook

2019-04-18 Thread Ryan Yuan (JIRA)
Ryan Yuan created AIRFLOW-4356: -- Summary: Add numWorkers and additionalUserLabels to DataFlowHook Key: AIRFLOW-4356 URL: https://issues.apache.org/jira/browse/AIRFLOW-4356 Project: Apache Airflow

[jira] [Commented] (AIRFLOW-4575) Operators using BigQueryHook need to provide location field

2019-05-30 Thread Ryan Yuan (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16852472#comment-16852472 ] Ryan Yuan commented on AIRFLOW-4575: [~sdevani] Do they have their own gcs_to_bq operator?

[jira] [Work started] (AIRFLOW-4746) Implement GCP Cloud Tasks' Hook and Operators

2019-06-07 Thread Ryan Yuan (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on AIRFLOW-4746 started by Ryan Yuan. -- > Implement GCP Cloud Tasks' Hook and Operators >

[jira] [Updated] (AIRFLOW-4746) Implement GCP Cloud Tasks' Hook and Operators

2019-06-07 Thread Ryan Yuan (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Yuan updated AIRFLOW-4746: --- Summary: Implement GCP Cloud Tasks' Hook and Operators (was: Imlement GCP Cloud Tasks' Hook and

[jira] [Created] (AIRFLOW-4746) Imlement GCP Cloud Tasks' Hook and Operators

2019-06-07 Thread Ryan Yuan (JIRA)
Ryan Yuan created AIRFLOW-4746: -- Summary: Imlement GCP Cloud Tasks' Hook and Operators Key: AIRFLOW-4746 URL: https://issues.apache.org/jira/browse/AIRFLOW-4746 Project: Apache Airflow Issue

[jira] [Commented] (AIRFLOW-4575) Operators using BigQueryHook need to provide location field

2019-05-29 Thread Ryan Yuan (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16851489#comment-16851489 ] Ryan Yuan commented on AIRFLOW-4575: [~sdevani], which version of Airflow are you using? >

[jira] [Created] (AIRFLOW-4779) Implement GCP Stackdriver' Hook and Operators

2019-06-11 Thread Ryan Yuan (JIRA)
Ryan Yuan created AIRFLOW-4779: -- Summary: Implement GCP Stackdriver' Hook and Operators Key: AIRFLOW-4779 URL: https://issues.apache.org/jira/browse/AIRFLOW-4779 Project: Apache Airflow Issue

[jira] [Commented] (AIRFLOW-3512) Create GCP Memorystore Redis Operators

2019-06-11 Thread Ryan Yuan (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16861730#comment-16861730 ] Ryan Yuan commented on AIRFLOW-3512: [~kamil.bregula] Cool! Please take this ticket. > Create GCP

[jira] [Assigned] (AIRFLOW-4074) Cannot put labels on Cloud Dataproc jobs

2019-06-11 Thread Ryan Yuan (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Yuan reassigned AIRFLOW-4074: -- Assignee: (was: Ryan Yuan) > Cannot put labels on Cloud Dataproc jobs >

[jira] [Work started] (AIRFLOW-4779) Implement GCP Stackdriver' Hook and Operators

2019-06-11 Thread Ryan Yuan (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on AIRFLOW-4779 started by Ryan Yuan. -- > Implement GCP Stackdriver' Hook and Operators >

[jira] [Created] (AIRFLOW-4811) Implement GCP DLP' Hook and Operators

2019-06-18 Thread Ryan Yuan (JIRA)
Ryan Yuan created AIRFLOW-4811: -- Summary: Implement GCP DLP' Hook and Operators Key: AIRFLOW-4811 URL: https://issues.apache.org/jira/browse/AIRFLOW-4811 Project: Apache Airflow Issue Type: New

[jira] [Work started] (AIRFLOW-4811) Implement GCP DLP' Hook and Operators

2019-06-18 Thread Ryan Yuan (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on AIRFLOW-4811 started by Ryan Yuan. -- > Implement GCP DLP' Hook and Operators > - >

[jira] [Closed] (AIRFLOW-4477) Add v2.models to BigQueryHook

2019-06-12 Thread Ryan Yuan (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Yuan closed AIRFLOW-4477. -- Resolution: Won't Do > Add v2.models to BigQueryHook > - > >

[jira] [Created] (AIRFLOW-4477) Add v2.models to BigQueryHook

2019-05-08 Thread Ryan Yuan (JIRA)
Ryan Yuan created AIRFLOW-4477: -- Summary: Add v2.models to BigQueryHook Key: AIRFLOW-4477 URL: https://issues.apache.org/jira/browse/AIRFLOW-4477 Project: Apache Airflow Issue Type: Improvement

[jira] [Work started] (AIRFLOW-4477) Add v2.models to BigQueryHook

2019-05-08 Thread Ryan Yuan (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on AIRFLOW-4477 started by Ryan Yuan. -- > Add v2.models to BigQueryHook > - > >

[jira] [Commented] (AIRFLOW-4897) Location not used to create empty dataset by bigquery_hook cursor

2019-07-06 Thread Ryan Yuan (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16879644#comment-16879644 ] Ryan Yuan commented on AIRFLOW-4897: [~kaxilnaik] Do you think if we can just treat 

[jira] [Work started] (AIRFLOW-4931) Add KMS Encryption Configuration to BigQuery Hook and Operators

2019-07-11 Thread Ryan Yuan (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on AIRFLOW-4931 started by Ryan Yuan. -- > Add KMS Encryption Configuration to BigQuery Hook and Operators >

[jira] [Created] (AIRFLOW-4931) Add KMS Encryption Configuration to BigQuery Hook and Operators

2019-07-11 Thread Ryan Yuan (JIRA)
Ryan Yuan created AIRFLOW-4931: -- Summary: Add KMS Encryption Configuration to BigQuery Hook and Operators Key: AIRFLOW-4931 URL: https://issues.apache.org/jira/browse/AIRFLOW-4931 Project: Apache

[jira] [Work started] (AIRFLOW-4886) Add routines methods to BigQuery Hooks and Operators

2019-07-02 Thread Ryan Yuan (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on AIRFLOW-4886 started by Ryan Yuan. -- > Add routines methods to BigQuery Hooks and Operators >

[jira] [Created] (AIRFLOW-4886) Add routines methods to BigQuery Hooks and Operators

2019-07-02 Thread Ryan Yuan (JIRA)
Ryan Yuan created AIRFLOW-4886: -- Summary: Add routines methods to BigQuery Hooks and Operators Key: AIRFLOW-4886 URL: https://issues.apache.org/jira/browse/AIRFLOW-4886 Project: Apache Airflow

[jira] [Updated] (AIRFLOW-4908) Implement BigQuery Hooks/Operators for update_dataset, patch_dataset and get_dataset

2019-07-08 Thread Ryan Yuan (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Yuan updated AIRFLOW-4908: --- Description: To create a BigQuery sink for GCP Stackdriver Logging, I have to assign `WRITER`

[jira] [Created] (AIRFLOW-4908) Implement BigQueryHook's update_dataset and patch_dataset

2019-07-07 Thread Ryan Yuan (JIRA)
Ryan Yuan created AIRFLOW-4908: -- Summary: Implement BigQueryHook's update_dataset and patch_dataset Key: AIRFLOW-4908 URL: https://issues.apache.org/jira/browse/AIRFLOW-4908 Project: Apache Airflow

[jira] [Updated] (AIRFLOW-4356) Add extra RuntimeEnvironment keys to DataFlowHook

2019-04-22 Thread Ryan Yuan (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Yuan updated AIRFLOW-4356: --- Description: Add numWorkers and additionalUserLabels and additionalExperiments to DataFlowHook's 

[jira] [Updated] (AIRFLOW-4356) Add extra RuntimeEnvironment keys to DataFlowHook

2019-04-22 Thread Ryan Yuan (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Yuan updated AIRFLOW-4356: --- Summary: Add extra RuntimeEnvironment keys to DataFlowHook (was: Add numWorkers and

[jira] [Updated] (AIRFLOW-5129) Add typehint to gcp_dlp_hook.py

2019-09-01 Thread Ryan Yuan (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Yuan updated AIRFLOW-5129: --- Issue Type: Improvement (was: New Feature) Priority: Minor (was: Major) > Add typehint to

[jira] [Created] (AIRFLOW-5370) Add typehint to GCP's Task Hook

2019-09-01 Thread Ryan Yuan (Jira)
Ryan Yuan created AIRFLOW-5370: -- Summary: Add typehint to GCP's Task Hook Key: AIRFLOW-5370 URL: https://issues.apache.org/jira/browse/AIRFLOW-5370 Project: Apache Airflow Issue Type:

[jira] [Assigned] (AIRFLOW-3362) Template to support jinja2 native python types

2019-09-01 Thread Ryan Yuan (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-3362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Yuan reassigned AIRFLOW-3362: -- Assignee: (was: Ryan Yuan) > Template to support jinja2 native python types >

[jira] [Work started] (AIRFLOW-5129) Add typehint to gcp_dlp_hook.py

2019-08-06 Thread Ryan Yuan (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on AIRFLOW-5129 started by Ryan Yuan. -- > Add typehint to gcp_dlp_hook.py > --- > >

[jira] [Created] (AIRFLOW-5129) Add typehint to gcp_dlp_hook.py

2019-08-06 Thread Ryan Yuan (JIRA)
Ryan Yuan created AIRFLOW-5129: -- Summary: Add typehint to gcp_dlp_hook.py Key: AIRFLOW-5129 URL: https://issues.apache.org/jira/browse/AIRFLOW-5129 Project: Apache Airflow Issue Type: New

[jira] [Created] (AIRFLOW-5013) Add GCP Data Catalog Hook and Operators

2019-07-21 Thread Ryan Yuan (JIRA)
Ryan Yuan created AIRFLOW-5013: -- Summary: Add GCP Data Catalog Hook and Operators Key: AIRFLOW-5013 URL: https://issues.apache.org/jira/browse/AIRFLOW-5013 Project: Apache Airflow Issue Type:

[jira] [Work started] (AIRFLOW-5013) Add GCP Data Catalog Hook and Operators

2019-07-21 Thread Ryan Yuan (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on AIRFLOW-5013 started by Ryan Yuan. -- > Add GCP Data Catalog Hook and Operators >

[jira] [Assigned] (AIRFLOW-3512) Create GCP Memorystore Redis Operators

2019-07-18 Thread Ryan Yuan (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Yuan reassigned AIRFLOW-3512: -- Assignee: Kamil Bregula (was: Ryan Yuan) > Create GCP Memorystore Redis Operators >

[jira] [Commented] (AIRFLOW-5025) DataflowPythonOperator uses Python2

2019-07-23 Thread Ryan Yuan (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16891469#comment-16891469 ] Ryan Yuan commented on AIRFLOW-5025: Duplicated.

[jira] [Created] (AIRFLOW-4964) Add BigQuery Data Transfer Hook and Operator

2019-07-15 Thread Ryan Yuan (JIRA)
Ryan Yuan created AIRFLOW-4964: -- Summary: Add BigQuery Data Transfer Hook and Operator Key: AIRFLOW-4964 URL: https://issues.apache.org/jira/browse/AIRFLOW-4964 Project: Apache Airflow Issue

[jira] [Work started] (AIRFLOW-4964) Add BigQuery Data Transfer Hook and Operator

2019-07-15 Thread Ryan Yuan (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on AIRFLOW-4964 started by Ryan Yuan. -- > Add BigQuery Data Transfer Hook and Operator >

[jira] [Closed] (AIRFLOW-4964) Add BigQuery Data Transfer Hook and Operator

2019-07-16 Thread Ryan Yuan (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Yuan closed AIRFLOW-4964. -- Resolution: Duplicate Polidea team is working on this. > Add BigQuery Data Transfer Hook and

[jira] [Reopened] (AIRFLOW-5129) Add typehint to gcp_dlp_hook.py

2019-10-01 Thread Ryan Yuan (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Yuan reopened AIRFLOW-5129: > Add typehint to gcp_dlp_hook.py > --- > > Key:

[jira] [Resolved] (AIRFLOW-5129) Add typehint to gcp_dlp_hook.py

2019-10-01 Thread Ryan Yuan (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Yuan resolved AIRFLOW-5129. Resolution: Implemented > Add typehint to gcp_dlp_hook.py > --- > >

[jira] [Work started] (AIRFLOW-4908) Implement BigQueryHook's update_dataset and patch_dataset

2019-07-07 Thread Ryan Yuan (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on AIRFLOW-4908 started by Ryan Yuan. -- > Implement BigQueryHook's update_dataset and patch_dataset >

[jira] [Commented] (AIRFLOW-5249) BigQueryCheckOperator fails for datasets outside of 'US' region

2019-12-08 Thread Ryan Yuan (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16991008#comment-16991008 ] Ryan Yuan commented on AIRFLOW-5249: [~michaelkhan3] [~pauld] [~tpilewicz] This should be fix in

[jira] [Created] (AIRFLOW-5685) Loading AVRO file from GCS to BQ throwing ValueError

2019-10-16 Thread Ryan Yuan (Jira)
Ryan Yuan created AIRFLOW-5685: -- Summary: Loading AVRO file from GCS to BQ throwing ValueError Key: AIRFLOW-5685 URL: https://issues.apache.org/jira/browse/AIRFLOW-5685 Project: Apache Airflow

[jira] [Work started] (AIRFLOW-5685) Loading AVRO file from GCS to BQ throwing ValueError

2019-10-16 Thread Ryan Yuan (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on AIRFLOW-5685 started by Ryan Yuan. -- > Loading AVRO file from GCS to BQ throwing ValueError >

[jira] [Created] (AIRFLOW-6267) Add View Creation to BigQueryOperator

2019-12-17 Thread Ryan Yuan (Jira)
Ryan Yuan created AIRFLOW-6267: -- Summary: Add View Creation to BigQueryOperator Key: AIRFLOW-6267 URL: https://issues.apache.org/jira/browse/AIRFLOW-6267 Project: Apache Airflow Issue Type: New

[jira] [Work started] (AIRFLOW-6267) Add View Creation to BigQueryOperator

2019-12-17 Thread Ryan Yuan (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on AIRFLOW-6267 started by Ryan Yuan. -- > Add View Creation to BigQueryOperator > - >

[jira] [Commented] (AIRFLOW-5013) Add GCP Data Catalog Hook and Operators

2019-12-19 Thread Ryan Yuan (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1660#comment-1660 ] Ryan Yuan commented on AIRFLOW-5013: Feel free to take this. Thanks [~kamil.bregula] > Add GCP

[jira] [Assigned] (AIRFLOW-5013) Add GCP Data Catalog Hook and Operators

2019-12-19 Thread Ryan Yuan (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Yuan reassigned AIRFLOW-5013: -- Assignee: Kamil Bregula (was: Ryan Yuan) > Add GCP Data Catalog Hook and Operators >

[jira] [Work started] (AIRFLOW-6981) Move Google Cloud Build from Discovery API to Python Library

2020-03-03 Thread Ryan Yuan (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on AIRFLOW-6981 started by Ryan Yuan. -- > Move Google Cloud Build from Discovery API to Python Library >

[jira] [Created] (AIRFLOW-6981) Move Google Cloud Build from Discovery API to Python Library

2020-03-03 Thread Ryan Yuan (Jira)
Ryan Yuan created AIRFLOW-6981: -- Summary: Move Google Cloud Build from Discovery API to Python Library Key: AIRFLOW-6981 URL: https://issues.apache.org/jira/browse/AIRFLOW-6981 Project: Apache Airflow

[jira] [Closed] (AIRFLOW-5370) Add typehint to GCP's Task Hook

2020-03-03 Thread Ryan Yuan (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Yuan closed AIRFLOW-5370. -- Resolution: Fixed > Add typehint to GCP's Task Hook > --- > >