[jira] [Commented] (AIRFLOW-2341) Trigger timing should follow cron style when we use cron style schedule_interval

2018-05-10 Thread Yu Ishikawa (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16470712#comment-16470712 ] Yu Ishikawa commented on AIRFLOW-2341: -- [~criccomini] What do you think of it? > Trigger timing

[jira] [Created] (AIRFLOW-2341) Trigger timing should follow cron style when we use cron style schedule_interval

2018-04-18 Thread Yu Ishikawa (JIRA)
Yu Ishikawa created AIRFLOW-2341: Summary: Trigger timing should follow cron style when we use cron style schedule_interval Key: AIRFLOW-2341 URL: https://issues.apache.org/jira/browse/AIRFLOW-2341

[jira] [Assigned] (AIRFLOW-2039) BigQueryOperator supports priority property

2018-01-26 Thread Yu Ishikawa (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Ishikawa reassigned AIRFLOW-2039: Assignee: Yu Ishikawa > BigQueryOperator supports priority property >

[jira] [Updated] (AIRFLOW-2039) BigQueryOperator supports priority property

2018-01-26 Thread Yu Ishikawa (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Ishikawa updated AIRFLOW-2039: - Description: h3. Goals - Add priority property to BigQueryOperator h3. Overview BigQuery has

[jira] [Created] (AIRFLOW-2039) BigQueryOperator supports priority property

2018-01-26 Thread Yu Ishikawa (JIRA)
Yu Ishikawa created AIRFLOW-2039: Summary: BigQueryOperator supports priority property Key: AIRFLOW-2039 URL: https://issues.apache.org/jira/browse/AIRFLOW-2039 Project: Apache Airflow Issue

[jira] [Closed] (AIRFLOW-2021) Can't register a GCP connection ID on the web UI

2018-01-22 Thread Yu Ishikawa (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Ishikawa closed AIRFLOW-2021. Resolution: Not A Problem Airflow 1.9.0 should run with flack>=0.11, <0.12. > Can't register a

[jira] [Commented] (AIRFLOW-2021) Can't register a GCP connection ID on the web UI

2018-01-22 Thread Yu Ishikawa (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16335079#comment-16335079 ] Yu Ishikawa commented on AIRFLOW-2021: -- I got it. The flask version should be 0.11.1. I installed

[jira] [Updated] (AIRFLOW-2021) Can't register a GCP connection ID on the web UI

2018-01-22 Thread Yu Ishikawa (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Ishikawa updated AIRFLOW-2021: - Description: I was not able to register a GCP connection ID on the web UI. The below error

[jira] [Commented] (AIRFLOW-1431) Cannot create connection for GCP using CLI

2018-01-22 Thread Yu Ishikawa (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16334798#comment-16334798 ] Yu Ishikawa commented on AIRFLOW-1431: -- [~criccomini] [~peay] Can we close the issue? > Cannot

[jira] [Updated] (AIRFLOW-2021) Can't register a GCP connection ID on the web UI

2018-01-22 Thread Yu Ishikawa (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Ishikawa updated AIRFLOW-2021: - Description: I was not able to register a GCP connection ID on the web UI. The below error

[jira] [Updated] (AIRFLOW-2021) Can't register a GCP connection ID on the web UI

2018-01-22 Thread Yu Ishikawa (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Ishikawa updated AIRFLOW-2021: - Attachment: (was: airflow_connections_error.jpg) > Can't register a GCP connection ID on

[jira] [Updated] (AIRFLOW-2021) Can't register a GCP connection ID on the web UI

2018-01-22 Thread Yu Ishikawa (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Ishikawa updated AIRFLOW-2021: - Attachment: airflow_connections_error.jpg > Can't register a GCP connection ID on the web UI >

[jira] [Updated] (AIRFLOW-2021) Can't register a GCP connection ID on the web UI

2018-01-22 Thread Yu Ishikawa (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Ishikawa updated AIRFLOW-2021: - Attachment: airflow_connections_error.png > Can't register a GCP connection ID on the web UI >

[jira] [Created] (AIRFLOW-2021) Can't register a GCP connection ID on the web UI

2018-01-22 Thread Yu Ishikawa (JIRA)
Yu Ishikawa created AIRFLOW-2021: Summary: Can't register a GCP connection ID on the web UI Key: AIRFLOW-2021 URL: https://issues.apache.org/jira/browse/AIRFLOW-2021 Project: Apache Airflow

[jira] [Closed] (AIRFLOW-1310) Kubernetes execute operator

2017-10-19 Thread Yu Ishikawa (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Ishikawa closed AIRFLOW-1310. Resolution: Duplicate > Kubernetes execute operator > --- > >

[jira] [Commented] (AIRFLOW-1330) Connection.parse_from_uri doesn't work for google_cloud_platform and so on

2017-09-05 Thread Yu Ishikawa (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16154209#comment-16154209 ] Yu Ishikawa commented on AIRFLOW-1330: -- That's a good idea. That would work. FYI, we have another

[jira] [Updated] (AIRFLOW-1330) Connection.parse_from_uri doesn't work for google_cloud_platform and so on

2017-09-01 Thread Yu Ishikawa (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Ishikawa updated AIRFLOW-1330: - Description: h2. Overview {{Connection.parse_from_uri}} doesn't work for some types like

[jira] [Assigned] (AIRFLOW-1330) Connection.parse_from_uri doesn't work for google_cloud_platform and so on

2017-09-01 Thread Yu Ishikawa (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Ishikawa reassigned AIRFLOW-1330: Assignee: Shintaro Murakami > Connection.parse_from_uri doesn't work for

[jira] [Comment Edited] (AIRFLOW-1330) Connection.parse_from_uri doesn't work for google_cloud_platform and so on

2017-08-30 Thread Yu Ishikawa (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16145674#comment-16145674 ] Yu Ishikawa edited comment on AIRFLOW-1330 at 8/30/17 6:34 AM: --- Let's

[jira] [Commented] (AIRFLOW-1330) Connection.parse_from_uri doesn't work for google_cloud_platform and so on

2017-08-29 Thread Yu Ishikawa (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16145674#comment-16145674 ] Yu Ishikawa commented on AIRFLOW-1330: -- Let's summarize our discussion. We have 3 options to fix

[jira] [Commented] (AIRFLOW-1506) Improve DataprocClusterCreateOperator

2017-08-25 Thread Yu Ishikawa (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16142309#comment-16142309 ] Yu Ishikawa commented on AIRFLOW-1506: -- [~derwin] Thank you for the comment. Personally, the scopes

[jira] [Created] (AIRFLOW-1533) differing arrow's color between tasks in graph view based on trigger rule

2017-08-25 Thread Yu Ishikawa (JIRA)
Yu Ishikawa created AIRFLOW-1533: Summary: differing arrow's color between tasks in graph view based on trigger rule Key: AIRFLOW-1533 URL: https://issues.apache.org/jira/browse/AIRFLOW-1533 Project:

[jira] [Commented] (AIRFLOW-1330) Connection.parse_from_uri doesn't work for google_cloud_platform and so on

2017-08-22 Thread Yu Ishikawa (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16137840#comment-16137840 ] Yu Ishikawa commented on AIRFLOW-1330: -- [~criccomini] Of course, we can also throw away

[jira] [Commented] (AIRFLOW-1330) Connection.parse_from_uri doesn't work for google_cloud_platform and so on

2017-08-17 Thread Yu Ishikawa (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16130013#comment-16130013 ] Yu Ishikawa commented on AIRFLOW-1330: -- Good point. I think we should consider backwards

[jira] [Created] (AIRFLOW-1506) Improve DataprocClusterCreateOperator

2017-08-11 Thread Yu Ishikawa (JIRA)
Yu Ishikawa created AIRFLOW-1506: Summary: Improve DataprocClusterCreateOperator Key: AIRFLOW-1506 URL: https://issues.apache.org/jira/browse/AIRFLOW-1506 Project: Apache Airflow Issue Type:

[jira] [Commented] (AIRFLOW-1501) Google Cloud Storage delete operator

2017-08-09 Thread Yu Ishikawa (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16120785#comment-16120785 ] Yu Ishikawa commented on AIRFLOW-1501: -- Literally! We can call the hook from a PythonOperator. I

[jira] [Assigned] (AIRFLOW-1501) Google Cloud Storage delete operator

2017-08-09 Thread Yu Ishikawa (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Ishikawa reassigned AIRFLOW-1501: Assignee: Yu Ishikawa > Google Cloud Storage delete operator >

[jira] [Commented] (AIRFLOW-1501) Google Cloud Storage delete operator

2017-08-09 Thread Yu Ishikawa (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16120756#comment-16120756 ] Yu Ishikawa commented on AIRFLOW-1501: -- [~criccomini] Thank you for the comment. I know we already

[jira] [Created] (AIRFLOW-1501) Google Cloud Storage delete operator

2017-08-09 Thread Yu Ishikawa (JIRA)
Yu Ishikawa created AIRFLOW-1501: Summary: Google Cloud Storage delete operator Key: AIRFLOW-1501 URL: https://issues.apache.org/jira/browse/AIRFLOW-1501 Project: Apache Airflow Issue Type:

[jira] [Closed] (AIRFLOW-1303) Slack post operator should be friendly to `on_failure_callback`

2017-07-27 Thread Yu Ishikawa (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Ishikawa closed AIRFLOW-1303. Resolution: Won't Do TriggerRule would be nice to handle children tasks when the parent fails >

[jira] [Closed] (AIRFLOW-1461) BigQueryOperator has a bug on destination_dataset_table

2017-07-27 Thread Yu Ishikawa (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Ishikawa closed AIRFLOW-1461. Resolution: Cannot Reproduce The cause is derived my environment, sorry. > BigQueryOperator has

[jira] [Created] (AIRFLOW-1461) BigQueryOperator has a bug on destination_dataset_table

2017-07-25 Thread Yu Ishikawa (JIRA)
Yu Ishikawa created AIRFLOW-1461: Summary: BigQueryOperator has a bug on destination_dataset_table Key: AIRFLOW-1461 URL: https://issues.apache.org/jira/browse/AIRFLOW-1461 Project: Apache Airflow

[jira] [Created] (AIRFLOW-1451) Add Google Compute Engine operators

2017-07-24 Thread Yu Ishikawa (JIRA)
Yu Ishikawa created AIRFLOW-1451: Summary: Add Google Compute Engine operators Key: AIRFLOW-1451 URL: https://issues.apache.org/jira/browse/AIRFLOW-1451 Project: Apache Airflow Issue Type:

[jira] [Updated] (AIRFLOW-1437) BigQueryTableDeleteOperator should define deletion_dataset_table as a template field

2017-07-20 Thread Yu Ishikawa (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Ishikawa updated AIRFLOW-1437: - Description: {{BigQueryTableDeleteOperator}} should define deletion_dataset_table as a

[jira] [Created] (AIRFLOW-1437) BigQueryTableDeleteOperator should have deletion_dataset_table as a template field

2017-07-20 Thread Yu Ishikawa (JIRA)
Yu Ishikawa created AIRFLOW-1437: Summary: BigQueryTableDeleteOperator should have deletion_dataset_table as a template field Key: AIRFLOW-1437 URL: https://issues.apache.org/jira/browse/AIRFLOW-1437

[jira] [Created] (AIRFLOW-1418) Implement google cloud storage checker

2017-07-14 Thread Yu Ishikawa (JIRA)
Yu Ishikawa created AIRFLOW-1418: Summary: Implement google cloud storage checker Key: AIRFLOW-1418 URL: https://issues.apache.org/jira/browse/AIRFLOW-1418 Project: Apache Airflow Issue

[jira] [Created] (AIRFLOW-1417) Add tests for BigQueryToCloudStorageOperator

2017-07-14 Thread Yu Ishikawa (JIRA)
Yu Ishikawa created AIRFLOW-1417: Summary: Add tests for BigQueryToCloudStorageOperator Key: AIRFLOW-1417 URL: https://issues.apache.org/jira/browse/AIRFLOW-1417 Project: Apache Airflow

[jira] [Commented] (AIRFLOW-1310) Kubernetes execute operator

2017-07-05 Thread Yu Ishikawa (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16075048#comment-16075048 ] Yu Ishikawa commented on AIRFLOW-1310: -- [~d23] Thank you for your contribution! I look forward to

[jira] [Assigned] (AIRFLOW-1310) Kubernetes execute operator

2017-07-05 Thread Yu Ishikawa (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Ishikawa reassigned AIRFLOW-1310: Assignee: Dennis Docter > Kubernetes execute operator > --- > >

[jira] [Commented] (AIRFLOW-1330) Connection.parse_from_uri doesn't work for google_cloud_platform and so on

2017-06-21 Thread Yu Ishikawa (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16057929#comment-16057929 ] Yu Ishikawa commented on AIRFLOW-1330: -- I think we need to change the command line options for a

[jira] [Commented] (AIRFLOW-1330) Connection.parse_from_uri doesn't work for google_cloud_platform and so on

2017-06-21 Thread Yu Ishikawa (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16057857#comment-16057857 ] Yu Ishikawa commented on AIRFLOW-1330: -- If we want to any connection whose connection URI includes

[jira] [Created] (AIRFLOW-1330) Connection.parse_from_uri doesn't work for google_cloud_platform and so on

2017-06-20 Thread Yu Ishikawa (JIRA)
Yu Ishikawa created AIRFLOW-1330: Summary: Connection.parse_from_uri doesn't work for google_cloud_platform and so on Key: AIRFLOW-1330 URL: https://issues.apache.org/jira/browse/AIRFLOW-1330

[jira] [Updated] (AIRFLOW-1323) Operators related to Dataproc should keep some parameters consistent

2017-06-19 Thread Yu Ishikawa (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Ishikawa updated AIRFLOW-1323: - Description: The parameters of {{DataprocClusterDeleteOperator}} and

[jira] [Updated] (AIRFLOW-1323) Operators related to Dataproc should keep some parameters consistent

2017-06-19 Thread Yu Ishikawa (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Ishikawa updated AIRFLOW-1323: - Summary: Operators related to Dataproc should keep some parameters consistent (was: Operators

[jira] [Updated] (AIRFLOW-1323) Operators related to Dataproc should keep consistency with the connection ID paramter

2017-06-19 Thread Yu Ishikawa (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Ishikawa updated AIRFLOW-1323: - Description: The parameters of {{DataprocClusterDeleteOperator}} and

[jira] [Created] (AIRFLOW-1323) Operators related to Dataproc should keep consistency with the connection ID paramter

2017-06-19 Thread Yu Ishikawa (JIRA)
Yu Ishikawa created AIRFLOW-1323: Summary: Operators related to Dataproc should keep consistency with the connection ID paramter Key: AIRFLOW-1323 URL: https://issues.apache.org/jira/browse/AIRFLOW-1323

[jira] [Commented] (AIRFLOW-1271) Google Cloud ML Training Operator

2017-06-15 Thread Yu Ishikawa (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16051237#comment-16051237 ] Yu Ishikawa commented on AIRFLOW-1271: -- [~pdwryst] Thank you for suggesting it. Do you have any

[jira] [Issue Comment Deleted] (AIRFLOW-1271) Google Cloud ML Training Operator

2017-06-15 Thread Yu Ishikawa (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Ishikawa updated AIRFLOW-1271: - Comment: was deleted (was: [~pdwryst] Thank you for suggesting it. Do you have any update this

[jira] [Updated] (AIRFLOW-1303) Slack post operator should be friendly to `on_failure_callback`

2017-06-14 Thread Yu Ishikawa (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Ishikawa updated AIRFLOW-1303: - Issue Type: Improvement (was: Bug) > Slack post operator should be friendly to

[jira] [Created] (AIRFLOW-1303) Slack post operator should be friendly to `on_failure_callback`

2017-06-12 Thread Yu Ishikawa (JIRA)
Yu Ishikawa created AIRFLOW-1303: Summary: Slack post operator should be friendly to `on_failure_callback` Key: AIRFLOW-1303 URL: https://issues.apache.org/jira/browse/AIRFLOW-1303 Project: Apache

[jira] [Updated] (AIRFLOW-1299) Google Dataproc cluster creation operator should support imageVersion feature

2017-06-09 Thread Yu Ishikawa (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Ishikawa updated AIRFLOW-1299: - Affects Version/s: (was: Airflow 2.0) Airflow 1.8 > Google Dataproc

[jira] [Created] (AIRFLOW-1299) Google Dataproc cluster creation operator should support imageVersion feature

2017-06-09 Thread Yu Ishikawa (JIRA)
Yu Ishikawa created AIRFLOW-1299: Summary: Google Dataproc cluster creation operator should support imageVersion feature Key: AIRFLOW-1299 URL: https://issues.apache.org/jira/browse/AIRFLOW-1299