[jira] [Commented] (AIRFLOW-3235) Add list function in AzureDataLakeHook

2018-12-31 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16731260#comment-16731260 ] jack commented on AIRFLOW-3235: --- This was merged. ticket can be closed. > Add list function in

[jira] [Commented] (AIRFLOW-55) Add HDFS Log Support

2018-12-31 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-55?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16731262#comment-16731262 ] jack commented on AIRFLOW-55: - Resolved by https://github.com/apache/incubator-airflow/pull/2119 > Add HDFS

[jira] [Commented] (AIRFLOW-496) HiveServer2Hook invokes incorrect Auth mechanism when user not specified

2018-12-29 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16730891#comment-16730891 ] jack commented on AIRFLOW-496: -- The problem is not in Impala it's in Airflow.  Airflow uses Impala as a

[jira] [Commented] (AIRFLOW-3316) GCS to BQ operator leaves schema_fields operator unset when autodetect=True

2018-12-29 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16730901#comment-16730901 ] jack commented on AIRFLOW-3316: --- I'm unable to reproduce this issue. first, {color:#24292e}schema_fields

[jira] [Commented] (AIRFLOW-3571) GoogleCloudStorageToBigQueryOperator succeeds to uploading CSV file from GCS to BiqQuery but a task is failed

2018-12-30 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16730970#comment-16730970 ] jack commented on AIRFLOW-3571: --- [~yohei] yep. You can create a ticket for all operators (example:

[jira] [Comment Edited] (AIRFLOW-3571) GoogleCloudStorageToBigQueryOperator succeeds to uploading CSV file from GCS to BiqQuery but a task is failed

2018-12-30 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16730970#comment-16730970 ] jack edited comment on AIRFLOW-3571 at 12/30/18 1:06 PM: - [~yohei] yep. You can

[jira] [Commented] (AIRFLOW-3614) Operators loading to GCS - to support CSV files

2019-01-02 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16731869#comment-16731869 ] jack commented on AIRFLOW-3614: --- Some work was started with 

[jira] [Created] (AIRFLOW-3614) Operators loading to GCS - to support CSV files

2019-01-02 Thread jack (JIRA)
jack created AIRFLOW-3614: - Summary: Operators loading to GCS - to support CSV files Key: AIRFLOW-3614 URL: https://issues.apache.org/jira/browse/AIRFLOW-3614 Project: Apache Airflow Issue Type:

[jira] [Commented] (AIRFLOW-3316) GCS to BQ operator leaves schema_fields operator unset when autodetect=True

2019-01-03 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16732810#comment-16732810 ] jack commented on AIRFLOW-3316: --- I think I see the problem. self.schema_fields will be set to None in

[jira] [Comment Edited] (AIRFLOW-3316) GCS to BQ operator leaves schema_fields operator unset when autodetect=True

2019-01-03 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16732810#comment-16732810 ] jack edited comment on AIRFLOW-3316 at 1/3/19 9:41 AM: --- I think I see the

[jira] [Comment Edited] (AIRFLOW-3316) GCS to BQ operator leaves schema_fields operator unset when autodetect=True

2019-01-03 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16732810#comment-16732810 ] jack edited comment on AIRFLOW-3316 at 1/3/19 9:42 AM: --- I think I see the

[jira] [Commented] (AIRFLOW-3061) Update Outdated (4 years old) Screenshots

2019-01-16 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16744009#comment-16744009 ] jack commented on AIRFLOW-3061: --- Wasn't this updated in 1.10.2?  > Update Outdated (4 years old)

[jira] [Commented] (AIRFLOW-2593) Expose next scheduled time

2019-01-16 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16744021#comment-16744021 ] jack commented on AIRFLOW-2593: --- We have pending PR for this:

[jira] [Commented] (AIRFLOW-3222) Remove bql keyword from BigQueryOperator

2019-01-16 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16744008#comment-16744008 ] jack commented on AIRFLOW-3222: --- PR for this ticket was merged. can someone close this? > Remove bql

[jira] [Commented] (AIRFLOW-2689) Add documentation on connection types

2019-01-16 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16744015#comment-16744015 ] jack commented on AIRFLOW-2689: --- Can you be more specific? > Add documentation on connection types >

[jira] [Commented] (AIRFLOW-3720) GoogleCloudStorageToS3Operator - incorrect folder compare

2019-01-17 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16744793#comment-16744793 ] jack commented on AIRFLOW-3720: --- The bug was fixed in 1.10.2 

[jira] [Created] (AIRFLOW-3721) UI: Dag Runs - Refer to the chosen run.

2019-01-17 Thread jack (JIRA)
jack created AIRFLOW-3721: - Summary: UI: Dag Runs - Refer to the chosen run. Key: AIRFLOW-3721 URL: https://issues.apache.org/jira/browse/AIRFLOW-3721 Project: Apache Airflow Issue Type: Improvement

[jira] [Commented] (AIRFLOW-1451) Add Google Compute Engine operators

2019-01-22 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16748485#comment-16748485 ] jack commented on AIRFLOW-1451: --- Wasn't this completed? > Add Google Compute Engine operators >

[jira] [Commented] (AIRFLOW-3419) S3_hook.select_key is broken on Python3

2019-01-21 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16748460#comment-16748460 ] jack commented on AIRFLOW-3419: --- [~sekikn] guess you have a go :) > S3_hook.select_key is broken on

[jira] [Commented] (AIRFLOW-2045) S3FileTransformOperator doesn't adhere to current boto3 API

2019-01-22 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16749630#comment-16749630 ] jack commented on AIRFLOW-2045: --- For s3  interaction the config requirement is  'boto3>=1.7.0, <1.8.0' >

[jira] [Commented] (AIRFLOW-1073) Dag stats not properly updated

2019-01-22 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16749636#comment-16749636 ] jack commented on AIRFLOW-1073: --- [~Fokko] is this still an issue? > Dag stats not properly updated >

[jira] [Commented] (AIRFLOW-3274) Add run_as_user and fs_group security context options for KubernetesExecutor

2019-01-23 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16749640#comment-16749640 ] jack commented on AIRFLOW-3274: --- [~pgag] Will you PR this? > Add run_as_user and fs_group security

[jira] [Commented] (AIRFLOW-1987) Illegal query generation with MS SQL Server as backend

2019-01-23 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16749644#comment-16749644 ] jack commented on AIRFLOW-1987: --- Airflow is being tested against MySQL, PostgreSQL and SQLite as

[jira] [Commented] (AIRFLOW-584) Airflow Pool does not limit running tasks

2019-01-23 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16749659#comment-16749659 ] jack commented on AIRFLOW-584: -- Can also confirm this is still an issue in 1.9 Was this fixed in 1.10 or

[jira] [Commented] (AIRFLOW-3723) Add Gzip capability to existing mongo_to_S3 operator

2019-01-17 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16745026#comment-16745026 ] jack commented on AIRFLOW-3723: --- With Google Storage the ability was added to the hook

[jira] [Issue Comment Deleted] (AIRFLOW-3720) GoogleCloudStorageToS3Operator - incorrect folder compare

2019-01-17 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jack updated AIRFLOW-3720: -- Comment: was deleted (was: The bug was fixed in 1.10.2 [https://github.com/apache/airflow/pull/4371]   ) >

[jira] [Commented] (AIRFLOW-2319) Table "dag_run" has (bad) second index on (dag_id, execution_date)

2019-01-17 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16745201#comment-16745201 ] jack commented on AIRFLOW-2319: --- [~akoeltringer] you can submit your proposal on the mailing list.. this

[jira] [Commented] (AIRFLOW-2165) XCOM values are being saved as bytestring

2019-01-17 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16745207#comment-16745207 ] jack commented on AIRFLOW-2165: --- [~kaxilnaik] is there something to do here or this can be closed? >

[jira] [Commented] (AIRFLOW-1850) Sqoop password is overwritten by reference

2019-01-17 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16745229#comment-16745229 ] jack commented on AIRFLOW-1850: --- [~Fokko] is this still an issue? > Sqoop password is overwritten by

[jira] [Commented] (AIRFLOW-103) Allow jinja templates to be used in task params

2019-01-22 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16749617#comment-16749617 ] jack commented on AIRFLOW-103: -- Totally agree with [~colinbreame] this is very common use case for me as

[jira] [Commented] (AIRFLOW-851) Docs: Info how to cancel a running job

2018-12-26 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16728971#comment-16728971 ] jack commented on AIRFLOW-851: -- There is no way to cancel a running task from the UI. You can set the DAG

[jira] [Commented] (AIRFLOW-3568) S3ToGoogleCloudStorageOperator failed after succeeding in copying files from s3

2018-12-26 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16728940#comment-16728940 ] jack commented on AIRFLOW-3568: --- I guess that this is the same issue as GoogleCloudStorageToS3Operator :

[jira] [Comment Edited] (AIRFLOW-3568) S3ToGoogleCloudStorageOperator failed after succeeding in copying files from s3

2018-12-26 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16729400#comment-16729400 ] jack edited comment on AIRFLOW-3568 at 12/27/18 7:31 AM: - [~yohei] No problem.

[jira] [Commented] (AIRFLOW-3568) S3ToGoogleCloudStorageOperator failed after succeeding in copying files from s3

2018-12-26 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16729400#comment-16729400 ] jack commented on AIRFLOW-3568: --- [~yohei] No problem. note that it was approved but not yet merged. It

[jira] [Commented] (AIRFLOW-3571) GoogleCloudStorageToBigQueryOperator succeeds to uploading CSV file from GCS to BiqQuery but a task is failed

2018-12-26 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16729398#comment-16729398 ] jack commented on AIRFLOW-3571: --- [~yohei] There is an open PR for adding support for locations to the

[jira] [Created] (AIRFLOW-3563) schedule_interval to raise error like broken DAG

2018-12-24 Thread jack (JIRA)
jack created AIRFLOW-3563: - Summary: schedule_interval to raise error like broken DAG Key: AIRFLOW-3563 URL: https://issues.apache.org/jira/browse/AIRFLOW-3563 Project: Apache Airflow Issue Type:

[jira] [Commented] (AIRFLOW-3667) Airflow scheduler not started as daemon

2019-01-10 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16739367#comment-16739367 ] jack commented on AIRFLOW-3667: --- This probably happens because 'dag_id': None dag_id isn't nullable.

[jira] [Commented] (AIRFLOW-3656) Airflow Web UI link to the docs should be dynamic to Airflow version

2019-01-13 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16741794#comment-16741794 ] jack commented on AIRFLOW-3656: --- [~kaxilnaik] what do you think of this idea? > Airflow Web UI link to

[jira] [Commented] (AIRFLOW-3690) Fix api.common.experimental.mark_tasks.set_state for the manually-triggered DAG Runs

2019-01-12 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16741477#comment-16741477 ] jack commented on AIRFLOW-3690: --- Is this related to https://issues.apache.org/jira/browse/AIRFLOW-419 ? 

[jira] [Updated] (AIRFLOW-3656) Airflow Web UI link to the docs should be dynamic to Airflow version

2019-01-09 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jack updated AIRFLOW-3656: -- Description: Currently in the UI Docs->Documentation directs to [https://airflow.incubator.apache.org/] #

[jira] [Created] (AIRFLOW-3656) Airflow Web UI link to the docs should be dynamic to Airflow version

2019-01-09 Thread jack (JIRA)
jack created AIRFLOW-3656: - Summary: Airflow Web UI link to the docs should be dynamic to Airflow version Key: AIRFLOW-3656 URL: https://issues.apache.org/jira/browse/AIRFLOW-3656 Project: Apache Airflow

[jira] [Commented] (AIRFLOW-1754) Add GCP logging download for Dataflow operator

2018-12-31 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16731228#comment-16731228 ] jack commented on AIRFLOW-1754: --- Wasn't this already implemented? > Add GCP logging download for

[jira] [Comment Edited] (AIRFLOW-1072) cannot import name viewkeys

2018-12-31 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16731232#comment-16731232 ] jack edited comment on AIRFLOW-1072 at 12/31/18 9:15 AM: - Airflow does not use

[jira] [Commented] (AIRFLOW-1161) HttpHook shall be configurable to non-status errors

2018-12-31 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16731256#comment-16731256 ] jack commented on AIRFLOW-1161: --- But this is exactly what Airflow provides... If the task fails it will

[jira] [Commented] (AIRFLOW-3656) Airflow Web UI link to the docs should be dynamic to Airflow version

2019-01-14 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16741973#comment-16741973 ] jack commented on AIRFLOW-3656: --- [~kaxilnaik] [~ashb]  My suggestion was to change the 

[jira] [Commented] (AIRFLOW-1469) ECSOperator with optional aws_conn_id results in a NullPointer

2019-01-14 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16741994#comment-16741994 ] jack commented on AIRFLOW-1469: --- This is indeed a bug. If you don't set the aws_conn_id it will default

[jira] [Commented] (AIRFLOW-3601) update operators to BigQuery to support location

2019-01-14 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742026#comment-16742026 ] jack commented on AIRFLOW-3601: --- Not sure if it's in the scope of this ticket/PR but there is also

[jira] [Commented] (AIRFLOW-3013) LDAPInvalidPortError: port must be an integer

2019-01-22 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16748838#comment-16748838 ] jack commented on AIRFLOW-3013: --- Can you check if this happens to you in the new UI? >

[jira] [Commented] (AIRFLOW-3368) Second {table} parameter on COPY command needs to be removed

2019-01-22 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16748856#comment-16748856 ] jack commented on AIRFLOW-3368: --- Duplicate of https://issues.apache.org/jira/browse/AIRFLOW-2862 PR: 

[jira] [Commented] (AIRFLOW-2632) AWSBatchOperator allow ints in overrides

2019-01-22 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16748858#comment-16748858 ] jack commented on AIRFLOW-2632: --- Ticket can be closed as per [~kaxilnaik] comment in the PR:

[jira] [Updated] (AIRFLOW-3656) Airflow Web UI link to the docs should be dynamic to Airflow version

2019-01-27 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jack updated AIRFLOW-3656: -- Attachment: 0101.PNG > Airflow Web UI link to the docs should be dynamic to Airflow version >

[jira] [Commented] (AIRFLOW-3656) Airflow Web UI link to the docs should be dynamic to Airflow version

2019-01-27 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16753340#comment-16753340 ] jack commented on AIRFLOW-3656: --- [~ashb] [~kaxilnaik]  I think I wasn't clear due to the incubation. Let

[jira] [Updated] (AIRFLOW-3057) add macros that see only successful dags

2019-01-27 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jack updated AIRFLOW-3057: -- Description: Assume the following case: 1st DAG successful 2nd DAG failed 3rd DAG starts running   When

[jira] [Commented] (AIRFLOW-3656) Airflow Web UI link to the docs should be dynamic to Airflow version

2019-01-27 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16753343#comment-16753343 ] jack commented on AIRFLOW-3656: --- [~kaxilnaik] Which shows the version for example now 1.10.2 but doesn't

[jira] [Commented] (AIRFLOW-3593) Allow '@' in usernames.

2019-01-27 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16753389#comment-16753389 ] jack commented on AIRFLOW-3593: --- Is this an issue with Airflow? The way to deal with this is to escape

[jira] [Comment Edited] (AIRFLOW-2076) [2017-11-21 16:12:40,961] {jobs.py:187} DEBUG - [heart] Boom.

2019-01-27 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16753368#comment-16753368 ] jack edited comment on AIRFLOW-2076 at 1/27/19 12:41 PM: - The [heart] Boom was

[jira] [Commented] (AIRFLOW-2076) [2017-11-21 16:12:40,961] {jobs.py:187} DEBUG - [heart] Boom.

2019-01-27 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16753368#comment-16753368 ] jack commented on AIRFLOW-2076: --- The [heart] Boom was removed in 1.9 since users were confusing this with

[jira] [Commented] (AIRFLOW-3620) Inlets and outlets are always empty in bash operator templates

2019-01-27 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16753374#comment-16753374 ] jack commented on AIRFLOW-3620: --- The docs has example using the BashOperator 

[jira] [Commented] (AIRFLOW-3283) Updated User Roles are not saving after re-login to the Airflow

2019-01-28 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16753982#comment-16753982 ] jack commented on AIRFLOW-3283: --- Wasn't this fixed in [https://github.com/apache/airflow/pull/4118]   ?

[jira] [Commented] (AIRFLOW-1773) [Mark Success] not work in UI

2019-01-28 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16753991#comment-16753991 ] jack commented on AIRFLOW-1773: --- I assume you used PostgreSQL as backend. This probably has the same

[jira] [Commented] (AIRFLOW-351) Failed to clear downstream tasks

2019-04-02 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16807537#comment-16807537 ] jack commented on AIRFLOW-351: -- [~vijaytdh] can you please check if the issue still present on the 1.10.3

[jira] [Created] (AIRFLOW-4166) Add CSV file support to CassandraToGoogleCloudStorageOperator

2019-03-27 Thread jack (JIRA)
jack created AIRFLOW-4166: - Summary: Add CSV file support to CassandraToGoogleCloudStorageOperator Key: AIRFLOW-4166 URL: https://issues.apache.org/jira/browse/AIRFLOW-4166 Project: Apache Airflow

[jira] [Commented] (AIRFLOW-4167) Edit DAG Run Button links to wrong page

2019-03-27 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16802653#comment-16802653 ] jack commented on AIRFLOW-4167: --- is it related to https://issues.apache.org/jira/browse/AIRFLOW-4064 ? 

[jira] [Comment Edited] (AIRFLOW-1421) DAG fails due to timeout: DAG status from UI unclear

2019-03-27 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16802607#comment-16802607 ] jack edited comment on AIRFLOW-1421 at 3/27/19 9:54 AM: I'm not sure this is a

[jira] [Comment Edited] (AIRFLOW-1421) DAG fails due to timeout: DAG status from UI unclear

2019-03-27 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16802607#comment-16802607 ] jack edited comment on AIRFLOW-1421 at 3/27/19 9:54 AM: I'm not sure this is a

[jira] [Commented] (AIRFLOW-351) Failed to clear downstream tasks

2019-03-27 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16802561#comment-16802561 ] jack commented on AIRFLOW-351: -- [~vijaytdh] are you running 1.9? According to 

[jira] [Commented] (AIRFLOW-2968) Broken DAG: [/usr/local/airflow/dags/bosse-example__master.zip] Error -5 while decompressing data: incomplete or truncated stream

2019-03-27 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16802542#comment-16802542 ] jack commented on AIRFLOW-2968: --- This might be fixed by [https://github.com/apache/airflow/pull/4439] 

[jira] [Commented] (AIRFLOW-986) HiveCliHook silently ignores 'proxy_user' in connection's extra parameters

2019-03-27 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16802649#comment-16802649 ] jack commented on AIRFLOW-986: -- PR [https://github.com/apache/airflow/pull/2153] In case someone wants to

[jira] [Commented] (AIRFLOW-2897) GKEPodOperator not deleting service account file after done with it

2019-03-27 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16802550#comment-16802550 ] jack commented on AIRFLOW-2897: --- [~Ben Marengo] Do you have some input on this? > GKEPodOperator not

[jira] [Commented] (AIRFLOW-1421) DAG fails due to timeout: DAG status from UI unclear

2019-03-27 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16802607#comment-16802607 ] jack commented on AIRFLOW-1421: --- I'm not sure this is a bug. This is how Airflow works. Consider a case

[jira] [Created] (AIRFLOW-4165) Add CSV file support to PostgresToGoogleCloudStorageOperator

2019-03-27 Thread jack (JIRA)
jack created AIRFLOW-4165: - Summary: Add CSV file support to PostgresToGoogleCloudStorageOperator Key: AIRFLOW-4165 URL: https://issues.apache.org/jira/browse/AIRFLOW-4165 Project: Apache Airflow

[jira] [Comment Edited] (AIRFLOW-1421) DAG fails due to timeout: DAG status from UI unclear

2019-03-27 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16802607#comment-16802607 ] jack edited comment on AIRFLOW-1421 at 3/27/19 9:55 AM: I'm not sure this is a

[jira] [Commented] (AIRFLOW-3209) return job id on bq operators

2019-03-26 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16801461#comment-16801461 ] jack commented on AIRFLOW-3209: --- That addiction would be nice! > return job id on bq operators >

[jira] [Commented] (AIRFLOW-4118) Instrument dagrun duration

2019-03-26 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16801558#comment-16801558 ] jack commented on AIRFLOW-4118: --- Pr merged but ticket still open > Instrument dagrun duration >

[jira] [Comment Edited] (AIRFLOW-3209) return job id on bq operators

2019-03-26 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16801461#comment-16801461 ] jack edited comment on AIRFLOW-3209 at 3/26/19 7:35 AM: That addition would be

[jira] [Commented] (AIRFLOW-3489) PostgresToGoogleCloudStorageOperator doesn't handle PostgreSQL json properly

2019-03-26 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16801459#comment-16801459 ] jack commented on AIRFLOW-3489: --- The Operator has the code that convert the Json to

[jira] [Commented] (AIRFLOW-3969) Remove MesosExecutor

2019-03-26 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16801649#comment-16801649 ] jack commented on AIRFLOW-3969: --- If it's to be removed maybe worth closing

[jira] [Commented] (AIRFLOW-4072) enable GKEPodOperator xcom

2019-03-25 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16800849#comment-16800849 ] jack commented on AIRFLOW-4072: --- Duplicated ticket of https://issues.apache.org/jira/browse/AIRFLOW-3113

[jira] [Created] (AIRFLOW-4236) Operators uploading to GCS needs to handle googleapiclient.errors

2019-04-04 Thread jack (JIRA)
jack created AIRFLOW-4236: - Summary: Operators uploading to GCS needs to handle googleapiclient.errors Key: AIRFLOW-4236 URL: https://issues.apache.org/jira/browse/AIRFLOW-4236 Project: Apache Airflow

[jira] [Updated] (AIRFLOW-4236) Operators uploading to GCS needs to handle googleapiclient.errors

2019-04-04 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jack updated AIRFLOW-4236: -- Labels: easy-fix (was: ) Component/s: operators gcp Issue Type: Bug (was:

[jira] [Comment Edited] (AIRFLOW-3428) RBAC UI "Logout" text says "Login"

2019-03-28 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16764802#comment-16764802 ] jack edited comment on AIRFLOW-3428 at 3/28/19 11:44 AM: - I don't see this

[jira] [Commented] (AIRFLOW-1645) librabbitmq 1.6.1 is incompatibe with celery 4.1

2019-03-28 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16803942#comment-16803942 ] jack commented on AIRFLOW-1645: --- Celery 4.2 was released a while ago

[jira] [Commented] (AIRFLOW-573) Jinja2 template failing env argument in BashOperater if string ends in .sh or .bash

2019-03-28 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16803692#comment-16803692 ] jack commented on AIRFLOW-573: -- [~adamos.loizou] There shouldn't be a problem specifing .sh  I think you

[jira] [Commented] (AIRFLOW-2897) GKEPodOperator not deleting service account file after done with it

2019-03-28 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16803687#comment-16803687 ] jack commented on AIRFLOW-2897: --- If it's sometimes needed while sometimes not. Maybe this should be

[jira] [Closed] (AIRFLOW-2679) GoogleCloudStorageToBigQueryOperator to support MERGE

2019-04-01 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jack closed AIRFLOW-2679. - Resolution: Not A Problem > GoogleCloudStorageToBigQueryOperator to support MERGE >

[jira] [Issue Comment Deleted] (AIRFLOW-55) Add HDFS Log Support

2019-04-01 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-55?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jack updated AIRFLOW-55: Comment: was deleted (was: Resolved by https://github.com/apache/incubator-airflow/pull/2119) > Add HDFS Log

[jira] [Commented] (AIRFLOW-825) Add Dataflow semantics

2019-04-01 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16806874#comment-16806874 ] jack commented on AIRFLOW-825: -- Last PR related to the issue: [https://github.com/apache/airflow/pull/2156]

[jira] [Commented] (AIRFLOW-4204) Update super() calls

2019-04-01 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16806808#comment-16806808 ] jack commented on AIRFLOW-4204: --- May be worth to fix https://issues.apache.org/jira/browse/AIRFLOW-3407 

[jira] [Created] (AIRFLOW-4195) Add Scylla hook

2019-03-31 Thread jack (JIRA)
jack created AIRFLOW-4195: - Summary: Add Scylla hook Key: AIRFLOW-4195 URL: https://issues.apache.org/jira/browse/AIRFLOW-4195 Project: Apache Airflow Issue Type: New Feature Reporter:

[jira] [Updated] (AIRFLOW-4195) Add Scylla hook

2019-03-31 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jack updated AIRFLOW-4195: -- Description: [https://www.scylladb.com/] Scylla rebuild the architecture of {color:#00}Apache Cassandra

[jira] [Commented] (AIRFLOW-1209) Hive Hook with beeline doesn't execute query if hql query doesn't have \n in the end

2019-02-25 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16777687#comment-16777687 ] jack commented on AIRFLOW-1209: --- I don't think Airflow should maintain backwards compatibility for bugs

[jira] [Comment Edited] (AIRFLOW-3047) HiveCliHook does not work properly with Beeline

2019-02-26 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16777878#comment-16777878 ] jack edited comment on AIRFLOW-3047 at 2/26/19 12:54 PM: - [~vladglinskiy] This

[jira] [Issue Comment Deleted] (AIRFLOW-3047) HiveCliHook does not work properly with Beeline

2019-02-26 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jack updated AIRFLOW-3047: -- Comment: was deleted (was: [~vladglinskiy] can you submit PR for this?) > HiveCliHook does not work

[jira] [Commented] (AIRFLOW-344) ImportError: No module named lockfile.pidlockfile

2019-02-26 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16777979#comment-16777979 ] jack commented on AIRFLOW-344: -- Is this still an issue? > ImportError: No module named

[jira] [Commented] (AIRFLOW-578) BaseJob does not check return code of a process

2019-02-26 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16777978#comment-16777978 ] jack commented on AIRFLOW-578: -- Is this still an issue? > BaseJob does not check return code of a process

[jira] [Commented] (AIRFLOW-2490) Add delete_dag for CLI

2019-02-28 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16780549#comment-16780549 ] jack commented on AIRFLOW-2490: --- This can be closed. duplicate issue was resolved. > Add delete_dag for

[jira] [Commented] (AIRFLOW-455) Job status still running after restart

2019-02-27 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16779351#comment-16779351 ] jack commented on AIRFLOW-455: -- fixed in https://issues.apache.org/jira/browse/AIRFLOW-2650 > Job status

[jira] [Commented] (AIRFLOW-1570) Tasks that finish unnaturally don't surface error messages.

2019-02-27 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16779120#comment-16779120 ] jack commented on AIRFLOW-1570: --- Fixed by [https://github.com/apache/airflow/pull/3204] ? > Tasks that

[jira] [Commented] (AIRFLOW-788) Context unexpectedly added to hive conf

2019-02-27 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16779100#comment-16779100 ] jack commented on AIRFLOW-788: -- wasn't this fixed by [https://github.com/apache/airflow/pull/3136] ? >

[jira] [Commented] (AIRFLOW-1274) HttpSensor parameter params is overriding BaseOperator params and should be renamed

2019-02-27 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16779103#comment-16779103 ] jack commented on AIRFLOW-1274: --- Fixed in 1.9.0 PR:  https://github.com/apache/airflow/pull/2342 >

  1   2   3   4   5   6   >