[jira] [Created] (AIRFLOW-2618) Improve UI by add "Next Run" column

2018-06-14 Thread jack (JIRA)
jack created AIRFLOW-2618: - Summary: Improve UI by add "Next Run" column Key: AIRFLOW-2618 URL: https://issues.apache.org/jira/browse/AIRFLOW-2618 Project: Apache Airflow Issue Type: Improvement

[jira] [Updated] (AIRFLOW-2637) Owner of DAG isn't constant in the UI

2018-06-18 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jack updated AIRFLOW-2637: -- Affects Version/s: Airflow 2.0 > Owner of DAG isn't constant in the UI >

[jira] [Created] (AIRFLOW-2637) Owner of DAG isn't constant in the UI

2018-06-18 Thread jack (JIRA)
jack created AIRFLOW-2637: - Summary: Owner of DAG isn't constant in the UI Key: AIRFLOW-2637 URL: https://issues.apache.org/jira/browse/AIRFLOW-2637 Project: Apache Airflow Issue Type: Bug

[jira] [Updated] (AIRFLOW-2635) Add discription column to UI

2018-06-18 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jack updated AIRFLOW-2635: -- Description: Currently in the UI we see the dag_id of the DAG. When many users use the UI it's not always

[jira] [Created] (AIRFLOW-2619) UI is inconsistent with actual data - each refresh shows diffrent data

2018-06-14 Thread jack (JIRA)
jack created AIRFLOW-2619: - Summary: UI is inconsistent with actual data - each refresh shows diffrent data Key: AIRFLOW-2619 URL: https://issues.apache.org/jira/browse/AIRFLOW-2619 Project: Apache Airflow

[jira] [Updated] (AIRFLOW-2618) Improve UI by add "Next Run" column

2018-06-17 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jack updated AIRFLOW-2618: -- Component/s: ui > Improve UI by add "Next Run" column > --- > >

[jira] [Updated] (AIRFLOW-2619) UI is inconsistent with actual data - each refresh shows diffrent data

2018-06-17 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jack updated AIRFLOW-2619: -- Component/s: ui core > UI is inconsistent with actual data - each refresh shows diffrent

[jira] [Updated] (AIRFLOW-2618) Improve UI by add "Next Run" column

2018-06-17 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jack updated AIRFLOW-2618: -- Priority: Minor (was: Trivial) > Improve UI by add "Next Run" column > ---

[jira] [Created] (AIRFLOW-2635) Add discription column to UI

2018-06-18 Thread jack (JIRA)
jack created AIRFLOW-2635: - Summary: Add discription column to UI Key: AIRFLOW-2635 URL: https://issues.apache.org/jira/browse/AIRFLOW-2635 Project: Apache Airflow Issue Type: Wish Affects

[jira] [Updated] (AIRFLOW-2635) Add discription column to UI

2018-06-26 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jack updated AIRFLOW-2635: -- Affects Version/s: 1.10 Fix Version/s: 2.0.0 Airflow 2.0 > Add discription

[jira] [Created] (AIRFLOW-2679) GoogleCloudStorageToBigQueryOperator to support UPSERT

2018-06-26 Thread jack (JIRA)
jack created AIRFLOW-2679: - Summary: GoogleCloudStorageToBigQueryOperator to support UPSERT Key: AIRFLOW-2679 URL: https://issues.apache.org/jira/browse/AIRFLOW-2679 Project: Apache Airflow Issue

[jira] [Updated] (AIRFLOW-2635) Add discription column to UI

2018-06-21 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jack updated AIRFLOW-2635: -- Fix Version/s: 1.10 1.10.0 > Add discription column to UI >

[jira] [Commented] (AIRFLOW-2644) Allow whild-cards in the search box in the UI

2018-06-20 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16517853#comment-16517853 ] jack commented on AIRFLOW-2644: --- [~ashb] =Say you have a dag name cd_ba While you type "cd" you will

[jira] [Comment Edited] (AIRFLOW-2644) Allow whild-cards in the search box in the UI

2018-06-20 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16517853#comment-16517853 ] jack edited comment on AIRFLOW-2644 at 6/20/18 9:22 AM: [~ashb] =Say you have

[jira] [Created] (AIRFLOW-2644) Allow whild-cards in the search box in the UI

2018-06-19 Thread jack (JIRA)
jack created AIRFLOW-2644: - Summary: Allow whild-cards in the search box in the UI Key: AIRFLOW-2644 URL: https://issues.apache.org/jira/browse/AIRFLOW-2644 Project: Apache Airflow Issue Type:

[jira] [Commented] (AIRFLOW-2902) S3ToBigQuery operator / S3ToGoogleStorage operator

2018-08-15 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16580926#comment-16580926 ] jack commented on AIRFLOW-2902: --- [~ashb] I didn't see S3ToGoogleCloudStorageOperator  in the docs. If

[jira] [Created] (AIRFLOW-2902) S3ToBigQuery operator / S3ToGoogleStorage operator

2018-08-15 Thread jack (JIRA)
jack created AIRFLOW-2902: - Summary: S3ToBigQuery operator / S3ToGoogleStorage operator Key: AIRFLOW-2902 URL: https://issues.apache.org/jira/browse/AIRFLOW-2902 Project: Apache Airflow Issue

[jira] [Commented] (AIRFLOW-2902) S3ToBigQuery operator / S3ToGoogleStorage operator

2018-08-16 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16582023#comment-16582023 ] jack commented on AIRFLOW-2902: --- [~ashb] That seems good! Note that the example there is missing the

[jira] [Created] (AIRFLOW-2925) gcp dataflow hook doesn't show traceback

2018-08-20 Thread jack (JIRA)
jack created AIRFLOW-2925: - Summary: gcp dataflow hook doesn't show traceback Key: AIRFLOW-2925 URL: https://issues.apache.org/jira/browse/AIRFLOW-2925 Project: Apache Airflow Issue Type:

[jira] [Commented] (AIRFLOW-2405) Roadmap or Cadence for Airflow releases?

2018-08-20 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16586081#comment-16586081 ] jack commented on AIRFLOW-2405: --- [~eschwartz] There isn't. The next 1.10.0 should be released very soon.

[jira] [Commented] (AIRFLOW-169) Hide expire dags in UI

2018-08-21 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16587340#comment-16587340 ] jack commented on AIRFLOW-169: -- To work around this simply "trun off" the dags from the UI. then you have a

[jira] [Commented] (AIRFLOW-1395) sql_alchemy_conn_cmd does not work when executor is non SequentialExecutor

2018-08-21 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16587331#comment-16587331 ] jack commented on AIRFLOW-1395: --- Your error says you are trying to work with SQLite & LocalExecutor -

[jira] [Commented] (AIRFLOW-2931) Make Quick Start work when user doesn't have `cryptography` installed

2018-08-22 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16588551#comment-16588551 ] jack commented on AIRFLOW-2931: --- The instructions are written in the configuration guide:

[jira] [Created] (AIRFLOW-2932) GoogleCloudStorageHook - allow compression of file

2018-08-22 Thread jack (JIRA)
jack created AIRFLOW-2932: - Summary: GoogleCloudStorageHook - allow compression of file Key: AIRFLOW-2932 URL: https://issues.apache.org/jira/browse/AIRFLOW-2932 Project: Apache Airflow Issue Type:

[jira] [Created] (AIRFLOW-2975) Add support for Amazon cloudwatch (computing power at will)

2018-08-29 Thread jack (JIRA)
jack created AIRFLOW-2975: - Summary: Add support for Amazon cloudwatch (computing power at will) Key: AIRFLOW-2975 URL: https://issues.apache.org/jira/browse/AIRFLOW-2975 Project: Apache Airflow

[jira] [Commented] (AIRFLOW-2965) Add CLI command to find the next dag run.

2018-08-27 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16594518#comment-16594518 ] jack commented on AIRFLOW-2965: --- [~sanand] I have no knowledge of how to implement this. Anyone Is

[jira] [Commented] (AIRFLOW-843) Store task exceptions in context

2018-08-23 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16589884#comment-16589884 ] jack commented on AIRFLOW-843: -- [~ashb] [~thesquelched] any progress with merging this? > Store task

[jira] [Commented] (AIRFLOW-971) Remove mysql as a dependency when not explicitly required

2018-08-22 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16588960#comment-16588960 ] jack commented on AIRFLOW-971: -- not sure why {{setup.py}}{color:#00} :{color}{{devel_minreq = devel +

[jira] [Commented] (AIRFLOW-1261) clarify the docs for the CLI's airflow run --local flag

2018-08-23 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16589957#comment-16589957 ] jack commented on AIRFLOW-1261: --- [~maxime.beauche...@apache.org] It appears in the docs:

[jira] [Commented] (AIRFLOW-655) Is there a way to add dags at run time without restarting the web server?

2018-08-23 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16589962#comment-16589962 ] jack commented on AIRFLOW-655: -- [~rouge] Why do you need to restart the webserver? The webserver is just a

[jira] [Commented] (AIRFLOW-2574) initdb fails when mysql password contains percent sign

2018-08-23 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16589975#comment-16589975 ] jack commented on AIRFLOW-2574: --- [~0] This is unrelated to MySQL. It happens because Airflow uses

[jira] [Commented] (AIRFLOW-627) Tasks getting Queued when Pool is full sometimes never run

2018-08-23 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16590072#comment-16590072 ] jack commented on AIRFLOW-627: -- [~btall...@gmail.com] What do you expect to happen when the pool is full?

[jira] [Commented] (AIRFLOW-438) "airflow initdb" not working

2018-08-23 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16590076#comment-16590076 ] jack commented on AIRFLOW-438: -- There shouldn't be any forced install of packages just because a specific

[jira] [Commented] (AIRFLOW-987) `airflow kerberos` ignores --keytab and --principal arguments

2018-08-23 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16590091#comment-16590091 ] jack commented on AIRFLOW-987: -- [~bolke] is it still an issue? > `airflow kerberos` ignores --keytab and

[jira] [Commented] (AIRFLOW-2890) AirFlow does not get started

2018-08-20 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16585990#comment-16585990 ] jack commented on AIRFLOW-2890: --- [~zhilevan] Are you trying to install Airflow over windows? it can't be

[jira] [Commented] (AIRFLOW-2824) Disable loading of default connections via airflow config

2018-08-20 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16585995#comment-16585995 ] jack commented on AIRFLOW-2824: --- [~ashb] I see that other have fallen to this as well... a doc fix is

[jira] [Created] (AIRFLOW-2965) Add CLI command to find the next dag run.

2018-08-27 Thread jack (JIRA)
jack created AIRFLOW-2965: - Summary: Add CLI command to find the next dag run. Key: AIRFLOW-2965 URL: https://issues.apache.org/jira/browse/AIRFLOW-2965 Project: Apache Airflow Issue Type: Task

[jira] [Updated] (AIRFLOW-2965) Add CLI command to find the next dag run.

2018-08-27 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jack updated AIRFLOW-2965: -- Description: I have a dag with the following properties: {code:java} dag = DAG(     dag_id='mydag',    

[jira] [Commented] (AIRFLOW-2958) airflow.exceptions.AirflowTaskTimeout: Timeout - 1 DAG with 3000 tasks + 3000 downstream tasks

2018-08-26 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16592816#comment-16592816 ] jack commented on AIRFLOW-2958: --- [~swagatsarma] You need to give more details. Code sample of what you

[jira] [Commented] (AIRFLOW-372) DAGs can run before start_date time

2018-08-29 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16596261#comment-16596261 ] jack commented on AIRFLOW-372: -- The recommendation I got when I started using airflow is to never mess with

[jira] [Commented] (AIRFLOW-2975) Add support for Amazon cloudwatch (computing power at will)

2018-08-29 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16596216#comment-16596216 ] jack commented on AIRFLOW-2975: --- [~ashb] How can I optimize the number of workers? 1 per core? > Add

[jira] [Closed] (AIRFLOW-2635) Add discription column to UI

2018-07-18 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jack closed AIRFLOW-2635. - Resolution: Not A Problem Fix Version/s: (was: 2.0.0) > Add discription column to UI >

[jira] [Created] (AIRFLOW-2764) Discription for dags

2018-07-18 Thread jack (JIRA)
jack created AIRFLOW-2764: - Summary: Discription for dags Key: AIRFLOW-2764 URL: https://issues.apache.org/jira/browse/AIRFLOW-2764 Project: Apache Airflow Issue Type: Wish Reporter:

[jira] [Updated] (AIRFLOW-2635) Add discription column to UI

2018-07-18 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jack updated AIRFLOW-2635: -- Description: Currently in the UI we see the dag_id of the DAG. When many users use the UI it's not always

[jira] [Commented] (AIRFLOW-2764) Discription for dags

2018-07-25 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16555177#comment-16555177 ] jack commented on AIRFLOW-2764: --- [~verdan] It's not the same. The description you are referring to is

[jira] [Comment Edited] (AIRFLOW-2764) Discription for dags

2018-07-25 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16555177#comment-16555177 ] jack edited comment on AIRFLOW-2764 at 7/25/18 6:02 AM: [~verdan] It's not the

[jira] [Commented] (AIRFLOW-2999) S3_hook - add the ability to download file to local disk

2018-09-05 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16603980#comment-16603980 ] jack commented on AIRFLOW-2999: --- [~XD-DENG] This won't work when you want to download a folder... which

[jira] [Commented] (AIRFLOW-2999) S3_hook - add the ability to download file to local disk

2018-09-06 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16605494#comment-16605494 ] jack commented on AIRFLOW-2999: --- [~XD-DENG] well I never saw a discussion on a topic before a PR was

[jira] [Updated] (AIRFLOW-2925) gcp dataflow hook doesn't show traceback

2018-09-06 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jack updated AIRFLOW-2925: -- Affects Version/s: (was: 1.10.0) 1.10.1 Issue Type: Bug (was:

[jira] [Updated] (AIRFLOW-2925) gcp dataflow hook doesn't show traceback

2018-09-06 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jack updated AIRFLOW-2925: -- Affects Version/s: (was: 1.10.1) 1.10.0 > gcp dataflow hook doesn't show

[jira] [Commented] (AIRFLOW-2932) GoogleCloudStorageHook - allow compression of file

2018-09-06 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16605628#comment-16605628 ] jack commented on AIRFLOW-2932: --- [~xnuinside]  [~kaxilnaik] This is exactly my intention :) I hope this

[jira] [Commented] (AIRFLOW-2999) S3_hook - add the ability to download file to local disk

2018-09-04 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16603239#comment-16603239 ] jack commented on AIRFLOW-2999: --- [~XD-DENG] seems like your territory if you would like to take it :)  >

[jira] [Created] (AIRFLOW-2746) UI shows error while there is no error.

2018-07-11 Thread jack (JIRA)
jack created AIRFLOW-2746: - Summary: UI shows error while there is no error. Key: AIRFLOW-2746 URL: https://issues.apache.org/jira/browse/AIRFLOW-2746 Project: Apache Airflow Issue Type: Bug

[jira] [Updated] (AIRFLOW-2724) Change the background color of running DAG to green

2018-07-09 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jack updated AIRFLOW-2724: -- Attachment: (was: 1.PNG) > Change the background color of running DAG to green >

[jira] [Updated] (AIRFLOW-2724) Change the background color of running DAG to green

2018-07-09 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jack updated AIRFLOW-2724: -- Attachment: 1.PNG > Change the background color of running DAG to green >

[jira] [Created] (AIRFLOW-2724) Change the background color of running DAG to green

2018-07-09 Thread jack (JIRA)
jack created AIRFLOW-2724: - Summary: Change the background color of running DAG to green Key: AIRFLOW-2724 URL: https://issues.apache.org/jira/browse/AIRFLOW-2724 Project: Apache Airflow Issue Type:

[jira] [Created] (AIRFLOW-3170) Jinja templating error - to be clearer

2018-10-08 Thread jack (JIRA)
jack created AIRFLOW-3170: - Summary: Jinja templating error - to be clearer Key: AIRFLOW-3170 URL: https://issues.apache.org/jira/browse/AIRFLOW-3170 Project: Apache Airflow Issue Type: Bug

[jira] [Updated] (AIRFLOW-3145) [Edit Docummntation ] reduce airflow dag scheduling latency in production

2018-10-08 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jack updated AIRFLOW-3145: -- Component/s: docs Summary: [Edit Docummntation ] reduce airflow dag scheduling latency in production

[jira] [Created] (AIRFLOW-3204) Allow standard SQL for BigQueryValueCheckOperator

2018-10-14 Thread jack (JIRA)
jack created AIRFLOW-3204: - Summary: Allow standard SQL for BigQueryValueCheckOperator Key: AIRFLOW-3204 URL: https://issues.apache.org/jira/browse/AIRFLOW-3204 Project: Apache Airflow Issue Type:

[jira] [Commented] (AIRFLOW-3205) GCS: Support multipart upload

2018-10-15 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16649979#comment-16649979 ] jack commented on AIRFLOW-3205: --- Some operators like: MySqlToGoogleCloudStorageOperator do support this

[jira] [Commented] (AIRFLOW-2999) S3_hook - add the ability to download file to local disk

2018-10-16 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16651171#comment-16651171 ] jack commented on AIRFLOW-2999: --- [~Fokko] [~kaxilnaik] [~ashb]   Do you guys have opinion on the issue ?

[jira] [Commented] (AIRFLOW-1471) DAGs not deleted from scheduler after DAG file is removed

2018-10-22 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16658762#comment-16658762 ] jack commented on AIRFLOW-1471: --- This is not a bug. Deleting DAG file manually doesn't delete it from

[jira] [Commented] (AIRFLOW-1523) Clicking on Graph View should display related DAG run

2018-10-22 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16658764#comment-16658764 ] jack commented on AIRFLOW-1523: --- This is actually quite annoying. I noticed this too.   > Clicking on

[jira] [Commented] (AIRFLOW-801) Outdated docstring on baseclass

2018-10-22 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16658695#comment-16658695 ] jack commented on AIRFLOW-801: -- The docs has been fixed isn't it? > Outdated docstring on baseclass >

[jira] [Commented] (AIRFLOW-1360) SLA miss goes to all emails in DAG

2018-10-22 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16658711#comment-16658711 ] jack commented on AIRFLOW-1360: --- Also happens on 1.9 > SLA miss goes to all emails in DAG >

[jira] [Commented] (AIRFLOW-2925) gcp dataflow hook doesn't show traceback

2018-10-22 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16658863#comment-16658863 ] jack commented on AIRFLOW-2925: --- [~xnuinside] where does the log shows the exception message? "DataFlow

[jira] [Commented] (AIRFLOW-2323) Should we replace the librabbitmq with other library in setup.py for Apache Airflow 1.9+?

2018-10-22 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16658901#comment-16658901 ] jack commented on AIRFLOW-2323: --- It doesn't seems like the librabbitmq lib is going to fix the problems.

[jira] [Commented] (AIRFLOW-1753) Can't install on windows 10

2018-10-22 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16659062#comment-16659062 ] jack commented on AIRFLOW-1753: --- [~ashb] I think it's worth mentioning on the docs (at least in the FAQ

[jira] [Commented] (AIRFLOW-2574) initdb fails when mysql password contains percent sign

2018-10-22 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16658796#comment-16658796 ] jack commented on AIRFLOW-2574: --- This was fixed and merged. Can be closed? > initdb fails when mysql

[jira] [Commented] (AIRFLOW-2722) ECSOperator requires network configuration parameter when FARGATE launch type is used

2018-10-22 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16658857#comment-16658857 ] jack commented on AIRFLOW-2722: --- [~ThomasVdBerge] this refers to your PR > ECSOperator requires network

[jira] [Issue Comment Deleted] (AIRFLOW-2574) initdb fails when mysql password contains percent sign

2018-10-22 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jack updated AIRFLOW-2574: -- Comment: was deleted (was: This was fixed and merged. Can be closed?) > initdb fails when mysql password

[jira] [Commented] (AIRFLOW-2141) Cannot create airflow variables when there is a list of dictionary as a value

2018-10-22 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16658904#comment-16658904 ] jack commented on AIRFLOW-2141: --- This is related to a similar ticket I opened:

[jira] [Commented] (AIRFLOW-63) Dangling Running Jobs

2018-10-21 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-63?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16658225#comment-16658225 ] jack commented on AIRFLOW-63: - [~ashb] I think your PR fixed this?

[jira] [Commented] (AIRFLOW-540) Allow BigQuery operators to specify default dataset

2018-10-21 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16658263#comment-16658263 ] jack commented on AIRFLOW-540: -- Specifying the default dataset is confusing. There are queries which run

[jira] [Commented] (AIRFLOW-210) sqlalchemy warns about task_instance.execution_date invoked with an empty sequence

2018-10-21 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16658228#comment-16658228 ] jack commented on AIRFLOW-210: -- [~ajayyadava] is this still an issue? > sqlalchemy warns about

[jira] [Commented] (AIRFLOW-2338) Airflow requires Hive config

2018-10-17 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16653029#comment-16653029 ] jack commented on AIRFLOW-2338: --- Are you running 1.10 or 1.9? > Airflow requires Hive config >

[jira] [Commented] (AIRFLOW-2136) MySqlOperator does not comply well with sql scripts with multiple statements with MySQL warnings

2018-10-17 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16653216#comment-16653216 ] jack commented on AIRFLOW-2136: --- You should submit your code with PR. If there are notes on this you will

[jira] [Commented] (AIRFLOW-2736) Airflow 1.9.0+ Scheduler not honouring "non_pooled_task_slot_count" config

2018-10-17 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16653211#comment-16653211 ] jack commented on AIRFLOW-2736: --- What are  the values of {{AIRFLOW__CORE__PARALLELISM and

[jira] [Comment Edited] (AIRFLOW-2736) Airflow 1.9.0+ Scheduler not honouring "non_pooled_task_slot_count" config

2018-10-17 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16653211#comment-16653211 ] jack edited comment on AIRFLOW-2736 at 10/17/18 9:00 AM: - What are the values

[jira] [Created] (AIRFLOW-3227) Airflow is broken when deleting a Variable

2018-10-18 Thread jack (JIRA)
jack created AIRFLOW-3227: - Summary: Airflow is broken when deleting a Variable Key: AIRFLOW-3227 URL: https://issues.apache.org/jira/browse/AIRFLOW-3227 Project: Apache Airflow Issue Type:

[jira] [Updated] (AIRFLOW-3227) Airflow is broken when deleting a Variable

2018-10-18 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jack updated AIRFLOW-3227: -- Priority: Critical (was: Major) Issue Type: Bug (was: Improvement) > Airflow is broken when deleting

[jira] [Closed] (AIRFLOW-3227) Airflow is broken when deleting a Variable

2018-10-18 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jack closed AIRFLOW-3227. - Resolution: Done > Airflow is broken when deleting a Variable > -- > >

[jira] [Commented] (AIRFLOW-3227) Airflow is broken when deleting a Variable

2018-10-18 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16654930#comment-16654930 ] jack commented on AIRFLOW-3227: --- [~ashb] I have not DAG file with that name. > Airflow is broken when

[jira] [Commented] (AIRFLOW-3227) Airflow is broken when deleting a Variable

2018-10-18 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16654964#comment-16654964 ] jack commented on AIRFLOW-3227: --- Well I have no such file nor it has logs folder.. I deleted records of

[jira] [Updated] (AIRFLOW-3169) Indicate in the main UI if the scheduler is NOT working.

2018-10-15 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jack updated AIRFLOW-3169: -- Labels: (was: easy-fix) > Indicate in the main UI if the scheduler is NOT working. >

[jira] [Updated] (AIRFLOW-3169) Indicate in the main UI if the scheduler is NOT working.

2018-10-15 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jack updated AIRFLOW-3169: -- Affects Version/s: 1.10.0 Labels: easy-fix (was: ) > Indicate in the main UI if the

[jira] [Updated] (AIRFLOW-3158) Improve error message for Broken DAG by adding function name

2018-10-15 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jack updated AIRFLOW-3158: -- Affects Version/s: (was: 1.9.0) 1.10.0 Labels: easy-fix (was: ) >

[jira] [Commented] (AIRFLOW-1114) S3Hook doesn't support Minio

2018-10-16 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16651707#comment-16651707 ] jack commented on AIRFLOW-1114: --- Is this still an issue? The S3Hook uses the AwsHook which uses boto3. >

[jira] [Commented] (AIRFLOW-2666) Cannot import exported variables

2018-10-16 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16651750#comment-16651750 ] jack commented on AIRFLOW-2666: --- I had no trouble importing float numbers. I did have a problem

[jira] [Commented] (AIRFLOW-374) Kill task instances that haven't been able to heartbeat for a while

2018-10-16 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16651685#comment-16651685 ] jack commented on AIRFLOW-374: -- Not sure if this is related but on 1.9.0 I occasionally see DAG run and a

[jira] [Commented] (AIRFLOW-1898) Large XComs are not supported and fail silently

2018-10-16 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16651693#comment-16651693 ] jack commented on AIRFLOW-1898: --- Regardless if there should be a limit or not There shouldn't be a

[jira] [Commented] (AIRFLOW-1279) BashOperator - How to access arguments in python file. (Arguments not found in python file)

2018-10-16 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16651702#comment-16651702 ] jack commented on AIRFLOW-1279: --- For support requests you may use the Slack channel:

[jira] [Commented] (AIRFLOW-2873) Improvements to Quick Start flow

2018-10-16 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16651717#comment-16651717 ] jack commented on AIRFLOW-2873: --- [~ggeijteman] I believe this is needed for the example DAGs >

[jira] [Commented] (AIRFLOW-981) TreeView date axis shows dates into the future

2018-10-16 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16651583#comment-16651583 ] jack commented on AIRFLOW-981: -- Never saw this on 1.9.0 Maybe it's a 1.7 issue that was resolved? >

[jira] [Commented] (AIRFLOW-2104) Recommendation for Airflow design/architecture

2018-10-16 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16651785#comment-16651785 ] jack commented on AIRFLOW-2104: --- You can get support on [https://stackoverflow.com/] or Slack channel

[jira] [Commented] (AIRFLOW-1940) s3_file_transform_operator does not work with boto3

2018-10-16 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16651799#comment-16651799 ] jack commented on AIRFLOW-1940: --- [~unclaimedpants] What exactly is the problem? >

[jira] [Created] (AIRFLOW-3254) BigQueryGetDataOperator to support reading query from SQL file

2018-10-24 Thread jack (JIRA)
jack created AIRFLOW-3254: - Summary: BigQueryGetDataOperator to support reading query from SQL file Key: AIRFLOW-3254 URL: https://issues.apache.org/jira/browse/AIRFLOW-3254 Project: Apache Airflow

[jira] [Commented] (AIRFLOW-351) Failed to clear downstream tasks

2018-10-28 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1344#comment-1344 ] jack commented on AIRFLOW-351: -- There seems to be an open (old) PR for this which isn't listed in the

[jira] [Commented] (AIRFLOW-2925) gcp dataflow hook doesn't show traceback

2018-10-28 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1334#comment-1334 ] jack commented on AIRFLOW-2925: --- [~xnuinside] correct me if I'm wrong but when raise Exception("DataFlow

[jira] [Commented] (AIRFLOW-1079) Dag is still visible in ui, after removing it from the dag folder

2018-10-28 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1347#comment-1347 ] jack commented on AIRFLOW-1079: --- Deleting the DAG file manually doesn't delete it from the database so it

  1   2   3   >