[jira] [Commented] (AIRFLOW-32) Remove deprecated features prior to releasing Airflow 2.0

2018-12-23 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-32?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16727965#comment-16727965 ] jack commented on AIRFLOW-32: - All tasks in this ticket have been merged. Can be closed? > Remove

[jira] [Commented] (AIRFLOW-2319) Table "dag_run" has (bad) second index on (dag_id, execution_date)

2018-12-23 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16727962#comment-16727962 ] jack commented on AIRFLOW-2319: --- [~akoeltringer] I think officialy there are only 3: SQlite, PostgreSQL

[jira] [Commented] (AIRFLOW-3045) Duplicate entry error with MySQL when update task_instances

2018-12-23 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16727960#comment-16727960 ] jack commented on AIRFLOW-3045: --- Shouldn't have this break any MySQL back-end installed since 1.10.0 ? >

[jira] [Commented] (AIRFLOW-2609) Fix small issue with the BranchPythonOperator. It currently is skipping tasks it should not.

2018-12-23 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16727957#comment-16727957 ] jack commented on AIRFLOW-2609: --- This ticket needs to be open. The PR wasn't merged yet:

[jira] [Commented] (AIRFLOW-3047) HiveCliHook does not work properly with Beeline

2018-12-23 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16727950#comment-16727950 ] jack commented on AIRFLOW-3047: --- [~vladglinskiy] can you submit PR for this? > HiveCliHook does not work

[jira] [Commented] (AIRFLOW-3243) UI task and dag clear feature cannot pick up dag parameters

2018-12-23 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16727944#comment-16727944 ] jack commented on AIRFLOW-3243: --- I don't think the max_active_runs is enforced when clearing tasks. > UI

[jira] [Commented] (AIRFLOW-3017) 404 error when opening log in the Web UI

2018-12-23 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16727939#comment-16727939 ] jack commented on AIRFLOW-3017: --- This seems like a local issue on the old UI which is deprecated for

[jira] [Commented] (AIRFLOW-2842) GCS rsync operator

2018-12-23 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16727842#comment-16727842 ] jack commented on AIRFLOW-2842: --- [~dlamblin] This can be achieved with BashOperator but you can say this

[jira] [Commented] (AIRFLOW-3288) Add SNS integration

2018-12-23 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16727827#comment-16727827 ] jack commented on AIRFLOW-3288: --- [~ashb] This was merged. The ticket can be closed. > Add SNS

[jira] [Commented] (AIRFLOW-3356) Scheduler gets stuck for certain DAGs

2018-12-22 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16727825#comment-16727825 ] jack commented on AIRFLOW-3356: --- I'm having the same issue also on 1.9 Some tasks are stuck on running

[jira] [Commented] (AIRFLOW-3426) Correct references to Python version tested (3.4 -> 3.5)

2018-12-20 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16725867#comment-16725867 ] jack commented on AIRFLOW-3426: --- This was merged. Ticket can be closed. > Correct references to Python

[jira] [Updated] (AIRFLOW-3254) BigQueryGetDataOperator to support reading query from SQL file

2018-12-20 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jack updated AIRFLOW-3254: -- Affects Version/s: (was: 1.10.0) 1.10.1 > BigQueryGetDataOperator to support

[jira] [Commented] (AIRFLOW-2143) Try number displays incorrect values in the web UI

2018-12-20 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16725686#comment-16725686 ] jack commented on AIRFLOW-2143: --- I see this also > Try number displays incorrect values in the web UI >

[jira] [Commented] (AIRFLOW-644) Issue with past runs when using starttime as datetime.now()

2018-12-20 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16725680#comment-16725680 ] jack commented on AIRFLOW-644: -- It's a bad practice to do 'start_date': datetime.now(),``` > Issue with

[jira] [Commented] (AIRFLOW-549) Scheduler child logs are created out of normal location

2018-12-20 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16725682#comment-16725682 ] jack commented on AIRFLOW-549: -- [~bolke] is this still an issue? > Scheduler child logs are created out of

[jira] [Commented] (AIRFLOW-1288) Bad owners field in DAGs breaks Airflow front page

2018-12-19 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16725610#comment-16725610 ] jack commented on AIRFLOW-1288: --- Did you set your owner to be a list instead of string? > Bad owners

[jira] [Commented] (AIRFLOW-1322) Cannot mark task as success

2018-12-19 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16725607#comment-16725607 ] jack commented on AIRFLOW-1322: --- [~Fokko] is this still an issue? > Cannot mark task as success >

[jira] [Commented] (AIRFLOW-1362) Paused dag restarted on upgrading airflow from 1.8.0 to 1.8.1

2018-12-19 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16725609#comment-16725609 ] jack commented on AIRFLOW-1362: --- Did it happen when you perform upgrade in your test environment? >

[jira] [Created] (AIRFLOW-3538) BigQueryToCloudStorageOperator to support bucket

2018-12-18 Thread jack (JIRA)
jack created AIRFLOW-3538: - Summary: BigQueryToCloudStorageOperator to support bucket Key: AIRFLOW-3538 URL: https://issues.apache.org/jira/browse/AIRFLOW-3538 Project: Apache Airflow Issue Type:

[jira] [Commented] (AIRFLOW-698) dag_run "scheduled" property should be it's own DB column

2018-12-17 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16722792#comment-16722792 ] jack commented on AIRFLOW-698: -- How setting up a new column resolve this ? > dag_run "scheduled" property

[jira] [Commented] (AIRFLOW-953) Tasks marked as successful should have complete state set

2018-12-17 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16722790#comment-16722790 ] jack commented on AIRFLOW-953: -- Why duration should be 0? It logs the time it took the task to be

[jira] [Commented] (AIRFLOW-2660) Deadlock error from SQLAlchemy when the parallelism is increased.

2018-12-17 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16722777#comment-16722777 ] jack commented on AIRFLOW-2660: --- I suspect that this is a known MySQL issue:

[jira] [Commented] (AIRFLOW-3254) BigQueryGetDataOperator to support reading query from SQL file

2018-12-16 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16722503#comment-16722503 ] jack commented on AIRFLOW-3254: --- [~kaxilnaik] any chance you are working on this for the 1.10.2? >

[jira] [Commented] (AIRFLOW-490) Scope should be auto-added to the connection per GCP hook

2018-12-12 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16719850#comment-16719850 ] jack commented on AIRFLOW-490: -- After checking... this was already implemented:

[jira] [Commented] (AIRFLOW-1536) DaemonContext uses default umask 0

2018-12-12 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16719251#comment-16719251 ] jack commented on AIRFLOW-1536: --- this could be a venerability though I'm not sure it's urgent to fix. >

[jira] [Commented] (AIRFLOW-3210) Changing defaults types in BigQuery Hook break BigQuery operator

2018-12-12 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16719224#comment-16719224 ] jack commented on AIRFLOW-3210: --- I think it was solved by 

[jira] [Commented] (AIRFLOW-353) when multiple tasks removed update state fails

2018-12-12 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16719230#comment-16719230 ] jack commented on AIRFLOW-353: -- Did [https://github.com/apache/incubator-airflow/pull/1675] resolve this

[jira] [Commented] (AIRFLOW-352) filter_by_owner is not working when use ldap authentication

2018-12-12 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16719226#comment-16719226 ] jack commented on AIRFLOW-352: -- Duplicate of https://issues.apache.org/jira/browse/AIRFLOW-1552 >

[jira] [Commented] (AIRFLOW-490) Scope should be auto-added to the connection per GCP hook

2018-12-12 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16719220#comment-16719220 ] jack commented on AIRFLOW-490: -- Sounds like a reasonable idea > Scope should be auto-added to the

[jira] [Commented] (AIRFLOW-473) Allow the usage of the same connection "service key" for GCP DataFlow

2018-12-12 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16719216#comment-16719216 ] jack commented on AIRFLOW-473: -- Is this still an issue? > Allow the usage of the same connection "service

[jira] [Commented] (AIRFLOW-691) Add SSH keepalive option to ssh_hook

2018-12-12 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16719213#comment-16719213 ] jack commented on AIRFLOW-691: -- Fixed with https://github.com/apache/incubator-airflow/pull/1937 > Add SSH

[jira] [Commented] (AIRFLOW-3419) S3_hook.select_key is broken on Python3

2018-12-12 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16719209#comment-16719209 ] jack commented on AIRFLOW-3419: --- I'm not sure this is the reason... the decode is the same for Python 3

[jira] [Updated] (AIRFLOW-3499) Add flag to Opeators to write the Render to the log.

2018-12-11 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jack updated AIRFLOW-3499: -- Description: *Motivation:* I have few operators who uses Variable. The variable is updated consistently

[jira] [Created] (AIRFLOW-3499) Add flag to Opeators to write the Render to the log.

2018-12-11 Thread jack (JIRA)
jack created AIRFLOW-3499: - Summary: Add flag to Opeators to write the Render to the log. Key: AIRFLOW-3499 URL: https://issues.apache.org/jira/browse/AIRFLOW-3499 Project: Apache Airflow Issue

[jira] [Commented] (AIRFLOW-1158) Multipart uploads to s3 cut off at nearest division

2018-12-11 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16716518#comment-16716518 ] jack commented on AIRFLOW-1158: --- According to the pull request this is no longer needed because Airflow

[jira] [Commented] (AIRFLOW-2265) Splunk Hook/Operator

2018-12-11 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16716497#comment-16716497 ] jack commented on AIRFLOW-2265: --- Hi [~yampelo] you can use the mailing list for some input. Also note

[jira] [Commented] (AIRFLOW-532) DB API hook's insert rows sets autocommit non-generically

2018-12-11 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16716489#comment-16716489 ] jack commented on AIRFLOW-532: -- [~ashb] can you close this? > DB API hook's insert rows sets autocommit

[jira] [Commented] (AIRFLOW-3347) Unable to configure Kubernetes secrets through environment

2018-12-10 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16715012#comment-16715012 ] jack commented on AIRFLOW-3347: --- [~cbandy] can you open a PR with the fix? > Unable to configure

[jira] [Commented] (AIRFLOW-54) Special tags when referring to other tasks

2018-12-10 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-54?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16714807#comment-16714807 ] jack commented on AIRFLOW-54: - This is a great idea +1 for it as well > Special tags when referring to

[jira] [Commented] (AIRFLOW-123) Differentiate Between Failure and Timeout

2018-12-10 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16714804#comment-16714804 ] jack commented on AIRFLOW-123: -- There can be various of reasons for DAG failure. Why "timeout" or more

[jira] [Commented] (AIRFLOW-1396) Transfer data from BigQuery to MySQL operator

2018-12-10 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16714783#comment-16714783 ] jack commented on AIRFLOW-1396: --- There isn't any direct operator from any database to BigQuery.

[jira] [Commented] (AIRFLOW-1417) Add tests for BigQueryToCloudStorageOperator

2018-12-10 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16714781#comment-16714781 ] jack commented on AIRFLOW-1417: --- I'm surprised we don't have that yet.  > Add tests for

[jira] [Commented] (AIRFLOW-1026) connection string using _cmd tin airflow.cfg is broken

2018-12-10 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16714687#comment-16714687 ] jack commented on AIRFLOW-1026: --- SQLite can not be used with LocalExecutor > connection string using

[jira] [Commented] (AIRFLOW-1822) Add gaiohttp and gthread gunicorn workerclass option in cli

2018-12-08 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16713881#comment-16713881 ] jack commented on AIRFLOW-1822: --- This ticket has also a pending PR:

[jira] [Commented] (AIRFLOW-1490) In order to get details on exceptions thrown by tasks, the onfailure callback needs an enhancement

2018-12-06 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16711477#comment-16711477 ] jack commented on AIRFLOW-1490: --- You can prepare PR with your code suggestions > In order to get details

[jira] [Commented] (AIRFLOW-1405) Airflow v 1.8.1 unable to properly initialize with MySQL

2018-12-06 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16711385#comment-16711385 ] jack commented on AIRFLOW-1405: --- I think the best solution for this is for Airflow to catch this

[jira] [Work stopped] (AIRFLOW-3071) Unable to clear Val of Variable from the UI

2018-12-05 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on AIRFLOW-3071 stopped by jack. - > Unable to clear Val of Variable from the UI > ---

[jira] [Assigned] (AIRFLOW-3071) Unable to clear Val of Variable from the UI

2018-12-05 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jack reassigned AIRFLOW-3071: - Assignee: (was: jack) > Unable to clear Val of Variable from the UI >

[jira] [Created] (AIRFLOW-3454) Task duration isn't updated while task is running

2018-12-05 Thread jack (JIRA)
jack created AIRFLOW-3454: - Summary: Task duration isn't updated while task is running Key: AIRFLOW-3454 URL: https://issues.apache.org/jira/browse/AIRFLOW-3454 Project: Apache Airflow Issue Type:

[jira] [Commented] (AIRFLOW-3058) Airflow log & multi-threading

2018-12-05 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16710075#comment-16710075 ] jack commented on AIRFLOW-3058: --- Yep. Added -u flag to the run of the script solve this issue. I think

[jira] [Closed] (AIRFLOW-3058) Airflow log & multi-threading

2018-12-05 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jack closed AIRFLOW-3058. - Resolution: Invalid > Airflow log & multi-threading > - > > Key:

[jira] [Commented] (AIRFLOW-1370) Scheduler is crashing because of IntegrityError

2018-12-02 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16706336#comment-16706336 ] jack commented on AIRFLOW-1370: --- Possibly duplicate of:

[jira] [Commented] (AIRFLOW-2219) Race condition to DagRun.verify_integrity between Scheduler and Webserver

2018-12-02 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16706338#comment-16706338 ] jack commented on AIRFLOW-2219: --- Possibly duplicate of

[jira] [Commented] (AIRFLOW-3364) Change Ooops Exception to something meanningfull

2018-11-27 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16700408#comment-16700408 ] jack commented on AIRFLOW-3364: --- This could be related to:

[jira] [Commented] (AIRFLOW-1703) Airflow LocalExecutor crashes after 3 hours of work. Database is locked

2018-11-27 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16700393#comment-16700393 ] jack commented on AIRFLOW-1703: --- SQLite with local executor? This doesn't make a lot of sense > Airflow

[jira] [Commented] (AIRFLOW-2076) [2017-11-21 16:12:40,961] {jobs.py:187} DEBUG - [heart] Boom.

2018-11-27 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16700382#comment-16700382 ] jack commented on AIRFLOW-2076: --- you are using old version of Airflow. can you check it against master?

[jira] [Commented] (AIRFLOW-1739) Cleanup naming ambiguity with TestDbApiHook test class

2018-11-26 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16699973#comment-16699973 ] jack commented on AIRFLOW-1739: --- PR was merged. Ticket can be closed. > Cleanup naming ambiguity with

[jira] [Created] (AIRFLOW-3399) BashOperator - bash_command is not rechecked after retry

2018-11-26 Thread jack (JIRA)
jack created AIRFLOW-3399: - Summary: BashOperator - bash_command is not rechecked after retry Key: AIRFLOW-3399 URL: https://issues.apache.org/jira/browse/AIRFLOW-3399 Project: Apache Airflow Issue

[jira] [Commented] (AIRFLOW-2813) `pip install apache-airflow` fails on Python 3.7

2018-11-26 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16698632#comment-16698632 ] jack commented on AIRFLOW-2813: --- [~ashb] this was resolved in 1.10.1 wasn't it? > `pip install

[jira] [Commented] (AIRFLOW-3302) Small CSS fixes

2018-11-26 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16698627#comment-16698627 ] jack commented on AIRFLOW-3302: --- PR was merged. The ticket can be closed. > Small CSS fixes >

[jira] [Commented] (AIRFLOW-3301) Update CI test for [AIRFLOW-3132] (PR #3977)

2018-11-26 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16698626#comment-16698626 ] jack commented on AIRFLOW-3301: --- PR was merged. This can be closed. > Update CI test for [AIRFLOW-3132]

[jira] [Created] (AIRFLOW-3364) Change Ooops Exception to something meanningfull

2018-11-19 Thread jack (JIRA)
jack created AIRFLOW-3364: - Summary: Change Ooops Exception to something meanningfull Key: AIRFLOW-3364 URL: https://issues.apache.org/jira/browse/AIRFLOW-3364 Project: Apache Airflow Issue Type:

[jira] [Commented] (AIRFLOW-2775) Recent Tasks Label Misleading

2018-11-18 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16690833#comment-16690833 ] jack commented on AIRFLOW-2775: --- isn't it better to just say "tasks from the most recent run" ? If it's

[jira] [Created] (AIRFLOW-3350) docs - explain how to use bitshift with lists

2018-11-14 Thread jack (JIRA)
jack created AIRFLOW-3350: - Summary: docs - explain how to use bitshift with lists Key: AIRFLOW-3350 URL: https://issues.apache.org/jira/browse/AIRFLOW-3350 Project: Apache Airflow Issue Type:

[jira] [Commented] (AIRFLOW-3337) "About" page version info is not available

2018-11-13 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16686141#comment-16686141 ] jack commented on AIRFLOW-3337: --- I think this was fixed by

[jira] [Updated] (AIRFLOW-3278) update operators uploading to GCS to support gzip flag

2018-11-08 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jack updated AIRFLOW-3278: -- Description: gzip flag was added to hook by PR:

[jira] [Commented] (AIRFLOW-3182) 'all_done' trigger rule works incorrectly with BranchPythonOperator upstream tasks

2018-11-08 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16679567#comment-16679567 ] jack commented on AIRFLOW-3182: --- Could the trigger rule you set be wrong? I think you should do:

[jira] [Commented] (AIRFLOW-3309) Missing Mongo DB connection type

2018-11-07 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16678283#comment-16678283 ] jack commented on AIRFLOW-3309: --- This should have been covered by

[jira] [Comment Edited] (AIRFLOW-2022) Web GUI paged entries do not show Last Run and DAG Runs

2018-11-07 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16678241#comment-16678241 ] jack edited comment on AIRFLOW-2022 at 11/7/18 1:50 PM: can't reproduce this.

[jira] [Commented] (AIRFLOW-2022) Web GUI paged entries do not show Last Run and DAG Runs

2018-11-07 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16678241#comment-16678241 ] jack commented on AIRFLOW-2022: --- can't reproduce this. Might be solved already. > Web GUI paged entries

[jira] [Commented] (AIRFLOW-284) HiveHook Cursor Scope Persistency

2018-11-05 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16675118#comment-16675118 ] jack commented on AIRFLOW-284: -- This was fixed: https://github.com/apache/incubator-airflow/pull/1629 >

[jira] [Commented] (AIRFLOW-3062) Add Qubole in integration docs

2018-11-05 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16675109#comment-16675109 ] jack commented on AIRFLOW-3062: --- This can be closed. it was merged. > Add Qubole in integration docs >

[jira] [Commented] (AIRFLOW-2323) Should we replace the librabbitmq with other library in setup.py for Apache Airflow 1.9+?

2018-11-01 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16671676#comment-16671676 ] jack commented on AIRFLOW-2323: --- According to

[jira] [Issue Comment Deleted] (AIRFLOW-2323) Should we replace the librabbitmq with other library in setup.py for Apache Airflow 1.9+?

2018-11-01 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jack updated AIRFLOW-2323: -- Comment: was deleted (was: According to [https://github.com/celery/librabbitmq/blob/master/Changelog]

[jira] [Comment Edited] (AIRFLOW-2323) Should we replace the librabbitmq with other library in setup.py for Apache Airflow 1.9+?

2018-11-01 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16658901#comment-16658901 ] jack edited comment on AIRFLOW-2323 at 11/1/18 2:27 PM: According to

[jira] [Commented] (AIRFLOW-2837) tenacity 4.8.0 breaks with python3.7

2018-11-01 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16671657#comment-16671657 ] jack commented on AIRFLOW-2837: --- Duplicate of https://issues.apache.org/jira/browse/AIRFLOW-2876 >

[jira] [Commented] (AIRFLOW-1068) Autocommit error with Airflow v1.7.1.3 and pymssql v2.1.3

2018-11-01 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16671615#comment-16671615 ] jack commented on AIRFLOW-1068: --- Are you referring to this ?

[jira] [Comment Edited] (AIRFLOW-2941) example_http_operator.py Python 3.7 invalid syntax

2018-11-01 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16671594#comment-16671594 ] jack edited comment on AIRFLOW-2941 at 11/1/18 1:06 PM: Should link this Jira

[jira] [Commented] (AIRFLOW-2941) example_http_operator.py Python 3.7 invalid syntax

2018-11-01 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16671594#comment-16671594 ] jack commented on AIRFLOW-2941: --- Should like this Jira to PR:

[jira] [Updated] (AIRFLOW-2764) Description for dags

2018-11-01 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jack updated AIRFLOW-2764: -- Summary: Description for dags (was: Discription for dags) > Description for dags > > >

[jira] [Created] (AIRFLOW-3278) update operators uploading to GCS to support gzip flag

2018-10-31 Thread jack (JIRA)
jack created AIRFLOW-3278: - Summary: update operators uploading to GCS to support gzip flag Key: AIRFLOW-3278 URL: https://issues.apache.org/jira/browse/AIRFLOW-3278 Project: Apache Airflow Issue

[jira] [Updated] (AIRFLOW-2644) Allow wild-cards in the search box in the UI

2018-10-31 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jack updated AIRFLOW-2644: -- Summary: Allow wild-cards in the search box in the UI (was: Allow whild-cards in the search box in the UI)

[jira] [Commented] (AIRFLOW-2541) Ability to discover custom plugins, operators, sensors, etc. from various locations

2018-10-31 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16669870#comment-16669870 ] jack commented on AIRFLOW-2541: --- [~riteshshrv] Why not submit your code suggestion as a PR? > Ability

[jira] [Created] (AIRFLOW-3269) mysql_hook replace depricated lib MySQLdb with PyMySQL

2018-10-29 Thread jack (JIRA)
jack created AIRFLOW-3269: - Summary: mysql_hook replace depricated lib MySQLdb with PyMySQL Key: AIRFLOW-3269 URL: https://issues.apache.org/jira/browse/AIRFLOW-3269 Project: Apache Airflow Issue

[jira] [Commented] (AIRFLOW-1533) differing arrow's color between tasks in graph view based on trigger rule

2018-10-29 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16667108#comment-16667108 ] jack commented on AIRFLOW-1533: --- This is a nice idea > differing arrow's color between tasks in graph

[jira] [Commented] (AIRFLOW-2999) S3_hook - add the ability to download file to local disk

2018-10-29 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16667096#comment-16667096 ] jack commented on AIRFLOW-2999: --- [~wileeam] I saw you assigned yourself on

[jira] [Issue Comment Deleted] (AIRFLOW-2999) S3_hook - add the ability to download file to local disk

2018-10-29 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jack updated AIRFLOW-2999: -- Comment: was deleted (was: [~wileeam] I saw you assigned yourself on

[jira] [Commented] (AIRFLOW-2999) S3_hook - add the ability to download file to local disk

2018-10-29 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16667093#comment-16667093 ] jack commented on AIRFLOW-2999: --- [~wileeam] I saw you assigned yourself on

[jira] [Updated] (AIRFLOW-2679) GoogleCloudStorageToBigQueryOperator to support MERGE

2018-10-29 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jack updated AIRFLOW-2679: -- Description: Currently the {color:#22}GoogleCloudStorageToBigQueryOp{color}{color:#22}erator

[jira] [Commented] (AIRFLOW-1079) Dag is still visible in ui, after removing it from the dag folder

2018-10-28 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1347#comment-1347 ] jack commented on AIRFLOW-1079: --- Deleting the DAG file manually doesn't delete it from the database so it

[jira] [Commented] (AIRFLOW-351) Failed to clear downstream tasks

2018-10-28 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1344#comment-1344 ] jack commented on AIRFLOW-351: -- There seems to be an open (old) PR for this which isn't listed in the

[jira] [Commented] (AIRFLOW-2925) gcp dataflow hook doesn't show traceback

2018-10-28 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1334#comment-1334 ] jack commented on AIRFLOW-2925: --- [~xnuinside] correct me if I'm wrong but when raise Exception("DataFlow

[jira] [Created] (AIRFLOW-3254) BigQueryGetDataOperator to support reading query from SQL file

2018-10-24 Thread jack (JIRA)
jack created AIRFLOW-3254: - Summary: BigQueryGetDataOperator to support reading query from SQL file Key: AIRFLOW-3254 URL: https://issues.apache.org/jira/browse/AIRFLOW-3254 Project: Apache Airflow

[jira] [Commented] (AIRFLOW-235) Improve connectors interface

2018-10-24 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16661974#comment-16661974 ] jack commented on AIRFLOW-235: -- I think this was already implemented. The Google Cloud Platform connection

[jira] [Commented] (AIRFLOW-376) TypeError("Boolean value of this clause is not defined")

2018-10-24 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16661971#comment-16661971 ] jack commented on AIRFLOW-376: -- [~xuanji] is this still an issue? > TypeError("Boolean value of this

[jira] [Commented] (AIRFLOW-1753) Can't install on windows 10

2018-10-22 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16659062#comment-16659062 ] jack commented on AIRFLOW-1753: --- [~ashb] I think it's worth mentioning on the docs (at least in the FAQ

[jira] [Commented] (AIRFLOW-2141) Cannot create airflow variables when there is a list of dictionary as a value

2018-10-22 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16658904#comment-16658904 ] jack commented on AIRFLOW-2141: --- This is related to a similar ticket I opened:

[jira] [Commented] (AIRFLOW-2323) Should we replace the librabbitmq with other library in setup.py for Apache Airflow 1.9+?

2018-10-22 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16658901#comment-16658901 ] jack commented on AIRFLOW-2323: --- It doesn't seems like the librabbitmq lib is going to fix the problems.

[jira] [Commented] (AIRFLOW-2925) gcp dataflow hook doesn't show traceback

2018-10-22 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16658863#comment-16658863 ] jack commented on AIRFLOW-2925: --- [~xnuinside] where does the log shows the exception message? "DataFlow

[jira] [Commented] (AIRFLOW-2722) ECSOperator requires network configuration parameter when FARGATE launch type is used

2018-10-22 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16658857#comment-16658857 ] jack commented on AIRFLOW-2722: --- [~ThomasVdBerge] this refers to your PR > ECSOperator requires network

  1   2   3   >