[jira] [Commented] (AIRFLOW-5509) Support PATCH method in `DatabricksHook`

2019-12-17 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16998500#comment-16998500 ] jack commented on AIRFLOW-5509: --- [~rosalyntaylor] you can always submit your PRs for improvements. No

[jira] [Commented] (AIRFLOW-6174) Airflow Databricks Hook requires host in extras

2019-12-17 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16998498#comment-16998498 ] jack commented on AIRFLOW-6174: --- This change was introduced in 

[jira] [Commented] (AIRFLOW-5171) Random task gets stuck in queued state despite all dependencies met

2019-12-17 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16998489#comment-16998489 ] jack commented on AIRFLOW-5171: --- I can confirm this bug also exist in 1.10.3 + Local Executor. Sadly for

[jira] [Commented] (AIRFLOW-5557) Mongo Replica connection Hostname causing a crash

2019-12-17 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16998316#comment-16998316 ] jack commented on AIRFLOW-5557: --- Additional info of replicas hostnames in mongo 

[jira] [Commented] (AIRFLOW-3534) KubernetesPodOperator breaks with active log-collection for long running tasks

2019-12-17 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-3534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16998279#comment-16998279 ] jack commented on AIRFLOW-3534: --- Could be related to https://issues.apache.org/jira/browse/AIRFLOW-5571

[jira] [Commented] (AIRFLOW-918) Improve bulk_load function for MySqlHook

2019-12-17 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16997977#comment-16997977 ] jack commented on AIRFLOW-918: -- [~ash] can be closed as duplicate of 

[jira] [Commented] (AIRFLOW-6218) PapermillOperator has no functional Jinja support

2019-12-16 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16997473#comment-16997473 ] jack commented on AIRFLOW-6218: --- [~bolke] do you know what is the problem? > PapermillOperator has no

[jira] [Commented] (AIRFLOW-3189) DbAPI get_uri returns invalid uri if schema is None

2019-12-16 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-3189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16997402#comment-16997402 ] jack commented on AIRFLOW-3189: --- [~zuku] seems close to another PR you submitted you might be interested

[jira] [Commented] (AIRFLOW-2940) Code Walkthrough keeping in mind the newbies who have a hard time figuring out where to start reading the code from.

2019-12-16 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-2940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16997392#comment-16997392 ] jack commented on AIRFLOW-2940: --- The docs are very extensive now.. I think this is no longer relevant >

[jira] [Commented] (AIRFLOW-5106) POST request are not working of Experimental Rest API

2019-12-16 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16997390#comment-16997390 ] jack commented on AIRFLOW-5106: --- [~Nimesha] can you be more specific? > POST request are not working of

[jira] [Commented] (AIRFLOW-4525) Trigger Dag Operator causes duplicate key exceptions and can cause runaway dag spawning as it is not atomic at the DB level (on Postgres at least.)

2019-12-11 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16993357#comment-16993357 ] jack commented on AIRFLOW-4525: --- I'm not quite sure I understand why we get orphaned sub dag entries and

[jira] [Commented] (AIRFLOW-4745) failed filtering when accessing DAG Runs page from DAG information page

2019-12-11 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16993346#comment-16993346 ] jack commented on AIRFLOW-4745: --- [~hkak03key] you are welcome to create a PR > failed filtering when

[jira] [Commented] (AIRFLOW-3794) Decommission modules in `airflow/contrib/auth/backends/`, other than `password_auth`

2019-12-10 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-3794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16992514#comment-16992514 ] jack commented on AIRFLOW-3794: ---  Do we need this? conrtib should be removed following to AIP 21 >

[jira] [Commented] (AIRFLOW-5597) Linkify urls in task instance log

2019-12-09 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16991926#comment-16991926 ] jack commented on AIRFLOW-5597: --- [~higrys] can this be set to 1.10.7 ? It has no release fix set >

[jira] [Commented] (AIRFLOW-2324) View SubDags on Home Page

2019-12-09 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16991919#comment-16991919 ] jack commented on AIRFLOW-2324: --- Why would you want that? Sub Dags are part of a "greater dag" what value

[jira] [Commented] (AIRFLOW-2432) Templated fields containing password / tokens is displaying in plain text on UI

2019-12-09 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-2432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16991915#comment-16991915 ] jack commented on AIRFLOW-2432: --- duplicate of https://issues.apache.org/jira/browse/AIRFLOW-4576 >

[jira] [Commented] (AIRFLOW-4264) Would it be possible to make DummyOperator a fairly distinct color then other types of operators?

2019-12-09 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16991903#comment-16991903 ] jack commented on AIRFLOW-4264: --- [~ash] is there something to do here? > Would it be possible to make

[jira] [Commented] (AIRFLOW-4576) Rendered Template & email_on_failure displays password variable in clear text

2019-12-09 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16991879#comment-16991879 ] jack commented on AIRFLOW-4576: --- If I understand you correctly you expect that encrypted variables will

[jira] [Commented] (AIRFLOW-5458) Flask-AppBuilder shows critical security vulnerability

2019-12-09 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16991877#comment-16991877 ] jack commented on AIRFLOW-5458: --- I think there is open PR for this

[jira] [Commented] (AIRFLOW-3535) Airflow should collect display names, not Firstname / Lastname

2019-12-01 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-3535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16985507#comment-16985507 ] jack commented on AIRFLOW-3535: --- Duplicate of  https://issues.apache.org/jira/browse/AIRFLOW-3442 >

[jira] [Commented] (AIRFLOW-4470) RBAC Github Enterprise OAuth provider callback URL?

2019-12-01 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16985506#comment-16985506 ] jack commented on AIRFLOW-4470: --- [~Nidhi94_] So this is a bug or documentation issue? > RBAC Github

[jira] [Commented] (AIRFLOW-3329) Initdb suggests wrong command for kubernetes module installation.

2019-12-01 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-3329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16985499#comment-16985499 ] jack commented on AIRFLOW-3329: --- Is this still an issue? > Initdb suggests wrong command for kubernetes

[jira] [Commented] (AIRFLOW-2906) DataDog Integration for Airflow

2019-12-01 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-2906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16985498#comment-16985498 ] jack commented on AIRFLOW-2906: --- [~cckavar] do you have something ready? > DataDog Integration for

[jira] [Commented] (AIRFLOW-3656) Airflow Web UI link to the docs should be dynamic to Airflow version

2019-11-28 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-3656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16984429#comment-16984429 ] jack commented on AIRFLOW-3656: --- I think this can be revisited now that the new website is on > Airflow

[jira] [Commented] (AIRFLOW-625) doc_md in concepts document seems wrong

2019-11-28 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16984427#comment-16984427 ] jack commented on AIRFLOW-625: -- [~ash] can be closed? > doc_md in concepts document seems wrong >

[jira] [Commented] (AIRFLOW-6086) SparkSubmitOperator - Unable to override spark_binary

2019-11-27 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16983624#comment-16983624 ] jack commented on AIRFLOW-6086: --- duplicate of https://issues.apache.org/jira/browse/AIRFLOW-5517 >

[jira] [Commented] (AIRFLOW-3407) BaseOperator and LoggingMixin do not call super().__init__

2019-11-27 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-3407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16983555#comment-16983555 ] jack commented on AIRFLOW-3407: --- also LoggingMixin doesn't inherit from other class so maybe need to edit

[jira] [Commented] (AIRFLOW-2011) Airflow ampq pool maintains dead connections

2019-11-27 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-2011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16983467#comment-16983467 ] jack commented on AIRFLOW-2011: --- The default value of broker_pool_limit in Celery is 10 

[jira] [Issue Comment Deleted] (AIRFLOW-2327) Cannot pickle PythonOperator dags

2019-11-27 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-2327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jack updated AIRFLOW-2327: -- Comment: was deleted (was: Mesos Executor is deprecated from Master so it's unlikely this will be ever

[jira] [Commented] (AIRFLOW-4470) RBAC Github Enterprise OAuth provider callback URL?

2019-11-27 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16983383#comment-16983383 ] jack commented on AIRFLOW-4470: --- same issue as https://issues.apache.org/jira/browse/AIRFLOW-2992 ? >

[jira] [Commented] (AIRFLOW-3407) BaseOperator and LoggingMixin do not call super().__init__

2019-11-27 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-3407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16983374#comment-16983374 ] jack commented on AIRFLOW-3407: --- This was fixed in another PR

[jira] [Commented] (AIRFLOW-2433) Operator with TriggerRule "one_success" with multiple upstream tasks is marked as Skipped instead of UpstreamFailed if all its upstream tasks are in "UpstreamFailed"

2019-11-27 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-2433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16983368#comment-16983368 ] jack commented on AIRFLOW-2433: --- [~vigneshwaran] is this still an issue? > Operator with TriggerRule

[jira] [Commented] (AIRFLOW-5920) Add support to execute OpenCypher query against Neo4j

2019-11-27 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16983312#comment-16983312 ] jack commented on AIRFLOW-5920: --- [~tfindlay] if the operator is functional and working it doesn't need to

[jira] [Commented] (AIRFLOW-6070) On the admin dashboard, the recent tasks column has no tooltip for tasks in 'null' state

2019-11-26 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16982535#comment-16982535 ] jack commented on AIRFLOW-6070: --- Null / None always need special treatment  Even though different issues

[jira] [Commented] (AIRFLOW-4742) Change ui icon of failed dag runs to a darker shade of red

2019-11-26 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16982518#comment-16982518 ] jack commented on AIRFLOW-4742: --- [~jason_ma] you can PR your change to airflow repo and get comments

[jira] [Commented] (AIRFLOW-1717) AttributeError while clicking on dag on webUI

2019-11-21 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-1717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16979495#comment-16979495 ] jack commented on AIRFLOW-1717: --- Had many releases since 1.8 clicking on DAG in the Ui works now for sure

[jira] [Commented] (AIRFLOW-3185) Add chunking to DBAPI_hook by implementing fetchmany and pandas chunksize

2019-11-21 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-3185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16979489#comment-16979489 ] jack commented on AIRFLOW-3185: --- [~tomanizer] do you have a final version to PR? > Add chunking to

[jira] [Commented] (AIRFLOW-4938) next_execution_date is not a Pendulum object

2019-11-21 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16979371#comment-16979371 ] jack commented on AIRFLOW-4938: --- Was fixed in 1.10.4: https://issues.apache.org/jira/browse/AIRFLOW-4788

[jira] [Issue Comment Deleted] (AIRFLOW-4938) next_execution_date is not a Pendulum object

2019-11-21 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jack updated AIRFLOW-4938: -- Comment: was deleted (was: Related/duplicate to/of : https://issues.apache.org/jira/browse/AIRFLOW-4788) >

[jira] [Commented] (AIRFLOW-578) BaseJob does not check return code of a process

2019-11-19 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16978161#comment-16978161 ] jack commented on AIRFLOW-578: -- [~lucafuji] are you still working on it? > BaseJob does not check return

[jira] [Commented] (AIRFLOW-5060) Add support of CatalogId to AwsGlueCatalogHook

2019-11-19 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16977628#comment-16977628 ] jack commented on AIRFLOW-5060: --- [~ash] any thoughts? > Add support of CatalogId to AwsGlueCatalogHook >

[jira] [Commented] (AIRFLOW-5920) Add support to execute OpenCypher query against Neo4j

2019-11-17 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16976003#comment-16976003 ] jack commented on AIRFLOW-5920: --- [~tfindlay] you can open a Draft PR and get comments from contributors. 

[jira] [Commented] (AIRFLOW-5232) Create pagerdutyhook in the airflow plugins, to support pagerduty.

2019-11-17 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16975997#comment-16975997 ] jack commented on AIRFLOW-5232: --- pagerdury hook was added in 

[jira] [Commented] (AIRFLOW-3344) Airflow DAG object clear function does not clear tasks in the upstream_failed state when only_failed=True

2019-11-17 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-3344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16975993#comment-16975993 ] jack commented on AIRFLOW-3344: --- [~steveatbat] can you PR your suggested change? > Airflow DAG object

[jira] [Commented] (AIRFLOW-918) Improve bulk_load function for MySqlHook

2019-11-17 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16975988#comment-16975988 ] jack commented on AIRFLOW-918: -- Duplicate of https://issues.apache.org/jira/browse/AIRFLOW-5921

[jira] [Commented] (AIRFLOW-5616) PrestoHook to use prestodb

2019-11-17 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16975985#comment-16975985 ] jack commented on AIRFLOW-5616: --- By the way PrestoSQL might be better than Prestodb 

[jira] [Commented] (AIRFLOW-5941) MySQLHook initialization fails when db charset is utf8mb4

2019-11-17 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16975982#comment-16975982 ] jack commented on AIRFLOW-5941: --- Possible root cause is 

[jira] [Created] (AIRFLOW-5939) exclude serve_logs from CLI docs

2019-11-15 Thread jack (Jira)
jack created AIRFLOW-5939: - Summary: exclude serve_logs from CLI docs Key: AIRFLOW-5939 URL: https://issues.apache.org/jira/browse/AIRFLOW-5939 Project: Apache Airflow Issue Type: Task

[jira] [Commented] (AIRFLOW-4789) Add Mysql Exception Handling while pushing data to XCom

2019-11-14 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16974327#comment-16974327 ] jack commented on AIRFLOW-4789: --- What is the exception? Can you provide example to reproduce ? > Add

[jira] [Commented] (AIRFLOW-4848) MySQL warnings about aborted connections, missing engine disposal

2019-11-14 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16974325#comment-16974325 ] jack commented on AIRFLOW-4848: --- Duplicate of https://issues.apache.org/jira/browse/AIRFLOW-3544? ? >

[jira] [Commented] (AIRFLOW-4066) dag_run failed while one operator is still running

2019-11-14 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16974156#comment-16974156 ] jack commented on AIRFLOW-4066: --- Which airflow version are you running? > dag_run failed while one

[jira] [Commented] (AIRFLOW-5627) transform function should be optional for s3_file_tranformation_operator

2019-11-14 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16974152#comment-16974152 ] jack commented on AIRFLOW-5627: --- If you don't want to transform then don't use transform operator.

[jira] [Commented] (AIRFLOW-2572) Airflow /admin/configurationview/ Running Configuration not accurate

2019-11-14 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-2572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16974119#comment-16974119 ] jack commented on AIRFLOW-2572: --- [~joejasinski] can you recheck this with newer version of Airflow? >

[jira] [Commented] (AIRFLOW-1753) Can't install on windows 10

2019-11-07 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-1753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16969386#comment-16969386 ] jack commented on AIRFLOW-1753: --- pwd is a built-in module(come with python installation) for unix like

[jira] [Commented] (AIRFLOW-3565) 404 response is unreachable

2019-11-07 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-3565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16969052#comment-16969052 ] jack commented on AIRFLOW-3565: --- Is this still an issue? We are 6 releases after 1.10.0 > 404 response

[jira] [Commented] (AIRFLOW-330) Decorated PythonOperator python_callable functions don't show the original function in task code view

2019-11-06 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16968374#comment-16968374 ] jack commented on AIRFLOW-330: -- if it's only Python 2 issue than probably this isn't needed anymore  >

[jira] [Commented] (AIRFLOW-3242) execution_date for TriggerDagRunOperator should be based from Triggering dag

2019-11-05 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-3242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16967657#comment-16967657 ] jack commented on AIRFLOW-3242: --- [~zhoufengzd] do you still experience the issue? I worked with backfill

[jira] [Commented] (AIRFLOW-3507) Fix Airflow k8s CI

2019-11-05 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-3507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16967653#comment-16967653 ] jack commented on AIRFLOW-3507: --- It was longed fixed? > Fix Airflow k8s CI > -- > >

[jira] [Commented] (AIRFLOW-3666) ExternalTaskSensor is not triggering the task

2019-11-05 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-3666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16967651#comment-16967651 ] jack commented on AIRFLOW-3666: --- What version of airflow are you running? can you check against 1.10.6?

[jira] [Commented] (AIRFLOW-3915) Scheduler fails for dags with datetime start_date

2019-11-05 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-3915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16967642#comment-16967642 ] jack commented on AIRFLOW-3915: --- If this is still an issue you are welcome to create PR > Scheduler

[jira] [Commented] (AIRFLOW-5814) Implementing Presto hook tests

2019-11-05 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16967621#comment-16967621 ] jack commented on AIRFLOW-5814: --- Merged. Jira can be closed > Implementing Presto hook tests >

[jira] [Comment Edited] (AIRFLOW-4881) Zombie collection fails task instances that should be scheduled for retry

2019-11-05 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16967518#comment-16967518 ] jack edited comment on AIRFLOW-4881 at 11/5/19 1:15 PM: Resolved in 

[jira] [Commented] (AIRFLOW-2732) Split hooks and operators out from core Airflow

2019-11-05 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-2732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16967517#comment-16967517 ] jack commented on AIRFLOW-2732: --- Do we need this? we are now moving stuff in the other direction from

[jira] [Commented] (AIRFLOW-4881) Zombie collection fails task instances that should be scheduled for retry

2019-11-05 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16967518#comment-16967518 ] jack commented on AIRFLOW-4881: --- Resolved in [https://github.com/apache/airflow/pull/5514] ? > Zombie

[jira] [Commented] (AIRFLOW-3098) Dag run succeeds (all related tasks green) yet airflow marks it as failed

2019-11-05 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-3098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16967515#comment-16967515 ] jack commented on AIRFLOW-3098: --- can you provide code to reproduce? > Dag run succeeds (all related

[jira] [Commented] (AIRFLOW-3032) _pickle.UnpicklingError with using remote MySQL Server

2019-11-05 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-3032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16967484#comment-16967484 ] jack commented on AIRFLOW-3032: --- [~ash] can be closed > _pickle.UnpicklingError with using remote MySQL

[jira] [Issue Comment Deleted] (AIRFLOW-5803) Rename S3Hook to AWSS3Hook

2019-10-29 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jack updated AIRFLOW-5803: -- Comment: was deleted (was: It doesn't need to be renamed. [~basph] is working on moving AWS operators

[jira] [Commented] (AIRFLOW-5803) Rename S3Hook to AWSS3Hook

2019-10-29 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16962050#comment-16962050 ] jack commented on AIRFLOW-5803: --- It doesn't need to be renamed. [~basph] is working on moving AWS

[jira] [Commented] (AIRFLOW-3514) Documentation for run_query slightly off for bigquery_hook

2019-10-28 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-3514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961538#comment-16961538 ] jack commented on AIRFLOW-3514: --- [~kamil.bregula] [~kaxilnaik]  can be closed? > Documentation for

[jira] [Commented] (AIRFLOW-1663) Redshift Connection, Hook, & Operator for COPY command usability

2019-10-28 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-1663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961540#comment-16961540 ] jack commented on AIRFLOW-1663: --- Possibly what was meant to be done on:

[jira] [Commented] (AIRFLOW-4734) Upsert functionality for PostgresHook.insert_rows()

2019-10-28 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961532#comment-16961532 ] jack commented on AIRFLOW-4734: --- [~oxymor0n] ahh :/ did you make any progress with it? > Upsert

[jira] [Commented] (AIRFLOW-4560) Tez queue parameter passed by mapred_queue is incorrect

2019-10-28 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961535#comment-16961535 ] jack commented on AIRFLOW-4560: --- [~ash] merged ages ago but still open :) 1.10.7? > Tez queue parameter

[jira] [Commented] (AIRFLOW-5616) PrestoHook to use prestodb

2019-10-28 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961528#comment-16961528 ] jack commented on AIRFLOW-5616: --- [~brilhana] You can PR when ready > PrestoHook to use prestodb >

[jira] [Commented] (AIRFLOW-5286) Add requeue logic to airflow scheduler and executor

2019-10-28 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961526#comment-16961526 ] jack commented on AIRFLOW-5286: --- Sounds useful! Are you planing to PR your code? > Add requeue logic to

[jira] [Commented] (AIRFLOW-5290) Add is updated before and between to GoogleCloudStorageHook

2019-10-28 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961522#comment-16961522 ] jack commented on AIRFLOW-5290: --- [~kamil.bregula] GCP related but not component set > Add is updated

[jira] [Commented] (AIRFLOW-5333) Move __init__ docstring to class docstring in PubSub

2019-10-28 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961521#comment-16961521 ] jack commented on AIRFLOW-5333: --- [~kamil.bregula]  Jira still open... can u also add doc component so it

[jira] [Assigned] (AIRFLOW-3140) Add MongoDBToGoogleStorage Opearator

2019-10-28 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-3140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jack reassigned AIRFLOW-3140: - Assignee: lightQ (was: Tanay Tummalapalli) > Add MongoDBToGoogleStorage Opearator >

[jira] [Commented] (AIRFLOW-5338) Add a RedsfhitToS3Operator

2019-10-28 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961520#comment-16961520 ] jack commented on AIRFLOW-5338: --- [~feluelle] I think it's a refactor task something like BaseSQLToS3 then

[jira] [Commented] (AIRFLOW-3140) Add MongoDBToGoogleStorage Opearator

2019-10-28 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-3140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961514#comment-16961514 ] jack commented on AIRFLOW-3140: --- [~quichu] changed assign to you > Add MongoDBToGoogleStorage Opearator

[jira] [Assigned] (AIRFLOW-3140) Add MongoDBToGoogleStorage Opearator

2019-10-28 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-3140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jack reassigned AIRFLOW-3140: - Assignee: Q C (was: lightQ) > Add MongoDBToGoogleStorage Opearator >

[jira] [Updated] (AIRFLOW-4927) Airflow task stuck in Scheduled mode due to pool not existed

2019-10-28 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jack updated AIRFLOW-4927: -- Affects Version/s: 1.10.6 1.10.5 > Airflow task stuck in Scheduled mode due to pool

[jira] [Commented] (AIRFLOW-3978) Add missing types in MySqlToGoogleCloudStorageOperator

2019-10-05 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-3978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16945135#comment-16945135 ] jack commented on AIRFLOW-3978: --- The question is what happens if your MySQL table has BINARY field and

[jira] [Commented] (AIRFLOW-5394) Invalid schedule interval issues

2019-10-03 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16943362#comment-16943362 ] jack commented on AIRFLOW-5394: --- Cron validation was introduced in 

[jira] [Commented] (AIRFLOW-5386) Move Google Dataproc to core

2019-10-03 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16943358#comment-16943358 ] jack commented on AIRFLOW-5386: --- PR was merged can Jira be closed? > Move Google Dataproc to core >

[jira] [Commented] (AIRFLOW-5500) Bug in trigger api endpoint

2019-10-02 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16943345#comment-16943345 ] jack commented on AIRFLOW-5500: --- Can you PR the fix? > Bug in trigger api endpoint >

[jira] [Commented] (AIRFLOW-3032) _pickle.UnpicklingError with using remote MySQL Server

2019-10-02 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-3032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16943343#comment-16943343 ] jack commented on AIRFLOW-3032: --- Is this still an issue? > _pickle.UnpicklingError with using remote

[jira] [Commented] (AIRFLOW-5121) Normalize *_conn_id parameters

2019-09-30 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16941291#comment-16941291 ] jack commented on AIRFLOW-5121: --- ho.. didn't notice subtasks are opened as we go.. I'm used you guys

[jira] [Commented] (AIRFLOW-5121) Normalize *_conn_id parameters

2019-09-30 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16941207#comment-16941207 ] jack commented on AIRFLOW-5121: --- [~kamil.bregula]  PR was merged. can Jira be closed? > Normalize

[jira] [Commented] (AIRFLOW-5114) TypeError when running S3ToGoogleCloudStorageTransferOperator or GoogleCloudStorageToGoogleCloudStorageTransferOperator with default arguments

2019-09-30 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16941214#comment-16941214 ] jack commented on AIRFLOW-5114: --- [~kamil.bregula]PR was merged. Jira can be closed > TypeError when

[jira] [Commented] (AIRFLOW-5118) Airflow DataprocClusterCreateOperator does not currently support setting optional components

2019-09-30 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16941208#comment-16941208 ] jack commented on AIRFLOW-5118: --- PR was merged. Jira can be closed > Airflow

[jira] [Commented] (AIRFLOW-5222) Dag run status is wrongly set to SUCCESS

2019-09-30 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16941202#comment-16941202 ] jack commented on AIRFLOW-5222: --- I think the DAG state is determent by the last task status. so in this

[jira] [Commented] (AIRFLOW-5231) S3Hook delete fails with over 1000 keys

2019-09-30 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16941199#comment-16941199 ] jack commented on AIRFLOW-5231: --- In luigi it was solved with loop deleting 1000 files each time

[jira] [Commented] (AIRFLOW-5471) Fix docstring in GcpTransferServiceOperationsListOperator

2019-09-30 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16941194#comment-16941194 ] jack commented on AIRFLOW-5471: --- [~ash] also merged and Jira open > Fix docstring in

[jira] [Commented] (AIRFLOW-5484) PigCliHook has incorrect named parameter

2019-09-30 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16941195#comment-16941195 ] jack commented on AIRFLOW-5484: --- [~ash] merged and Jira open > PigCliHook has incorrect named parameter

[jira] [Commented] (AIRFLOW-5487) airflow/utils/strings.py: Fix unused warning variable

2019-09-30 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16941179#comment-16941179 ] jack commented on AIRFLOW-5487: --- [~ash] PR was merged Jira is still open > airflow/utils/strings.py: Fix

[jira] [Commented] (AIRFLOW-5490) security.py: Fix incorrect None comparison

2019-09-30 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16941178#comment-16941178 ] jack commented on AIRFLOW-5490: --- [~ash] PR was merged. Jira can be closed > security.py: Fix incorrect

[jira] [Commented] (AIRFLOW-5568) Add Hook / Operators for GCP Healthcare API

2019-09-30 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16941171#comment-16941171 ] jack commented on AIRFLOW-5568: --- Can you please add also GCP component? > Add Hook / Operators for GCP

[jira] [Commented] (AIRFLOW-5541) Exclude example tags from coverage

2019-09-30 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16941175#comment-16941175 ] jack commented on AIRFLOW-5541: --- [~Urbaszek] can you close this? was covered in another pr/ticket >

[jira] [Commented] (AIRFLOW-5566) Invalid deprecation warning for airflow home specification within config file

2019-09-30 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16941172#comment-16941172 ] jack commented on AIRFLOW-5566: --- Can you PR a fix? > Invalid deprecation warning for airflow home

[jira] [Commented] (AIRFLOW-1940) s3_file_transform_operator does not work with boto3

2019-09-30 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-1940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16941169#comment-16941169 ] jack commented on AIRFLOW-1940: --- [~ash] can this be closed? > s3_file_transform_operator does not work

  1   2   3   4   5   6   >