[GitHub] [airflow] dstandish commented on issue #6163: [AIRFLOW-4574] SSHHook private_key may only be supplied in extras

2019-09-25 Thread GitBox
dstandish commented on issue #6163: [AIRFLOW-4574] SSHHook private_key may only be supplied in extras URL: https://github.com/apache/airflow/pull/6163#issuecomment-535337864 @mik-laj is this PR ok or should i split it up -- one to fix the oversight (missing tunnel support) and another to

[jira] [Resolved] (AIRFLOW-5555) Remove Hipchat integration

2019-09-25 Thread Xiaodong Deng (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaodong Deng resolved AIRFLOW-. Fix Version/s: 2.0.0 Resolution: Resolved > Remove Hipchat integration >

[jira] [Commented] (AIRFLOW-5555) Remove Hipchat integration

2019-09-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16938196#comment-16938196 ] ASF GitHub Bot commented on AIRFLOW-: - XD-DENG commented on pull request #6184:

[jira] [Commented] (AIRFLOW-5555) Remove Hipchat integration

2019-09-25 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16938197#comment-16938197 ] ASF subversion and git services commented on AIRFLOW-: -- Commit

[GitHub] [airflow] XD-DENG merged pull request #6184: [AIRFLOW-5555] Remove Hipchat integration

2019-09-25 Thread GitBox
XD-DENG merged pull request #6184: [AIRFLOW-] Remove Hipchat integration URL: https://github.com/apache/airflow/pull/6184 This is an automated message from the Apache Git Service. To respond to the message, please log on

[jira] [Updated] (AIRFLOW-5557) Mongo Replica connection Hostname causing a crash

2019-09-25 Thread SANGAMESH PATIL (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SANGAMESH PATIL updated AIRFLOW-5557: - Description: Hi,   I tried to provide mongo hostname in replicated format as follows

[jira] [Updated] (AIRFLOW-5557) Mongo Replica connection Hostname causing a crash

2019-09-25 Thread SANGAMESH PATIL (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SANGAMESH PATIL updated AIRFLOW-5557: - Description: Hi,   I tried to provide mongo hostname in replicated format as follows

[jira] [Created] (AIRFLOW-5557) Mongo Replica connection Hostname causing a crash

2019-09-25 Thread SANGAMESH PATIL (Jira)
SANGAMESH PATIL created AIRFLOW-5557: Summary: Mongo Replica connection Hostname causing a crash Key: AIRFLOW-5557 URL: https://issues.apache.org/jira/browse/AIRFLOW-5557 Project: Apache Airflow

[jira] [Created] (AIRFLOW-5556) Should not use dagbag_import_timeout to time out DagFileProcessor

2019-09-25 Thread Ping Zhang (Jira)
Ping Zhang created AIRFLOW-5556: --- Summary: Should not use dagbag_import_timeout to time out DagFileProcessor Key: AIRFLOW-5556 URL: https://issues.apache.org/jira/browse/AIRFLOW-5556 Project: Apache

[GitHub] [airflow] pingzh opened a new pull request #6186: Add dag file processor timeout

2019-09-25 Thread GitBox
pingzh opened a new pull request #6186: Add dag file processor timeout URL: https://github.com/apache/airflow/pull/6186 to timeout DagFileProcessor As of right now, it uses dagbag_import_timeout to control time out of DagFileProcessor, which is intended to control the timeout of

[GitHub] [airflow] codecov-io commented on issue #6185: [AIRFLOW-5554] Require statsd 3.3.0 for timedelta stat transformation

2019-09-25 Thread GitBox
codecov-io commented on issue #6185: [AIRFLOW-5554] Require statsd 3.3.0 for timedelta stat transformation URL: https://github.com/apache/airflow/pull/6185#issuecomment-535251424 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6185?src=pr=h1) Report > Merging

[jira] [Commented] (AIRFLOW-5554) Airflow 1.10.4+ needs statsd>=3.3.0

2019-09-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16938090#comment-16938090 ] ASF GitHub Bot commented on AIRFLOW-5554: - suburbanmtman commented on pull request #6185:

[GitHub] [airflow] suburbanmtman opened a new pull request #6185: [AIRFLOW-5554] Require statsd 3.3.0 for timedelta stat transformation

2019-09-25 Thread GitBox
suburbanmtman opened a new pull request #6185: [AIRFLOW-5554] Require statsd 3.3.0 for timedelta stat transformation URL: https://github.com/apache/airflow/pull/6185 Make sure you have checked _all_ steps below. ### Jira - [ X ] My PR addresses the following [Airflow

[jira] [Commented] (AIRFLOW-5554) Airflow 1.10.4+ needs statsd>=3.3.0

2019-09-25 Thread David Smith (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16938080#comment-16938080 ] David Smith commented on AIRFLOW-5554: -- [~ash] sorry initial typo in the version, it was really

[jira] [Updated] (AIRFLOW-5554) Airflow 1.10.4+ needs statsd>=3.3.0

2019-09-25 Thread David Smith (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Smith updated AIRFLOW-5554: - Description: Our environment configuration uses statsd 3.2.2, which is a valid dependency

[jira] [Commented] (AIRFLOW-5555) Remove Hipchat integration

2019-09-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16938064#comment-16938064 ] ASF GitHub Bot commented on AIRFLOW-: - mik-laj commented on pull request #6184:

[GitHub] [airflow] mik-laj opened a new pull request #6184: [AIRFLOW-5555] Remove Hipchat integration

2019-09-25 Thread GitBox
mik-laj opened a new pull request #6184: [AIRFLOW-] Remove Hipchat integration URL: https://github.com/apache/airflow/pull/6184 Hipchat has reached end of life and is no longer available. For more information please see

[jira] [Updated] (AIRFLOW-5555) Remove Hipchat integration

2019-09-25 Thread Kamil Bregula (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kamil Bregula updated AIRFLOW-: --- Summary: Remove Hipchat integration (was: Remove hipchat integration) > Remove Hipchat

[jira] [Created] (AIRFLOW-5555) Remove hipchat integration

2019-09-25 Thread Kamil Bregula (Jira)
Kamil Bregula created AIRFLOW-: -- Summary: Remove hipchat integration Key: AIRFLOW- URL: https://issues.apache.org/jira/browse/AIRFLOW- Project: Apache Airflow Issue Type:

[jira] [Commented] (AIRFLOW-5554) Airflow 1.10.4+ needs statsd>=3.3.0

2019-09-25 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16938029#comment-16938029 ] Ash Berlin-Taylor commented on AIRFLOW-5554: The setup.py file for 1.10.4 says minimum of

[jira] [Created] (AIRFLOW-5554) Airflow 1.10.4+ needs statsd>=3.3.0

2019-09-25 Thread David Smith (Jira)
David Smith created AIRFLOW-5554: Summary: Airflow 1.10.4+ needs statsd>=3.3.0 Key: AIRFLOW-5554 URL: https://issues.apache.org/jira/browse/AIRFLOW-5554 Project: Apache Airflow Issue Type:

[jira] [Commented] (AIRFLOW-774) dagbag_size/collect_dags/dagbag_import_errors stats incorrect

2019-09-25 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16938016#comment-16938016 ] ASF subversion and git services commented on AIRFLOW-774: - Commit

[jira] [Commented] (AIRFLOW-3871) Allow Jinja templating recursively on object attributes

2019-09-25 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-3871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16938019#comment-16938019 ] ASF subversion and git services commented on AIRFLOW-3871: -- Commit

[GitHub] [airflow] ashb commented on a change in pull request #6182: [AIRFLOW-3877] -Changing full file path in scheduler

2019-09-25 Thread GitBox
ashb commented on a change in pull request #6182: [AIRFLOW-3877] -Changing full file path in scheduler URL: https://github.com/apache/airflow/pull/6182#discussion_r328311836 ## File path: airflow/jobs/scheduler_job.py ## @@ -1077,7 +1080,12 @@ def

[GitHub] [airflow] ashb commented on issue #4642: [AIRFLOW-2694] Declare permissions in DAG definition

2019-09-25 Thread GitBox
ashb commented on issue #4642: [AIRFLOW-2694] Declare permissions in DAG definition URL: https://github.com/apache/airflow/pull/4642#issuecomment-535185645 @feng-tao Yeah, I've been wanting to backport it when I tried (somewhere around 1.10.2? .3?) it was full of conflicts, and I haven't

[jira] [Commented] (AIRFLOW-4864) Don't call load_test_configuration multiple times

2019-09-25 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16938017#comment-16938017 ] ASF subversion and git services commented on AIRFLOW-4864: -- Commit

[jira] [Commented] (AIRFLOW-4858) Conf historical convenience functions are not deprecated properly

2019-09-25 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16938020#comment-16938020 ] ASF subversion and git services commented on AIRFLOW-4858: -- Commit

[jira] [Commented] (AIRFLOW-5419) Marking task failed doesn't kill the task when it is run through impersonation(run_as_user)

2019-09-25 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16938015#comment-16938015 ] ASF subversion and git services commented on AIRFLOW-5419: -- Commit

[jira] [Commented] (AIRFLOW-4858) Conf historical convenience functions are not deprecated properly

2019-09-25 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16938018#comment-16938018 ] ASF subversion and git services commented on AIRFLOW-4858: -- Commit

[jira] [Commented] (AIRFLOW-5419) Marking task failed doesn't kill the task when it is run through impersonation(run_as_user)

2019-09-25 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16938014#comment-16938014 ] ASF subversion and git services commented on AIRFLOW-5419: -- Commit

[GitHub] [airflow] codecov-io commented on issue #6183: [AIRFLOW-5553] Bytes value check done based on the type of the variable

2019-09-25 Thread GitBox
codecov-io commented on issue #6183: [AIRFLOW-5553] Bytes value check done based on the type of the variable URL: https://github.com/apache/airflow/pull/6183#issuecomment-535170945 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6183?src=pr=h1) Report > Merging

[jira] [Commented] (AIRFLOW-4226) DataProcPySparkOperator gets project ID from gcp_conn_id rather than project_id

2019-09-25 Thread Kaxil Naik (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16937970#comment-16937970 ] Kaxil Naik commented on AIRFLOW-4226: - Thanks [~kamil.bregula] > DataProcPySparkOperator gets

[jira] [Commented] (AIRFLOW-5553) mysql_to_gcs.MySqlToGoogleCloudStorageOperator binary values cannot be encoded whenever a BQ schema is not explicitly specified

2019-09-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16937973#comment-16937973 ] ASF GitHub Bot commented on AIRFLOW-5553: - stoynov96 commented on pull request #6183:

[GitHub] [airflow] stoynov96 opened a new pull request #6183: [AIRFLOW-5553] Bytes value check done based on the type of the variable

2019-09-25 Thread GitBox
stoynov96 opened a new pull request #6183: [AIRFLOW-5553] Bytes value check done based on the type of the variable URL: https://github.com/apache/airflow/pull/6183 Make sure you have checked _all_ steps below. ### Jira - [x] My PR addresses the following [Airflow

[jira] [Updated] (AIRFLOW-5553) mysql_to_gcs.MySqlToGoogleCloudStorageOperator binary values cannot be encoded whenever a BQ schema is not explicitly specified

2019-09-25 Thread Nikolay Stoynov (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nikolay Stoynov updated AIRFLOW-5553: - Description:   The MySqlGoogleCloudStorageOperator currently deals with `bytes`

[jira] [Commented] (AIRFLOW-4068) Add GoogleCloudStorageFileTransformOperator

2019-09-25 Thread Kamil Bregula (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16937956#comment-16937956 ] Kamil Bregula commented on AIRFLOW-4068: Unfortunately, this will be difficult because the

[jira] [Updated] (AIRFLOW-5553) mysql_to_gcs.MySqlToGoogleCloudStorageOperator binary values cannot be encoded whenever a BQ schema is not explicitly specified

2019-09-25 Thread Nikolay Stoynov (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nikolay Stoynov updated AIRFLOW-5553: - Description:   The MySqlGoogleCloudStorageOperator currently deals with `bytes`

[jira] [Created] (AIRFLOW-5553) mysql_to_gcs.MySqlToGoogleCloudStorageOperator binary values cannot be encoded whenever a BQ schema is not explicitly specified

2019-09-25 Thread Nikolay Stoynov (Jira)
Nikolay Stoynov created AIRFLOW-5553: Summary: mysql_to_gcs.MySqlToGoogleCloudStorageOperator binary values cannot be encoded whenever a BQ schema is not explicitly specified Key: AIRFLOW-5553 URL:

[GitHub] [airflow] codecov-io commented on issue #6182: [AIRFLOW-3877] -Changing full file path in scheduler

2019-09-25 Thread GitBox
codecov-io commented on issue #6182: [AIRFLOW-3877] -Changing full file path in scheduler URL: https://github.com/apache/airflow/pull/6182#issuecomment-535127671 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6182?src=pr=h1) Report > Merging

[GitHub] [airflow] feng-tao commented on issue #4642: [AIRFLOW-2694] Declare permissions in DAG definition

2019-09-25 Thread GitBox
feng-tao commented on issue #4642: [AIRFLOW-2694] Declare permissions in DAG definition URL: https://github.com/apache/airflow/pull/4642#issuecomment-535107660 @ashb didn't know this pr is not in preview releaseI think this one is very important for DAG level access. @icyfox-bupt I am

[GitHub] [airflow] XD-DENG commented on a change in pull request #6178: [AIRFLOW-5546] Fix DataprocClusterCreateOperator

2019-09-25 Thread GitBox
XD-DENG commented on a change in pull request #6178: [AIRFLOW-5546] Fix DataprocClusterCreateOperator URL: https://github.com/apache/airflow/pull/6178#discussion_r328208312 ## File path: airflow/gcp/operators/dataproc.py ## @@ -485,7 +485,20 @@ def

[GitHub] [airflow] vipul007ravi opened a new pull request #6181: adding vipul007ravi as user

2019-09-25 Thread GitBox
vipul007ravi opened a new pull request #6181: adding vipul007ravi as user URL: https://github.com/apache/airflow/pull/6181 Make sure you have checked _all_ steps below. ### Jira - [ ] My PR addresses the following [Airflow Jira](https://issues.apache.org/jira/browse/AIRFLOW/)

[jira] [Created] (AIRFLOW-5552) Adding user to README

2019-09-25 Thread Vipul Pandey (Jira)
Vipul Pandey created AIRFLOW-5552: - Summary: Adding user to README Key: AIRFLOW-5552 URL: https://issues.apache.org/jira/browse/AIRFLOW-5552 Project: Apache Airflow Issue Type: Improvement

[jira] [Commented] (AIRFLOW-5549) Extend BigQueryGetDataOperator to handle pagination

2019-09-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16937797#comment-16937797 ] ASF GitHub Bot commented on AIRFLOW-5549: - mohannadbanayosi commented on pull request #6180:

[GitHub] [airflow] mohannadbanayosi opened a new pull request #6180: [AIRFLOW-5549] Exteded BQ GetDataOperator to handle query params

2019-09-25 Thread GitBox
mohannadbanayosi opened a new pull request #6180: [AIRFLOW-5549] Exteded BQ GetDataOperator to handle query params URL: https://github.com/apache/airflow/pull/6180 ### Jira - [x] My PR addresses the following [Airflow Jira](https://issues.apache.org/jira/browse/AIRFLOW-5549) issues

[jira] [Created] (AIRFLOW-5551) error log file should not contain access logs

2019-09-25 Thread Sadok Ben Yahya (Jira)
Sadok Ben Yahya created AIRFLOW-5551: Summary: error log file should not contain access logs Key: AIRFLOW-5551 URL: https://issues.apache.org/jira/browse/AIRFLOW-5551 Project: Apache Airflow

[jira] [Updated] (AIRFLOW-5134) REST API: get task instance logs

2019-09-25 Thread Norbert Biczo (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Norbert Biczo updated AIRFLOW-5134: --- Summary: REST API: get task instance logs (was: Get task instance logs REST API endpoint)

[jira] [Created] (AIRFLOW-5550) REST API: get tasks for a DAG

2019-09-25 Thread Norbert Biczo (Jira)
Norbert Biczo created AIRFLOW-5550: -- Summary: REST API: get tasks for a DAG Key: AIRFLOW-5550 URL: https://issues.apache.org/jira/browse/AIRFLOW-5550 Project: Apache Airflow Issue Type: New

[jira] [Work started] (AIRFLOW-5549) Extend BigQueryGetDataOperator to handle pagination

2019-09-25 Thread Mohannad Albanayosy (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on AIRFLOW-5549 started by Mohannad Albanayosy. > Extend BigQueryGetDataOperator to handle pagination >

[jira] [Updated] (AIRFLOW-5548) REST API: get DAGs

2019-09-25 Thread Norbert Biczo (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Norbert Biczo updated AIRFLOW-5548: --- Summary: REST API: get DAGs (was: Get DAGs REST API endpoint) > REST API: get DAGs >

[jira] [Created] (AIRFLOW-5549) Extend BigQueryGetDataOperator to handle pagination

2019-09-25 Thread Mohannad Albanayosy (Jira)
Mohannad Albanayosy created AIRFLOW-5549: Summary: Extend BigQueryGetDataOperator to handle pagination Key: AIRFLOW-5549 URL: https://issues.apache.org/jira/browse/AIRFLOW-5549 Project: Apache

[jira] [Created] (AIRFLOW-5548) Get DAGs REST API endpoint

2019-09-25 Thread Norbert Biczo (Jira)
Norbert Biczo created AIRFLOW-5548: -- Summary: Get DAGs REST API endpoint Key: AIRFLOW-5548 URL: https://issues.apache.org/jira/browse/AIRFLOW-5548 Project: Apache Airflow Issue Type: New

[jira] [Updated] (AIRFLOW-5134) Get task instance logs REST API endpoint

2019-09-25 Thread Norbert Biczo (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Norbert Biczo updated AIRFLOW-5134: --- Affects Version/s: (was: 1.10.3) 2.0.0 > Get task instance logs

[jira] [Resolved] (AIRFLOW-5528) end of log mark in broken in es_task_handler

2019-09-25 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor resolved AIRFLOW-5528. Fix Version/s: 1.1 0.6 Resolution: Fixed > end of log mark in broken in

[jira] [Updated] (AIRFLOW-5528) end of log mark in broken in es_task_handler

2019-09-25 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor updated AIRFLOW-5528: --- Fix Version/s: (was: 1.1 0.6) 1.10.6 > end of log mark in

[jira] [Assigned] (AIRFLOW-5509) Support PATCH method in `DatabricksHook`

2019-09-25 Thread Rosalyn Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rosalyn Taylor reassigned AIRFLOW-5509: --- Assignee: Rosalyn Taylor > Support PATCH method in `DatabricksHook` >

[jira] [Commented] (AIRFLOW-5448) Make Kubernetes Executor compatible with Istio service mesh

2019-09-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16937712#comment-16937712 ] ASF GitHub Bot commented on AIRFLOW-5448: - sjmiller609 commented on pull request #6171:

[GitHub] [airflow] sjmiller609 commented on issue #6171: [AIRFLOW-5448] Handle istio-proxy for Kubernetes Pods

2019-09-25 Thread GitBox
sjmiller609 commented on issue #6171: [AIRFLOW-5448] Handle istio-proxy for Kubernetes Pods URL: https://github.com/apache/airflow/pull/6171#issuecomment-535012352 @ashb mentioned this will only be accepted after being integrated into master's version

[GitHub] [airflow] sjmiller609 closed pull request #6171: [AIRFLOW-5448] Handle istio-proxy for Kubernetes Pods

2019-09-25 Thread GitBox
sjmiller609 closed pull request #6171: [AIRFLOW-5448] Handle istio-proxy for Kubernetes Pods URL: https://github.com/apache/airflow/pull/6171 This is an automated message from the Apache Git Service. To respond to the

[jira] [Commented] (AIRFLOW-4858) Conf historical convenience functions are not deprecated properly

2019-09-25 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16937676#comment-16937676 ] ASF subversion and git services commented on AIRFLOW-4858: -- Commit

[jira] [Commented] (AIRFLOW-4041) Can't delete password for connections

2019-09-25 Thread Andrew Desousa (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16937685#comment-16937685 ] Andrew Desousa commented on AIRFLOW-4041: - Yes, [~jackjack10]. This seems to be the identical

[jira] [Comment Edited] (AIRFLOW-4226) DataProcPySparkOperator gets project ID from gcp_conn_id rather than project_id

2019-09-25 Thread Kaxil Naik (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16937683#comment-16937683 ] Kaxil Naik edited comment on AIRFLOW-4226 at 9/25/19 12:23 PM: --- Thanks

[jira] [Assigned] (AIRFLOW-4226) DataProcPySparkOperator gets project ID from gcp_conn_id rather than project_id

2019-09-25 Thread Kaxil Naik (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik reassigned AIRFLOW-4226: --- Assignee: Kaxil Naik > DataProcPySparkOperator gets project ID from gcp_conn_id rather

[jira] [Updated] (AIRFLOW-4226) DataProcPySparkOperator gets project ID from gcp_conn_id rather than project_id

2019-09-25 Thread Kaxil Naik (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik updated AIRFLOW-4226: Fix Version/s: 1.10.6 Affects Version/s: 1.10.3 1.10.4

[jira] [Updated] (AIRFLOW-4226) DataProcPySparkOperator gets project ID from gcp_conn_id rather than project_id

2019-09-25 Thread Kaxil Naik (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik updated AIRFLOW-4226: Issue Type: Improvement (was: Bug) > DataProcPySparkOperator gets project ID from gcp_conn_id

[jira] [Commented] (AIRFLOW-4226) DataProcPySparkOperator gets project ID from gcp_conn_id rather than project_id

2019-09-25 Thread Kaxil Naik (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16937683#comment-16937683 ] Kaxil Naik commented on AIRFLOW-4226: - Thanks [~jackjack10]. [~liblonga] I agree this should

[jira] [Commented] (AIRFLOW-4858) Conf historical convenience functions are not deprecated properly

2019-09-25 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16937674#comment-16937674 ] ASF subversion and git services commented on AIRFLOW-4858: -- Commit

[jira] [Commented] (AIRFLOW-3871) Allow Jinja templating recursively on object attributes

2019-09-25 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-3871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16937675#comment-16937675 ] ASF subversion and git services commented on AIRFLOW-3871: -- Commit

[jira] [Commented] (AIRFLOW-4864) Don't call load_test_configuration multiple times

2019-09-25 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16937673#comment-16937673 ] ASF subversion and git services commented on AIRFLOW-4864: -- Commit

[GitHub] [airflow] icyfox-bupt commented on issue #4642: [AIRFLOW-2694] Declare permissions in DAG definition

2019-09-25 Thread GitBox
icyfox-bupt commented on issue #4642: [AIRFLOW-2694] Declare permissions in DAG definition URL: https://github.com/apache/airflow/pull/4642#issuecomment-534986971 > @icyfox-bupt Airflow's "release workflow" is that all commits are made to master and then cherry-picked back on to the

[GitHub] [airflow] ashb commented on issue #4642: [AIRFLOW-2694] Declare permissions in DAG definition

2019-09-25 Thread GitBox
ashb commented on issue #4642: [AIRFLOW-2694] Declare permissions in DAG definition URL: https://github.com/apache/airflow/pull/4642#issuecomment-534986353 @icyfox-bupt Airflow's "release workflow" is that all commits are made to master and then cherry-picked back on to the release branch

[GitHub] [airflow] icyfox-bupt commented on issue #4642: [AIRFLOW-2694] Declare permissions in DAG definition

2019-09-25 Thread GitBox
icyfox-bupt commented on issue #4642: [AIRFLOW-2694] Declare permissions in DAG definition URL: https://github.com/apache/airflow/pull/4642#issuecomment-534984811 Hi, @feng-tao and @astahlman : Thanks for this commit and I wonder why this function didn't implement on rbac views ?

[jira] [Commented] (AIRFLOW-4010) First time task waiting for previous dependency completion

2019-09-25 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16937610#comment-16937610 ] jack commented on AIRFLOW-4010: --- Can you please explain what is the bug? > First time task waiting for

[GitHub] [airflow] ashb commented on issue #6014: [AIRFLOW-5342] Fix MSSQL breaking task_instance db migration

2019-09-25 Thread GitBox
ashb commented on issue #6014: [AIRFLOW-5342] Fix MSSQL breaking task_instance db migration URL: https://github.com/apache/airflow/pull/6014#issuecomment-534963425 Only people with commit rights can restart the build for some reason (beats me, ask Travis.) I have restarted it.

[jira] [Commented] (AIRFLOW-4041) Can't delete password for connections

2019-09-25 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16937608#comment-16937608 ] jack commented on AIRFLOW-4041: --- [~andrew.desousa] This sound similar to what you fixed for Variables in 

[GitHub] [airflow] kaxil commented on a change in pull request #4460: [AIRFLOW-3604] Add Azure Hdinsight operators for creating cluster and submitting

2019-09-25 Thread GitBox
kaxil commented on a change in pull request #4460: [AIRFLOW-3604] Add Azure Hdinsight operators for creating cluster and submitting URL: https://github.com/apache/airflow/pull/4460#discussion_r328049171 ## File path: airflow/contrib/example_dags/example_azure_hdinsight_operators.py

[GitHub] [airflow] kaxil commented on a change in pull request #4460: [AIRFLOW-3604] Add Azure Hdinsight operators for creating cluster and submitting

2019-09-25 Thread GitBox
kaxil commented on a change in pull request #4460: [AIRFLOW-3604] Add Azure Hdinsight operators for creating cluster and submitting URL: https://github.com/apache/airflow/pull/4460#discussion_r328048973 ## File path: airflow/contrib/example_dags/example_azure_hdinsight_operators.py

[GitHub] [airflow] kaxil commented on a change in pull request #4460: [AIRFLOW-3604] Add Azure Hdinsight operators for creating cluster and submitting

2019-09-25 Thread GitBox
kaxil commented on a change in pull request #4460: [AIRFLOW-3604] Add Azure Hdinsight operators for creating cluster and submitting URL: https://github.com/apache/airflow/pull/4460#discussion_r328048930 ## File path: airflow/contrib/example_dags/example_azure_hdinsight_operators.py

[GitHub] [airflow] kaxil commented on issue #4460: [AIRFLOW-3604] Add Azure Hdinsight operators for creating cluster and submitting

2019-09-25 Thread GitBox
kaxil commented on issue #4460: [AIRFLOW-3604] Add Azure Hdinsight operators for creating cluster and submitting URL: https://github.com/apache/airflow/pull/4460#issuecomment-534961403 @alikemalocalan Can you fix pylint errors please: ``` * Module

[jira] [Commented] (AIRFLOW-4238) Experimental API sometimes responds with Bad Request

2019-09-25 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16937613#comment-16937613 ] Ash Berlin-Taylor commented on AIRFLOW-4238: This is probably caused by the (currently)

[jira] [Commented] (AIRFLOW-4238) Experimental API sometimes responds with Bad Request

2019-09-25 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16937602#comment-16937602 ] jack commented on AIRFLOW-4238: --- [~ash] Is this considered a bug or it's a no fix as expected behavior? 

[GitHub] [airflow] codecov-io commented on issue #6016: [AIRFLOW-5408] Fix env variable name in Kubernetes template

2019-09-25 Thread GitBox
codecov-io commented on issue #6016: [AIRFLOW-5408] Fix env variable name in Kubernetes template URL: https://github.com/apache/airflow/pull/6016#issuecomment-534960038 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6016?src=pr=h1) Report > Merging

[jira] [Commented] (AIRFLOW-4042) resources parameter is not documented in KubernetesPodOperator

2019-09-25 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16937606#comment-16937606 ] jack commented on AIRFLOW-4042: --- It is now so probably fixed at some point

[GitHub] [airflow] kaxil merged pull request #6179: [AIRFLOW-XXX] Don't trust python-requests.org to run a valid HTTPS server

2019-09-25 Thread GitBox
kaxil merged pull request #6179: [AIRFLOW-XXX] Don't trust python-requests.org to run a valid HTTPS server URL: https://github.com/apache/airflow/pull/6179 This is an automated message from the Apache Git Service. To

[jira] [Commented] (AIRFLOW-4213) backfill stuck when when the dates range contains clock changing

2019-09-25 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16937604#comment-16937604 ] jack commented on AIRFLOW-4213: --- It was fixed in 1.10.4 wasn't it? > backfill stuck when when the dates

[jira] [Resolved] (AIRFLOW-4248) FileExistsError when creating log dir in file_processor_handler.py

2019-09-25 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor resolved AIRFLOW-4248. Fix Version/s: 1.10.3 Resolution: Fixed > FileExistsError when creating

[jira] [Commented] (AIRFLOW-4248) FileExistsError when creating log dir in file_processor_handler.py

2019-09-25 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16937600#comment-16937600 ] jack commented on AIRFLOW-4248: --- [~ash] this was merged a while ago. Can this be closed? (Maybe cherry

[jira] [Commented] (AIRFLOW-4226) DataProcPySparkOperator gets project ID from gcp_conn_id rather than project_id

2019-09-25 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16937597#comment-16937597 ] jack commented on AIRFLOW-4226: --- [~kaxilnaik] ping :)  > DataProcPySparkOperator gets project ID from

[jira] [Commented] (AIRFLOW-4216) Sensors not rescheduled when root task with 'reschedule' mode

2019-09-25 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16937594#comment-16937594 ] jack commented on AIRFLOW-4216: --- Can you provide example that reproduce this bug? > Sensors not

[jira] [Commented] (AIRFLOW-4068) Add GoogleCloudStorageFileTransformOperator

2019-09-25 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16937591#comment-16937591 ] jack commented on AIRFLOW-4068: --- [~kamil.bregula] I see u merged this. Thx! Can this be released in

[jira] [Commented] (AIRFLOW-3581) Fix next_ds/prev_ds semantics for manual runs

2019-09-25 Thread Menelaos Kokolios (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-3581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16937590#comment-16937590 ] Menelaos Kokolios commented on AIRFLOW-3581: [~aoen] I believe we need to be more careful

[jira] [Commented] (AIRFLOW-1223) Is there a (preferred) method for programmatically forcing a dag's refresh

2019-09-25 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-1223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16937588#comment-16937588 ] jack commented on AIRFLOW-1223: --- I don't think there is a CLI for that. > Is there a (preferred) method

[jira] [Commented] (AIRFLOW-1778) Task_instance and Dag_run recycle

2019-09-25 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-1778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16937578#comment-16937578 ] jack commented on AIRFLOW-1778: --- Deleting a dag run also delete the tasks > Task_instance and Dag_run

[jira] [Commented] (AIRFLOW-3223) RBAC with GitHub Authentication

2019-09-25 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-3223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16937577#comment-16937577 ] jack commented on AIRFLOW-3223: --- I don't see such support explained in the docs?  > RBAC with GitHub

[GitHub] [airflow] ashb opened a new pull request #6179: [AIRFLOW-XXX] Don't trust python-requests.org to run a valid HTTPS server

2019-09-25 Thread GitBox
ashb opened a new pull request #6179: [AIRFLOW-XXX] Don't trust python-requests.org to run a valid HTTPS server URL: https://github.com/apache/airflow/pull/6179 This is the 3rd or 4th time we've had a problem with the docs from requests causing the docs step of our build to fail. So

[jira] [Updated] (AIRFLOW-3877) Scheduler sending the absolute path to workers

2019-09-25 Thread Vipul Pandey (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-3877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vipul Pandey updated AIRFLOW-3877: -- Summary: Scheduler sending the absolute path to workers (was: Scheduler sending the

[jira] [Created] (AIRFLOW-5547) S3_hook creates a new connection even if a connection exists for method calls

2019-09-25 Thread Omkar (Jira)
Omkar created AIRFLOW-5547: -- Summary: S3_hook creates a new connection even if a connection exists for method calls Key: AIRFLOW-5547 URL: https://issues.apache.org/jira/browse/AIRFLOW-5547 Project: Apache

[jira] [Assigned] (AIRFLOW-3877) Scheduler sending the absolute path to celery

2019-09-25 Thread Vipul Pandey (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-3877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vipul Pandey reassigned AIRFLOW-3877: - Assignee: Vipul Pandey > Scheduler sending the absolute path to celery >

[jira] [Updated] (AIRFLOW-3877) Scheduler sending full file path of dags to workers

2019-09-25 Thread Vipul Pandey (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-3877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vipul Pandey updated AIRFLOW-3877: -- Summary: Scheduler sending full file path of dags to workers (was: Scheduler sending the

[GitHub] [airflow] mortenbpost commented on issue #6014: [AIRFLOW-5342] Fix MSSQL breaking task_instance db migration

2019-09-25 Thread GitBox
mortenbpost commented on issue #6014: [AIRFLOW-5342] Fix MSSQL breaking task_instance db migration URL: https://github.com/apache/airflow/pull/6014#issuecomment-534883553 @ashb It's pylinted and cicd passes on my local branch. It errored here because of a k8 timeout, but I don't see how I

  1   2   >