[jira] [Commented] (AIRFLOW-620) Ability to refresh logs of a TI without reloading whole page

[ https://issues.apache.org/jira/browse/AIRFLOW-620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16598324#comment-16598324 ] ASF GitHub Bot commented on AIRFLOW-620: r39132 closed pull request #1875: [AIRF

[GitHub] r39132 closed pull request #1875: [AIRFLOW-620] Add log refresh button to TI's log view page

r39132 closed pull request #1875: [AIRFLOW-620] Add log refresh button to TI's log view page URL: https://github.com/apache/incubator-airflow/pull/1875 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of provenanc

[GitHub] r39132 commented on issue #1875: [AIRFLOW-620] Add log refresh button to TI's log view page

r39132 commented on issue #1875: [AIRFLOW-620] Add log refresh button to TI's log view page URL: https://github.com/apache/incubator-airflow/pull/1875#issuecomment-417568453 closing for now.. reopen to update and rebase. Th

[GitHub] feng-tao commented on issue #3821: [AIRFLOW-2983] Add prev_ds_nodash and next_ds_nodash macro

feng-tao commented on issue #3821: [AIRFLOW-2983] Add prev_ds_nodash and next_ds_nodash macro URL: https://github.com/apache/incubator-airflow/pull/3821#issuecomment-417564477 Thanks @r39132 . Will keep in mind next time. Th

[GitHub] r39132 commented on issue #3821: [AIRFLOW-2983] Add prev_ds_nodash and next_ds_nodash macro

r39132 commented on issue #3821: [AIRFLOW-2983] Add prev_ds_nodash and next_ds_nodash macro URL: https://github.com/apache/incubator-airflow/pull/3821#issuecomment-417561701 FYI... don't forget to close JIRA issues when you merge ... for future reference .. I just closed https://issues.ap

[jira] [Closed] (AIRFLOW-2983) Add prev_ds_nodash and next_ds_nodash macro

[ https://issues.apache.org/jira/browse/AIRFLOW-2983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Anand closed AIRFLOW-2983. Resolution: Fixed > Add prev_ds_nodash and next_ds_nodash macro > --

[GitHub] yeluolei commented on issue #3675: [AIRFLOW-2834] fix build script for k8s docker

yeluolei commented on issue #3675: [AIRFLOW-2834] fix build script for k8s docker URL: https://github.com/apache/incubator-airflow/pull/3675#issuecomment-417559822 @ashb This is an automated message from the Apache Git Serv

[GitHub] gerardo commented on issue #3797: [AIRFLOW-2952] Splits CI into k8s + docker-compose

gerardo commented on issue #3797: [AIRFLOW-2952] Splits CI into k8s + docker-compose URL: https://github.com/apache/incubator-airflow/pull/3797#issuecomment-417558995 @dimberman we missed [creating the airflow database for postgresql](https://github.com/apache/incubator-airflow/blob/b7f63

[GitHub] gerardo commented on issue #3797: [AIRFLOW-2952] Splits CI into k8s + docker-compose

gerardo commented on issue #3797: [AIRFLOW-2952] Splits CI into k8s + docker-compose URL: https://github.com/apache/incubator-airflow/pull/3797#issuecomment-417552202 @dimberman I'm trying to figure out the simplest changes that can get this to work. So far: - `airflow initdb` is f

[GitHub] dimberman commented on issue #3797: [AIRFLOW-2952] Splits CI into k8s + docker-compose

dimberman commented on issue #3797: [AIRFLOW-2952] Splits CI into k8s + docker-compose URL: https://github.com/apache/incubator-airflow/pull/3797#issuecomment-417545995 @gerardo Ok it's now solidly back in the court of "getting TOX to work". Kubeadm is able to build and deploy. PTAL and l

[GitHub] dimberman commented on issue #3797: [AIRFLOW-2952] Splits CI into k8s + docker-compose

dimberman commented on issue #3797: [AIRFLOW-2952] Splits CI into k8s + docker-compose URL: https://github.com/apache/incubator-airflow/pull/3797#issuecomment-417541379 cc: @feng-tao @kaxil just a warning any PR merged right now is not being tested against kubernetes. ---

[GitHub] codecov-io edited a comment on issue #3823: [AIRFLOW-2985] An operator for S3 object copying

codecov-io edited a comment on issue #3823: [AIRFLOW-2985] An operator for S3 object copying URL: https://github.com/apache/incubator-airflow/pull/3823#issuecomment-417296502 # [Codecov](https://codecov.io/gh/apache/incubator-airflow/pull/3823?src=pr&el=h1) Report > Merging [#3823](h

[GitHub] codecov-io edited a comment on issue #3823: [AIRFLOW-2985] An operator for S3 object copying

codecov-io edited a comment on issue #3823: [AIRFLOW-2985] An operator for S3 object copying URL: https://github.com/apache/incubator-airflow/pull/3823#issuecomment-417296502 # [Codecov](https://codecov.io/gh/apache/incubator-airflow/pull/3823?src=pr&el=h1) Report > Merging [#3823](h

[GitHub] XD-DENG commented on issue #3823: [AIRFLOW-2985] An operator for S3 object copying

XD-DENG commented on issue #3823: [AIRFLOW-2985] An operator for S3 object copying URL: https://github.com/apache/incubator-airflow/pull/3823#issuecomment-417539567 Hi both @ashb @feng-tao , I have updated the code bases on your earlier inputs: - Changed the way to specify bucket/k

[GitHub] dimberman commented on issue #3797: [AIRFLOW-2952] Splits CI into k8s + docker-compose

dimberman commented on issue #3797: [AIRFLOW-2952] Splits CI into k8s + docker-compose URL: https://github.com/apache/incubator-airflow/pull/3797#issuecomment-417538581 @Fokko @bolkedebruin @gerardo I was able to get kubeadm to work with a local registry (that was a rough experience lol).

[GitHub] feng-tao commented on issue #3820: [AIRFLOW-XXX] Fix Docstrings for Hooks/Operators

feng-tao commented on issue #3820: [AIRFLOW-XXX] Fix Docstrings for Hooks/Operators URL: https://github.com/apache/incubator-airflow/pull/3820#issuecomment-417536750 lgtm @kaxil This is an automated message from the Apache

[jira] [Commented] (AIRFLOW-2983) Add prev_ds_nodash and next_ds_nodash macro

[ https://issues.apache.org/jira/browse/AIRFLOW-2983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16598158#comment-16598158 ] ASF GitHub Bot commented on AIRFLOW-2983: - feng-tao closed pull request #3821:

[GitHub] feng-tao closed pull request #3821: [AIRFLOW-2983] Add prev_ds_nodash and next_ds_nodash macro

feng-tao closed pull request #3821: [AIRFLOW-2983] Add prev_ds_nodash and next_ds_nodash macro URL: https://github.com/apache/incubator-airflow/pull/3821 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of provena

[GitHub] feng-tao commented on issue #3821: [AIRFLOW-2983] Add prev_ds_nodash and next_ds_nodash macro

feng-tao commented on issue #3821: [AIRFLOW-2983] Add prev_ds_nodash and next_ds_nodash macro URL: https://github.com/apache/incubator-airflow/pull/3821#issuecomment-417536518 Hey @kaxil, @r39132, a test to check template context is added. Merge it now. ---

[GitHub] codecov-io edited a comment on issue #3821: [AIRFLOW-2983] Add prev_ds_nodash and next_ds_nodash macro

codecov-io edited a comment on issue #3821: [AIRFLOW-2983] Add prev_ds_nodash and next_ds_nodash macro URL: https://github.com/apache/incubator-airflow/pull/3821#issuecomment-417186769 # [Codecov](https://codecov.io/gh/apache/incubator-airflow/pull/3821?src=pr&el=h1) Report > Merging

[GitHub] codecov-io edited a comment on issue #3821: [AIRFLOW-2983] Add prev_ds_nodash and next_ds_nodash macro

codecov-io edited a comment on issue #3821: [AIRFLOW-2983] Add prev_ds_nodash and next_ds_nodash macro URL: https://github.com/apache/incubator-airflow/pull/3821#issuecomment-417186769 # [Codecov](https://codecov.io/gh/apache/incubator-airflow/pull/3821?src=pr&el=h1) Report > Merging

[GitHub] feng-tao commented on issue #3821: [AIRFLOW-2983] Add prev_ds_nodash and next_ds_nodash macro

feng-tao commented on issue #3821: [AIRFLOW-2983] Add prev_ds_nodash and next_ds_nodash macro URL: https://github.com/apache/incubator-airflow/pull/3821#issuecomment-417515885 @kaxil , thanks for the comment. I added a unit test to check. Will wait for CI to finish. -

[GitHub] gerardo commented on a change in pull request #3797: [AIRFLOW-2952] Splits CI into k8s + docker-compose

gerardo commented on a change in pull request #3797: [AIRFLOW-2952] Splits CI into k8s + docker-compose URL: https://github.com/apache/incubator-airflow/pull/3797#discussion_r214217582 ## File path: .travis.yml ## @@ -26,14 +26,14 @@ env: - TRAVIS_CACHE=$HOME/.travis_

[GitHub] ndmar commented on issue #2708: [AIRFLOW-1746] Add a Nomad operator to trigger job from Airflow

ndmar commented on issue #2708: [AIRFLOW-1746] Add a Nomad operator to trigger job from Airflow URL: https://github.com/apache/incubator-airflow/pull/2708#issuecomment-417502998 @etrabelsi @Fokko Just discovered this PR and am pretty excited about it, as we just started using Airflow on N

[GitHub] codecov-io edited a comment on issue #3825: [AIRFLOW-2989] Add param to set bootDiskType in Dataproc Op

codecov-io edited a comment on issue #3825: [AIRFLOW-2989] Add param to set bootDiskType in Dataproc Op URL: https://github.com/apache/incubator-airflow/pull/3825#issuecomment-417496304 # [Codecov](https://codecov.io/gh/apache/incubator-airflow/pull/3825?src=pr&el=h1) Report > Merging

[GitHub] codecov-io edited a comment on issue #3825: [AIRFLOW-2989] Add param to set bootDiskType in Dataproc Op

codecov-io edited a comment on issue #3825: [AIRFLOW-2989] Add param to set bootDiskType in Dataproc Op URL: https://github.com/apache/incubator-airflow/pull/3825#issuecomment-417496304 # [Codecov](https://codecov.io/gh/apache/incubator-airflow/pull/3825?src=pr&el=h1) Report > Merging

[jira] [Commented] (AIRFLOW-2548) Output Plugin Import Errors to WebUI

[ https://issues.apache.org/jira/browse/AIRFLOW-2548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16598028#comment-16598028 ] Jimmy Cao commented on AIRFLOW-2548: This makes sense to me. Are you working on a P

[GitHub] codecov-io edited a comment on issue #3825: [AIRFLOW-2989] Add param to set bootDiskType in Dataproc Op

codecov-io edited a comment on issue #3825: [AIRFLOW-2989] Add param to set bootDiskType in Dataproc Op URL: https://github.com/apache/incubator-airflow/pull/3825#issuecomment-417496304 # [Codecov](https://codecov.io/gh/apache/incubator-airflow/pull/3825?src=pr&el=h1) Report > Merging

[GitHub] codecov-io commented on issue #3825: [AIRFLOW-2989] Add param to set bootDiskType in Dataproc Op

codecov-io commented on issue #3825: [AIRFLOW-2989] Add param to set bootDiskType in Dataproc Op URL: https://github.com/apache/incubator-airflow/pull/3825#issuecomment-417496304 # [Codecov](https://codecov.io/gh/apache/incubator-airflow/pull/3825?src=pr&el=h1) Report > Merging [#382

[jira] [Commented] (AIRFLOW-2988) GCP Dataflow hook should specifically run python2

[ https://issues.apache.org/jira/browse/AIRFLOW-2988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16598001#comment-16598001 ] ASF GitHub Bot commented on AIRFLOW-2988: - jcao219 opened a new pull request #3

[GitHub] jcao219 opened a new pull request #3826: [AIRFLOW-2988] Run specifically python2 for dataflow

jcao219 opened a new pull request #3826: [AIRFLOW-2988] Run specifically python2 for dataflow URL: https://github.com/apache/incubator-airflow/pull/3826 Apache beam does not yet support python3, so it's best to run dataflow jobs with python2 specifically until python3 support is complete

[jira] [Commented] (AIRFLOW-2989) No Parameter to change bootDiskType for DataprocClusterCreateOperator

[ https://issues.apache.org/jira/browse/AIRFLOW-2989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16597996#comment-16597996 ] ASF GitHub Bot commented on AIRFLOW-2989: - kaxil opened a new pull request #382

[GitHub] kaxil opened a new pull request #3825: [AIRFLOW-2989] Add param to set bootDiskType in Dataproc Op

kaxil opened a new pull request #3825: [AIRFLOW-2989] Add param to set bootDiskType in Dataproc Op URL: https://github.com/apache/incubator-airflow/pull/3825 Make sure you have checked _all_ steps below. ### Jira - [x] My PR addresses the following [Airflow Jira](http

[GitHub] kaxil commented on issue #3825: [AIRFLOW-2989] Add param to set bootDiskType in Dataproc Op

kaxil commented on issue #3825: [AIRFLOW-2989] Add param to set bootDiskType in Dataproc Op URL: https://github.com/apache/incubator-airflow/pull/3825#issuecomment-417488271 cc @Fokko @fenglu-g This is an automated message

[jira] [Created] (AIRFLOW-2989) No Parameter to change bootDiskType for DataprocClusterCreateOperator

Kaxil Naik created AIRFLOW-2989: --- Summary: No Parameter to change bootDiskType for DataprocClusterCreateOperator Key: AIRFLOW-2989 URL: https://issues.apache.org/jira/browse/AIRFLOW-2989 Project: Apach

[GitHub] codecov-io edited a comment on issue #3817: [AIRFLOW-2974] Extended Databricks hook with cluster operation

codecov-io edited a comment on issue #3817: [AIRFLOW-2974] Extended Databricks hook with cluster operation URL: https://github.com/apache/incubator-airflow/pull/3817#issuecomment-416701478 # [Codecov](https://codecov.io/gh/apache/incubator-airflow/pull/3817?src=pr&el=h1) Report > Merg

[jira] [Created] (AIRFLOW-2988) GCP Dataflow hook should specifically run python2

Jimmy Cao created AIRFLOW-2988: -- Summary: GCP Dataflow hook should specifically run python2 Key: AIRFLOW-2988 URL: https://issues.apache.org/jira/browse/AIRFLOW-2988 Project: Apache Airflow Issu

[GitHub] codecov-io edited a comment on issue #3817: [AIRFLOW-2974] Extended Databricks hook with cluster operation

codecov-io edited a comment on issue #3817: [AIRFLOW-2974] Extended Databricks hook with cluster operation URL: https://github.com/apache/incubator-airflow/pull/3817#issuecomment-416701478 # [Codecov](https://codecov.io/gh/apache/incubator-airflow/pull/3817?src=pr&el=h1) Report > Merg

[GitHub] xnuinside commented on issue #3733: [AIRFLOW-491] Add cache parameter in BigQuery query method - with 'api_resource_configs'

xnuinside commented on issue #3733: [AIRFLOW-491] Add cache parameter in BigQuery query method - with 'api_resource_configs' URL: https://github.com/apache/incubator-airflow/pull/3733#issuecomment-417475558 @kaxil, check pls. And thanks in advance!

[GitHub] kaxil commented on issue #3821: [AIRFLOW-2983] Add prev_ds_nodash and next_ds_nodash macro

kaxil commented on issue #3821: [AIRFLOW-2983] Add prev_ds_nodash and next_ds_nodash macro URL: https://github.com/apache/incubator-airflow/pull/3821#issuecomment-417475014 LGTM. @feng-tao Can we add a simple test for this?

[GitHub] codecov-io commented on issue #3820: [AIRFLOW-XXX] Fix Docstrings for Hooks/Operators

codecov-io commented on issue #3820: [AIRFLOW-XXX] Fix Docstrings for Hooks/Operators URL: https://github.com/apache/incubator-airflow/pull/3820#issuecomment-417466806 # [Codecov](https://codecov.io/gh/apache/incubator-airflow/pull/3820?src=pr&el=h1) Report > Merging [#3820](https://

[GitHub] dimberman commented on issue #3797: [AIRFLOW-2952] Splits CI into k8s + docker-compose

dimberman commented on issue #3797: [AIRFLOW-2952] Splits CI into k8s + docker-compose URL: https://github.com/apache/incubator-airflow/pull/3797#issuecomment-417466718 @gerardo I agree that it would be a pain, but it's going to REALLY hurt if we merge PRs for a couple of weeks and then c

[GitHub] gerardo commented on issue #3797: [AIRFLOW-2952] Splits CI into k8s + docker-compose

gerardo commented on issue #3797: [AIRFLOW-2952] Splits CI into k8s + docker-compose URL: https://github.com/apache/incubator-airflow/pull/3797#issuecomment-417461794 @dimberman I can take a stab at making this work in a separate branch if you want. This is definitely a blocker, but rever

[jira] [Updated] (AIRFLOW-2963) Error parsing AIRFLOW_CONN_ URI

[ https://issues.apache.org/jira/browse/AIRFLOW-2963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Casandra julie mitchell updated AIRFLOW-2963: - Attachment: (was: 2811fb90a1302h.txt) > Error parsing AIRFLOW_CONN_

[jira] [Updated] (AIRFLOW-2963) Error parsing AIRFLOW_CONN_ URI

[ https://issues.apache.org/jira/browse/AIRFLOW-2963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Casandra julie mitchell updated AIRFLOW-2963: - Attachment: 2811fb90a1302h.txt > Error parsing AIRFLOW_CONN_ URI >

[jira] [Assigned] (AIRFLOW-2963) Error parsing AIRFLOW_CONN_ URI

[ https://issues.apache.org/jira/browse/AIRFLOW-2963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Casandra julie mitchell reassigned AIRFLOW-2963: Assignee: Casandra julie mitchell > Error parsing AIRFLOW_CONN_

[jira] [Updated] (AIRFLOW-2900) Code not visible for Packaged DAGs

[ https://issues.apache.org/jira/browse/AIRFLOW-2900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik updated AIRFLOW-2900: Affects Version/s: (was: Airflow 1.9.0) 1.10.0 1

[jira] [Updated] (AIRFLOW-2900) Code not visible for Packaged DAGs

[ https://issues.apache.org/jira/browse/AIRFLOW-2900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik updated AIRFLOW-2900: Fix Version/s: 1.10.1 > Code not visible for Packaged DAGs > -- >

[jira] [Resolved] (AIRFLOW-2900) Code not visible for Packaged DAGs

[ https://issues.apache.org/jira/browse/AIRFLOW-2900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik resolved AIRFLOW-2900. - Resolution: Fixed Resolved by https://github.com/apache/incubator-airflow/pull/3749 > Code not

[GitHub] kaxil closed pull request #3749: [AIRFLOW-2900] Show code for packaged DAGs

kaxil closed pull request #3749: [AIRFLOW-2900] Show code for packaged DAGs URL: https://github.com/apache/incubator-airflow/pull/3749 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of provenance: As this is a f

[jira] [Commented] (AIRFLOW-2900) Code not visible for Packaged DAGs

[ https://issues.apache.org/jira/browse/AIRFLOW-2900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16597881#comment-16597881 ] ASF GitHub Bot commented on AIRFLOW-2900: - kaxil closed pull request #3749: [AI

[GitHub] kaxil commented on issue #3749: [AIRFLOW-2900] Show code for packaged DAGs

kaxil commented on issue #3749: [AIRFLOW-2900] Show code for packaged DAGs URL: https://github.com/apache/incubator-airflow/pull/3749#issuecomment-417451770 Awesome, Great work. This is an automated message from the Apache Gi

[jira] [Updated] (AIRFLOW-2981) TypeError in dataflow operators when using GCS jar or py_file

[ https://issues.apache.org/jira/browse/AIRFLOW-2981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeffrey Payne updated AIRFLOW-2981: --- Description: The {{GoogleCloudBucketHelper.google_cloud_to_local}} function attempts to co

[jira] [Work started] (AIRFLOW-2981) TypeError in dataflow operators when using GCS jar or py_file

[ https://issues.apache.org/jira/browse/AIRFLOW-2981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on AIRFLOW-2981 started by Jeffrey Payne. -- > TypeError in dataflow operators when using GCS jar or py_file > ---

[jira] [Updated] (AIRFLOW-2983) Add prev_ds_nodash and next_ds_nodash macro

[ https://issues.apache.org/jira/browse/AIRFLOW-2983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Feng updated AIRFLOW-2983: -- Description: Similar to [#3418|https://github.com/apache/incubator-airflow/pull/3418], but introduce

[GitHub] feng-tao commented on issue #3821: [AIRFLOW-2983] Add prev_ds_nodash and next_ds_nodash macro

feng-tao commented on issue #3821: [AIRFLOW-2983] Add prev_ds_nodash and next_ds_nodash macro URL: https://github.com/apache/incubator-airflow/pull/3821#issuecomment-417446554 Thanks @r39132 for the feedback. I updated the description in the pr and jira and let me know if it looks ok to

[jira] [Commented] (AIRFLOW-2986) Airflow Worker does not reach sqs

[ https://issues.apache.org/jira/browse/AIRFLOW-2986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16597832#comment-16597832 ] Shivakumar Gopalakrishnan commented on AIRFLOW-2986: yes, I have 

[jira] [Commented] (AIRFLOW-2986) Airflow Worker does not reach sqs

[ https://issues.apache.org/jira/browse/AIRFLOW-2986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16597828#comment-16597828 ] Ash Berlin-Taylor commented on AIRFLOW-2986: You mentioned you have a proxy

[GitHub] r39132 commented on issue #1875: [AIRFLOW-620] Add log refresh button to TI's log view page

r39132 commented on issue #1875: [AIRFLOW-620] Add log refresh button to TI's log view page URL: https://github.com/apache/incubator-airflow/pull/1875#issuecomment-417429399 @msumit What do you want to do with this PR? Close and re-open a fresh one or rebase and ask for a review. If I don

[GitHub] r39132 commented on issue #3821: [AIRFLOW-2983] Add prev_ds_nodash and next_ds_nodash macro

r39132 commented on issue #3821: [AIRFLOW-2983] Add prev_ds_nodash and next_ds_nodash macro URL: https://github.com/apache/incubator-airflow/pull/3821#issuecomment-417428702 @feng-tao can you provide a description for your change to the JIRA? The problem statement should be apparent to an

[GitHub] xnuinside commented on a change in pull request #3733: [AIRFLOW-491] Add cache parameter in BigQuery query method - with 'api_resource_configs'

xnuinside commented on a change in pull request #3733: [AIRFLOW-491] Add cache parameter in BigQuery query method - with 'api_resource_configs' URL: https://github.com/apache/incubator-airflow/pull/3733#discussion_r213896240 ## File path: airflow/contrib/hooks/bigquery_hook.py

[jira] [Commented] (AIRFLOW-491) Add cache parameter in BigQuery query method

[ https://issues.apache.org/jira/browse/AIRFLOW-491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16597733#comment-16597733 ] ASF GitHub Bot commented on AIRFLOW-491: xnuinside opened a new pull request #37

[GitHub] xnuinside opened a new pull request #3733: [AIRFLOW-491] Add cache parameter in BigQuery query method - with 'api_resource_configs'

xnuinside opened a new pull request #3733: [AIRFLOW-491] Add cache parameter in BigQuery query method - with 'api_resource_configs' URL: https://github.com/apache/incubator-airflow/pull/3733 Make sure you have checked _all_ steps below. ### Jira - [x] My PR addresses the follo

[jira] [Commented] (AIRFLOW-491) Add cache parameter in BigQuery query method

[ https://issues.apache.org/jira/browse/AIRFLOW-491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16597730#comment-16597730 ] ASF GitHub Bot commented on AIRFLOW-491: xnuinside closed pull request #3733: [A

[GitHub] xnuinside closed pull request #3733: [AIRFLOW-491] Add cache parameter in BigQuery query method - with 'api_resource_configs'

xnuinside closed pull request #3733: [AIRFLOW-491] Add cache parameter in BigQuery query method - with 'api_resource_configs' URL: https://github.com/apache/incubator-airflow/pull/3733 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displaye

[GitHub] tedmiston edited a comment on issue #3656: [AIRFLOW-2803] Fix all ESLint issues

tedmiston edited a comment on issue #3656: [AIRFLOW-2803] Fix all ESLint issues URL: https://github.com/apache/incubator-airflow/pull/3656#issuecomment-417341304 @r39132 Yes, I've been working on the revisions discussed above and anticipate pushing up the next pass later today or tomorrow.

[jira] [Created] (AIRFLOW-2987) "About" page version info is not available

Frank Maritato created AIRFLOW-2987: --- Summary: "About" page version info is not available Key: AIRFLOW-2987 URL: https://issues.apache.org/jira/browse/AIRFLOW-2987 Project: Apache Airflow I

[GitHub] feng-tao edited a comment on issue #3823: [AIRFLOW-2985] An operator for S3 object copying

feng-tao edited a comment on issue #3823: [AIRFLOW-2985] An operator for S3 object copying URL: https://github.com/apache/incubator-airflow/pull/3823#issuecomment-417384630 Thanks for the info. Then I think it should add a todo / note in the comment about the limitation for cross bucket c

[GitHub] feng-tao commented on issue #3823: [AIRFLOW-2985] An operator for S3 object copying

feng-tao commented on issue #3823: [AIRFLOW-2985] An operator for S3 object copying URL: https://github.com/apache/incubator-airflow/pull/3823#issuecomment-417384630 Thanks for the info. Then I think it should mention a todo / note in the code about the limitation for cross bucket copying

[jira] [Commented] (AIRFLOW-2986) Airflow Worker does not reach sqs

[ https://issues.apache.org/jira/browse/AIRFLOW-2986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16597631#comment-16597631 ] Shivakumar Gopalakrishnan commented on AIRFLOW-2986: curl https://e

[jira] [Commented] (AIRFLOW-2986) Airflow Worker does not reach sqs

[ https://issues.apache.org/jira/browse/AIRFLOW-2986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16597626#comment-16597626 ] Ash Berlin-Taylor commented on AIRFLOW-2986: This sounds like a problem wit

[jira] [Updated] (AIRFLOW-2986) Airflow Worker does not reach sqs

[ https://issues.apache.org/jira/browse/AIRFLOW-2986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor updated AIRFLOW-2986: --- Description: I am running the airflow worker service. The service is not able to co

[jira] [Created] (AIRFLOW-2986) Airflow Worker does not reach sqs

Shivakumar Gopalakrishnan created AIRFLOW-2986: -- Summary: Airflow Worker does not reach sqs Key: AIRFLOW-2986 URL: https://issues.apache.org/jira/browse/AIRFLOW-2986 Project: Apache Airflo

[GitHub] XD-DENG commented on issue #3823: [AIRFLOW-2985] An operator for S3 object copying

XD-DENG commented on issue #3823: [AIRFLOW-2985] An operator for S3 object copying URL: https://github.com/apache/incubator-airflow/pull/3823#issuecomment-417363095 Thanks @ashb for adding up & clarifying. My intention for this PR is to provide the same `copy_object()` feature in `boto3`,

[GitHub] XD-DENG commented on issue #3823: [AIRFLOW-2985] An operator for S3 object copying

XD-DENG commented on issue #3823: [AIRFLOW-2985] An operator for S3 object copying URL: https://github.com/apache/incubator-airflow/pull/3823#issuecomment-417361467 Hi @feng-tao , my day-to-day use cases are normally copying within one bucket. But I believe copying across buckets is allow

[GitHub] ashb commented on issue #3823: [AIRFLOW-2985] An operator for S3 object copying

ashb commented on issue #3823: [AIRFLOW-2985] An operator for S3 object copying URL: https://github.com/apache/incubator-airflow/pull/3823#issuecomment-417361162 This would only work if the same connection ID has access to both buckets - and will make AWS do the copy (so we don't have to d

[GitHub] jakebiesinger commented on issue #3749: [AIRFLOW-2900] Show code for packaged DAGs

jakebiesinger commented on issue #3749: [AIRFLOW-2900] Show code for packaged DAGs URL: https://github.com/apache/incubator-airflow/pull/3749#issuecomment-417359964 Thanks, @kaxil. Looks like I had a bad merge when I squashed my commit. Should be working now. ---

[GitHub] jakahn commented on issue #3805: [AIRFLOW-2062] Add per-connection KMS encryption.

jakahn commented on issue #3805: [AIRFLOW-2062] Add per-connection KMS encryption. URL: https://github.com/apache/incubator-airflow/pull/3805#issuecomment-417359277 @bolkedebruin @gerardo, thanks for the feedback. The intent is that this implementation _should_ be able to support ot

[GitHub] feng-tao commented on issue #3823: [AIRFLOW-2985] An operator for S3 object copying

feng-tao commented on issue #3823: [AIRFLOW-2985] An operator for S3 object copying URL: https://github.com/apache/incubator-airflow/pull/3823#issuecomment-417358938 Different s3 bucket is only acceessible by different IAM role. How does this operator work with different IAM roles?

[GitHub] dimberman commented on issue #3797: [AIRFLOW-2952] Splits CI into k8s + docker-compose

dimberman commented on issue #3797: [AIRFLOW-2952] Splits CI into k8s + docker-compose URL: https://github.com/apache/incubator-airflow/pull/3797#issuecomment-417349648 @Fokko @gerardo Quick update. I've been still running into weird minikube issues and have been unable to get the CI to b

[GitHub] tedmiston commented on issue #3656: [AIRFLOW-2803] Fix all ESLint issues

tedmiston commented on issue #3656: [AIRFLOW-2803] Fix all ESLint issues URL: https://github.com/apache/incubator-airflow/pull/3656#issuecomment-417341304 @r39132 Yes, I've been working on the revisions discussed above and anticipate pushing up the next pass later today or tomorrow. -

[GitHub] msumit closed pull request #3824: [AIRFLOW-XXX] Add Format to company list

msumit closed pull request #3824: [AIRFLOW-XXX] Add Format to company list URL: https://github.com/apache/incubator-airflow/pull/3824 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of provenance: As this is a fo

[GitHub] codecov-io edited a comment on issue #3824: [AIRFLOW-XXX] Add Format to company list

codecov-io edited a comment on issue #3824: [AIRFLOW-XXX] Add Format to company list URL: https://github.com/apache/incubator-airflow/pull/3824#issuecomment-417325998 # [Codecov](https://codecov.io/gh/apache/incubator-airflow/pull/3824?src=pr&el=h1) Report > Merging [#3824](https://c

[GitHub] codecov-io commented on issue #3824: [AIRFLOW-XXX] Add Format to company list

codecov-io commented on issue #3824: [AIRFLOW-XXX] Add Format to company list URL: https://github.com/apache/incubator-airflow/pull/3824#issuecomment-417325998 # [Codecov](https://codecov.io/gh/apache/incubator-airflow/pull/3824?src=pr&el=h1) Report > Merging [#3824](https://codecov.i

[GitHub] mascah edited a comment on issue #2946: [AIRFLOW-1927] Convert naive datetimes for TaskInstances

mascah edited a comment on issue #2946: [AIRFLOW-1927] Convert naive datetimes for TaskInstances URL: https://github.com/apache/incubator-airflow/pull/2946#issuecomment-417314553 @Fokko @bolkedebruin Can you guys please confirm that this was intended to change the output of macros?

[GitHub] mascah commented on issue #2946: [AIRFLOW-1927] Convert naive datetimes for TaskInstances

mascah commented on issue #2946: [AIRFLOW-1927] Convert naive datetimes for TaskInstances URL: https://github.com/apache/incubator-airflow/pull/2946#issuecomment-417314553 @Fokko @bolkedebruin Can you guys please confirm that this was intended to change the output of macros? In 1.

[GitHub] jasonicarter opened a new pull request #3824: [AIRFLOW-XXX] Add Format to company list

jasonicarter opened a new pull request #3824: [AIRFLOW-XXX] Add Format to company list URL: https://github.com/apache/incubator-airflow/pull/3824 Make sure you have checked _all_ steps below. ### Jira - [x] My PR addresses the following [Airflow Jira](https://issues.apache.or

[jira] [Comment Edited] (AIRFLOW-2966) KubernetesExecutor + namespace quotas kills scheduler if the pod can't be launched

[ https://issues.apache.org/jira/browse/AIRFLOW-2966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16597385#comment-16597385 ] Roland de Boo edited comment on AIRFLOW-2966 at 8/30/18 12:40 PM: ---

[GitHub] codecov-io edited a comment on issue #3733: [AIRFLOW-491] Add cache parameter in BigQuery query method - with 'api_resource_configs'

codecov-io edited a comment on issue #3733: [AIRFLOW-491] Add cache parameter in BigQuery query method - with 'api_resource_configs' URL: https://github.com/apache/incubator-airflow/pull/3733#issuecomment-413105867 # [Codecov](https://codecov.io/gh/apache/incubator-airflow/pull/3733?src=p

[GitHub] codecov-io edited a comment on issue #3733: [AIRFLOW-491] Add cache parameter in BigQuery query method - with 'api_resource_configs'

codecov-io edited a comment on issue #3733: [AIRFLOW-491] Add cache parameter in BigQuery query method - with 'api_resource_configs' URL: https://github.com/apache/incubator-airflow/pull/3733#issuecomment-413105867 # [Codecov](https://codecov.io/gh/apache/incubator-airflow/pull/3733?src=p

[GitHub] bolkedebruin commented on issue #3526: [AIRFLOW-2651] Add file system hooks with a common interface

bolkedebruin commented on issue #3526: [AIRFLOW-2651] Add file system hooks with a common interface URL: https://github.com/apache/incubator-airflow/pull/3526#issuecomment-417304220 @jrderuiter I like the possibilities that this will deliver, but I think some architectural updates are req

[jira] [Comment Edited] (AIRFLOW-2966) KubernetesExecutor + namespace quotas kills scheduler if the pod can't be launched

[ https://issues.apache.org/jira/browse/AIRFLOW-2966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16597385#comment-16597385 ] Roland de Boo edited comment on AIRFLOW-2966 at 8/30/18 12:35 PM: ---

[GitHub] codecov-io edited a comment on issue #3733: [AIRFLOW-491] Add cache parameter in BigQuery query method - with 'api_resource_configs'

codecov-io edited a comment on issue #3733: [AIRFLOW-491] Add cache parameter in BigQuery query method - with 'api_resource_configs' URL: https://github.com/apache/incubator-airflow/pull/3733#issuecomment-413105867 # [Codecov](https://codecov.io/gh/apache/incubator-airflow/pull/3733?src=p

[jira] [Commented] (AIRFLOW-2966) KubernetesExecutor + namespace quotas kills scheduler if the pod can't be launched

[ https://issues.apache.org/jira/browse/AIRFLOW-2966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16597385#comment-16597385 ] Roland de Boo commented on AIRFLOW-2966: Colleague of John here. Some additiona

[GitHub] bolkedebruin closed pull request #3761: Subdag inherit runid *do not merge*

bolkedebruin closed pull request #3761: Subdag inherit runid *do not merge* URL: https://github.com/apache/incubator-airflow/pull/3761 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of provenance: As this is a f

[GitHub] bolkedebruin commented on issue #3761: Subdag inherit runid *do not merge*

bolkedebruin commented on issue #3761: Subdag inherit runid *do not merge* URL: https://github.com/apache/incubator-airflow/pull/3761#issuecomment-417302471 please run this on your own CI and discuss it on the mailing list. CI costs Apache Infra money.

[GitHub] xnuinside commented on a change in pull request #3733: [AIRFLOW-491] Add cache parameter in BigQuery query method - with 'api_resource_configs'

xnuinside commented on a change in pull request #3733: [AIRFLOW-491] Add cache parameter in BigQuery query method - with 'api_resource_configs' URL: https://github.com/apache/incubator-airflow/pull/3733#discussion_r213894129 ## File path: airflow/contrib/hooks/bigquery_hook.py

[jira] [Commented] (AIRFLOW-2779) Verify and correct licenses

[ https://issues.apache.org/jira/browse/AIRFLOW-2779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16597382#comment-16597382 ] ASF GitHub Bot commented on AIRFLOW-2779: - bolkedebruin closed pull request #38

[GitHub] bolkedebruin closed pull request #3803: [AIRFLOW-2779] Restore Copyright notice of GHE auth backend

bolkedebruin closed pull request #3803: [AIRFLOW-2779] Restore Copyright notice of GHE auth backend URL: https://github.com/apache/incubator-airflow/pull/3803 This is an automated message from the Apache Git Service. To resp

[jira] [Commented] (AIRFLOW-2984) Cannot convert naive_datetime when task has a naive start_date/end_date

[ https://issues.apache.org/jira/browse/AIRFLOW-2984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16597377#comment-16597377 ] ASF GitHub Bot commented on AIRFLOW-2984: - bolkedebruin closed pull request #38

  1   2   >