[jira] [Created] (AIRFLOW-3592) Logs cannot be viewed while in rescheduled state

2018-12-29 Thread Stefan Seelmann (JIRA)
Stefan Seelmann created AIRFLOW-3592: Summary: Logs cannot be viewed while in rescheduled state Key: AIRFLOW-3592 URL: https://issues.apache.org/jira/browse/AIRFLOW-3592 Project: Apache Airflow

[GitHub] seelmann commented on issue #3596: [AIRFLOW-2747] Explicit re-schedule of sensors

2018-12-29 Thread GitBox
seelmann commented on issue #3596: [AIRFLOW-2747] Explicit re-schedule of sensors URL: https://github.com/apache/incubator-airflow/pull/3596#issuecomment-450479933 I created several sub-tasks in https://issues.apache.org/jira/browse/AIRFLOW-2747

[jira] [Created] (AIRFLOW-3591) Fix start date, end date, duration for rescheduled tasks

2018-12-29 Thread Stefan Seelmann (JIRA)
Stefan Seelmann created AIRFLOW-3591: Summary: Fix start date, end date, duration for rescheduled tasks Key: AIRFLOW-3591 URL: https://issues.apache.org/jira/browse/AIRFLOW-3591 Project: Apache

[GitHub] odracci commented on issue #3770: [AIRFLOW-3281] Fix Kubernetes operator with git-sync

2018-12-29 Thread GitBox
odracci commented on issue #3770: [AIRFLOW-3281] Fix Kubernetes operator with git-sync URL: https://github.com/apache/incubator-airflow/pull/3770#issuecomment-450485058 @dimberman I mentioned it in

[jira] [Created] (AIRFLOW-3594) Update License Headers in Python Files

2018-12-29 Thread Felix Uellendall (JIRA)
Felix Uellendall created AIRFLOW-3594: - Summary: Update License Headers in Python Files Key: AIRFLOW-3594 URL: https://issues.apache.org/jira/browse/AIRFLOW-3594 Project: Apache Airflow

[jira] [Commented] (AIRFLOW-3594) Unify different License Header

2018-12-29 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16730667#comment-16730667 ] ASF GitHub Bot commented on AIRFLOW-3594: - feluelle commented on pull request #4399:

[jira] [Assigned] (AIRFLOW-3462) Refactor: Move TaskReschedule out of models.py

2018-12-29 Thread Stefan Seelmann (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Seelmann reassigned AIRFLOW-3462: Assignee: Stefan Seelmann > Refactor: Move TaskReschedule out of models.py >

[jira] [Created] (AIRFLOW-3590) In case of reschedule executor should not log success

2018-12-29 Thread Stefan Seelmann (JIRA)
Stefan Seelmann created AIRFLOW-3590: Summary: In case of reschedule executor should not log success Key: AIRFLOW-3590 URL: https://issues.apache.org/jira/browse/AIRFLOW-3590 Project: Apache

[jira] [Updated] (AIRFLOW-3593) Allow '@' in usernames.

2018-12-29 Thread will-beta (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] will-beta updated AIRFLOW-3593: --- Description: The username provided by *Azure Database for PostgreSQL server* has a '@'. But

[GitHub] stale[bot] commented on issue #3605: [AIRFLOW-1238] Decode URL-encoded characters.

2018-12-29 Thread GitBox
stale[bot] commented on issue #3605: [AIRFLOW-1238] Decode URL-encoded characters. URL: https://github.com/apache/incubator-airflow/pull/3605#issuecomment-450503386 This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further

[GitHub] jmcarp opened a new pull request #4401: [AIRFLOW-3596] Clean up undefined template variables.

2018-12-29 Thread GitBox
jmcarp opened a new pull request #4401: [AIRFLOW-3596] Clean up undefined template variables. URL: https://github.com/apache/incubator-airflow/pull/4401 Make sure you have checked _all_ steps below. ### Jira - [x] My PR addresses the following [Airflow

[jira] [Updated] (AIRFLOW-3594) Unify different License Header

2018-12-29 Thread Felix Uellendall (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Uellendall updated AIRFLOW-3594: -- Description: Some Files still have an old version of the Apache License. (was: Some

[GitHub] feluelle opened a new pull request #4400: [AIRFLOW-3595] Add tests for Hive2SambaOperator

2018-12-29 Thread GitBox
feluelle opened a new pull request #4400: [AIRFLOW-3595] Add tests for Hive2SambaOperator URL: https://github.com/apache/incubator-airflow/pull/4400 Make sure you have checked _all_ steps below. ### Jira - [x] My PR addresses the following [Airflow

[GitHub] chinhngt commented on issue #4389: [AIRFLOW-3583] Fix AirflowException import

2018-12-29 Thread GitBox
chinhngt commented on issue #4389: [AIRFLOW-3583] Fix AirflowException import URL: https://github.com/apache/incubator-airflow/pull/4389#issuecomment-450495458 @jgao54 Thanks for taking a look. I must missed something then. Below is the exception I got when turning remote logging to wasb

[GitHub] stale[bot] commented on issue #1964: [AIRFLOW-722] Add Celery queue sensor

2018-12-29 Thread GitBox
stale[bot] commented on issue #1964: [AIRFLOW-722] Add Celery queue sensor URL: https://github.com/apache/incubator-airflow/pull/1964#issuecomment-450503388 This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity

[GitHub] stale[bot] commented on issue #2747: AIRFLOW-1772: Fix bug with handling cron expressions as an schedule i…

2018-12-29 Thread GitBox
stale[bot] commented on issue #2747: AIRFLOW-1772: Fix bug with handling cron expressions as an schedule i… URL: https://github.com/apache/incubator-airflow/pull/2747#issuecomment-450503385 This issue has been automatically marked as stale because it has not had recent activity. It will

[jira] [Updated] (AIRFLOW-3594) Unify different License Header

2018-12-29 Thread Felix Uellendall (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Uellendall updated AIRFLOW-3594: -- Summary: Unify different License Header (was: Update License Headers in Python

[jira] [Created] (AIRFLOW-3595) Add tests for HiveToSambaOperator

2018-12-29 Thread Felix Uellendall (JIRA)
Felix Uellendall created AIRFLOW-3595: - Summary: Add tests for HiveToSambaOperator Key: AIRFLOW-3595 URL: https://issues.apache.org/jira/browse/AIRFLOW-3595 Project: Apache Airflow Issue

[jira] [Resolved] (AIRFLOW-3327) BiqQuery job checking doesn't include location, which api requires outside US/EU

2018-12-29 Thread Kaxil Naik (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik resolved AIRFLOW-3327. - Resolution: Fixed Fix Version/s: 2.0.0 > BiqQuery job checking doesn't include

[GitHub] feluelle opened a new pull request #4399: [AIRFLOW-3594] Unify different License Header

2018-12-29 Thread GitBox
feluelle opened a new pull request #4399: [AIRFLOW-3594] Unify different License Header URL: https://github.com/apache/incubator-airflow/pull/4399 Make sure you have checked _all_ steps below. ### Jira - [x] My PR addresses the following [Airflow

[jira] [Commented] (AIRFLOW-3595) Add tests for HiveToSambaOperator

2018-12-29 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16730694#comment-16730694 ] ASF GitHub Bot commented on AIRFLOW-3595: - feluelle commented on pull request #4400:

[GitHub] codecov-io edited a comment on issue #4400: [AIRFLOW-3595] Add tests for Hive2SambaOperator

2018-12-29 Thread GitBox
codecov-io edited a comment on issue #4400: [AIRFLOW-3595] Add tests for Hive2SambaOperator URL: https://github.com/apache/incubator-airflow/pull/4400#issuecomment-450495465 # [Codecov](https://codecov.io/gh/apache/incubator-airflow/pull/4400?src=pr=h1) Report > Merging

[GitHub] codecov-io commented on issue #4400: [AIRFLOW-3595] Add tests for Hive2SambaOperator

2018-12-29 Thread GitBox
codecov-io commented on issue #4400: [AIRFLOW-3595] Add tests for Hive2SambaOperator URL: https://github.com/apache/incubator-airflow/pull/4400#issuecomment-450495465 # [Codecov](https://codecov.io/gh/apache/incubator-airflow/pull/4400?src=pr=h1) Report > Merging

[jira] [Created] (AIRFLOW-3596) Clean up undefined template variables

2018-12-29 Thread Josh Carp (JIRA)
Josh Carp created AIRFLOW-3596: -- Summary: Clean up undefined template variables Key: AIRFLOW-3596 URL: https://issues.apache.org/jira/browse/AIRFLOW-3596 Project: Apache Airflow Issue Type:

[jira] [Commented] (AIRFLOW-496) HiveServer2Hook invokes incorrect Auth mechanism when user not specified

2018-12-29 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16730891#comment-16730891 ] jack commented on AIRFLOW-496: -- The problem is not in Impala it's in Airflow.  Airflow uses Impala as a

[GitHub] jgao54 commented on issue #4389: [AIRFLOW-3583] Fix AirflowException import

2018-12-29 Thread GitBox
jgao54 commented on issue #4389: [AIRFLOW-3583] Fix AirflowException import URL: https://github.com/apache/incubator-airflow/pull/4389#issuecomment-450528332 @chinhngt actually you are right, was able to reproduce. I'd expect airflow init module to be imported but turns out for logging

[jira] [Updated] (AIRFLOW-3327) BiqQuery job checking doesn't include location, which api requires outside US/EU

2018-12-29 Thread Kaxil Naik (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik updated AIRFLOW-3327: Fix Version/s: (was: 2.0.0) > BiqQuery job checking doesn't include location, which api

[GitHub] dimberman commented on issue #3770: [AIRFLOW-3281] Fix Kubernetes operator with git-sync

2018-12-29 Thread GitBox
dimberman commented on issue #3770: [AIRFLOW-3281] Fix Kubernetes operator with git-sync URL: https://github.com/apache/incubator-airflow/pull/3770#issuecomment-450533177 @odracci yeah that LGTM then. @Fokko good to go!

[jira] [Assigned] (AIRFLOW-2790) snakebite syntax error: baseTime = min(time * (1L << retries), cap);

2018-12-29 Thread Yohei Onishi (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yohei Onishi reassigned AIRFLOW-2790: - Assignee: Yohei Onishi > snakebite syntax error: baseTime = min(time * (1L <<

[jira] [Commented] (AIRFLOW-3571) GoogleCloudStorageToBigQueryOperator succeeds to uploading CSV file from GCS to BiqQuery but a task is failed

2018-12-29 Thread Yohei Onishi (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16730906#comment-16730906 ] Yohei Onishi commented on AIRFLOW-3571: --- OK will do > GoogleCloudStorageToBigQueryOperator

[jira] [Commented] (AIRFLOW-3316) GCS to BQ operator leaves schema_fields operator unset when autodetect=True

2018-12-29 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16730901#comment-16730901 ] jack commented on AIRFLOW-3316: --- I'm unable to reproduce this issue. first, {color:#24292e}schema_fields

[GitHub] kaxil closed pull request #4364: [AIRFLOW-3550] Standardize GKE hook.

2018-12-29 Thread GitBox
kaxil closed pull request #4364: [AIRFLOW-3550] Standardize GKE hook. URL: https://github.com/apache/incubator-airflow/pull/4364 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of provenance: As this is a

[jira] [Resolved] (AIRFLOW-3568) S3ToGoogleCloudStorageOperator failed after succeeding in copying files from s3

2018-12-29 Thread Kaxil Naik (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik resolved AIRFLOW-3568. - Resolution: Fixed Fix Version/s: 1.10.2

[jira] [Commented] (AIRFLOW-2939) `set` fails in case of `exisiting_files is None` and in case of `json.dumps`

2018-12-29 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16730853#comment-16730853 ] ASF GitHub Bot commented on AIRFLOW-2939: - kaxil commented on pull request #4371:

[jira] [Updated] (AIRFLOW-3371) BigQueryHook's Ability to Create View

2018-12-29 Thread Kaxil Naik (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik updated AIRFLOW-3371: Fix Version/s: (was: 2.0.0) 1.10.2 > BigQueryHook's Ability to Create

[jira] [Updated] (AIRFLOW-3355) Fix BigQueryCursor.execute to work with Python3

2018-12-29 Thread Kaxil Naik (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik updated AIRFLOW-3355: Fix Version/s: (was: 2.0.0) 1.10.2 > Fix BigQueryCursor.execute to work

[jira] [Updated] (AIRFLOW-3332) Add BigQuery Streaming insert_all to BigQueryHook

2018-12-29 Thread Kaxil Naik (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik updated AIRFLOW-3332: Fix Version/s: (was: 2.0.0) 1.10.2 > Add BigQuery Streaming insert_all to

[jira] [Resolved] (AIRFLOW-2863) GKEClusterHook catches wrong exception

2018-12-29 Thread Kaxil Naik (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik resolved AIRFLOW-2863. - Resolution: Fixed Fix Version/s: 1.10.2 > GKEClusterHook catches wrong exception >

[jira] [Commented] (AIRFLOW-3550) GKEClusterHook doesn't use gcp_conn_id

2018-12-29 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16730856#comment-16730856 ] ASF GitHub Bot commented on AIRFLOW-3550: - kaxil commented on pull request #4364:

[jira] [Updated] (AIRFLOW-2917) Set AIRFLOW__CORE__SQL_ALCHEMY_CONN only when needed for k8s executor

2018-12-29 Thread Kaxil Naik (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik updated AIRFLOW-2917: Fix Version/s: (was: 2.0.0) 1.10.2 > Set AIRFLOW__CORE__SQL_ALCHEMY_CONN

[jira] [Reopened] (AIRFLOW-2997) Support for clustered tables in Bigquery hooks/operators

2018-12-29 Thread Kaxil Naik (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik reopened AIRFLOW-2997: - > Support for clustered tables in Bigquery hooks/operators >

[jira] [Updated] (AIRFLOW-2640) Add Cassandra table sensor

2018-12-29 Thread Kaxil Naik (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik updated AIRFLOW-2640: Fix Version/s: (was: 2.0.0) 1.10.2 > Add Cassandra table sensor >

[jira] [Updated] (AIRFLOW-2916) Add argument `verify` for AwsHook() and S3 related sensors/operators

2018-12-29 Thread Kaxil Naik (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik updated AIRFLOW-2916: Fix Version/s: (was: 2.0.0) 1.10.2 > Add argument `verify` for AwsHook()

[jira] [Updated] (AIRFLOW-2889) Fix typos detected by github.com/client9/misspell

2018-12-29 Thread Kaxil Naik (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik updated AIRFLOW-2889: Fix Version/s: (was: 2.0.0) 1.10.2 > Fix typos detected by

[jira] [Updated] (AIRFLOW-491) Add cache parameter in BigQuery query method

2018-12-29 Thread Kaxil Naik (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik updated AIRFLOW-491: --- Fix Version/s: (was: 2.0.0) 1.10.2 > Add cache parameter in BigQuery query

[jira] [Updated] (AIRFLOW-2758) Add a sensor for MongoDB

2018-12-29 Thread Kaxil Naik (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik updated AIRFLOW-2758: Fix Version/s: (was: 2.0.0) 1.10.2 > Add a sensor for MongoDB >

[jira] [Updated] (AIRFLOW-2755) k8s workers think DAGs are always in `/tmp/dags`

2018-12-29 Thread Kaxil Naik (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik updated AIRFLOW-2755: Fix Version/s: (was: 2.0.0) 1.10.2 > k8s workers think DAGs are always in

[jira] [Updated] (AIRFLOW-2655) Default Kubernetes worker configurations are inconsistent

2018-12-29 Thread Kaxil Naik (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik updated AIRFLOW-2655: Fix Version/s: (was: 2.0.0) 1.10.2 > Default Kubernetes worker

[jira] [Updated] (AIRFLOW-3402) Set default kubernetes affinity and toleration settings in airflow.cfg

2018-12-29 Thread Kaxil Naik (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik updated AIRFLOW-3402: Fix Version/s: 1.10.2 > Set default kubernetes affinity and toleration settings in airflow.cfg >

[GitHub] stale[bot] closed pull request #4127: Bug Fix: Secrets object and key separated by ":"

2018-12-29 Thread GitBox
stale[bot] closed pull request #4127: Bug Fix: Secrets object and key separated by ":" URL: https://github.com/apache/incubator-airflow/pull/4127 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of provenance:

[jira] [Resolved] (AIRFLOW-2939) `set` fails in case of `exisiting_files is None` and in case of `json.dumps`

2018-12-29 Thread Kaxil Naik (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik resolved AIRFLOW-2939. - Resolution: Fixed Fix Version/s: 1.10.2 Resolved by

[jira] [Updated] (AIRFLOW-2887) Add to BigQueryBaseCursor methods for creating insert dataset

2018-12-29 Thread Kaxil Naik (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik updated AIRFLOW-2887: Fix Version/s: (was: 2.0.0) 1.10.2 > Add to BigQueryBaseCursor methods

[GitHub] kaxil closed pull request #4371: [AIRFLOW-2939][AIRFLOW-3568] fix TypeError on GoogleCloudStorageToS3Operator / S3ToGoogleCloudStorageOperator

2018-12-29 Thread GitBox
kaxil closed pull request #4371: [AIRFLOW-2939][AIRFLOW-3568] fix TypeError on GoogleCloudStorageToS3Operator / S3ToGoogleCloudStorageOperator URL: https://github.com/apache/incubator-airflow/pull/4371 This is a PR merged from a forked repository. As GitHub hides the original diff on