[jira] [Created] (AIRFLOW-2452) Document field_dict for HiveCliHook.load_file must be OrderedDict

Kengo Seki created AIRFLOW-2452: --- Summary: Document field_dict for HiveCliHook.load_file must be OrderedDict Key: AIRFLOW-2452 URL: https://issues.apache.org/jira/browse/AIRFLOW-2452 Project: Apache Air

[jira] [Created] (AIRFLOW-2451) GoogleCloudStorageToGoogleCloudStorageOperator adds an extra "/" character when used with wildcard

Berislav Lopac created AIRFLOW-2451: --- Summary: GoogleCloudStorageToGoogleCloudStorageOperator adds an extra "/" character when used with wildcard Key: AIRFLOW-2451 URL: https://issues.apache.org/jira/browse/AIRF

[jira] [Commented] (AIRFLOW-2442) Airflow run command leaves database connections open

[ https://issues.apache.org/jira/browse/AIRFLOW-2442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16471237#comment-16471237 ] ASF subversion and git services commented on AIRFLOW-2442: -- Com

incubator-airflow git commit: [AIRFLOW-2442][AIRFLOW-2] Airflow run command leaves database connections open

Repository: incubator-airflow Updated Branches: refs/heads/master 961aa0581 -> 250faad0f [AIRFLOW-2442][AIRFLOW-2] Airflow run command leaves database connections open Closes #3336 from afernandez/afernandez_db Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo Commit: ht

[jira] [Commented] (AIRFLOW-2376) backports.configparser.NoSectionError: No section: u'hive'

[ https://issues.apache.org/jira/browse/AIRFLOW-2376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16471197#comment-16471197 ] Tao Feng commented on AIRFLOW-2376: --- I reproduce it by running airflow backfill exampl

[jira] [Commented] (AIRFLOW-2376) backports.configparser.NoSectionError: No section: u'hive'

[ https://issues.apache.org/jira/browse/AIRFLOW-2376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16471190#comment-16471190 ] Siddharth Anand commented on AIRFLOW-2376: -- Can you provide all steps to reprod

[jira] [Commented] (AIRFLOW-2016) Add support for Dataproc Workflow Templates

[ https://issues.apache.org/jira/browse/AIRFLOW-2016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16471151#comment-16471151 ] ASF subversion and git services commented on AIRFLOW-2016: -- Com

incubator-airflow git commit: [AIRFLOW-2016] assign template_fields for Dataproc Workflow Template sub-classes, not base class

Repository: incubator-airflow Updated Branches: refs/heads/v1-10-test e6484c34a -> 50153f378 [AIRFLOW-2016] assign template_fields for Dataproc Workflow Template sub-classes, not base class Closes #3346 from mchalek/mchalek-fix-inline- workflow-template-operator (cherry picked from commit 961

[jira] [Commented] (AIRFLOW-2016) Add support for Dataproc Workflow Templates

[ https://issues.apache.org/jira/browse/AIRFLOW-2016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16471149#comment-16471149 ] ASF subversion and git services commented on AIRFLOW-2016: -- Com

incubator-airflow git commit: [AIRFLOW-2016] assign template_fields for Dataproc Workflow Template sub-classes, not base class

Repository: incubator-airflow Updated Branches: refs/heads/master 7ca45b252 -> 961aa0581 [AIRFLOW-2016] assign template_fields for Dataproc Workflow Template sub-classes, not base class Closes #3346 from mchalek/mchalek-fix-inline- workflow-template-operator Project: http://git-wip-us.apache

[jira] [Created] (AIRFLOW-2450) Upgrade supported k8s versions in Airflow

Daniel Imberman created AIRFLOW-2450: Summary: Upgrade supported k8s versions in Airflow Key: AIRFLOW-2450 URL: https://issues.apache.org/jira/browse/AIRFLOW-2450 Project: Apache Airflow

incubator-airflow git commit: add BelugaDB to Airflow users

Repository: incubator-airflow Updated Branches: refs/heads/master 686e805e6 -> 7ca45b252 add BelugaDB to Airflow users Closes #3339 from lucianoviola/add-belugadb-to- company-list Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo Commit: http://git-wip-us.apache.org/repo

[jira] [Commented] (AIRFLOW-2446) Add S3ToRedshiftTransfer to the "Integration" doc

[ https://issues.apache.org/jira/browse/AIRFLOW-2446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16470875#comment-16470875 ] ASF subversion and git services commented on AIRFLOW-2446: -- Com

[jira] [Resolved] (AIRFLOW-2446) Add S3ToRedshiftTransfer to the "Integration" doc

[ https://issues.apache.org/jira/browse/AIRFLOW-2446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong resolved AIRFLOW-2446. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request #3340 [

[jira] [Commented] (AIRFLOW-2446) Add S3ToRedshiftTransfer to the "Integration" doc

[ https://issues.apache.org/jira/browse/AIRFLOW-2446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16470874#comment-16470874 ] ASF subversion and git services commented on AIRFLOW-2446: -- Com

incubator-airflow git commit: [AIRFLOW-2446] Add S3ToRedshiftTransfer into the "Integration" doc

Repository: incubator-airflow Updated Branches: refs/heads/v1-10-test 8e731ffec -> e6484c34a [AIRFLOW-2446] Add S3ToRedshiftTransfer into the "Integration" doc This PR adds an undocumented AWS-related operator into the "Integration" section and fixes some obsolete description. Closes #3340 fr

[jira] [Commented] (AIRFLOW-2446) Add S3ToRedshiftTransfer to the "Integration" doc

[ https://issues.apache.org/jira/browse/AIRFLOW-2446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16470872#comment-16470872 ] ASF subversion and git services commented on AIRFLOW-2446: -- Com

incubator-airflow git commit: [AIRFLOW-2446] Add S3ToRedshiftTransfer into the "Integration" doc

Repository: incubator-airflow Updated Branches: refs/heads/master 0ae21cf6e -> 686e805e6 [AIRFLOW-2446] Add S3ToRedshiftTransfer into the "Integration" doc This PR adds an undocumented AWS-related operator into the "Integration" section and fixes some obsolete description. Closes #3340 from s

[jira] [Commented] (AIRFLOW-2446) Add S3ToRedshiftTransfer to the "Integration" doc

[ https://issues.apache.org/jira/browse/AIRFLOW-2446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16470873#comment-16470873 ] ASF subversion and git services commented on AIRFLOW-2446: -- Com

[jira] [Commented] (AIRFLOW-2449) Fix operators.py to run all test cases

[ https://issues.apache.org/jira/browse/AIRFLOW-2449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16470823#comment-16470823 ] ASF subversion and git services commented on AIRFLOW-2449: -- Com

[jira] [Resolved] (AIRFLOW-2449) Fix operators.py to run all test cases

[ https://issues.apache.org/jira/browse/AIRFLOW-2449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong resolved AIRFLOW-2449. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request #3344 [

[jira] [Commented] (AIRFLOW-2449) Fix operators.py to run all test cases

[ https://issues.apache.org/jira/browse/AIRFLOW-2449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16470824#comment-16470824 ] ASF subversion and git services commented on AIRFLOW-2449: -- Com

incubator-airflow git commit: [AIRFLOW-2449] Fix operators.py to run all test cases

Repository: incubator-airflow Updated Branches: refs/heads/master 5de22d7fa -> 0ae21cf6e [AIRFLOW-2449] Fix operators.py to run all test cases MySqlTest and PostgresTest in tests/operators/operators.py have some unexecuted tests due to wrong naming convention. This PR fixes it. Closes #3344 f

[jira] [Resolved] (AIRFLOW-2424) Add dagrun status endpoint and increased k8s test coverage

[ https://issues.apache.org/jira/browse/AIRFLOW-2424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong resolved AIRFLOW-2424. --- Resolution: Fixed Fix Version/s: 2.0.0 1.10.0 Issue resolv

[jira] [Commented] (AIRFLOW-2424) Add dagrun status endpoint and increased k8s test coverage

[ https://issues.apache.org/jira/browse/AIRFLOW-2424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16470798#comment-16470798 ] ASF subversion and git services commented on AIRFLOW-2424: -- Com

[jira] [Commented] (AIRFLOW-2424) Add dagrun status endpoint and increased k8s test coverage

[ https://issues.apache.org/jira/browse/AIRFLOW-2424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16470801#comment-16470801 ] ASF subversion and git services commented on AIRFLOW-2424: -- Com

[jira] [Commented] (AIRFLOW-2424) Add dagrun status endpoint and increased k8s test coverage

[ https://issues.apache.org/jira/browse/AIRFLOW-2424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16470805#comment-16470805 ] ASF subversion and git services commented on AIRFLOW-2424: -- Com

[jira] [Commented] (AIRFLOW-2424) Add dagrun status endpoint and increased k8s test coverage

[ https://issues.apache.org/jira/browse/AIRFLOW-2424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16470806#comment-16470806 ] ASF subversion and git services commented on AIRFLOW-2424: -- Com

[jira] [Commented] (AIRFLOW-2424) Add dagrun status endpoint and increased k8s test coverage

[ https://issues.apache.org/jira/browse/AIRFLOW-2424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16470802#comment-16470802 ] ASF subversion and git services commented on AIRFLOW-2424: -- Com

[jira] [Commented] (AIRFLOW-2424) Add dagrun status endpoint and increased k8s test coverage

[ https://issues.apache.org/jira/browse/AIRFLOW-2424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16470803#comment-16470803 ] ASF subversion and git services commented on AIRFLOW-2424: -- Com

[jira] [Commented] (AIRFLOW-2424) Add dagrun status endpoint and increased k8s test coverage

[ https://issues.apache.org/jira/browse/AIRFLOW-2424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16470800#comment-16470800 ] ASF subversion and git services commented on AIRFLOW-2424: -- Com

[jira] [Commented] (AIRFLOW-2424) Add dagrun status endpoint and increased k8s test coverage

[ https://issues.apache.org/jira/browse/AIRFLOW-2424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16470799#comment-16470799 ] ASF subversion and git services commented on AIRFLOW-2424: -- Com

incubator-airflow git commit: [AIRFLOW-2424] Add dagrun status endpoint and increased k8s test coverage

Repository: incubator-airflow Updated Branches: refs/heads/v1-10-test 1e6c0e96b -> 8e731ffec [AIRFLOW-2424] Add dagrun status endpoint and increased k8s test coverage [AIRFLOW-2424] Add dagrun status endpoint and increase k8s test coverage [AIRFLOW-2424] Added minikube fixes by @kimoonkim [A

incubator-airflow git commit: [AIRFLOW-2424] Add dagrun status endpoint and increased k8s test coverage

Repository: incubator-airflow Updated Branches: refs/heads/master 74027c9a6 -> 5de22d7fa [AIRFLOW-2424] Add dagrun status endpoint and increased k8s test coverage [AIRFLOW-2424] Add dagrun status endpoint and increase k8s test coverage [AIRFLOW-2424] Added minikube fixes by @kimoonkim [AIRFL

[jira] [Commented] (AIRFLOW-2016) Add support for Dataproc Workflow Templates

[ https://issues.apache.org/jira/browse/AIRFLOW-2016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16470779#comment-16470779 ] Dan Sedov commented on AIRFLOW-2016: [~mchalek] - I think you're right and I misunde

[jira] [Commented] (AIRFLOW-2016) Add support for Dataproc Workflow Templates

[ https://issues.apache.org/jira/browse/AIRFLOW-2016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16470746#comment-16470746 ] Kevin McHale commented on AIRFLOW-2016: --- hi [~DanSedov] I recently tried using the

[jira] [Commented] (AIRFLOW-2341) Trigger timing should follow cron style when we use cron style schedule_interval

[ https://issues.apache.org/jira/browse/AIRFLOW-2341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16470712#comment-16470712 ] Yu Ishikawa commented on AIRFLOW-2341: -- [~criccomini] What do you think of it? > T

[jira] [Created] (AIRFLOW-2449) Fix operators.py to run all test cases

Kengo Seki created AIRFLOW-2449: --- Summary: Fix operators.py to run all test cases Key: AIRFLOW-2449 URL: https://issues.apache.org/jira/browse/AIRFLOW-2449 Project: Apache Airflow Issue Type: B

[jira] [Created] (AIRFLOW-2448) Enhance HiveCliHook.load_df to work with datetime

Kengo Seki created AIRFLOW-2448: --- Summary: Enhance HiveCliHook.load_df to work with datetime Key: AIRFLOW-2448 URL: https://issues.apache.org/jira/browse/AIRFLOW-2448 Project: Apache Airflow Is

[jira] [Commented] (AIRFLOW-2441) Fix bugs in HiveCliHook.load_df

[ https://issues.apache.org/jira/browse/AIRFLOW-2441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16470074#comment-16470074 ] ASF subversion and git services commented on AIRFLOW-2441: -- Com

[jira] [Commented] (AIRFLOW-2441) Fix bugs in HiveCliHook.load_df

[ https://issues.apache.org/jira/browse/AIRFLOW-2441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16470075#comment-16470075 ] ASF subversion and git services commented on AIRFLOW-2441: -- Com

[jira] [Resolved] (AIRFLOW-2441) Fix bugs in HiveCliHook.load_df

[ https://issues.apache.org/jira/browse/AIRFLOW-2441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bolke de Bruin resolved AIRFLOW-2441. - Resolution: Fixed Fix Version/s: 1.10.0 Issue resolved by pull request #3334 [htt

incubator-airflow git commit: [AIRFLOW-2441] Fix bugs in HiveCliHook.load_df

Repository: incubator-airflow Updated Branches: refs/heads/master f7c33afea -> 74027c9a6 [AIRFLOW-2441] Fix bugs in HiveCliHook.load_df This PR fixes HiveCliHook.load_df to: 1. encode delimiter with the specified encoding before passing it to pandas.DataFrame.to_csv so as not to fail 2

[jira] [Commented] (AIRFLOW-2358) make kubernetes examples installed optionally

[ https://issues.apache.org/jira/browse/AIRFLOW-2358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16470071#comment-16470071 ] ASF subversion and git services commented on AIRFLOW-2358: -- Com

[jira] [Resolved] (AIRFLOW-2358) make kubernetes examples installed optionally

[ https://issues.apache.org/jira/browse/AIRFLOW-2358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bolke de Bruin resolved AIRFLOW-2358. - Resolution: Fixed Fix Version/s: 1.10.0 Issue resolved by pull request #3315 [htt

[jira] [Commented] (AIRFLOW-2358) make kubernetes examples installed optionally

[ https://issues.apache.org/jira/browse/AIRFLOW-2358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16470070#comment-16470070 ] ASF subversion and git services commented on AIRFLOW-2358: -- Com

incubator-airflow git commit: [AIRFLOW-2358][AIRFLOW-201804] Make the Kubernetes example optional

Repository: incubator-airflow Updated Branches: refs/heads/master 8ed30b1f0 -> f7c33afea [AIRFLOW-2358][AIRFLOW-201804] Make the Kubernetes example optional If you havent installed Kubernetes the initdb operation will fail Closes #3315 from Fokko/AIRFLOW-2358 Project: http://git-wip-us.apac

[jira] [Resolved] (AIRFLOW-2436) Remove cli_logger in initdb

[ https://issues.apache.org/jira/browse/AIRFLOW-2436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bolke de Bruin resolved AIRFLOW-2436. - Resolution: Fixed Fix Version/s: 1.10.0 Issue resolved by pull request #3330 [htt

[jira] [Commented] (AIRFLOW-2436) Remove cli_logger in initdb

[ https://issues.apache.org/jira/browse/AIRFLOW-2436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16470052#comment-16470052 ] ASF subversion and git services commented on AIRFLOW-2436: -- Com

incubator-airflow git commit: [AIRFLOW-2436] Remove cli_logger in initdb

Repository: incubator-airflow Updated Branches: refs/heads/master f6e9f1bed -> 8ed30b1f0 [AIRFLOW-2436] Remove cli_logger in initdb Closes #3330 from jinhyukchang/master Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo Commit: http://git-wip-us.apache.org/repos/asf/incu

[jira] [Resolved] (AIRFLOW-2444) Remove unused option(include_adhoc) in cli backfill command

[ https://issues.apache.org/jira/browse/AIRFLOW-2444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bolke de Bruin resolved AIRFLOW-2444. - Resolution: Fixed Fix Version/s: 1.10.0 Issue resolved by pull request #3337 [htt

[jira] [Commented] (AIRFLOW-2444) Remove unused option(include_adhoc) in cli backfill command

[ https://issues.apache.org/jira/browse/AIRFLOW-2444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16470048#comment-16470048 ] ASF subversion and git services commented on AIRFLOW-2444: -- Com

incubator-airflow git commit: [AIRFLOW-2444] Remove unused option(include_adhoc) in cli backfill command

Repository: incubator-airflow Updated Branches: refs/heads/master ae51daf89 -> f6e9f1bed [AIRFLOW-2444] Remove unused option(include_adhoc) in cli backfill command Closes #3337 from feng-tao/remove-unused-flag Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo Commit: htt

[jira] [Commented] (AIRFLOW-2447) Fix TestHiveMetastoreHook to run all cases

[ https://issues.apache.org/jira/browse/AIRFLOW-2447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16470046#comment-16470046 ] ASF subversion and git services commented on AIRFLOW-2447: -- Com

[jira] [Resolved] (AIRFLOW-2447) Fix TestHiveMetastoreHook to run all cases

[ https://issues.apache.org/jira/browse/AIRFLOW-2447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bolke de Bruin resolved AIRFLOW-2447. - Resolution: Fixed Fix Version/s: 1.10.0 Issue resolved by pull request #3341 [htt

[jira] [Commented] (AIRFLOW-2447) Fix TestHiveMetastoreHook to run all cases

[ https://issues.apache.org/jira/browse/AIRFLOW-2447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16470045#comment-16470045 ] ASF subversion and git services commented on AIRFLOW-2447: -- Com

incubator-airflow git commit: [AIRFLOW-2447] Fix TestHiveMetastoreHook to run all cases

Repository: incubator-airflow Updated Branches: refs/heads/master e813c606f -> ae51daf89 [AIRFLOW-2447] Fix TestHiveMetastoreHook to run all cases TestHiveMetastoreHook has a method which name doesn't start with test_. This PR renames it to be executed. Closes #3341 from sekikn/AIRFLOW-2447

[jira] [Commented] (AIRFLOW-2445) Allow templating for kubernetes operator

[ https://issues.apache.org/jira/browse/AIRFLOW-2445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16470043#comment-16470043 ] ASF subversion and git services commented on AIRFLOW-2445: -- Com

[jira] [Resolved] (AIRFLOW-2445) Allow templating for kubernetes operator

[ https://issues.apache.org/jira/browse/AIRFLOW-2445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bolke de Bruin resolved AIRFLOW-2445. - Resolution: Fixed Fix Version/s: 1.10.0 Issue resolved by pull request #3338 [htt

incubator-airflow git commit: [AIRFLOW-2445] Allow templating in kubernetes operator

Repository: incubator-airflow Updated Branches: refs/heads/master 06017f66e -> e813c606f [AIRFLOW-2445] Allow templating in kubernetes operator Closes #3338 from ese/k8s-templating Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo Commit: http://git-wip-us.apache.org/rep