[jira] [Created] (AIRFLOW-6565) BigQuery - replace deprecated parameters with correct ones
Tobiasz Kedzierski created AIRFLOW-6565: --- Summary: BigQuery - replace deprecated parameters with correct ones Key: AIRFLOW-6565 URL: https://issues.apache.org/jira/browse/AIRFLOW-6565 Project: Apache Airflow Issue Type: Improvement Components: gcp, operators Affects Versions: 1.10.7 Reporter: Tobiasz Kedzierski Assignee: Tobiasz Kedzierski -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (AIRFLOW-6565) BigQuery - replace deprecated connection parameters
[ https://issues.apache.org/jira/browse/AIRFLOW-6565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tobiasz Kedzierski updated AIRFLOW-6565: Summary: BigQuery - replace deprecated connection parameters (was: BigQuery - replace deprecated parameters with correct ones) > BigQuery - replace deprecated connection parameters > --- > > Key: AIRFLOW-6565 > URL: https://issues.apache.org/jira/browse/AIRFLOW-6565 > Project: Apache Airflow > Issue Type: Improvement > Components: gcp, operators >Affects Versions: 1.10.7 >Reporter: Tobiasz Kedzierski >Assignee: Tobiasz Kedzierski >Priority: Minor > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (AIRFLOW-6534) BigQuery - move methods from BigQueryBaseCursor to BigQueryHook
Tobiasz Kedzierski created AIRFLOW-6534: --- Summary: BigQuery - move methods from BigQueryBaseCursor to BigQueryHook Key: AIRFLOW-6534 URL: https://issues.apache.org/jira/browse/AIRFLOW-6534 Project: Apache Airflow Issue Type: Improvement Components: gcp, hooks, operators Affects Versions: 1.10.7 Reporter: Tobiasz Kedzierski Assignee: Tobiasz Kedzierski -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (AIRFLOW-6498) BigQuery operator tests - add deprecation tests
Tobiasz Kedzierski created AIRFLOW-6498: --- Summary: BigQuery operator tests - add deprecation tests Key: AIRFLOW-6498 URL: https://issues.apache.org/jira/browse/AIRFLOW-6498 Project: Apache Airflow Issue Type: Improvement Components: gcp, operators, tests Affects Versions: 1.10.7 Reporter: Tobiasz Kedzierski Assignee: Tobiasz Kedzierski -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (AIRFLOW-6485) BigQuery hook - add missing tests
[ https://issues.apache.org/jira/browse/AIRFLOW-6485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tobiasz Kedzierski updated AIRFLOW-6485: Summary: BigQuery hook - add missing tests (was: BigQuery hook - add missing test for BIgQueryBaseCursor methods) > BigQuery hook - add missing tests > -- > > Key: AIRFLOW-6485 > URL: https://issues.apache.org/jira/browse/AIRFLOW-6485 > Project: Apache Airflow > Issue Type: Improvement > Components: gcp, hooks, tests >Affects Versions: 1.10.7 >Reporter: Tobiasz Kedzierski >Assignee: Tobiasz Kedzierski >Priority: Minor > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (AIRFLOW-6485) BigQuery hook - add missing test for BIgQueryBaseCursor methods
Tobiasz Kedzierski created AIRFLOW-6485: --- Summary: BigQuery hook - add missing test for BIgQueryBaseCursor methods Key: AIRFLOW-6485 URL: https://issues.apache.org/jira/browse/AIRFLOW-6485 Project: Apache Airflow Issue Type: Improvement Components: gcp, hooks, tests Affects Versions: 1.10.7 Reporter: Tobiasz Kedzierski Assignee: Tobiasz Kedzierski -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (AIRFLOW-6484) BigQuery hook - standardize handling http exceptions (missing)
Tobiasz Kedzierski created AIRFLOW-6484: --- Summary: BigQuery hook - standardize handling http exceptions (missing) Key: AIRFLOW-6484 URL: https://issues.apache.org/jira/browse/AIRFLOW-6484 Project: Apache Airflow Issue Type: Improvement Components: gcp, hooks Affects Versions: 1.10.7 Reporter: Tobiasz Kedzierski Assignee: Tobiasz Kedzierski -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (AIRFLOW-6442) BigQuery hook - standardize handling http exceptions
Tobiasz Kedzierski created AIRFLOW-6442: --- Summary: BigQuery hook - standardize handling http exceptions Key: AIRFLOW-6442 URL: https://issues.apache.org/jira/browse/AIRFLOW-6442 Project: Apache Airflow Issue Type: Improvement Components: gcp, hooks Affects Versions: 1.10.7 Reporter: Tobiasz Kedzierski Assignee: Tobiasz Kedzierski -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (AIRFLOW-6430) BigQuery hook - add tests for BigQueryBaseCursor
[ https://issues.apache.org/jira/browse/AIRFLOW-6430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tobiasz Kedzierski updated AIRFLOW-6430: Summary: BigQuery hook - add tests for BigQueryBaseCursor (was: BigQuery hook - add tests) > BigQuery hook - add tests for BigQueryBaseCursor > > > Key: AIRFLOW-6430 > URL: https://issues.apache.org/jira/browse/AIRFLOW-6430 > Project: Apache Airflow > Issue Type: Improvement > Components: gcp, hooks, tests >Affects Versions: 1.10.7 >Reporter: Tobiasz Kedzierski >Assignee: Tobiasz Kedzierski >Priority: Minor > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (AIRFLOW-6430) BigQuery hook - add tests
Tobiasz Kedzierski created AIRFLOW-6430: --- Summary: BigQuery hook - add tests Key: AIRFLOW-6430 URL: https://issues.apache.org/jira/browse/AIRFLOW-6430 Project: Apache Airflow Issue Type: Improvement Components: gcp, hooks, tests Affects Versions: 1.10.7 Reporter: Tobiasz Kedzierski Assignee: Tobiasz Kedzierski -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (AIRFLOW-6408) BigQuery hook - add tests for patch_table method
Tobiasz Kedzierski created AIRFLOW-6408: --- Summary: BigQuery hook - add tests for patch_table method Key: AIRFLOW-6408 URL: https://issues.apache.org/jira/browse/AIRFLOW-6408 Project: Apache Airflow Issue Type: Improvement Components: gcp, hooks, tests Affects Versions: 1.10.7 Reporter: Tobiasz Kedzierski Assignee: Tobiasz Kedzierski -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (AIRFLOW-6409) BigQuery hook - add tests for run_query method
Tobiasz Kedzierski created AIRFLOW-6409: --- Summary: BigQuery hook - add tests for run_query method Key: AIRFLOW-6409 URL: https://issues.apache.org/jira/browse/AIRFLOW-6409 Project: Apache Airflow Issue Type: Improvement Components: gcp, hooks, tests Affects Versions: 1.10.7 Reporter: Tobiasz Kedzierski Assignee: Tobiasz Kedzierski -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (AIRFLOW-6407) BigQuery hook - add tests for create_external_table method
Tobiasz Kedzierski created AIRFLOW-6407: --- Summary: BigQuery hook - add tests for create_external_table method Key: AIRFLOW-6407 URL: https://issues.apache.org/jira/browse/AIRFLOW-6407 Project: Apache Airflow Issue Type: Improvement Components: gcp, hooks, tests Affects Versions: 1.10.7 Reporter: Tobiasz Kedzierski Assignee: Tobiasz Kedzierski -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (AIRFLOW-6403) BigQuery - add tests for BigQueryCursor
Tobiasz Kedzierski created AIRFLOW-6403: --- Summary: BigQuery - add tests for BigQueryCursor Key: AIRFLOW-6403 URL: https://issues.apache.org/jira/browse/AIRFLOW-6403 Project: Apache Airflow Issue Type: Improvement Components: gcp, hooks, tests Affects Versions: 1.10.7 Reporter: Tobiasz Kedzierski Assignee: Tobiasz Kedzierski -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (AIRFLOW-6317) BigQuery - move repeated variables to constants in hook tests
Tobiasz Kedzierski created AIRFLOW-6317: --- Summary: BigQuery - move repeated variables to constants in hook tests Key: AIRFLOW-6317 URL: https://issues.apache.org/jira/browse/AIRFLOW-6317 Project: Apache Airflow Issue Type: Improvement Components: gcp, hooks, tests Affects Versions: 1.10.6 Reporter: Tobiasz Kedzierski Assignee: Tobiasz Kedzierski -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (AIRFLOW-6314) BigQuery - improve BigQueryHook test
Tobiasz Kedzierski created AIRFLOW-6314: --- Summary: BigQuery - improve BigQueryHook test Key: AIRFLOW-6314 URL: https://issues.apache.org/jira/browse/AIRFLOW-6314 Project: Apache Airflow Issue Type: Improvement Components: gcp, hooks, tests Affects Versions: 1.10.6 Reporter: Tobiasz Kedzierski Assignee: Tobiasz Kedzierski -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (AIRFLOW-6240) BigQuery - remove unnecessary mocks in hook system tests
[ https://issues.apache.org/jira/browse/AIRFLOW-6240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tobiasz Kedzierski updated AIRFLOW-6240: Summary: BigQuery - remove unnecessary mocks in hook system tests (was: BigQuery - remove unnecessary mocks in hook system tests [depends on [AIRFLOW-6220]]) > BigQuery - remove unnecessary mocks in hook system tests > > > Key: AIRFLOW-6240 > URL: https://issues.apache.org/jira/browse/AIRFLOW-6240 > Project: Apache Airflow > Issue Type: Improvement > Components: gcp, hooks, tests >Affects Versions: 1.10.6 >Reporter: Tobiasz Kedzierski >Assignee: Tobiasz Kedzierski >Priority: Minor > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (AIRFLOW-6240) BigQuery - remove unnecessary mocks in hook system tests [depends on [AIRFLOW-6220]]
Tobiasz Kedzierski created AIRFLOW-6240: --- Summary: BigQuery - remove unnecessary mocks in hook system tests [depends on [AIRFLOW-6220]] Key: AIRFLOW-6240 URL: https://issues.apache.org/jira/browse/AIRFLOW-6240 Project: Apache Airflow Issue Type: Improvement Components: gcp, hooks, tests Affects Versions: 1.10.6 Reporter: Tobiasz Kedzierski Assignee: Tobiasz Kedzierski -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (AIRFLOW-6223) BigQuery - improve hook tests [depends on AIRFLOW-6220]
[ https://issues.apache.org/jira/browse/AIRFLOW-6223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tobiasz Kedzierski updated AIRFLOW-6223: Summary: BigQuery - improve hook tests [depends on AIRFLOW-6220] (was: BigQeury - improve hook tests [depends on AIRFLOW-6220]) > BigQuery - improve hook tests [depends on AIRFLOW-6220] > --- > > Key: AIRFLOW-6223 > URL: https://issues.apache.org/jira/browse/AIRFLOW-6223 > Project: Apache Airflow > Issue Type: Improvement > Components: gcp, hooks, tests >Affects Versions: 1.10.6 >Reporter: Tobiasz Kedzierski >Assignee: Tobiasz Kedzierski >Priority: Minor > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (AIRFLOW-6223) BigQeury - improve hook tests [depends on AIRFLOW-6220]
[ https://issues.apache.org/jira/browse/AIRFLOW-6223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tobiasz Kedzierski updated AIRFLOW-6223: Summary: BigQeury - improve hook tests [depends on AIRFLOW-6220] (was: BigQeury - improve hook test [depends on AIRFLOW-6220]) > BigQeury - improve hook tests [depends on AIRFLOW-6220] > --- > > Key: AIRFLOW-6223 > URL: https://issues.apache.org/jira/browse/AIRFLOW-6223 > Project: Apache Airflow > Issue Type: Improvement > Components: gcp, hooks, tests >Affects Versions: 1.10.6 >Reporter: Tobiasz Kedzierski >Assignee: Tobiasz Kedzierski >Priority: Minor > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (AIRFLOW-6223) BigQeury - improve hook test [depends on AIRFLOW-6220]
[ https://issues.apache.org/jira/browse/AIRFLOW-6223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tobiasz Kedzierski updated AIRFLOW-6223: Summary: BigQeury - improve hook test [depends on AIRFLOW-6220] (was: BigQeury - improve hook test) > BigQeury - improve hook test [depends on AIRFLOW-6220] > -- > > Key: AIRFLOW-6223 > URL: https://issues.apache.org/jira/browse/AIRFLOW-6223 > Project: Apache Airflow > Issue Type: Improvement > Components: gcp, hooks, tests >Affects Versions: 1.10.6 >Reporter: Tobiasz Kedzierski >Assignee: Tobiasz Kedzierski >Priority: Minor > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (AIRFLOW-6220) BigQuery - remove redundant hook tests after renaming
[ https://issues.apache.org/jira/browse/AIRFLOW-6220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tobiasz Kedzierski updated AIRFLOW-6220: Summary: BigQuery - remove redundant hook tests after renaming (was: BigQuery - remove reduntant hook tests after renaming) > BigQuery - remove redundant hook tests after renaming > - > > Key: AIRFLOW-6220 > URL: https://issues.apache.org/jira/browse/AIRFLOW-6220 > Project: Apache Airflow > Issue Type: Bug > Components: gcp, hooks, tests >Affects Versions: 1.10.6 >Reporter: Tobiasz Kedzierski >Assignee: Tobiasz Kedzierski >Priority: Minor > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (AIRFLOW-6223) BigQeury - improve hook test
Tobiasz Kedzierski created AIRFLOW-6223: --- Summary: BigQeury - improve hook test Key: AIRFLOW-6223 URL: https://issues.apache.org/jira/browse/AIRFLOW-6223 Project: Apache Airflow Issue Type: Improvement Components: gcp, hooks, tests Affects Versions: 1.10.6 Reporter: Tobiasz Kedzierski Assignee: Tobiasz Kedzierski -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (AIRFLOW-6220) BigQuery - remove reduntant hook tests after renaming
Tobiasz Kedzierski created AIRFLOW-6220: --- Summary: BigQuery - remove reduntant hook tests after renaming Key: AIRFLOW-6220 URL: https://issues.apache.org/jira/browse/AIRFLOW-6220 Project: Apache Airflow Issue Type: Bug Components: gcp, hooks, tests Affects Versions: 1.10.6 Reporter: Tobiasz Kedzierski Assignee: Tobiasz Kedzierski -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Closed] (AIRFLOW-6215) BigQuery - use unittest assertions in hooks tests
[ https://issues.apache.org/jira/browse/AIRFLOW-6215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tobiasz Kedzierski closed AIRFLOW-6215. --- Resolution: Invalid Due to introduced recently `pytest` the assertions are welcome in the tests. > BigQuery - use unittest assertions in hooks tests > - > > Key: AIRFLOW-6215 > URL: https://issues.apache.org/jira/browse/AIRFLOW-6215 > Project: Apache Airflow > Issue Type: Improvement > Components: gcp, hooks, tests >Affects Versions: 1.10.6 >Reporter: Tobiasz Kedzierski >Assignee: Tobiasz Kedzierski >Priority: Minor > > Make assertions consistent across the test file. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (AIRFLOW-6215) BigQuery - use unittest assertions in hooks tests
Tobiasz Kedzierski created AIRFLOW-6215: --- Summary: BigQuery - use unittest assertions in hooks tests Key: AIRFLOW-6215 URL: https://issues.apache.org/jira/browse/AIRFLOW-6215 Project: Apache Airflow Issue Type: Improvement Components: gcp, hooks, tests Affects Versions: 1.10.6 Reporter: Tobiasz Kedzierski Assignee: Tobiasz Kedzierski Make assertions consistent across the test file. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (AIRFLOW-6203) BigQuery - parametrize hook tests
Tobiasz Kedzierski created AIRFLOW-6203: --- Summary: BigQuery - parametrize hook tests Key: AIRFLOW-6203 URL: https://issues.apache.org/jira/browse/AIRFLOW-6203 Project: Apache Airflow Issue Type: Improvement Components: gcp, hooks, tests Affects Versions: 1.10.6 Reporter: Tobiasz Kedzierski Assignee: Tobiasz Kedzierski -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Closed] (AIRFLOW-6059) Fix typo in docs build.sh - path providers instead of provider
[ https://issues.apache.org/jira/browse/AIRFLOW-6059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tobiasz Kedzierski closed AIRFLOW-6059. --- Resolution: Duplicate it was redundant to [https://github.com/apache/airflow/pull/6599] https://issues.apache.org/jira/browse/AIRFLOW-6007 > Fix typo in docs build.sh - path providers instead of provider > -- > > Key: AIRFLOW-6059 > URL: https://issues.apache.org/jira/browse/AIRFLOW-6059 > Project: Apache Airflow > Issue Type: Improvement > Components: documentation >Affects Versions: 1.10.6 >Reporter: Tobiasz Kedzierski >Assignee: Tobiasz Kedzierski >Priority: Minor > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (AIRFLOW-6172) BigQuery - Move BigQuery hook Pandas data frame system tests to separate file
[ https://issues.apache.org/jira/browse/AIRFLOW-6172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tobiasz Kedzierski updated AIRFLOW-6172: Summary: BigQuery - Move BigQuery hook Pandas data frame system tests to separate file (was: BigQuery - Move BigQuery Pandas data frame system tests to separate file) > BigQuery - Move BigQuery hook Pandas data frame system tests to separate file > - > > Key: AIRFLOW-6172 > URL: https://issues.apache.org/jira/browse/AIRFLOW-6172 > Project: Apache Airflow > Issue Type: Improvement > Components: gcp, hooks >Affects Versions: 1.10.6 >Reporter: Tobiasz Kedzierski >Assignee: Tobiasz Kedzierski >Priority: Minor > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (AIRFLOW-6172) BigQuery - Move BigQuery Pandas data frame system tests to separate file
Tobiasz Kedzierski created AIRFLOW-6172: --- Summary: BigQuery - Move BigQuery Pandas data frame system tests to separate file Key: AIRFLOW-6172 URL: https://issues.apache.org/jira/browse/AIRFLOW-6172 Project: Apache Airflow Issue Type: Improvement Components: gcp, hooks Affects Versions: 1.10.6 Reporter: Tobiasz Kedzierski Assignee: Tobiasz Kedzierski -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (AIRFLOW-6059) Fix typo in docs build.sh - path providers instead of provider
[ https://issues.apache.org/jira/browse/AIRFLOW-6059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tobiasz Kedzierski updated AIRFLOW-6059: Summary: Fix typo in docs build.sh - path providers instead of provider (was: Fix typo in docs build.sh) > Fix typo in docs build.sh - path providers instead of provider > -- > > Key: AIRFLOW-6059 > URL: https://issues.apache.org/jira/browse/AIRFLOW-6059 > Project: Apache Airflow > Issue Type: Improvement > Components: documentation >Affects Versions: 1.10.6 >Reporter: Tobiasz Kedzierski >Assignee: Tobiasz Kedzierski >Priority: Minor > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (AIRFLOW-6059) Fix typo in docs build.sh
Tobiasz Kedzierski created AIRFLOW-6059: --- Summary: Fix typo in docs build.sh Key: AIRFLOW-6059 URL: https://issues.apache.org/jira/browse/AIRFLOW-6059 Project: Apache Airflow Issue Type: Improvement Components: documentation Affects Versions: 1.10.6 Reporter: Tobiasz Kedzierski Assignee: Tobiasz Kedzierski -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (AIRFLOW-6042) Fix SFTPToGcsExampleDagsSystemTest
Tobiasz Kedzierski created AIRFLOW-6042: --- Summary: Fix SFTPToGcsExampleDagsSystemTest Key: AIRFLOW-6042 URL: https://issues.apache.org/jira/browse/AIRFLOW-6042 Project: Apache Airflow Issue Type: Improvement Components: gcp, tests Affects Versions: 1.10.6 Reporter: Tobiasz Kedzierski Assignee: Tobiasz Kedzierski -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (AIRFLOW-5853) BigQuery - standardize task_ids in example_dag
Tobiasz Kedzierski created AIRFLOW-5853: --- Summary: BigQuery - standardize task_ids in example_dag Key: AIRFLOW-5853 URL: https://issues.apache.org/jira/browse/AIRFLOW-5853 Project: Apache Airflow Issue Type: Improvement Components: examples, gcp Affects Versions: 1.10.6 Reporter: Tobiasz Kedzierski Assignee: Tobiasz Kedzierski -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (AIRFLOW-5807) Move SFTP from contrib to core
Tobiasz Kedzierski created AIRFLOW-5807: --- Summary: Move SFTP from contrib to core Key: AIRFLOW-5807 URL: https://issues.apache.org/jira/browse/AIRFLOW-5807 Project: Apache Airflow Issue Type: Bug Components: contrib, hooks, operators Affects Versions: 1.10.5 Reporter: Tobiasz Kedzierski Assignee: Tobiasz Kedzierski -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (AIRFLOW-5718) Add SFTPToGoogleCloudStorageOperator
Tobiasz Kedzierski created AIRFLOW-5718: --- Summary: Add SFTPToGoogleCloudStorageOperator Key: AIRFLOW-5718 URL: https://issues.apache.org/jira/browse/AIRFLOW-5718 Project: Apache Airflow Issue Type: Sub-task Components: gcp, operators Affects Versions: 1.10.5 Reporter: Tobiasz Kedzierski Assignee: Tobiasz Kedzierski -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (AIRFLOW-5717) Add get_tree_map method to SFTPHook
Tobiasz Kedzierski created AIRFLOW-5717: --- Summary: Add get_tree_map method to SFTPHook Key: AIRFLOW-5717 URL: https://issues.apache.org/jira/browse/AIRFLOW-5717 Project: Apache Airflow Issue Type: Improvement Components: hooks Affects Versions: 1.10.5 Reporter: Tobiasz Kedzierski Assignee: Tobiasz Kedzierski -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (AIRFLOW-5707) Add type annotations to SFTPHook
Tobiasz Kedzierski created AIRFLOW-5707: --- Summary: Add type annotations to SFTPHook Key: AIRFLOW-5707 URL: https://issues.apache.org/jira/browse/AIRFLOW-5707 Project: Apache Airflow Issue Type: Improvement Components: hooks Affects Versions: 1.10.5 Reporter: Tobiasz Kedzierski Assignee: Tobiasz Kedzierski -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Comment Edited] (AIRFLOW-3333) New features enable transferring of files or data from GCS to a SFTP remote path and SFTP to GCS path.
[ https://issues.apache.org/jira/browse/AIRFLOW-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16954489#comment-16954489 ] Tobiasz Kedzierski edited comment on AIRFLOW- at 10/18/19 7:30 PM: --- Hi [~aaronfowles], [~pulinpathneja], [~kamil.bregula], I was also working on this, I have `GoogleCloudStorageToSFTPOperator` in progress. WDYT about it? -here is link:- [-https://github.com/PolideaInternal/airflow/pull/361/files#diff-741a1ddda812aa42923ba786189f671f-] Edit: I've created subtask and PR for GCS to SFTP Operator: https://issues.apache.org/jira/browse/AIRFLOW-5696 was (Author: tobked): Hi [~aaronfowles], [~pulinpathneja], [~kamil.bregula], I was also working on this, I have `GoogleCloudStorageToSFTPOperator` in progress. WDYT about it? here is link: [https://github.com/PolideaInternal/airflow/pull/361/files#diff-741a1ddda812aa42923ba786189f671f] > New features enable transferring of files or data from GCS to a SFTP remote > path and SFTP to GCS path. > --- > > Key: AIRFLOW- > URL: https://issues.apache.org/jira/browse/AIRFLOW- > Project: Apache Airflow > Issue Type: New Feature > Components: contrib, gcp >Reporter: Pulin Pathneja >Priority: Major > > New features enable transferring of files or data from GCS(Google Cloud > Storage) to a SFTP remote path and SFTP to GCS(Google Cloud Storage) path. > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (AIRFLOW-5696) Add GoogleCloudStorageToSFTPOperator
Tobiasz Kedzierski created AIRFLOW-5696: --- Summary: Add GoogleCloudStorageToSFTPOperator Key: AIRFLOW-5696 URL: https://issues.apache.org/jira/browse/AIRFLOW-5696 Project: Apache Airflow Issue Type: Sub-task Components: gcp, operators Affects Versions: 1.10.5 Reporter: Tobiasz Kedzierski Assignee: Tobiasz Kedzierski -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (AIRFLOW-3333) New features enable transferring of files or data from GCS to a SFTP remote path and SFTP to GCS path.
[ https://issues.apache.org/jira/browse/AIRFLOW-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16954524#comment-16954524 ] Tobiasz Kedzierski commented on AIRFLOW-: - Thanks [~aaronfowles]. Are you on apache-airflow.slack.com ? You can ping me there (my nickname is `_TobKed`_) and we can talk there and learn from each other. > New features enable transferring of files or data from GCS to a SFTP remote > path and SFTP to GCS path. > --- > > Key: AIRFLOW- > URL: https://issues.apache.org/jira/browse/AIRFLOW- > Project: Apache Airflow > Issue Type: New Feature > Components: contrib, gcp >Reporter: Pulin Pathneja >Priority: Major > > New features enable transferring of files or data from GCS(Google Cloud > Storage) to a SFTP remote path and SFTP to GCS(Google Cloud Storage) path. > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (AIRFLOW-3333) New features enable transferring of files or data from GCS to a SFTP remote path and SFTP to GCS path.
[ https://issues.apache.org/jira/browse/AIRFLOW-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16954491#comment-16954491 ] Tobiasz Kedzierski commented on AIRFLOW-: - Maybe I will add units tests to `GoogleCloudStorageToSFTPOperator` (I already have system tests) and create PR and we could work on SFTPtoGoogleCloudStorage` together? > New features enable transferring of files or data from GCS to a SFTP remote > path and SFTP to GCS path. > --- > > Key: AIRFLOW- > URL: https://issues.apache.org/jira/browse/AIRFLOW- > Project: Apache Airflow > Issue Type: New Feature > Components: contrib, gcp >Reporter: Pulin Pathneja >Priority: Major > > New features enable transferring of files or data from GCS(Google Cloud > Storage) to a SFTP remote path and SFTP to GCS(Google Cloud Storage) path. > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (AIRFLOW-3333) New features enable transferring of files or data from GCS to a SFTP remote path and SFTP to GCS path.
[ https://issues.apache.org/jira/browse/AIRFLOW-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16954489#comment-16954489 ] Tobiasz Kedzierski commented on AIRFLOW-: - Hi [~aaronfowles], [~pulinpathneja], [~kamil.bregula], I was also working on this, I have `GoogleCloudStorageToSFTPOperator` in progress. WDYT about it? here is link: [https://github.com/PolideaInternal/airflow/pull/361/files#diff-741a1ddda812aa42923ba786189f671f] > New features enable transferring of files or data from GCS to a SFTP remote > path and SFTP to GCS path. > --- > > Key: AIRFLOW- > URL: https://issues.apache.org/jira/browse/AIRFLOW- > Project: Apache Airflow > Issue Type: New Feature > Components: contrib, gcp >Reporter: Pulin Pathneja >Priority: Major > > New features enable transferring of files or data from GCS(Google Cloud > Storage) to a SFTP remote path and SFTP to GCS(Google Cloud Storage) path. > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (AIRFLOW-5667) Improve type annotations in GCP
Tobiasz Kedzierski created AIRFLOW-5667: --- Summary: Improve type annotations in GCP Key: AIRFLOW-5667 URL: https://issues.apache.org/jira/browse/AIRFLOW-5667 Project: Apache Airflow Issue Type: Improvement Components: gcp Affects Versions: 1.10.5 Reporter: Tobiasz Kedzierski Assignee: Tobiasz Kedzierski -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (AIRFLOW-5665) Add path_exists method to SFTPHook
Tobiasz Kedzierski created AIRFLOW-5665: --- Summary: Add path_exists method to SFTPHook Key: AIRFLOW-5665 URL: https://issues.apache.org/jira/browse/AIRFLOW-5665 Project: Apache Airflow Issue Type: Improvement Components: contrib Affects Versions: 1.10.5 Reporter: Tobiasz Kedzierski Assignee: Tobiasz Kedzierski -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (AIRFLOW-5622) Improve creating directories in SFTPHook
Tobiasz Kedzierski created AIRFLOW-5622: --- Summary: Improve creating directories in SFTPHook Key: AIRFLOW-5622 URL: https://issues.apache.org/jira/browse/AIRFLOW-5622 Project: Apache Airflow Issue Type: Improvement Components: contrib, hooks Affects Versions: 1.10.5 Reporter: Tobiasz Kedzierski Assignee: Tobiasz Kedzierski -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (AIRFLOW-5526) Update docs configuration due to migration of GCP docs
Tobiasz Kedzierski created AIRFLOW-5526: --- Summary: Update docs configuration due to migration of GCP docs Key: AIRFLOW-5526 URL: https://issues.apache.org/jira/browse/AIRFLOW-5526 Project: Apache Airflow Issue Type: Improvement Components: documentation Affects Versions: 1.10.5 Reporter: Tobiasz Kedzierski Assignee: Tobiasz Kedzierski -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (AIRFLOW-5521) Fix link to GCP documentation
Tobiasz Kedzierski created AIRFLOW-5521: --- Summary: Fix link to GCP documentation Key: AIRFLOW-5521 URL: https://issues.apache.org/jira/browse/AIRFLOW-5521 Project: Apache Airflow Issue Type: Bug Components: documentation Affects Versions: 1.10.5 Reporter: Tobiasz Kedzierski Assignee: Tobiasz Kedzierski -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (AIRFLOW-5515) Add stacklevel to GCP deprecation warnings
Tobiasz Kedzierski created AIRFLOW-5515: --- Summary: Add stacklevel to GCP deprecation warnings Key: AIRFLOW-5515 URL: https://issues.apache.org/jira/browse/AIRFLOW-5515 Project: Apache Airflow Issue Type: Improvement Components: gcp Affects Versions: 1.10.5 Reporter: Tobiasz Kedzierski Assignee: Tobiasz Kedzierski -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (AIRFLOW-5514) No implicit optional flag for mypy
Tobiasz Kedzierski created AIRFLOW-5514: --- Summary: No implicit optional flag for mypy Key: AIRFLOW-5514 URL: https://issues.apache.org/jira/browse/AIRFLOW-5514 Project: Apache Airflow Issue Type: Improvement Components: core Affects Versions: 1.10.5 Reporter: Tobiasz Kedzierski Assignee: Tobiasz Kedzierski -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (AIRFLOW-5504) Improve project_id in GCP Kubernetes Hook
Tobiasz Kedzierski created AIRFLOW-5504: --- Summary: Improve project_id in GCP Kubernetes Hook Key: AIRFLOW-5504 URL: https://issues.apache.org/jira/browse/AIRFLOW-5504 Project: Apache Airflow Issue Type: Improvement Components: gcp Affects Versions: 1.10.5 Reporter: Tobiasz Kedzierski Assignee: Tobiasz Kedzierski -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Created] (AIRFLOW-5479) Normalize get_conn method in GCP Kubernetes hook
Tobiasz Kedzierski created AIRFLOW-5479: --- Summary: Normalize get_conn method in GCP Kubernetes hook Key: AIRFLOW-5479 URL: https://issues.apache.org/jira/browse/AIRFLOW-5479 Project: Apache Airflow Issue Type: Improvement Components: gcp Affects Versions: 1.10.5 Reporter: Tobiasz Kedzierski Assignee: Tobiasz Kedzierski -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Created] (AIRFLOW-5477) Rewrite Google PubSub Hook to Google Cloud Python
Tobiasz Kedzierski created AIRFLOW-5477: --- Summary: Rewrite Google PubSub Hook to Google Cloud Python Key: AIRFLOW-5477 URL: https://issues.apache.org/jira/browse/AIRFLOW-5477 Project: Apache Airflow Issue Type: Improvement Components: gcp Affects Versions: 1.10.5 Reporter: Tobiasz Kedzierski Assignee: Tobiasz Kedzierski -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Created] (AIRFLOW-5475) Normalize gcp_conn_id in operators and hooks
Tobiasz Kedzierski created AIRFLOW-5475: --- Summary: Normalize gcp_conn_id in operators and hooks Key: AIRFLOW-5475 URL: https://issues.apache.org/jira/browse/AIRFLOW-5475 Project: Apache Airflow Issue Type: Improvement Components: gcp Affects Versions: 1.10.5 Reporter: Tobiasz Kedzierski -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Created] (AIRFLOW-5471) Fix docstring in GcpTransferServiceOperationsListOperator
Tobiasz Kedzierski created AIRFLOW-5471: --- Summary: Fix docstring in GcpTransferServiceOperationsListOperator Key: AIRFLOW-5471 URL: https://issues.apache.org/jira/browse/AIRFLOW-5471 Project: Apache Airflow Issue Type: Improvement Components: gcp Affects Versions: 1.10.5 Reporter: Tobiasz Kedzierski Assignee: Tobiasz Kedzierski -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Created] (AIRFLOW-5446) Rewrite Google KMS Hook with Google Api Client
Tobiasz Kedzierski created AIRFLOW-5446: --- Summary: Rewrite Google KMS Hook with Google Api Client Key: AIRFLOW-5446 URL: https://issues.apache.org/jira/browse/AIRFLOW-5446 Project: Apache Airflow Issue Type: Improvement Components: gcp Affects Versions: 1.10.5 Reporter: Tobiasz Kedzierski Assignee: Tobiasz Kedzierski Fix For: 1.10.5 -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Created] (AIRFLOW-5424) Type annotations for GCP hooks
Tobiasz Kedzierski created AIRFLOW-5424: --- Summary: Type annotations for GCP hooks Key: AIRFLOW-5424 URL: https://issues.apache.org/jira/browse/AIRFLOW-5424 Project: Apache Airflow Issue Type: Improvement Components: gcp Affects Versions: 1.10.5 Reporter: Tobiasz Kedzierski Assignee: Tobiasz Kedzierski -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Created] (AIRFLOW-5423) Type annotations for GCP sensors
Tobiasz Kedzierski created AIRFLOW-5423: --- Summary: Type annotations for GCP sensors Key: AIRFLOW-5423 URL: https://issues.apache.org/jira/browse/AIRFLOW-5423 Project: Apache Airflow Issue Type: Improvement Components: gcp Affects Versions: 1.10.5 Reporter: Tobiasz Kedzierski Assignee: Tobiasz Kedzierski -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Created] (AIRFLOW-5422) Add type annotations to GCP operators
Tobiasz Kedzierski created AIRFLOW-5422: --- Summary: Add type annotations to GCP operators Key: AIRFLOW-5422 URL: https://issues.apache.org/jira/browse/AIRFLOW-5422 Project: Apache Airflow Issue Type: Improvement Components: gcp Affects Versions: 1.10.5 Reporter: Tobiasz Kedzierski Assignee: Tobiasz Kedzierski -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Updated] (AIRFLOW-5412) Add get_conn/get_client tests to hooks
[ https://issues.apache.org/jira/browse/AIRFLOW-5412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tobiasz Kedzierski updated AIRFLOW-5412: Summary: Add get_conn/get_client tests to hooks (was: Add get_conn/get_client to hooks tests) > Add get_conn/get_client tests to hooks > -- > > Key: AIRFLOW-5412 > URL: https://issues.apache.org/jira/browse/AIRFLOW-5412 > Project: Apache Airflow > Issue Type: Improvement > Components: tests >Affects Versions: 1.10.5 >Reporter: Tobiasz Kedzierski >Assignee: Tobiasz Kedzierski >Priority: Minor > -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Created] (AIRFLOW-5412) Add get_conn/get_client to hooks tests
Tobiasz Kedzierski created AIRFLOW-5412: --- Summary: Add get_conn/get_client to hooks tests Key: AIRFLOW-5412 URL: https://issues.apache.org/jira/browse/AIRFLOW-5412 Project: Apache Airflow Issue Type: Improvement Components: tests Affects Versions: 1.10.5 Reporter: Tobiasz Kedzierski Assignee: Tobiasz Kedzierski -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Created] (AIRFLOW-5403) Fix input check in GKE Operator
Tobiasz Kedzierski created AIRFLOW-5403: --- Summary: Fix input check in GKE Operator Key: AIRFLOW-5403 URL: https://issues.apache.org/jira/browse/AIRFLOW-5403 Project: Apache Airflow Issue Type: Improvement Components: gcp Affects Versions: 1.10.4 Reporter: Tobiasz Kedzierski Assignee: Tobiasz Kedzierski -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Created] (AIRFLOW-5360) Type annotations for BaseSensorOperator
Tobiasz Kedzierski created AIRFLOW-5360: --- Summary: Type annotations for BaseSensorOperator Key: AIRFLOW-5360 URL: https://issues.apache.org/jira/browse/AIRFLOW-5360 Project: Apache Airflow Issue Type: Improvement Components: core Affects Versions: 1.10.4 Reporter: Tobiasz Kedzierski Assignee: Tobiasz Kedzierski -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Created] (AIRFLOW-5359) Update type annotations in BaseOperator
Tobiasz Kedzierski created AIRFLOW-5359: --- Summary: Update type annotations in BaseOperator Key: AIRFLOW-5359 URL: https://issues.apache.org/jira/browse/AIRFLOW-5359 Project: Apache Airflow Issue Type: Improvement Components: core Affects Versions: 1.10.4 Reporter: Tobiasz Kedzierski Assignee: Tobiasz Kedzierski -- This message was sent by Atlassian Jira (v8.3.2#803003)