[jira] [Work started] (AIRFLOW-5158) Google Sheets hook
[ https://issues.apache.org/jira/browse/AIRFLOW-5158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on AIRFLOW-5158 started by Omar Al-Jadda. -- > Google Sheets hook > -- > > Key: AIRFLOW-5158 > URL: https://issues.apache.org/jira/browse/AIRFLOW-5158 > Project: Apache Airflow > Issue Type: New Feature > Components: hooks >Affects Versions: 1.10.4 >Reporter: Omar Al-Jadda >Assignee: Omar Al-Jadda >Priority: Major > Fix For: 1.10.5 > > > Need a hook that can both read and write from a google sheet. > Planning to implement the Reading & Writing Cell Values of the API: > [https://developers.google.com/sheets/api/guides/values] > In particular get / update / append both single range and batch -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Commented] (AIRFLOW-4732) Add hook to interact with Google Drive (GoogleDriveHook)
[ https://issues.apache.org/jira/browse/AIRFLOW-4732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16906797#comment-16906797 ] Omar Al-Jadda commented on AIRFLOW-4732: I'm implementing AIRFLOW-5158 to interact specifically with the Google sheets API, please comment there if you have any requests, questions etc. > Add hook to interact with Google Drive (GoogleDriveHook) > > > Key: AIRFLOW-4732 > URL: https://issues.apache.org/jira/browse/AIRFLOW-4732 > Project: Apache Airflow > Issue Type: Wish > Components: gcp, hooks >Affects Versions: 1.10.3 >Reporter: jack >Priority: Major > > Having a hook for Google Drive will make it easier to Airflow users to > upload/delete/change files in Drive. > > Example for use case and code sample: > [https://pacuna.io/data-engineering/etl/2018/07/01/etl-sheets-postgres.html] -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Updated] (AIRFLOW-5158) Google Sheets hook
[ https://issues.apache.org/jira/browse/AIRFLOW-5158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Omar Al-Jadda updated AIRFLOW-5158: --- Summary: Google Sheets hook (was: Google Sheet hook) > Google Sheets hook > -- > > Key: AIRFLOW-5158 > URL: https://issues.apache.org/jira/browse/AIRFLOW-5158 > Project: Apache Airflow > Issue Type: New Feature > Components: hooks >Affects Versions: 1.10.4 >Reporter: Omar Al-Jadda >Assignee: Omar Al-Jadda >Priority: Major > Fix For: 1.10.5 > > > Need a hook that can both read and write from a google sheet. > Planning to implement the Reading & Writing Cell Values of the API: > [https://developers.google.com/sheets/api/guides/values] > In particular get / update / append both single range and batch -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Assigned] (AIRFLOW-5158) Google Sheet hook
[ https://issues.apache.org/jira/browse/AIRFLOW-5158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Omar Al-Jadda reassigned AIRFLOW-5158: -- Assignee: Omar Al-Jadda Fix Version/s: 1.10.5 Description: Need a hook that can both read and write from a google sheet. Planning to implement the Reading & Writing Cell Values of the API: [https://developers.google.com/sheets/api/guides/values] In particular get / update / append both single range and batch was:Need a hook that can both read and write from a google sheet Component/s: (was: operators) hooks > Google Sheet hook > - > > Key: AIRFLOW-5158 > URL: https://issues.apache.org/jira/browse/AIRFLOW-5158 > Project: Apache Airflow > Issue Type: New Feature > Components: hooks >Affects Versions: 1.10.4 >Reporter: Omar Al-Jadda >Assignee: Omar Al-Jadda >Priority: Major > Fix For: 1.10.5 > > > Need a hook that can both read and write from a google sheet. > Planning to implement the Reading & Writing Cell Values of the API: > [https://developers.google.com/sheets/api/guides/values] > In particular get / update / append both single range and batch -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Comment Edited] (AIRFLOW-5158) Google Sheet hook
[ https://issues.apache.org/jira/browse/AIRFLOW-5158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16904666#comment-16904666 ] Omar Al-Jadda edited comment on AIRFLOW-5158 at 8/11/19 2:20 PM: - correct, I've updated. I'm planning to code this and submit the PR. If anyone has made any progress on this or has any comments/suggestions please share! was (Author: hagope): correct, I've updated. I'm planning to code this, if anyone and submit the PR. If anyone has made any progress on this or has any comments/suggestions please share! > Google Sheet hook > - > > Key: AIRFLOW-5158 > URL: https://issues.apache.org/jira/browse/AIRFLOW-5158 > Project: Apache Airflow > Issue Type: New Feature > Components: operators >Affects Versions: 1.10.4 >Reporter: Omar Al-Jadda >Priority: Major > > Need a hook that can both read and write from a google sheet -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Commented] (AIRFLOW-5158) Google Sheet hook
[ https://issues.apache.org/jira/browse/AIRFLOW-5158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16904666#comment-16904666 ] Omar Al-Jadda commented on AIRFLOW-5158: correct, I've updated. I'm planning to code this, if anyone and submit the PR. If anyone has made any progress on this or has any comments/suggestions please share! > Google Sheet hook > - > > Key: AIRFLOW-5158 > URL: https://issues.apache.org/jira/browse/AIRFLOW-5158 > Project: Apache Airflow > Issue Type: New Feature > Components: operators >Affects Versions: 1.10.4 >Reporter: Omar Al-Jadda >Priority: Major > > Need a hook that can both read and write from a google sheet -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Updated] (AIRFLOW-5158) Google Sheet hook
[ https://issues.apache.org/jira/browse/AIRFLOW-5158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Omar Al-Jadda updated AIRFLOW-5158: --- Description: Need a hook that can both read and write from a google sheet (was: Need an operator that can both read and write from a google sheet) > Google Sheet hook > - > > Key: AIRFLOW-5158 > URL: https://issues.apache.org/jira/browse/AIRFLOW-5158 > Project: Apache Airflow > Issue Type: New Feature > Components: operators >Affects Versions: 1.10.4 >Reporter: Omar Al-Jadda >Priority: Major > > Need a hook that can both read and write from a google sheet -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Updated] (AIRFLOW-5158) Google Sheet hook
[ https://issues.apache.org/jira/browse/AIRFLOW-5158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Omar Al-Jadda updated AIRFLOW-5158: --- Summary: Google Sheet hook (was: Google Sheet Operator) > Google Sheet hook > - > > Key: AIRFLOW-5158 > URL: https://issues.apache.org/jira/browse/AIRFLOW-5158 > Project: Apache Airflow > Issue Type: New Feature > Components: operators >Affects Versions: 1.10.4 >Reporter: Omar Al-Jadda >Priority: Major > > Need an operator that can both read and write from a google sheet -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Created] (AIRFLOW-5158) Google Sheet Operator
Omar Al-Jadda created AIRFLOW-5158: -- Summary: Google Sheet Operator Key: AIRFLOW-5158 URL: https://issues.apache.org/jira/browse/AIRFLOW-5158 Project: Apache Airflow Issue Type: New Feature Components: operators Affects Versions: 1.10.4 Reporter: Omar Al-Jadda Need an operator that can both read and write from a google sheet -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Created] (AIRFLOW-5157) S3ToRedshiftTransfer hard codes aws credentials gets logged
Omar Al-Jadda created AIRFLOW-5157: -- Summary: S3ToRedshiftTransfer hard codes aws credentials gets logged Key: AIRFLOW-5157 URL: https://issues.apache.org/jira/browse/AIRFLOW-5157 Project: Apache Airflow Issue Type: Bug Components: hooks, operators Affects Versions: 1.10.4 Reporter: Omar Al-Jadda should not include with credentials in the copy command as the aws credentials get logged, [https://github.com/apache/airflow/blob/master/airflow/operators/s3_to_redshift_operator.py#L102-L103] -- This message was sent by Atlassian JIRA (v7.6.14#76016)