[jira] [Work started] (AIRFLOW-5158) Google Sheets hook

2019-08-16 Thread Omar Al-Jadda (JIRA)


 [ 
https://issues.apache.org/jira/browse/AIRFLOW-5158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Work on AIRFLOW-5158 started by Omar Al-Jadda.
--
> Google Sheets hook
> --
>
> Key: AIRFLOW-5158
> URL: https://issues.apache.org/jira/browse/AIRFLOW-5158
> Project: Apache Airflow
>  Issue Type: New Feature
>  Components: hooks
>Affects Versions: 1.10.4
>Reporter: Omar Al-Jadda
>Assignee: Omar Al-Jadda
>Priority: Major
> Fix For: 1.10.5
>
>
> Need a hook that can both read and write from a google sheet.
> Planning to implement the  Reading & Writing Cell Values of the API:
> [https://developers.google.com/sheets/api/guides/values]
> In particular get / update / append both single range and batch



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)


[jira] [Commented] (AIRFLOW-4732) Add hook to interact with Google Drive (GoogleDriveHook)

2019-08-13 Thread Omar Al-Jadda (JIRA)


[ 
https://issues.apache.org/jira/browse/AIRFLOW-4732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16906797#comment-16906797
 ] 

Omar Al-Jadda commented on AIRFLOW-4732:


I'm implementing  AIRFLOW-5158 to interact specifically with the Google sheets 
API, please comment there if you have any requests, questions etc.

> Add hook to interact with Google Drive (GoogleDriveHook)
> 
>
> Key: AIRFLOW-4732
> URL: https://issues.apache.org/jira/browse/AIRFLOW-4732
> Project: Apache Airflow
>  Issue Type: Wish
>  Components: gcp, hooks
>Affects Versions: 1.10.3
>Reporter: jack
>Priority: Major
>
> Having a hook for Google Drive will make it easier to Airflow users to 
> upload/delete/change files in Drive.
>  
> Example for use case and code sample:
> [https://pacuna.io/data-engineering/etl/2018/07/01/etl-sheets-postgres.html]



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)


[jira] [Updated] (AIRFLOW-5158) Google Sheets hook

2019-08-13 Thread Omar Al-Jadda (JIRA)


 [ 
https://issues.apache.org/jira/browse/AIRFLOW-5158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Omar Al-Jadda updated AIRFLOW-5158:
---
Summary: Google Sheets hook  (was: Google Sheet hook)

> Google Sheets hook
> --
>
> Key: AIRFLOW-5158
> URL: https://issues.apache.org/jira/browse/AIRFLOW-5158
> Project: Apache Airflow
>  Issue Type: New Feature
>  Components: hooks
>Affects Versions: 1.10.4
>Reporter: Omar Al-Jadda
>Assignee: Omar Al-Jadda
>Priority: Major
> Fix For: 1.10.5
>
>
> Need a hook that can both read and write from a google sheet.
> Planning to implement the  Reading & Writing Cell Values of the API:
> [https://developers.google.com/sheets/api/guides/values]
> In particular get / update / append both single range and batch



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)


[jira] [Assigned] (AIRFLOW-5158) Google Sheet hook

2019-08-13 Thread Omar Al-Jadda (JIRA)


 [ 
https://issues.apache.org/jira/browse/AIRFLOW-5158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Omar Al-Jadda reassigned AIRFLOW-5158:
--

 Assignee: Omar Al-Jadda
Fix Version/s: 1.10.5
  Description: 
Need a hook that can both read and write from a google sheet.

Planning to implement the  Reading & Writing Cell Values of the API:

[https://developers.google.com/sheets/api/guides/values]

In particular get / update / append both single range and batch

  was:Need a hook that can both read and write from a google sheet

  Component/s: (was: operators)
   hooks

> Google Sheet hook
> -
>
> Key: AIRFLOW-5158
> URL: https://issues.apache.org/jira/browse/AIRFLOW-5158
> Project: Apache Airflow
>  Issue Type: New Feature
>  Components: hooks
>Affects Versions: 1.10.4
>Reporter: Omar Al-Jadda
>Assignee: Omar Al-Jadda
>Priority: Major
> Fix For: 1.10.5
>
>
> Need a hook that can both read and write from a google sheet.
> Planning to implement the  Reading & Writing Cell Values of the API:
> [https://developers.google.com/sheets/api/guides/values]
> In particular get / update / append both single range and batch



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)


[jira] [Comment Edited] (AIRFLOW-5158) Google Sheet hook

2019-08-11 Thread Omar Al-Jadda (JIRA)


[ 
https://issues.apache.org/jira/browse/AIRFLOW-5158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16904666#comment-16904666
 ] 

Omar Al-Jadda edited comment on AIRFLOW-5158 at 8/11/19 2:20 PM:
-

correct, I've updated. I'm planning to code this and submit the PR. If anyone 
has made any progress on this or has any comments/suggestions please share!


was (Author: hagope):
correct, I've updated. I'm planning to code this, if anyone and submit the PR. 
If anyone has made any progress on this or has any comments/suggestions please 
share!

> Google Sheet hook
> -
>
> Key: AIRFLOW-5158
> URL: https://issues.apache.org/jira/browse/AIRFLOW-5158
> Project: Apache Airflow
>  Issue Type: New Feature
>  Components: operators
>Affects Versions: 1.10.4
>Reporter: Omar Al-Jadda
>Priority: Major
>
> Need a hook that can both read and write from a google sheet



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)


[jira] [Commented] (AIRFLOW-5158) Google Sheet hook

2019-08-11 Thread Omar Al-Jadda (JIRA)


[ 
https://issues.apache.org/jira/browse/AIRFLOW-5158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16904666#comment-16904666
 ] 

Omar Al-Jadda commented on AIRFLOW-5158:


correct, I've updated. I'm planning to code this, if anyone and submit the PR. 
If anyone has made any progress on this or has any comments/suggestions please 
share!

> Google Sheet hook
> -
>
> Key: AIRFLOW-5158
> URL: https://issues.apache.org/jira/browse/AIRFLOW-5158
> Project: Apache Airflow
>  Issue Type: New Feature
>  Components: operators
>Affects Versions: 1.10.4
>Reporter: Omar Al-Jadda
>Priority: Major
>
> Need a hook that can both read and write from a google sheet



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)


[jira] [Updated] (AIRFLOW-5158) Google Sheet hook

2019-08-11 Thread Omar Al-Jadda (JIRA)


 [ 
https://issues.apache.org/jira/browse/AIRFLOW-5158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Omar Al-Jadda updated AIRFLOW-5158:
---
Description: Need a hook that can both read and write from a google sheet  
(was: Need an operator that can both read and write from a google sheet)

> Google Sheet hook
> -
>
> Key: AIRFLOW-5158
> URL: https://issues.apache.org/jira/browse/AIRFLOW-5158
> Project: Apache Airflow
>  Issue Type: New Feature
>  Components: operators
>Affects Versions: 1.10.4
>Reporter: Omar Al-Jadda
>Priority: Major
>
> Need a hook that can both read and write from a google sheet



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)


[jira] [Updated] (AIRFLOW-5158) Google Sheet hook

2019-08-11 Thread Omar Al-Jadda (JIRA)


 [ 
https://issues.apache.org/jira/browse/AIRFLOW-5158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Omar Al-Jadda updated AIRFLOW-5158:
---
Summary: Google Sheet hook  (was: Google Sheet Operator)

> Google Sheet hook
> -
>
> Key: AIRFLOW-5158
> URL: https://issues.apache.org/jira/browse/AIRFLOW-5158
> Project: Apache Airflow
>  Issue Type: New Feature
>  Components: operators
>Affects Versions: 1.10.4
>Reporter: Omar Al-Jadda
>Priority: Major
>
> Need an operator that can both read and write from a google sheet



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)


[jira] [Created] (AIRFLOW-5158) Google Sheet Operator

2019-08-09 Thread Omar Al-Jadda (JIRA)
Omar Al-Jadda created AIRFLOW-5158:
--

 Summary: Google Sheet Operator
 Key: AIRFLOW-5158
 URL: https://issues.apache.org/jira/browse/AIRFLOW-5158
 Project: Apache Airflow
  Issue Type: New Feature
  Components: operators
Affects Versions: 1.10.4
Reporter: Omar Al-Jadda


Need an operator that can both read and write from a google sheet



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)


[jira] [Created] (AIRFLOW-5157) S3ToRedshiftTransfer hard codes aws credentials gets logged

2019-08-09 Thread Omar Al-Jadda (JIRA)
Omar Al-Jadda created AIRFLOW-5157:
--

 Summary: S3ToRedshiftTransfer hard codes aws credentials gets 
logged
 Key: AIRFLOW-5157
 URL: https://issues.apache.org/jira/browse/AIRFLOW-5157
 Project: Apache Airflow
  Issue Type: Bug
  Components: hooks, operators
Affects Versions: 1.10.4
Reporter: Omar Al-Jadda


should not include with credentials in the copy command as the aws credentials 
get logged, 
[https://github.com/apache/airflow/blob/master/airflow/operators/s3_to_redshift_operator.py#L102-L103]

 



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)