[
https://issues.apache.org/jira/browse/BEAM-9898?focusedWorklogId=478370&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-478370
]
ASF GitHub Bot logged work on BEAM-9898:
----------------------------------------
Author: ASF GitHub Bot
Created on: 03/Sep/20 08:36
Start Date: 03/Sep/20 08:36
Worklog Time Spent: 10m
Work Description: piotr-szuberski commented on a change in pull request
#12758:
URL: https://github.com/apache/beam/pull/12758#discussion_r482784051
##########
File path: CHANGES.md
##########
@@ -100,6 +100,8 @@
* Support for X source added (Java/Python)
([BEAM-X](https://issues.apache.org/jira/browse/BEAM-X)).
* Add streaming support to SnowflakeIO in Java SDK
([BEAM-9896](https://issues.apache.org/jira/browse/BEAM-9896 ))
* Support reading and writing to Google Healthcare DICOM APIs in Python SDK
([BEAM-10601](https://issues.apache.org/jira/browse/BEAM-10601))
+* Add dispositions for SnowflakeIO.write
([BEAM-10343](https://issues.apache.org/jira/browse/BEAM-10343))
Review comment:
@youngoli Could I also ask you to change these lines (103, 104, 140, 141
as well? I've noticed that snowflake dispositions and cross-language read was
added in 2.24, not 2.23 (it was pushed at 2.23 but was merged after the 2.23
release)
It would also be great to move snowflake.py from apache_beam.io.external to
apache_beam.io to avoid backward compatibility issues, but I don't know how
much changes would you like to do. It's just moving this file, there are no
other files that depend on it (integration tests and cross-language write will
be added in 2.25.0).
On the other hand we could add apache_beam/io/snowflake.py and
apache_beam/io/external/xlang_snowflakeio_it_test.py from the current master to
the 2.24.0 RC and remove apache_beam/io/external/snowflake.py - it would be no
more work, these tests don't run on jenkins, so they won't break anything. We
would have snowflake read and write for python at once without much work.
But I probably am asking for too much at once - I don't know how much are
you willing to do so I understand if you decide to stop at 1) - but 2) would be
of similiar complexity. 3) would require to take changes from current master
but is also easy.
TL;DR - choose one of them:
1. just remove lines 140-141 and add 103-104
2. do 1) and move apache_beam/io/external/snowflake.py to
apache_beam/io/snowflake.py - then in CHANGES.md:104 should be
`apache_beam.io.snowflake` instead of `apache_beam.io.external.snowflake`
3. Take following from current master `apache_beam/io/snowflake.py` and
`apache_beam/io/external/xlang_snowflakeio_it_test.py`, remove
`apache_beam/io/external/snowflake.py` and do 1), but in CHANGES.md:104 paste
```* Add cross-language support to SnowflakeIO now available in the Python
module `apache_beam.io.snowflake`
([BEAM-9897](https://issues.apache.org/jira/browse/BEAM-9897),
[BEAM-9898](https://issues.apache.org/jira/browse/BEAM-9898)).```
Thanks in advance! Whatever you choose it will save users some confusion!
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 478370)
Time Spent: 6h (was: 5h 50m)
> Add cross-language support to SnowflakeIO.Write
> -----------------------------------------------
>
> Key: BEAM-9898
> URL: https://issues.apache.org/jira/browse/BEAM-9898
> Project: Beam
> Issue Type: New Feature
> Components: cross-language, io-ideas
> Affects Versions: 2.25.0
> Reporter: Dariusz Aniszewski
> Assignee: Piotr Szuberski
> Priority: P3
> Fix For: 2.25.0
>
> Time Spent: 6h
> Remaining Estimate: 0h
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
