[
https://issues.apache.org/jira/browse/BEAM-9898?focusedWorklogId=478382&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-478382
]
ASF GitHub Bot logged work on BEAM-9898:
----------------------------------------
Author: ASF GitHub Bot
Created on: 03/Sep/20 08:47
Start Date: 03/Sep/20 08:47
Worklog Time Spent: 10m
Work Description: piotr-szuberski commented on a change in pull request
#12758:
URL: https://github.com/apache/beam/pull/12758#discussion_r482784051
##########
File path: CHANGES.md
##########
@@ -100,6 +100,8 @@
* Support for X source added (Java/Python)
([BEAM-X](https://issues.apache.org/jira/browse/BEAM-X)).
* Add streaming support to SnowflakeIO in Java SDK
([BEAM-9896](https://issues.apache.org/jira/browse/BEAM-9896 ))
* Support reading and writing to Google Healthcare DICOM APIs in Python SDK
([BEAM-10601](https://issues.apache.org/jira/browse/BEAM-10601))
+* Add dispositions for SnowflakeIO.write
([BEAM-10343](https://issues.apache.org/jira/browse/BEAM-10343))
Review comment:
@youngoli Could I also ask you to change these lines in CHANGES.md (103,
104, 140, 141)? I've noticed that snowflake dispositions and cross-language
read was added in 2.24, not 2.23 (it was pushed at 2.23 but was merged after
the 2.23 release) and it's a bit mess.
It would also be great to move snowflake.py from apache_beam.io.external to
apache_beam.io to avoid backward compatibility issues, it's just moving this
file, there are no other files that depend on it (integration tests and
cross-language write are in 2.25.0).
On the other hand we could add apache_beam/io/snowflake.py and
apache_beam/io/external/xlang_snowflakeio_it_test.py from the current master to
the 2.24.0 RC and remove apache_beam/io/external/snowflake.py - it would be not
a lot more work, these tests don't run on jenkins, so they won't break
anything. We would have snowflake read and write for python at once in 2.24
without much work.
But I probably am asking for too much at once - I don't know how much are
you willing to do so I understand if you decide to stop at 1). 2) would be of
similiar complexity and will avoid backwards compatibility issues. 3) would
require to take files from the current master but is also easy.
TL;DR - choose one of them:
1. just remove lines 140-141 and add 103-104
2. do 1) and move apache_beam/io/external/snowflake.py to
apache_beam/io/snowflake.py - then in CHANGES.md:104 should be
`apache_beam.io.snowflake` instead of `apache_beam.io.external.snowflake`
3. Take following from current master `apache_beam/io/snowflake.py` and
`apache_beam/io/external/xlang_snowflakeio_it_test.py`, remove
`apache_beam/io/external/snowflake.py` and do 1), but in CHANGES.md:104 paste
```* Add cross-language support to SnowflakeIO now available in the Python
module `apache_beam.io.snowflake`
([BEAM-9897](https://issues.apache.org/jira/browse/BEAM-9897),
[BEAM-9898](https://issues.apache.org/jira/browse/BEAM-9898)).```
Sorry for the troubles and thanks in advance! Whatever option you choose it
will save users some confusion!
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 478382)
Time Spent: 6h 40m (was: 6.5h)
> Add cross-language support to SnowflakeIO.Write
> -----------------------------------------------
>
> Key: BEAM-9898
> URL: https://issues.apache.org/jira/browse/BEAM-9898
> Project: Beam
> Issue Type: New Feature
> Components: cross-language, io-ideas
> Affects Versions: 2.25.0
> Reporter: Dariusz Aniszewski
> Assignee: Piotr Szuberski
> Priority: P3
> Fix For: 2.25.0
>
> Time Spent: 6h 40m
> Remaining Estimate: 0h
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
