[
https://issues.apache.org/jira/browse/BEAM-4061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mairbek Khadikov resolved BEAM-4061.
Resolution: Fixed
> Chaining SpannerIO#write() transfo
[
https://issues.apache.org/jira/browse/BEAM-4061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mairbek Khadikov updated BEAM-4061:
---
Fix Version/s: (was: 2.6.0)
2.5.0
> Chaining SpannerIO#wr
[
https://issues.apache.org/jira/browse/BEAM-4061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16540667#comment-16540667
]
Mairbek Khadikov commented on BEAM-4061:
It was fixed with Beam 2.5.0
> Chaining SpannerIO#wr
[
https://issues.apache.org/jira/browse/BEAM-3973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16479727#comment-16479727
]
Mairbek Khadikov commented on BEAM-3973:
Fixed with [https://github.com/apache/beam/pull/4946
[
https://issues.apache.org/jira/browse/BEAM-3973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mairbek Khadikov resolved BEAM-3973.
Resolution: Fixed
> Allow to disable batch API in Spanne
[
https://issues.apache.org/jira/browse/BEAM-4264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mairbek Khadikov resolved BEAM-4264.
Resolution: Fixed
> Java PostCommit Spanner tests are failing due to "Instance n
[
https://issues.apache.org/jira/browse/BEAM-2837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mairbek Khadikov reopened BEAM-2837:
> Writing To Spanner From Google Cloud DataFlow - Fail
[
https://issues.apache.org/jira/browse/BEAM-2837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16441299#comment-16441299
]
Mairbek Khadikov commented on BEAM-2837:
It seems like it is still possible to run into the version
Mairbek Khadikov created BEAM-4061:
--
Summary: Chaining SpannerIO#write() transforms
Key: BEAM-4061
URL: https://issues.apache.org/jira/browse/BEAM-4061
Project: Beam
Issue Type: Bug
[
https://issues.apache.org/jira/browse/BEAM-3973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mairbek Khadikov updated BEAM-3973:
---
Description: In 2.4.0, SpannerIO#read has been migrated to use batch API.
The batch API
Mairbek Khadikov created BEAM-3973:
--
Summary: Allow to disable batch API in SpannerIO
Key: BEAM-3973
URL: https://issues.apache.org/jira/browse/BEAM-3973
Project: Beam
Issue Type: Bug
[
https://issues.apache.org/jira/browse/BEAM-3932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mairbek Khadikov updated BEAM-3932:
---
Description: More details here
https://stackoverflow.com/questions/49484770/dataflow-spanner
Mairbek Khadikov created BEAM-3932:
--
Summary: Spanner MutationSizeEstimator doesn't handle null array
values
Key: BEAM-3932
URL: https://issues.apache.org/jira/browse/BEAM-3932
Project: Beam
GitHub user mairbek opened a pull request:
https://github.com/apache/beam/pull/4139
Update cloud spanner library to 0.29.0
R: @jkff
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/mairbek/beam depsupdate
Alternatively you can
GitHub user mairbek opened a pull request:
https://github.com/apache/beam/pull/4014
[BEAM-1542] SpannerIO: mutation encoding and size estimation improvements
#4013 must be reviewed merged first
You can merge this pull request into a Git repository by running:
$ git pull https
GitHub user mairbek opened a pull request:
https://github.com/apache/beam/pull/4013
[BEAM-1542] A transform for reading the Spanner schema
A part of https://github.com/apache/beam/pull/3729.
Ideally, spanner schema should be an introspection part of the Cloud
Spanner
GitHub user mairbek opened a pull request:
https://github.com/apache/beam/pull/3925
[BEAM-2837] OrderedCode library
provides encoding a sequence of typed entities into a byte array that can
be lexicographically sorted.
R: @chamikaramj
You can merge this pull request
GitHub user mairbek opened a pull request:
https://github.com/apache/beam/pull/3907
[BEAM-2837] Allows to set a Cloud Spanner host.
Allows to set a Cloud Spanner host. https://batch-spanner.googleapis.com/
is set as a default host name.
You can merge this pull request
GitHub user mairbek opened a pull request:
https://github.com/apache/beam/pull/3862
[BEAM-2837] Exclude grpc-google-common-protos:0.1.0 dependency
Exclude grpc-google-common-protos:0.1.0 dependency that comes from
grpc-google-pubsub-v1.
R: @jkff
You can merge
[
https://issues.apache.org/jira/browse/BEAM-2837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16170773#comment-16170773
]
Mairbek Khadikov commented on BEAM-2837:
As a workaround, you could exclude _grpc-google-common
[
https://issues.apache.org/jira/browse/BEAM-2837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16155916#comment-16155916
]
Mairbek Khadikov commented on BEAM-2837:
This is likely grpc-google-common-protos dependency coming
GitHub user mairbek opened a pull request:
https://github.com/apache/beam/pull/3729
[BEAM-1542] Added a preprocessing step to the Cloud Spanner sink.
The general intuition we follow here: if mutations are presorted by the
primary key before batching, it is more likely
GitHub user mairbek opened a pull request:
https://github.com/apache/beam/pull/3696
[BEAM-1542] Make AbstractSpannerFn public
Make AbstractSpannerFn public to support custom user defined functions that
use Cloud Spanner.
R: @jkff
You can merge this pull request
GitHub user mairbek opened a pull request:
https://github.com/apache/beam/pull/3591
[BEAM-1542] Introduced `SpannerIO.readFn`
`SpannerIO.readFn` allows to pipe reading from Cloud Spanner to other
computations. The motivating use case is exporting data from a Spanner
database, when
GitHub user mairbek opened a pull request:
https://github.com/apache/beam/pull/3574
[BEAM-1542] Specifies a User Agent in Spanner Client
R: @jkff
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/mairbek/beam useragent
[
https://issues.apache.org/jira/browse/BEAM-2538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16086459#comment-16086459
]
Mairbek Khadikov commented on BEAM-2538:
Stephen, can we close this?
> Spanner IO ITs fail
GitHub user mairbek opened a pull request:
https://github.com/apache/beam/pull/3472
Get rid of Apache Commons dependency
Be sure to do all of the following to help us incorporate your contribution
quickly and easily:
- [ ] Make sure the PR title is formatted like
[
https://issues.apache.org/jira/browse/BEAM-2538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16067464#comment-16067464
]
Mairbek Khadikov commented on BEAM-2538:
Should be fixed with https://github.com/apache/beam/pull
GitHub user mairbek opened a pull request:
https://github.com/apache/beam/pull/3395
[BEAM-1542] Cloud Spanner Source
Defines Cloud Spanner Source API, and a naive implementation, similar to
JdbcIO.
Also includes https://github.com/apache/beam/pull/3358
You can merge
GitHub user mairbek opened a pull request:
https://github.com/apache/beam/pull/3358
[BEAM-1542] Support ValueProviders in SpannerIO
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/mairbek/beam providers
Alternatively you can
GitHub user mairbek opened a pull request:
https://github.com/apache/beam/pull/3319
[BEAM-1542] SpannerIO: Introduced a MutationGroup.
Allows to group together mutations in a logical bundle that is submitted in
the same transaction.
You can merge this pull request into a Git
GitHub user mairbek opened a pull request:
https://github.com/apache/beam/pull/3298
[BEAM-2394] Support concurrent execution of SpannerWriteIT test
Generate a random table name.
Assume Spanner database exists.
Run Java JDK Version Test
You can merge this pull request
[
https://issues.apache.org/jira/browse/BEAM-2394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16037411#comment-16037411
]
Mairbek Khadikov commented on BEAM-2394:
Got it. We need to use a random database name. Or even
[
https://issues.apache.org/jira/browse/BEAM-2394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16037391#comment-16037391
]
Mairbek Khadikov commented on BEAM-2394:
Interesting, are these tests running concurrently
GitHub user mairbek opened a pull request:
https://github.com/apache/beam/pull/3259
[BEAM-2379] Avoid reading projectId from environment variable in tests.
SpannerOptions.Builder requires projectId to be not-null.
Was green because I had GOOGLE_APPLICATION_CREDENTIALS
[
https://issues.apache.org/jira/browse/BEAM-2379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16029909#comment-16029909
]
Mairbek Khadikov commented on BEAM-2379:
Will send a fix PR
> SpannerIO tests are fail
Github user mairbek closed the pull request at:
https://github.com/apache/beam/pull/3221
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature
[
https://issues.apache.org/jira/browse/BEAM-1542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16023881#comment-16023881
]
Mairbek Khadikov commented on BEAM-1542:
Created https://github.com/apache/beam-site/pull/252
GitHub user mairbek opened a pull request:
https://github.com/apache/beam-site/pull/252
Added Cloud Spanner Connector
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/mairbek/beam-site patch-1
Alternatively you can review
GitHub user mairbek opened a pull request:
https://github.com/apache/beam/pull/3221
[BEAM-1542] SpannerIO sink updates
Unit and integration test.
Logical mutation size estimation.
Be sure to do all of the following to help us incorporate your contribution
quickly
Github user mairbek closed the pull request at:
https://github.com/apache/beam/pull/2555
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature
GitHub user mairbek opened a pull request:
https://github.com/apache/beam/pull/2555
BEAM-1542: Bump grpc-google-common-protos.version to support Cloud Spanner
client.
Be sure to do all of the following to help us incorporate your contribution
quickly and easily
[
https://issues.apache.org/jira/browse/BEAM-1542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15957937#comment-15957937
]
Mairbek Khadikov commented on BEAM-1542:
Hi Guy, I work on Cloud Spanner at Google. Let us know
GitHub user mairbek opened a pull request:
https://github.com/apache/beam-site/pull/171
Typo fix in "Reading Data Into Your Pipeline" example.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/mairbek/beam-site fix
Alt
44 matches
Mail list logo
