[
https://issues.apache.org/jira/browse/BEAM-8889?focusedWorklogId=435748&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-435748
]
ASF GitHub Bot logged work on BEAM-8889:
----------------------------------------
Author: ASF GitHub Bot
Created on: 20/May/20 22:56
Start Date: 20/May/20 22:56
Worklog Time Spent: 10m
Work Description: TheNeuralBit commented on pull request #11651:
URL: https://github.com/apache/beam/pull/11651#issuecomment-631776883
It looks like Dataflow VR tests are going to fail:
```
15:10:31 org.apache.beam.sdk.transforms.join.CoGroupByKeyTest >
testCoGroupByKeyWithWindowing FAILED
15:10:31 java.lang.RuntimeException at CoGroupByKeyTest.java:494
15:10:31 Caused by: java.lang.OutOfMemoryError
15:10:31
15:10:31 org.apache.beam.sdk.transforms.FlattenTest >
testFlattenIterablesLists FAILED
15:10:31 java.lang.RuntimeException at FlattenTest.java:270
15:10:31 Caused by: java.lang.OutOfMemoryError
15:10:31
15:10:31 org.apache.beam.sdk.transforms.CreateTest > testCreateWithVoidType
FAILED
15:10:31 java.lang.RuntimeException at CreateTest.java:326
15:10:31 Caused by: java.lang.OutOfMemoryError
15:10:31
15:10:31 org.apache.beam.sdk.transforms.ReshuffleTest >
testReshuffleAfterSlidingWindows FAILED
15:10:31 java.lang.RuntimeException at ReshuffleTest.java:251
15:10:31 Caused by: java.lang.RuntimeException
15:10:31 Caused by: java.lang.IllegalArgumentException
15:10:31 Caused by: java.lang.OutOfMemoryError
```
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 435748)
Remaining Estimate: 132h 20m (was: 132.5h)
Time Spent: 35h 40m (was: 35.5h)
> Make GcsUtil use GoogleCloudStorage
> -----------------------------------
>
> Key: BEAM-8889
> URL: https://issues.apache.org/jira/browse/BEAM-8889
> Project: Beam
> Issue Type: Improvement
> Components: io-java-gcp
> Affects Versions: 2.16.0
> Reporter: Esun Kim
> Assignee: VASU NORI
> Priority: P2
> Labels: gcs
> Original Estimate: 168h
> Time Spent: 35h 40m
> Remaining Estimate: 132h 20m
>
> [GcsUtil|https://github.com/apache/beam/blob/master/sdks/java/extensions/google-cloud-platform-core/src/main/java/org/apache/beam/sdk/extensions/gcp/util/GcsUtil.java]
> is a primary class to access Google Cloud Storage on Apache Beam. Current
> implementation directly creates GoogleCloudStorageReadChannel and
> GoogleCloudStorageWriteChannel by itself to read and write GCS data rather
> than using
> [GoogleCloudStorage|https://github.com/GoogleCloudPlatform/bigdata-interop/blob/master/gcsio/src/main/java/com/google/cloud/hadoop/gcsio/GoogleCloudStorage.java]
> which is an abstract class providing basic IO capability which eventually
> creates channel objects. This request is about updating GcsUtil to use
> GoogleCloudStorage to create read and write channel, which is expected
> flexible because it can easily pick up the new change; e.g. new channel
> implementation using new protocol without code change.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
