[
https://issues.apache.org/jira/browse/BEAM-10137?focusedWorklogId=463604&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-463604
]
ASF GitHub Bot logged work on BEAM-10137:
-----------------------------------------
Author: ASF GitHub Bot
Created on: 29/Jul/20 07:14
Start Date: 29/Jul/20 07:14
Worklog Time Spent: 10m
Work Description: piotr-szuberski edited a comment on pull request #12297:
URL: https://github.com/apache/beam/pull/12297#issuecomment-664541514
@TheNeuralBit I've moved all commits to this PR. I have a feeling that big
PR is better than few smaller PRs dependent of each other - they are much less
maintainable. I'm used to Gerrit where each dependent commit is a PR rebased on
the previous commit.
I tried to use testcontainers with localstack but I encountered a problem
that I can create, read and write streams via boto3, but I'm unable to use it
with Beam. What I found is that kinesis java sdk by default uses CBOR which can
be disabled by executing java program with kinesis sdk with executing it with
-Dcom.amazonaws.sdk.disableCertChecking=true. But I don't have an idea how to
do that in beam's execution model - do you have any idea or suggestion how
could I do that?
In general the tests before introducing localstack work correctly. Commits
after the localstack introduction don't work, I just put vanilla kinesis test
to indicate that the container seems to work properly.
Edit: write test is now working after adding disabling certificate
verification option.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 463604)
Time Spent: 2h 40m (was: 2.5h)
> Add cross-language wrapper for Java's KinesisIO Read
> ----------------------------------------------------
>
> Key: BEAM-10137
> URL: https://issues.apache.org/jira/browse/BEAM-10137
> Project: Beam
> Issue Type: Sub-task
> Components: cross-language, io-java-kinesis, io-py-aws
> Affects Versions: Not applicable
> Reporter: Piotr Szuberski
> Assignee: Piotr Szuberski
> Priority: P2
> Labels: portability
> Fix For: Not applicable
>
> Time Spent: 2h 40m
> Remaining Estimate: 0h
>
> Add cross-language wrapper for Java's KinesisIO Read
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
