peay created BEAM-1573:
--
Summary: KafkaIO does not allow using Kafka serializers and
deserializers
Key: BEAM-1573
URL: https://issues.apache.org/jira/browse/BEAM-1573
Project: Beam
Issue Type: Bug
[
https://issues.apache.org/jira/browse/BEAM-1573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15888481#comment-15888481
]
peay commented on BEAM-1573:
Yes, if we can agree on a solution. I would suggest to just remove the ignore
on
[
https://issues.apache.org/jira/browse/BEAM-1573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15888717#comment-15888717
]
peay edited comment on BEAM-1573 at 2/28/17 9:20 PM:
-
Actually, thinking more about it,
[
https://issues.apache.org/jira/browse/BEAM-1573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15888717#comment-15888717
]
peay edited comment on BEAM-1573 at 3/1/17 12:20 AM:
-
Actually, thinking more about it,
[
https://issues.apache.org/jira/browse/BEAM-1751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15936384#comment-15936384
]
peay commented on BEAM-1751:
This is a bit blocking -- this completely clogs Dataflow's error log and I am
[
https://issues.apache.org/jira/browse/BEAM-1751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15941125#comment-15941125
]
peay edited comment on BEAM-1751 at 3/24/17 9:13 PM:
-
Hum, good point -- I messed up my
[
https://issues.apache.org/jira/browse/BEAM-1751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15941125#comment-15941125
]
peay commented on BEAM-1751:
Hum, good point -- I messed up my staging. With
[
https://issues.apache.org/jira/browse/BEAM-1751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15941015#comment-15941015
]
peay commented on BEAM-1751:
I just ran it with {{0.7.0-SNAPSHOT}} from this morning -- same issue, nothing
[
https://issues.apache.org/jira/browse/BEAM-1751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15938568#comment-15938568
]
peay commented on BEAM-1751:
The Bigtable table has 504 rows, one column family and a couple columns.
>
[
https://issues.apache.org/jira/browse/BEAM-1751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15937330#comment-15937330
]
peay edited comment on BEAM-1751 at 3/22/17 11:05 PM:
--
I can reproduce with:
[
https://issues.apache.org/jira/browse/BEAM-1751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15937330#comment-15937330
]
peay edited comment on BEAM-1751 at 3/22/17 11:05 PM:
--
I can reproduce with:
[
https://issues.apache.org/jira/browse/BEAM-1751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15937330#comment-15937330
]
peay commented on BEAM-1751:
I can reproduce with:
{{code}}
public static void main(String[] args) throws
peay created BEAM-1751:
--
Summary: Singleton ByteKeyRange with BigtableIO and Dataflow runner
Key: BEAM-1751
URL: https://issues.apache.org/jira/browse/BEAM-1751
Project: Beam
Issue Type: Bug
[
https://issues.apache.org/jira/browse/BEAM-1751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
peay updated BEAM-1751:
---
Description:
I am getting this exception on a smallish table of a couple hundreds of rows
from Bigtable, when running
[
https://issues.apache.org/jira/browse/BEAM-1751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15933915#comment-15933915
]
peay commented on BEAM-1751:
Yes, correct. I have an unbounded source in this pipeline, and I use the
[
https://issues.apache.org/jira/browse/BEAM-1848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15952249#comment-15952249
]
peay commented on BEAM-1848:
Indeed, the issue is gone. Thanks for looking into it so quickly -- I hadn't
[
https://issues.apache.org/jira/browse/BEAM-1573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15906595#comment-15906595
]
peay edited comment on BEAM-1573 at 3/12/17 5:23 PM:
-
[~rangadi] I have made some good
[
https://issues.apache.org/jira/browse/BEAM-1573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15906595#comment-15906595
]
peay edited comment on BEAM-1573 at 3/12/17 5:23 PM:
-
[~rangadi] I have made some good
[
https://issues.apache.org/jira/browse/BEAM-1573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15906595#comment-15906595
]
peay edited comment on BEAM-1573 at 3/12/17 5:23 PM:
-
[~rangadi] I have made some good
[
https://issues.apache.org/jira/browse/BEAM-1573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15901275#comment-15901275
]
peay commented on BEAM-1573:
OK, I will get started on a PR.
> KafkaIO does not allow using Kafka serializers
[
https://issues.apache.org/jira/browse/BEAM-1573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15897752#comment-15897752
]
peay commented on BEAM-1573:
[~rangadi] OK, that makes sense. I was hoping to try and keep everything as a
[
https://issues.apache.org/jira/browse/BEAM-1573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
peay updated BEAM-1573:
---
Issue Type: Improvement (was: Bug)
> KafkaIO does not allow using Kafka serializers and deserializers
>
[
https://issues.apache.org/jira/browse/BEAM-1573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15897752#comment-15897752
]
peay edited comment on BEAM-1573 at 3/6/17 6:15 PM:
[~rangadi] OK, that makes sense. I
[
https://issues.apache.org/jira/browse/BEAM-1573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15892746#comment-15892746
]
peay commented on BEAM-1573:
My concern is for both source and sink.
I'd like to be able to use custom
[
https://issues.apache.org/jira/browse/BEAM-1573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15892746#comment-15892746
]
peay edited comment on BEAM-1573 at 3/2/17 6:38 PM:
My concern is for both source and
[
https://issues.apache.org/jira/browse/BEAM-1573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15888717#comment-15888717
]
peay commented on BEAM-1573:
Actually, thinking more about it, just setting the serializer class in the
Kafka
[
https://issues.apache.org/jira/browse/BEAM-1573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15888717#comment-15888717
]
peay edited comment on BEAM-1573 at 2/28/17 7:24 PM:
-
Actually, thinking more about it,
peay created BEAM-1848:
--
Summary: GroupByKey stuck with more than one worker on Dataflow
Key: BEAM-1848
URL: https://issues.apache.org/jira/browse/BEAM-1848
Project: Beam
Issue Type: Bug
peay created BEAM-2326:
--
Summary: Verbose INFO logging with stateful DoFns and Dataflow
Key: BEAM-2326
URL: https://issues.apache.org/jira/browse/BEAM-2326
Project: Beam
Issue Type: Bug
peay created BEAM-2449:
--
Summary: Support ValueProviders in KafkaIO
Key: BEAM-2449
URL: https://issues.apache.org/jira/browse/BEAM-2449
Project: Beam
Issue Type: Improvement
Components:
[
https://issues.apache.org/jira/browse/BEAM-2326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16044935#comment-16044935
]
peay commented on BEAM-2326:
Thanks [~kenn]!
> Verbose INFO logging with stateful DoFns and Dataflow
>
31 matches
Mail list logo
