[jira] [Commented] (BEAM-1631) Flink runner: submit job to a Flink-on-YARN cluster

2017-03-06 Thread Xu Mingmin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15898281#comment-15898281 ] Xu Mingmin commented on BEAM-1631: -- Do I understand correctly? I can submit a job with Fli

[jira] [Commented] (BEAM-68) Support for limiting parallelism of a step

2017-03-06 Thread Xu Mingmin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-68?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15898151#comment-15898151 ] Xu Mingmin commented on BEAM-68: This's required by some runners. With this parameter, runner

[jira] [Commented] (BEAM-68) Support for limiting parallelism of a step

2017-03-05 Thread Xu Mingmin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-68?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15896589#comment-15896589 ] Xu Mingmin commented on BEAM-68: Notice this task when tuning a Beam job on Flink. Would like

[jira] [Updated] (BEAM-301) Add a Beam SQL DSL

2017-03-02 Thread Xu Mingmin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xu Mingmin updated BEAM-301: Description: The SQL DSL helps developers to build a Beam pipeline from SQL statement in String directly. In

[jira] [Updated] (BEAM-301) Add a Beam SQL DSL

2017-03-02 Thread Xu Mingmin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xu Mingmin updated BEAM-301: Description: The SQL DSL helps developers to build a Beam pipeline from SQL statement in String directly. In

[jira] [Commented] (BEAM-1529) First sentence should end with a period. [JavadocStyle]

2017-02-23 Thread Xu Mingmin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15881409#comment-15881409 ] Xu Mingmin commented on BEAM-1529: -- Sure, please close it. > First sentence should end wi

[jira] [Commented] (BEAM-1529) First sentence should end with a period. [JavadocStyle]

2017-02-23 Thread Xu Mingmin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15881011#comment-15881011 ] Xu Mingmin commented on BEAM-1529: -- thanks [~jbonofre], works with the new format now. >

[jira] [Resolved] (BEAM-1407) Support multiple Kafka client in KakaIO

2017-02-22 Thread Xu Mingmin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xu Mingmin resolved BEAM-1407. -- Resolution: Fixed Fix Version/s: 0.6.0 > Support multiple Kafka client in KakaIO > ---

[jira] [Issue Comment Deleted] (BEAM-1514) change default timestamp in KafkaIO

2017-02-22 Thread Xu Mingmin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xu Mingmin updated BEAM-1514: - Comment: was deleted (was: [~davor], can I have your help on how to setup the multiple version test? I'm n

[jira] [Commented] (BEAM-1516) null value is not supported in Map with AvroCoder

2017-02-21 Thread Xu Mingmin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15877644#comment-15877644 ] Xu Mingmin commented on BEAM-1516: -- [~dhalp...@google.com], that's an option. This should

[jira] [Created] (BEAM-1529) First sentence should end with a period. [JavadocStyle]

2017-02-21 Thread Xu Mingmin (JIRA)
Xu Mingmin created BEAM-1529: Summary: First sentence should end with a period. [JavadocStyle] Key: BEAM-1529 URL: https://issues.apache.org/jira/browse/BEAM-1529 Project: Beam Issue Type: Test

[jira] [Comment Edited] (BEAM-1515) junit test KafkaIO with multiple Kafka client versions

2017-02-21 Thread Xu Mingmin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15877586#comment-15877586 ] Xu Mingmin edited comment on BEAM-1515 at 2/22/17 6:47 AM: --- yes,

[jira] [Commented] (BEAM-1515) junit test KafkaIO with multiple Kafka client versions

2017-02-21 Thread Xu Mingmin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15877586#comment-15877586 ] Xu Mingmin commented on BEAM-1515: -- yes, that's what I want to do, make sure the existing

[jira] [Updated] (BEAM-1515) junit test KafkaIO with multiple Kafka client versions

2017-02-21 Thread Xu Mingmin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xu Mingmin updated BEAM-1515: - Summary: junit test KafkaIO with multiple Kafka client versions (was: unit KafkaIO with multiple Kafka cl

[jira] [Commented] (BEAM-1514) change default timestamp in KafkaIO

2017-02-21 Thread Xu Mingmin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15877176#comment-15877176 ] Xu Mingmin commented on BEAM-1514: -- [~davor], can I have your help on how to setup the mul

[jira] [Commented] (BEAM-1516) null value is not supported in Map with AvroCoder

2017-02-21 Thread Xu Mingmin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15876906#comment-15876906 ] Xu Mingmin commented on BEAM-1516: -- Had some tests, Null value in Map is supported when Ma

[jira] [Commented] (BEAM-1516) null value is not supported in Map with AvroCoder

2017-02-21 Thread Xu Mingmin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15876389#comment-15876389 ] Xu Mingmin commented on BEAM-1516: -- would like to take this task if no duplication > null

[jira] [Created] (BEAM-1516) null value is not supported in Map with AvroCoder

2017-02-20 Thread Xu Mingmin (JIRA)
Xu Mingmin created BEAM-1516: Summary: null value is not supported in Map with AvroCoder Key: BEAM-1516 URL: https://issues.apache.org/jira/browse/BEAM-1516 Project: Beam Issue Type: Bug

[jira] [Created] (BEAM-1515) unit KafkaIO with multiple Kafka client versions

2017-02-20 Thread Xu Mingmin (JIRA)
Xu Mingmin created BEAM-1515: Summary: unit KafkaIO with multiple Kafka client versions Key: BEAM-1515 URL: https://issues.apache.org/jira/browse/BEAM-1515 Project: Beam Issue Type: Improvement

[jira] [Commented] (BEAM-1514) change default timestamp in KafkaIO

2017-02-20 Thread Xu Mingmin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15875030#comment-15875030 ] Xu Mingmin commented on BEAM-1514: -- agree, timestamp function defined in user's beam pipel

[jira] [Commented] (BEAM-1514) change default timestamp in KafkaIO

2017-02-20 Thread Xu Mingmin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15875015#comment-15875015 ] Xu Mingmin commented on BEAM-1514: -- [~davor], will refer to the naming standard in Cloud P

[jira] [Comment Edited] (BEAM-1514) change default timestamp in KafkaIO

2017-02-20 Thread Xu Mingmin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15874972#comment-15874972 ] Xu Mingmin edited comment on BEAM-1514 at 2/20/17 8:00 PM: --- will

[jira] [Commented] (BEAM-1514) change default timestamp in KafkaIO

2017-02-20 Thread Xu Mingmin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15874972#comment-15874972 ] Xu Mingmin commented on BEAM-1514: -- will submit a PR after BEAM-1407, the priority would b

[jira] [Created] (BEAM-1514) change default timestamp in KafkaIO

2017-02-20 Thread Xu Mingmin (JIRA)
Xu Mingmin created BEAM-1514: Summary: change default timestamp in KafkaIO Key: BEAM-1514 URL: https://issues.apache.org/jira/browse/BEAM-1514 Project: Beam Issue Type: Improvement Comp

[jira] [Created] (BEAM-1488) add ConsoleIO

2017-02-14 Thread Xu Mingmin (JIRA)
Xu Mingmin created BEAM-1488: Summary: add ConsoleIO Key: BEAM-1488 URL: https://issues.apache.org/jira/browse/BEAM-1488 Project: Beam Issue Type: New Feature Components: sdk-java-core

[jira] [Commented] (BEAM-1461) duplication with StartBundle and prepareForProcessing in DoFn

2017-02-14 Thread Xu Mingmin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15866377#comment-15866377 ] Xu Mingmin commented on BEAM-1461: -- +1 `prepareForProcessing` is only used with Aggregator

[jira] [Created] (BEAM-1461) duplication with StartBundle and prepareForProcessing in DoFn

2017-02-10 Thread Xu Mingmin (JIRA)
Xu Mingmin created BEAM-1461: Summary: duplication with StartBundle and prepareForProcessing in DoFn Key: BEAM-1461 URL: https://issues.apache.org/jira/browse/BEAM-1461 Project: Beam Issue Type:

[jira] [Commented] (BEAM-1407) Support multiple Kafka client in KakaIO

2017-02-07 Thread Xu Mingmin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15856653#comment-15856653 ] Xu Mingmin commented on BEAM-1407: -- add a design doc https://docs.google.com/document/d/1

[jira] [Commented] (BEAM-1407) Support multiple Kafka client in KakaIO

2017-02-06 Thread Xu Mingmin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15854963#comment-15854963 ] Xu Mingmin commented on BEAM-1407: -- Thanks! will add a design doc soon. > Support multipl

[jira] [Updated] (BEAM-1407) Support multiple Kafka client in KakaIO

2017-02-06 Thread Xu Mingmin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xu Mingmin updated BEAM-1407: - Description: enhance KafkaIO to work with Kafka client 0.9 and 0.10, (maybe 0.8 as well ?), 1). to fully l

[jira] [Updated] (BEAM-1407) Support multiple Kafka client in KakaIO

2017-02-06 Thread Xu Mingmin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xu Mingmin updated BEAM-1407: - Summary: Support multiple Kafka client in KakaIO (was: Support Kafka client 0.10 in KakaIO) > Support mul

[jira] [Created] (BEAM-1407) Support Kafka client 0.10 in KakaIO

2017-02-06 Thread Xu Mingmin (JIRA)
Xu Mingmin created BEAM-1407: Summary: Support Kafka client 0.10 in KakaIO Key: BEAM-1407 URL: https://issues.apache.org/jira/browse/BEAM-1407 Project: Beam Issue Type: Improvement Comp

[jira] [Commented] (BEAM-1407) Support Kafka client 0.10 in KakaIO

2017-02-06 Thread Xu Mingmin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15854892#comment-15854892 ] Xu Mingmin commented on BEAM-1407: -- [~davor], can you assign this task to me? > Support K

[jira] [Created] (BEAM-1214) fail to run on SparkRunner with VerifyError

2016-12-23 Thread Xu Mingmin (JIRA)
Xu Mingmin created BEAM-1214: Summary: fail to run on SparkRunner with VerifyError Key: BEAM-1214 URL: https://issues.apache.org/jira/browse/BEAM-1214 Project: Beam Issue Type: Bug Comp

[jira] [Commented] (BEAM-307) Upgrade/Test to Kafka 0.10

2016-12-22 Thread Xu Mingmin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15771409#comment-15771409 ] Xu Mingmin commented on BEAM-307: - Hi [~j...@nanthrax.net], I'm very interesting in this tas

<    1   2   3   4   5   6