[jira] [Commented] (APEXMALHAR-2119) Make DirectoryScanner in AbstractFileInputOperator inheritance friendly.

2016-06-20 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15341105#comment-15341105 ] ASF GitHub Bot commented on APEXMALHAR-2119: Github user tushargosavi commented on a diff

[GitHub] apex-malhar pull request #318: APEXMALHAR-2119 add setters for partition cou...

2016-06-20 Thread tushargosavi
Github user tushargosavi commented on a diff in the pull request: https://github.com/apache/apex-malhar/pull/318#discussion_r67808791 --- Diff: library/src/main/java/com/datatorrent/lib/io/fs/AbstractFileInputOperator.java --- @@ -1110,6 +1116,16 @@ public String toString()

[GitHub] apex-malhar pull request #321: APEXMALHAR-2120 #resolve #comment solve probl...

2016-06-20 Thread tweise
Github user tweise commented on a diff in the pull request: https://github.com/apache/apex-malhar/pull/321#discussion_r67807919 --- Diff: kafka/src/test/java/org/apache/apex/malhar/kafka/KafkaInputOperatorTest.java --- @@ -275,10 +324,21 @@ public void testInputOperator(boolean

[jira] [Commented] (APEXMALHAR-2120) Fix bugs on KafkaInputOperatorTest AbstractKafkaInputOperator

2016-06-20 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15341085#comment-15341085 ] ASF GitHub Bot commented on APEXMALHAR-2120: Github user tweise commented on a diff in

[GitHub] apex-malhar pull request #321: APEXMALHAR-2120 #resolve #comment solve probl...

2016-06-20 Thread tweise
Github user tweise commented on a diff in the pull request: https://github.com/apache/apex-malhar/pull/321#discussion_r67807860 --- Diff: kafka/src/test/java/org/apache/apex/malhar/kafka/KafkaInputOperatorTest.java --- @@ -68,26 +70,53 @@ public static String

[jira] [Commented] (APEXMALHAR-2120) Fix bugs on KafkaInputOperatorTest AbstractKafkaInputOperator

2016-06-20 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15341084#comment-15341084 ] ASF GitHub Bot commented on APEXMALHAR-2120: Github user tweise commented on a diff in

[GitHub] apex-malhar pull request #321: APEXMALHAR-2120 #resolve #comment solve probl...

2016-06-20 Thread tweise
Github user tweise commented on a diff in the pull request: https://github.com/apache/apex-malhar/pull/321#discussion_r67807822 --- Diff: kafka/src/test/java/org/apache/apex/malhar/kafka/KafkaInputOperatorTest.java --- @@ -49,13 +50,14 @@ import

[jira] [Commented] (APEXMALHAR-2120) Fix bugs on KafkaInputOperatorTest AbstractKafkaInputOperator

2016-06-20 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15341081#comment-15341081 ] ASF GitHub Bot commented on APEXMALHAR-2120: Github user tweise commented on a diff in

[jira] [Commented] (APEXMALHAR-2121) KafkaInputOperator emitTuple method should be able to emit more than just message

2016-06-20 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15341069#comment-15341069 ] ASF GitHub Bot commented on APEXMALHAR-2121: Github user DT-Priyanka commented on a diff

[GitHub] apex-malhar pull request #323: APEXMALHAR-2121: Updating KafkaInputOperator ...

2016-06-20 Thread DT-Priyanka
Github user DT-Priyanka commented on a diff in the pull request: https://github.com/apache/apex-malhar/pull/323#discussion_r67807361 --- Diff: contrib/src/main/java/com/datatorrent/contrib/kafka/AbstractKafkaInputOperator.java --- @@ -203,6 +204,14 @@ public

[GitHub] apex-malhar pull request #321: APEXMALHAR-2120 #resolve #comment solve probl...

2016-06-20 Thread siyuanh
Github user siyuanh commented on a diff in the pull request: https://github.com/apache/apex-malhar/pull/321#discussion_r67780118 --- Diff: kafka/pom.xml --- @@ -198,7 +198,7 @@ org.apache.kafka kafka_2.11 - 0.9.0.0 --- End diff --

send this email to subscribe

2016-06-20 Thread Yunhan Wang

[jira] [Commented] (APEXMALHAR-2120) Fix bugs on KafkaInputOperatorTest AbstractKafkaInputOperator

2016-06-20 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15340544#comment-15340544 ] ASF GitHub Bot commented on APEXMALHAR-2120: Github user brightchen commented on a diff

[jira] [Commented] (APEXMALHAR-2120) Fix bugs on KafkaInputOperatorTest AbstractKafkaInputOperator

2016-06-20 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15340545#comment-15340545 ] ASF GitHub Bot commented on APEXMALHAR-2120: Github user brightchen commented on a diff

[jira] [Commented] (APEXMALHAR-2120) Fix bugs on KafkaInputOperatorTest AbstractKafkaInputOperator

2016-06-20 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15340530#comment-15340530 ] ASF GitHub Bot commented on APEXMALHAR-2120: Github user brightchen commented on a diff

[jira] [Commented] (APEXMALHAR-2120) Fix bugs on KafkaInputOperatorTest AbstractKafkaInputOperator

2016-06-20 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15340488#comment-15340488 ] ASF GitHub Bot commented on APEXMALHAR-2120: Github user siyuanh commented on a diff in

[GitHub] apex-malhar pull request #321: APEXMALHAR-2120 #resolve #comment solve probl...

2016-06-20 Thread siyuanh
Github user siyuanh commented on a diff in the pull request: https://github.com/apache/apex-malhar/pull/321#discussion_r67774397 --- Diff: kafka/src/main/java/org/apache/apex/malhar/kafka/KafkaConsumerWrapper.java --- @@ -129,6 +130,11 @@ public void

[jira] [Commented] (APEXMALHAR-2120) Fix bugs on KafkaInputOperatorTest AbstractKafkaInputOperator

2016-06-20 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15340485#comment-15340485 ] ASF GitHub Bot commented on APEXMALHAR-2120: Github user siyuanh commented on a diff in

[GitHub] apex-malhar pull request #321: APEXMALHAR-2120 #resolve #comment solve probl...

2016-06-20 Thread siyuanh
Github user siyuanh commented on a diff in the pull request: https://github.com/apache/apex-malhar/pull/321#discussion_r67774142 --- Diff: kafka/src/main/java/org/apache/apex/malhar/kafka/KafkaConsumerWrapper.java --- @@ -74,7 +75,7 @@ private static final Logger

[jira] [Commented] (APEXMALHAR-2120) Fix bugs on KafkaInputOperatorTest AbstractKafkaInputOperator

2016-06-20 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15340463#comment-15340463 ] ASF GitHub Bot commented on APEXMALHAR-2120: Github user brightchen commented on a diff

[GitHub] apex-malhar pull request #321: APEXMALHAR-2120 #resolve #comment solve probl...

2016-06-20 Thread brightchen
Github user brightchen commented on a diff in the pull request: https://github.com/apache/apex-malhar/pull/321#discussion_r67772302 --- Diff: kafka/pom.xml --- @@ -198,7 +198,7 @@ org.apache.kafka kafka_2.11 - 0.9.0.0 --- End diff --

[GitHub] apex-malhar pull request #321: APEXMALHAR-2120 #resolve #comment solve probl...

2016-06-20 Thread siyuanh
Github user siyuanh commented on a diff in the pull request: https://github.com/apache/apex-malhar/pull/321#discussion_r67770746 --- Diff: kafka/pom.xml --- @@ -198,7 +198,7 @@ org.apache.kafka kafka_2.11 - 0.9.0.0 --- End diff --

[jira] [Commented] (APEXMALHAR-2120) Fix bugs on KafkaInputOperatorTest AbstractKafkaInputOperator

2016-06-20 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15340435#comment-15340435 ] ASF GitHub Bot commented on APEXMALHAR-2120: Github user siyuanh commented on a diff in

[GitHub] apex-malhar pull request #320: APEXMALHAR-2120 #resolve #comment solve probl...

2016-06-20 Thread siyuanh
Github user siyuanh commented on a diff in the pull request: https://github.com/apache/apex-malhar/pull/320#discussion_r67769627 --- Diff: kafka/pom.xml --- @@ -198,7 +198,7 @@ org.apache.kafka kafka_2.11 - 0.9.0.0 + 0.9.0.1 ---

[GitHub] apex-malhar pull request #321: APEXMALHAR-2120 #resolve #comment solve probl...

2016-06-20 Thread brightchen
Github user brightchen commented on a diff in the pull request: https://github.com/apache/apex-malhar/pull/321#discussion_r67763894 --- Diff: kafka/src/test/java/org/apache/apex/malhar/kafka/KafkaInputOperatorTest.java --- @@ -275,10 +324,21 @@ public void

[jira] [Commented] (APEXMALHAR-2120) Fix bugs on KafkaInputOperatorTest AbstractKafkaInputOperator

2016-06-20 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15340377#comment-15340377 ] ASF GitHub Bot commented on APEXMALHAR-2120: Github user brightchen commented on a diff

[jira] [Commented] (APEXMALHAR-2120) Fix bugs on KafkaInputOperatorTest AbstractKafkaInputOperator

2016-06-20 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15340370#comment-15340370 ] ASF GitHub Bot commented on APEXMALHAR-2120: Github user brightchen commented on a diff

[GitHub] apex-malhar pull request #321: APEXMALHAR-2120 #resolve #comment solve probl...

2016-06-20 Thread brightchen
Github user brightchen commented on a diff in the pull request: https://github.com/apache/apex-malhar/pull/321#discussion_r67763344 --- Diff: kafka/src/test/java/org/apache/apex/malhar/kafka/KafkaInputOperatorTest.java --- @@ -68,26 +70,53 @@ public static String

[GitHub] apex-malhar pull request #319: REVIEW ONLY: Operator supporting the Beam con...

2016-06-20 Thread davidyan74
Github user davidyan74 commented on a diff in the pull request: https://github.com/apache/apex-malhar/pull/319#discussion_r67760503 --- Diff: stream/src/main/java/org/apache/apex/malhar/stream/window/WindowedStorage.java --- @@ -0,0 +1,134 @@ +/** + * Licensed to the

[GitHub] apex-malhar pull request #319: REVIEW ONLY: Operator supporting the Beam con...

2016-06-20 Thread davidyan74
Github user davidyan74 commented on a diff in the pull request: https://github.com/apache/apex-malhar/pull/319#discussion_r67760461 --- Diff: stream/src/main/java/org/apache/apex/malhar/stream/window/Accumulation.java --- @@ -0,0 +1,73 @@ +/** + * Licensed to the Apache

[GitHub] apex-malhar pull request #319: REVIEW ONLY: Operator supporting the Beam con...

2016-06-20 Thread davidyan74
Github user davidyan74 commented on a diff in the pull request: https://github.com/apache/apex-malhar/pull/319#discussion_r67760438 --- Diff: stream/src/main/java/org/apache/apex/malhar/stream/window/impl/WindowedOperatorImpl.java --- @@ -0,0 +1,436 @@ +package

[GitHub] apex-malhar pull request #316: High-level WindowedStream API (Review only)

2016-06-20 Thread brightchen
Github user brightchen commented on a diff in the pull request: https://github.com/apache/apex-malhar/pull/316#discussion_r67746283 --- Diff: library/src/main/java/com/datatorrent/lib/window/WindowOption.java --- @@ -0,0 +1,143 @@ +package com.datatorrent.lib.window; +

[jira] [Commented] (APEXMALHAR-2048) Create concrete implementation of ArrayListMultiMap using managed state.

2016-06-20 Thread Timothy Farkas (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15340104#comment-15340104 ] Timothy Farkas commented on APEXMALHAR-2048: Sure, I'll open the PR tonight. Thanks,

Re: Proposal : DAG - SetOperatorAttribute

2016-06-20 Thread Sandesh Hegde
Hi All, This change has been merged, will be part of 3.5. New API in the DAG, setOperatorAttribute(Operator operator, Attribute key, T value) ) Another API was deprecated, "setAttribute(Operator ... " Thanks On Tue, Jun 7, 2016 at 1:08 PM Sandesh Hegde wrote: > I

[GitHub] apex-malhar pull request #323: APEXMALHAR-2121: Updating KafkaInputOperator ...

2016-06-20 Thread siyuanh
Github user siyuanh commented on a diff in the pull request: https://github.com/apache/apex-malhar/pull/323#discussion_r67717267 --- Diff: contrib/src/main/java/com/datatorrent/contrib/kafka/AbstractKafkaInputOperator.java --- @@ -203,6 +204,14 @@ public

Re: [ANNOUNCE] New Apache Apex PMC Member: Siyuan Hua

2016-06-20 Thread Siyuan Hua
Thanks guys! Apex cannot do well without the effort from the whole community. Thank you every one! Regards, Siyuan On Thu, Jun 16, 2016 at 9:18 PM, Tushar Gosavi wrote: > Congratulations Siyuan > > - Tushar. > > > On Thu, Jun 16, 2016 at 10:43 PM, Sandesh Hegde

[jira] [Commented] (APEXCORE-470) New Api for setting the attribute on the operator ( setOperatorAttribute )

2016-06-20 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15339574#comment-15339574 ] ASF GitHub Bot commented on APEXCORE-470: - Github user asfgit closed the pull request at:

[GitHub] apex-core pull request #349: APEXCORE-470 New API in DAG - setOperatorAttrib...

2016-06-20 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/apex-core/pull/349 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] apex-malhar pull request #319: REVIEW ONLY: Operator supporting the Beam con...

2016-06-20 Thread tushargosavi
Github user tushargosavi commented on a diff in the pull request: https://github.com/apache/apex-malhar/pull/319#discussion_r67679805 --- Diff: stream/src/main/java/org/apache/apex/malhar/stream/api/WindowedStream.java --- @@ -53,4 +60,121 @@ */ public interface

[GitHub] apex-malhar pull request #319: REVIEW ONLY: Operator supporting the Beam con...

2016-06-20 Thread tushargosavi
Github user tushargosavi commented on a diff in the pull request: https://github.com/apache/apex-malhar/pull/319#discussion_r67652351 --- Diff: stream/src/main/java/org/apache/apex/malhar/stream/window/WindowedStorage.java --- @@ -0,0 +1,134 @@ +/** + * Licensed to the

[GitHub] apex-malhar pull request #323: APEXMALHAR-2121: Updating KafkaInputOperator ...

2016-06-20 Thread DT-Priyanka
GitHub user DT-Priyanka opened a pull request: https://github.com/apache/apex-malhar/pull/323 APEXMALHAR-2121: Updating KafkaInputOperator to add emitTuple method with access to more kafka parameters Added emitTuple method with KafkaMessage as parameter. A user can override this