[jira] [Updated] (APEXMALHAR-2139) UniqueCounter changes

[ https://issues.apache.org/jira/browse/APEXMALHAR-2139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aayushi Acharya updated APEXMALHAR-2139: Labels: pr (was: ) > UniqueCounter changes > - > >

[jira] [Commented] (APEXMALHAR-2086) Kafka Output Operator with Kafka 0.9 API

[ https://issues.apache.org/jira/browse/APEXMALHAR-2086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15378590#comment-15378590 ] ASF GitHub Bot commented on APEXMALHAR-2086: Github user asfgit closed the pull request

[GitHub] apex-malhar pull request #298: [APEXMALHAR-2086] Kafka output operator: 0.9....

Github user asfgit closed the pull request at: https://github.com/apache/apex-malhar/pull/298 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[jira] [Commented] (APEXCORE-488) Issues in SSL communication with StrAM

[ https://issues.apache.org/jira/browse/APEXCORE-488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15378582#comment-15378582 ] ASF GitHub Bot commented on APEXCORE-488: - Github user gauravgopi123 commented on a diff in the

[GitHub] apex-core pull request #357: APEXCORE-488: Issues in SSL communication with ...

Github user gauravgopi123 commented on a diff in the pull request: https://github.com/apache/apex-core/pull/357#discussion_r70900700 --- Diff: engine/src/main/java/com/datatorrent/stram/util/ConfigUtils.java --- @@ -68,15 +68,30 @@ public static String getRMUsername(Configuration

[GitHub] apex-core pull request #357: APEXCORE-488: Issues in SSL communication with ...

Github user gauravgopi123 commented on a diff in the pull request: https://github.com/apache/apex-core/pull/357#discussion_r70900320 --- Diff: engine/src/main/java/com/datatorrent/stram/util/ConfigUtils.java --- @@ -68,15 +68,30 @@ public static String getRMUsername(Configuration

Re: APEXMALHAR-1701 Deduper in Malhar

In general, windows cannot share state. But you can have a custom WindowedStorage implementation that does the dedup more efficiently than the default behavior. David On Thu, Jul 14, 2016 at 2:40 PM, Pramod Immaneni wrote: > Bhupesh, > > When using "Windows Operator",

[jira] [Commented] (APEXMALHAR-1701) Deduper : create a deduper backed by Managed State

[ https://issues.apache.org/jira/browse/APEXMALHAR-1701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15378565#comment-15378565 ] ASF GitHub Bot commented on APEXMALHAR-1701: Github user davidyan74 commented on a diff

[GitHub] apex-malhar pull request #343: [Review Only] APEXMALHAR-1701: Deduper using ...

Github user davidyan74 commented on a diff in the pull request: https://github.com/apache/apex-malhar/pull/343#discussion_r70899817 --- Diff: library/src/main/java/org/apache/apex/malhar/lib/dedup/AbstractWindowedDeduper.java --- @@ -0,0 +1,97 @@ +/** + * Licensed to the

[jira] [Commented] (APEXCORE-488) Issues in SSL communication with StrAM

[ https://issues.apache.org/jira/browse/APEXCORE-488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15378560#comment-15378560 ] ASF GitHub Bot commented on APEXCORE-488: - Github user gauravgopi123 commented on a diff in the

[GitHub] apex-malhar pull request #343: [Review Only] APEXMALHAR-1701: Deduper using ...

Github user davidyan74 commented on a diff in the pull request: https://github.com/apache/apex-malhar/pull/343#discussion_r70899585 --- Diff: library/src/test/java/org/apache/apex/malhar/lib/dedup/WindowedDeduperTest.java --- @@ -0,0 +1,160 @@ +/** + * Licensed to the

[jira] [Commented] (APEXMALHAR-1701) Deduper : create a deduper backed by Managed State

[ https://issues.apache.org/jira/browse/APEXMALHAR-1701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15378562#comment-15378562 ] ASF GitHub Bot commented on APEXMALHAR-1701: Github user davidyan74 commented on a diff

[jira] [Commented] (APEXCORE-488) Issues in SSL communication with StrAM

[ https://issues.apache.org/jira/browse/APEXCORE-488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15378535#comment-15378535 ] ASF GitHub Bot commented on APEXCORE-488: - Github user PramodSSImmaneni commented on a diff in

Re: JMS Input Operator enhancements

Yes. ActiveMQ is already there and uses Apache so nothing to do there. The libs for AWS SQS also use the Apache license. On 7/14/16, 2:42 PM, "Pramod Immaneni" wrote: What is the license covering the libraries, Apache? On Thu, Jul 14, 2016 at 2:37 PM,

Re: JMS Input Operator enhancements

What is the license covering the libraries, Apache? On Thu, Jul 14, 2016 at 2:37 PM, Sanjay Pujare wrote: > Sounds good. Will go with test scope. > > On 7/14/16, 12:57 PM, "Ashwin Chandra Putta" > wrote: > > They can be made test scoped in

Re: APEXMALHAR-1701 Deduper in Malhar

Bhupesh, When using "Windows Operator", if you were using sliding time windows like you were originally thinking then you would have the correct dedup behavior with the example case you mentioned with the tuples isn't it? Can the sliding windows share state with each other? Thanks On Thu, Jul

Re: JMS Input Operator enhancements

Sounds good. Will go with test scope. On 7/14/16, 12:57 PM, "Ashwin Chandra Putta" wrote: They can be made test scoped in malhar for testing. The user of this operator can add the implementation specific dependency in their application pom where they use

[jira] [Commented] (APEXMALHAR-2149) Add unittests for FunctionOperator

[ https://issues.apache.org/jira/browse/APEXMALHAR-2149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15378401#comment-15378401 ] ASF GitHub Bot commented on APEXMALHAR-2149: GitHub user ShunxinLu opened a pull request:

[GitHub] apex-malhar pull request #344: APEXMALHAR-2149 #resolve #comment Added unit ...

GitHub user ShunxinLu opened a pull request: https://github.com/apache/apex-malhar/pull/344 APEXMALHAR-2149 #resolve #comment Added unit tests for FunctionOperator APEXMALHAR-2149 #resolve #comment Added unit tests for FunctionOperator (Map, FlatMap, Filter) You can merge this

[jira] [Created] (APEXCORE-492) The exception from ExitCondition should not be swallowed

Siyuan Hua created APEXCORE-492: --- Summary: The exception from ExitCondition should not be swallowed Key: APEXCORE-492 URL: https://issues.apache.org/jira/browse/APEXCORE-492 Project: Apache Apex Core

Re: JMS Input Operator enhancements

They can be made test scoped in malhar for testing. The user of this operator can add the implementation specific dependency in their application pom where they use this operator and supply the corresponding connection factory class name. Regards, Ashwin. On Thu, Jul 14, 2016 at 11:55 AM, Sanjay

[jira] [Created] (APEXMALHAR-2156) JMS Input operator enhancements

Sanjay M Pujare created APEXMALHAR-2156: --- Summary: JMS Input operator enhancements Key: APEXMALHAR-2156 URL: https://issues.apache.org/jira/browse/APEXMALHAR-2156 Project: Apache Apex Malhar

Re: JMS Input Operator enhancements

Pramod, The JMS “wrapper” library needs the actual client library as you can see in com.datatorrent.lib.io.jms.JMSBase.getConnectionFactory() Class clazz = (Class)Class.forName(connectionFactoryClass); Where it loads the client library’s connectionFactoryClass by name. Instead of

Re: JMS Input Operator enhancements

Hi Sanjay, If there are going to separate operators developed for SQS and ActiveMQ using the native api, why do we need to add the client libraries for those to JMS? Are these only needed for testing? Thanks On Thu, Jul 14, 2016 at 11:16 AM, Sanjay Pujare wrote: > Hi

[jira] [Updated] (APEXMALHAR-2066) Add jdbc poller input operator

[ https://issues.apache.org/jira/browse/APEXMALHAR-2066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] devendra tagare updated APEXMALHAR-2066: Description: Create a JDBC poller input operator that has the following

JMS Input Operator enhancements

Hi all, I am proposing the following enhancements to the Malhar JMS input operator. Let me know if you have any comments. Enhancements are proposed to the malhar JMS Input Operator (in the package com.datatorrent.lib.io.jms) to make it usable with any JMS compatible message broker for basic

[jira] [Created] (APEXMALHAR-2154) Update kafka 0.9 input operator to use new CheckpointNotificationListener

Siyuan Hua created APEXMALHAR-2154: -- Summary: Update kafka 0.9 input operator to use new CheckpointNotificationListener Key: APEXMALHAR-2154 URL: https://issues.apache.org/jira/browse/APEXMALHAR-2154

Re: APEXMALHAR-1701 Deduper in Malhar

Hi All, I also implemented a De-duplication operator using Windowed Operator. Now we have two implementations, one with Managed state and another using Windowed operator. Here are their details: 1. *With Managed State - * - The operator is implemented using managed state as the storage for

[jira] [Created] (APEXMALHAR-2155) Make high-level api support multiple ports

Siyuan Hua created APEXMALHAR-2155: -- Summary: Make high-level api support multiple ports Key: APEXMALHAR-2155 URL: https://issues.apache.org/jira/browse/APEXMALHAR-2155 Project: Apache Apex Malhar

[jira] [Commented] (APEXCORE-488) Issues in SSL communication with StrAM

[ https://issues.apache.org/jira/browse/APEXCORE-488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15377617#comment-15377617 ] ASF GitHub Bot commented on APEXCORE-488: - Github user PramodSSImmaneni commented on a diff in

[GitHub] apex-core pull request #357: APEXCORE-488: Issues in SSL communication with ...

Github user PramodSSImmaneni commented on a diff in the pull request: https://github.com/apache/apex-core/pull/357#discussion_r70850997 --- Diff: engine/src/main/java/com/datatorrent/stram/util/ConfigUtils.java --- @@ -68,15 +68,30 @@ public static String

[jira] [Commented] (APEXCORE-488) Issues in SSL communication with StrAM

[ https://issues.apache.org/jira/browse/APEXCORE-488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15377337#comment-15377337 ] ASF GitHub Bot commented on APEXCORE-488: - Github user gauravgopi123 commented on a diff in the

[GitHub] apex-core pull request #357: APEXCORE-488: Issues in SSL communication with ...

Github user gauravgopi123 commented on a diff in the pull request: https://github.com/apache/apex-core/pull/357#discussion_r70848037 --- Diff: engine/src/main/java/com/datatorrent/stram/util/ConfigUtils.java --- @@ -68,15 +68,30 @@ public static String getRMUsername(Configuration

[jira] [Commented] (APEXMALHAR-1701) Deduper : create a deduper backed by Managed State

[ https://issues.apache.org/jira/browse/APEXMALHAR-1701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15376900#comment-15376900 ] ASF GitHub Bot commented on APEXMALHAR-1701: GitHub user bhupeshchawda opened a pull

[GitHub] apex-malhar pull request #343: [Review Only] APEXMALHAR-1701: Deduper using ...

GitHub user bhupeshchawda opened a pull request: https://github.com/apache/apex-malhar/pull/343 [Review Only] APEXMALHAR-1701: Deduper using Windowed Operator - Initial Commit. Ad… …ded Tests Added an implementation based on Windowed Operator You can merge this pull

[GitHub] apex-malhar pull request #330: Initial cut of Inner Join operator for REVIEW...

Github user chaithu14 commented on a diff in the pull request: https://github.com/apache/apex-malhar/pull/330#discussion_r70789750 --- Diff: library/src/main/java/com/datatorrent/lib/join/AbstractManagedStateInnerJoinOperator.java --- @@ -0,0 +1,259 @@ +/** + * Licensed

[jira] [Resolved] (APEXMALHAR-2019) Creation of S3 Input Module

[ https://issues.apache.org/jira/browse/APEXMALHAR-2019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yogi Devendra resolved APEXMALHAR-2019. --- Resolution: Fixed > Creation of S3 Input Module > --- >

[jira] [Updated] (APEXMALHAR-2019) Creation of S3 Input Module

[ https://issues.apache.org/jira/browse/APEXMALHAR-2019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yogi Devendra updated APEXMALHAR-2019: -- Fix Version/s: 3.5.0 > Creation of S3 Input Module > --- >

[jira] [Commented] (APEXMALHAR-2019) Creation of S3 Input Module

[ https://issues.apache.org/jira/browse/APEXMALHAR-2019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15376406#comment-15376406 ] ASF GitHub Bot commented on APEXMALHAR-2019: Github user asfgit closed the pull request

[GitHub] apex-malhar pull request #263: APEXMALHAR-2019 S3-Input Implemented S3 Input...

Github user asfgit closed the pull request at: https://github.com/apache/apex-malhar/pull/263 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[jira] [Created] (APEXMALHAR-2153) Add user documentation for Enricher on apex docs

Chinmay Kolhatkar created APEXMALHAR-2153: - Summary: Add user documentation for Enricher on apex docs Key: APEXMALHAR-2153 URL: https://issues.apache.org/jira/browse/APEXMALHAR-2153 Project:

[jira] [Created] (APEXMALHAR-2152) Enricher - Add fixed length file format support to FSLoader

Chinmay Kolhatkar created APEXMALHAR-2152: - Summary: Enricher - Add fixed length file format support to FSLoader Key: APEXMALHAR-2152 URL: https://issues.apache.org/jira/browse/APEXMALHAR-2152

[jira] [Created] (APEXMALHAR-2151) Enricher - Add delimited file format support to FSLoader

Chinmay Kolhatkar created APEXMALHAR-2151: - Summary: Enricher - Add delimited file format support to FSLoader Key: APEXMALHAR-2151 URL: https://issues.apache.org/jira/browse/APEXMALHAR-2151