[jira] [Created] (APEXMALHAR-2363) Kafka input operator needs a force exit in case it can't recover from application offsets

Siyuan Hua created APEXMALHAR-2363: -- Summary: Kafka input operator needs a force exit in case it can't recover from application offsets Key: APEXMALHAR-2363 URL: https://issues.apache.org/jira/browse/APEXMALHAR

Re: [VOTE] Apache Apex Malhar Release 3.6.0 (RC1)

+1 Verified checksums Verified compilation Verified build and test Verified pi demo On Wed, Nov 30, 2016 at 9:50 AM, Tushar Gosavi wrote: > +1 > > Verified checksums > Verified compilation > > - Tushar. > > > On Wed, Nov 30, 2016 at 7:43 PM, Thomas Weise

Re: Malhar release 3.6

> wrote: > > > > > > > >> Hi Thomas, > > > >> > > > >>I am working on APEXMALHAR-2284 and will open a PR in couple of > > days. > > > >> > > > >> Regards, > > > >> Chaitanya > > > >

[jira] [Commented] (APEXMALHAR-2301) Implement another TimeBucketAssigner to work with any time

[ https://issues.apache.org/jira/browse/APEXMALHAR-2301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15682657#comment-15682657 ] Siyuan Hua commented on APEXMALHAR-2301: Ok, there are couple things here, the current

Re: [DISCUSSION] Custom Control Tuples

I will vote for approach 1. First of all that one sounds easier to do to me. And I think idempotency is important. It may run at the cost of higher latency but I think it is ok And in addition, when in the future if users do need realtime control tuple processing, we can always add the option on

Re: Malhar release 3.6

+1 Thanks！ Sent from my iPhone > On Oct 26, 2016, at 13:11, Thomas Weise wrote: > > Hi, > > I'm proposing another release of Malhar in November. There are 49 issues > marked for the release, including important bug fixes, new documentation, > SQL support and the work for

[jira] [Updated] (APEXMALHAR-2203) Control tuple port and watermark support in high-level API (version 1)

[ https://issues.apache.org/jira/browse/APEXMALHAR-2203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyuan Hua updated APEXMALHAR-2203: --- Summary: Control tuple port and watermark support in high-level API (version 1

[jira] [Commented] (APEXMALHAR-2203) Control tuple port and watermark support in high-level API (version 1)

[ https://issues.apache.org/jira/browse/APEXMALHAR-2203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15592494#comment-15592494 ] Siyuan Hua commented on APEXMALHAR-2203: Support _single_ control tuple port Support both

Make cli support high-level API and SQL

Given we already have first version of high-level API and SQL PR is getting close to be merged. And also we have ability to launch application grammatically. I think it's nice to have our cli support both high-level API and SQL directly so people can simply prototype what they need and/or try out

[jira] [Created] (APEXMALHAR-2301) Implement another TimeBucketAssigner to work with any time

Siyuan Hua created APEXMALHAR-2301: -- Summary: Implement another TimeBucketAssigner to work with any time Key: APEXMALHAR-2301 URL: https://issues.apache.org/jira/browse/APEXMALHAR-2301 Project

[jira] [Commented] (APEXMALHAR-2220) Move the FunctionOperator to Malhar library

[ https://issues.apache.org/jira/browse/APEXMALHAR-2220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15573091#comment-15573091 ] Siyuan Hua commented on APEXMALHAR-2220: [~d9liang] The malhar-library should be depends

[jira] [Commented] (APEXMALHAR-2283) Refactor kafka output operator

[ https://issues.apache.org/jira/browse/APEXMALHAR-2283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15569248#comment-15569248 ] Siyuan Hua commented on APEXMALHAR-2283: There are couple of solutions to "exactly

[jira] [Updated] (APEXMALHAR-2283) Refactor kafka output operator

[ https://issues.apache.org/jira/browse/APEXMALHAR-2283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyuan Hua updated APEXMALHAR-2283: --- Assignee: Siyuan Hua > Refactor kafka output opera

[jira] [Updated] (APEXMALHAR-2283) Refactor kafka output operator

[ https://issues.apache.org/jira/browse/APEXMALHAR-2283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyuan Hua updated APEXMALHAR-2283: --- Description: The abstract kafka output operator needs to be refactored 1. Needs to set

Many FileSplitterInputTest.testRecoveryOfPartialFile test failures

There are many com.datatorrent.lib.io.fs.FileSplitterInputTest. testRecoveryOfPartialFile test failures in Jenkins CI

[jira] [Commented] (APEXMALHAR-2276) ManagedState: value of a key does not get over-written in the same time bucket

[ https://issues.apache.org/jira/browse/APEXMALHAR-2276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15546598#comment-15546598 ] Siyuan Hua commented on APEXMALHAR-2276: Time will be mapped to a time bucket anyways

[jira] [Commented] (APEXMALHAR-2220) Move the FunctionOperator to Malhar library

[ https://issues.apache.org/jira/browse/APEXMALHAR-2220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15543057#comment-15543057 ] Siyuan Hua commented on APEXMALHAR-2220: Sorry, I mean org.apache.apex.malhar.lib.function

[jira] [Commented] (APEXMALHAR-2220) Move the FunctionOperator to Malhar library

[ https://issues.apache.org/jira/browse/APEXMALHAR-2220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15542972#comment-15542972 ] Siyuan Hua commented on APEXMALHAR-2220: Maybe call them com.datatorrent.lib.function

[jira] [Created] (APEXMALHAR-2275) ManagedTimeUnifiedStateImpl doesn't support time events properly

Siyuan Hua created APEXMALHAR-2275: -- Summary: ManagedTimeUnifiedStateImpl doesn't support time events properly Key: APEXMALHAR-2275 URL: https://issues.apache.org/jira/browse/APEXMALHAR-2275 Project

[jira] [Created] (APEXMALHAR-2276) ManagedTimeUnifiedStateImpl doesn't support time events properly

Siyuan Hua created APEXMALHAR-2276: -- Summary: ManagedTimeUnifiedStateImpl doesn't support time events properly Key: APEXMALHAR-2276 URL: https://issues.apache.org/jira/browse/APEXMALHAR-2276 Project

[jira] [Resolved] (APEXMALHAR-2267) Remove the word "Byte" in the spillable data structures because it's implied

[ https://issues.apache.org/jira/browse/APEXMALHAR-2267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyuan Hua resolved APEXMALHAR-2267. Resolution: Fixed > Remove the word "Byte" in the spillable data struc

[jira] [Resolved] (APEXMALHAR-2130) Scalable windowed storage

[ https://issues.apache.org/jira/browse/APEXMALHAR-2130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyuan Hua resolved APEXMALHAR-2130. Resolution: Fixed > Scalable windowed stor

[jira] [Reopened] (APEXMALHAR-2130) Scalable windowed storage

[ https://issues.apache.org/jira/browse/APEXMALHAR-2130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyuan Hua reopened APEXMALHAR-2130: > Scalable windowed storage > - > >

[jira] [Updated] (APEXMALHAR-2130) Scalable windowed storage

[ https://issues.apache.org/jira/browse/APEXMALHAR-2130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyuan Hua updated APEXMALHAR-2130: --- Fix Version/s: 3.6.0 > Scalable windowed stor

[jira] [Commented] (APEXMALHAR-2230) Intermittent test failure in Kafka module

[ https://issues.apache.org/jira/browse/APEXMALHAR-2230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15526808#comment-15526808 ] Siyuan Hua commented on APEXMALHAR-2230: Another test failure that could be useful

[jira] [Resolved] (APEXMALHAR-2248) Create SpillableSet and SpillableSetMultimap interfaces and implementation

[ https://issues.apache.org/jira/browse/APEXMALHAR-2248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyuan Hua resolved APEXMALHAR-2248. Resolution: Fixed > Create SpillableSet and SpillableSetMultimap interfa

[jira] [Updated] (APEXMALHAR-2248) Create SpillableSet and SpillableSetMultimap interfaces and implementation

[ https://issues.apache.org/jira/browse/APEXMALHAR-2248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyuan Hua updated APEXMALHAR-2248: --- Fix Version/s: 3.6.0 > Create SpillableSet and SpillableSetMultimap interfa

[jira] [Commented] (APEXMALHAR-2244) Optimize WindowedStorage and Spillable data structures for time series

[ https://issues.apache.org/jira/browse/APEXMALHAR-2244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15513770#comment-15513770 ] Siyuan Hua commented on APEXMALHAR-2244: Each spillable DS implementation use

[jira] [Updated] (APEXMALHAR-2253) Iterator for spillable data structure should throw ConcurrentModificationException during the iteration

[ https://issues.apache.org/jira/browse/APEXMALHAR-2253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyuan Hua updated APEXMALHAR-2253: --- Assignee: David Yan > Iterator for spillable data structure should th

[jira] [Created] (APEXMALHAR-2253) Iterator for spillable data structure should throw ConcurrentModificationException during the iteration

Siyuan Hua created APEXMALHAR-2253: -- Summary: Iterator for spillable data structure should throw ConcurrentModificationException during the iteration Key: APEXMALHAR-2253 URL: https://issues.apache.org/jira

[jira] [Commented] (APEXMALHAR-2241) The metadata kafka consumer should also pickup the properties setting on the kafka input operator.

[ https://issues.apache.org/jira/browse/APEXMALHAR-2241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15496632#comment-15496632 ] Siyuan Hua commented on APEXMALHAR-2241: Hey [~Venkatesh Kottapalli] Would you like to fix

[jira] [Created] (APEXMALHAR-2241) The metadata kafka consumer should also pickup the properties setting on the kafka input operator.

Siyuan Hua created APEXMALHAR-2241: -- Summary: The metadata kafka consumer should also pickup the properties setting on the kafka input operator. Key: APEXMALHAR-2241 URL: https://issues.apache.org/jira/browse

[jira] [Updated] (APEXMALHAR-2241) The metadata kafka consumer should also pickup the properties setting on the kafka input operator.

[ https://issues.apache.org/jira/browse/APEXMALHAR-2241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyuan Hua updated APEXMALHAR-2241: --- Assignee: Venkatesh Kottapalli > The metadata kafka consumer should also pic

[jira] [Commented] (APEXMALHAR-2230) Intermittent test failure in Kafka module

[ https://issues.apache.org/jira/browse/APEXMALHAR-2230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15491639#comment-15491639 ] Siyuan Hua commented on APEXMALHAR-2230: Good news is this time we can be sure

[jira] [Commented] (APEXMALHAR-2230) Intermittent test failure in Kafka module

[ https://issues.apache.org/jira/browse/APEXMALHAR-2230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15491628#comment-15491628 ] Siyuan Hua commented on APEXMALHAR-2230: The code looks impossible to receive extra END_TUPLE

[jira] [Created] (APEXCORE-529) Support annotation to automate lifecycle callbacks like setup() teardown() etc

Siyuan Hua created APEXCORE-529: --- Summary: Support annotation to automate lifecycle callbacks like setup() teardown() etc Key: APEXCORE-529 URL: https://issues.apache.org/jira/browse/APEXCORE-529

Re: [ANNOUNCE] New Apache Apex PMC Member: Chandni Singh

Congrats Chandni! Regards, Siyuan On Mon, Sep 12, 2016 at 9:33 AM, Thomas Weise wrote: > The Apache Apex PMC is pleased to announce that Chandni Singh is now a PMC > member. We appreciate all her contributions to the project so far, and are > looking forward to more. > >

[jira] [Commented] (APEXMALHAR-2230) Intermittent test failure in Kafka module

[ https://issues.apache.org/jira/browse/APEXMALHAR-2230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15474990#comment-15474990 ] Siyuan Hua commented on APEXMALHAR-2230: Not necessarily related to Kafka. This is caused

[jira] [Assigned] (APEXMALHAR-2230) Intermittent test failure in Kafka module

[ https://issues.apache.org/jira/browse/APEXMALHAR-2230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyuan Hua reassigned APEXMALHAR-2230: -- Assignee: Siyuan Hua > Intermittent test failure in Kafka mod

[jira] [Commented] (APEXMALHAR-2220) Move the FunctionOperator to Malhar library

[ https://issues.apache.org/jira/browse/APEXMALHAR-2220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15468074#comment-15468074 ] Siyuan Hua commented on APEXMALHAR-2220: [~d9liang] The function operators are all under

[jira] [Updated] (APEXMALHAR-2220) Move the FunctionOperator to Malhar library

[ https://issues.apache.org/jira/browse/APEXMALHAR-2220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyuan Hua updated APEXMALHAR-2220: --- Assignee: Dongming Liang (was: Siyuan Hua) > Move the FunctionOperator to Mal

[jira] [Created] (APEXMALHAR-2220) Move the FunctionOperator to Malhar library

Siyuan Hua created APEXMALHAR-2220: -- Summary: Move the FunctionOperator to Malhar library Key: APEXMALHAR-2220 URL: https://issues.apache.org/jira/browse/APEXMALHAR-2220 Project: Apache Apex Malhar

[jira] [Updated] (APEXMALHAR-2142) High-level API window support

[ https://issues.apache.org/jira/browse/APEXMALHAR-2142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyuan Hua updated APEXMALHAR-2142: --- Attachment: Java-High-level-API-Siyuan.pdf Apache Beam AutoComplete

[jira] [Updated] (APEXMALHAR-1939) Stream API

[ https://issues.apache.org/jira/browse/APEXMALHAR-1939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyuan Hua updated APEXMALHAR-1939: --- Attachment: Java-High-level-API-Siyuan.pdf Apache Beam AutoComplete

[jira] [Created] (APEXMALHAR-2217) Remove some redundant code in WindowedStorage and WindowedKeyedStorage

Siyuan Hua created APEXMALHAR-2217: -- Summary: Remove some redundant code in WindowedStorage and WindowedKeyedStorage Key: APEXMALHAR-2217 URL: https://issues.apache.org/jira/browse/APEXMALHAR-2217

Re: [VOTE] Apache Apex Malhar Release 3.5.0 (RC2)

+1 File integrity check Build and license check Pi-demo for 10min All above look good Thanks, Siyuan On Tue, Aug 30, 2016 at 11:37 PM, Thomas Weise wrote: > Dear Community, > > Please vote on the following Apache Apex Malhar 3.5.0 release candidate. > > RC2 fixes the copyright

Re: [VOTE] Apache Apex Malhar Release 3.5.0 (RC1)

+1 Checked for - File integration - Source code verification - Check for compilation and license - Run pi demo for 10 min On Sun, Aug 28, 2016 at 9:59 PM, Thomas Weise wrote: > Dear Community, > > Please vote on the following Apache Apex Malhar 3.5.0 release candidate.

[jira] [Updated] (APEXMALHAR-2214) Use tuple internally so it can carry over the window semantics

[ https://issues.apache.org/jira/browse/APEXMALHAR-2214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyuan Hua updated APEXMALHAR-2214: --- Assignee: Siyuan Hua > Use tuple internally so it can carry over the window semant

[jira] [Created] (APEXMALHAR-2214) Use tuple internally so it can carry over the window semantics

Siyuan Hua created APEXMALHAR-2214: -- Summary: Use tuple internally so it can carry over the window semantics Key: APEXMALHAR-2214 URL: https://issues.apache.org/jira/browse/APEXMALHAR-2214 Project

[jira] [Created] (APEXMALHAR-2213) Refactor Stream API to make it easier to specify keys for keyed transformation

Siyuan Hua created APEXMALHAR-2213: -- Summary: Refactor Stream API to make it easier to specify keys for keyed transformation Key: APEXMALHAR-2213 URL: https://issues.apache.org/jira/browse/APEXMALHAR-2213

[jira] [Created] (APEXMALHAR-2212) Tuple codec to make application build by High-level api more efficient

Siyuan Hua created APEXMALHAR-2212: -- Summary: Tuple codec to make application build by High-level api more efficient Key: APEXMALHAR-2212 URL: https://issues.apache.org/jira/browse/APEXMALHAR-2212

[jira] [Closed] (APEXMALHAR-2134) Catch NullPointerException if some Kafka partition has no leader broker

[ https://issues.apache.org/jira/browse/APEXMALHAR-2134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyuan Hua closed APEXMALHAR-2134. -- Resolution: Fixed > Catch NullPointerException if some Kafka partition has no lea

[jira] [Created] (APEXMALHAR-2208) High-level API beam examples

Siyuan Hua created APEXMALHAR-2208: -- Summary: High-level API beam examples Key: APEXMALHAR-2208 URL: https://issues.apache.org/jira/browse/APEXMALHAR-2208 Project: Apache Apex Malhar Issue

[jira] [Closed] (APEXMALHAR-2208) High-level API beam examples

[ https://issues.apache.org/jira/browse/APEXMALHAR-2208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyuan Hua closed APEXMALHAR-2208. -- Resolution: Fixed > High-level API beam examp

[jira] [Updated] (APEXMALHAR-2199) 0.8 kafka input operator doesn't support chroot zookeeper path (multitenant kafka support)

[ https://issues.apache.org/jira/browse/APEXMALHAR-2199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyuan Hua updated APEXMALHAR-2199: --- Affects Version/s: (was: 3.4.0) > 0.8 kafka input operator doesn't support chr

[jira] [Updated] (APEXMALHAR-2199) 0.8 kafka input operator doesn't support chroot zookeeper path (multitenant kafka support)

[ https://issues.apache.org/jira/browse/APEXMALHAR-2199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyuan Hua updated APEXMALHAR-2199: --- Assignee: Siyuan Hua (was: Chaitanya) > 0.8 kafka input operator doesn't support chr

[jira] [Commented] (APEXMALHAR-2154) Update kafka 0.9 input operator to use new CheckpointNotificationListener

[ https://issues.apache.org/jira/browse/APEXMALHAR-2154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15437102#comment-15437102 ] Siyuan Hua commented on APEXMALHAR-2154: I don't think so > Update kafka 0.9 in

[jira] [Commented] (APEXMALHAR-2199) 0.8 kafka input operator doesn't support chroot zookeeper path (multitenant kafka support)

[ https://issues.apache.org/jira/browse/APEXMALHAR-2199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15435402#comment-15435402 ] Siyuan Hua commented on APEXMALHAR-2199: 0.9 operator should not have this problem >

[jira] [Commented] (APEXMALHAR-2199) 0.8 kafka input operator doesn't support chroot zookeeper path (multitenant kafka support)

[ https://issues.apache.org/jira/browse/APEXMALHAR-2199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15435399#comment-15435399 ] Siyuan Hua commented on APEXMALHAR-2199: [~chaithu] Can you please take a look? The bug

[jira] [Updated] (APEXMALHAR-2199) 0.8 kafka input operator doesn't support chroot zookeeper path (multitenant kafka support)

[ https://issues.apache.org/jira/browse/APEXMALHAR-2199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyuan Hua updated APEXMALHAR-2199: --- Affects Version/s: 3.5.0 3.4.0 > 0.8 kafka input operator does

[jira] [Created] (APEXMALHAR-2199) 0.8 kafka input operator doesn't support chroot zookeeper path (multitenant kafka support)

Siyuan Hua created APEXMALHAR-2199: -- Summary: 0.8 kafka input operator doesn't support chroot zookeeper path (multitenant kafka support) Key: APEXMALHAR-2199 URL: https://issues.apache.org/jira/browse/APEXMALHAR

[jira] [Updated] (APEXMALHAR-2180) KafkaInput Operator partitions has to be unchanged in case of dynamic scaling of ONE_TO_MANY strategy.

[ https://issues.apache.org/jira/browse/APEXMALHAR-2180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyuan Hua updated APEXMALHAR-2180: --- Fix Version/s: 3.5.0 > KafkaInput Operator partitions has to be unchanged in c

[jira] [Resolved] (APEXMALHAR-2180) KafkaInput Operator partitions has to be unchanged in case of dynamic scaling of ONE_TO_MANY strategy.

[ https://issues.apache.org/jira/browse/APEXMALHAR-2180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyuan Hua resolved APEXMALHAR-2180. Resolution: Fixed > KafkaInput Operator partitions has to be unchanged in c

[jira] [Resolved] (APEXMALHAR-2169) KafkaInputoperator: Remove the stuff related to Partition Based on throughput.

[ https://issues.apache.org/jira/browse/APEXMALHAR-2169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyuan Hua resolved APEXMALHAR-2169. Resolution: Fixed > KafkaInputoperator: Remove the stuff related to Partition Ba

[jira] [Updated] (APEXMALHAR-2169) KafkaInputoperator: Remove the stuff related to Partition Based on throughput.

[ https://issues.apache.org/jira/browse/APEXMALHAR-2169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyuan Hua updated APEXMALHAR-2169: --- Fix Version/s: 3.5.0 > KafkaInputoperator: Remove the stuff related to Partition Ba

[jira] [Updated] (APEXMALHAR-2154) Update kafka 0.9 input operator to use new CheckpointNotificationListener

[ https://issues.apache.org/jira/browse/APEXMALHAR-2154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyuan Hua updated APEXMALHAR-2154: --- Fix Version/s: 3.5.0 > Update kafka 0.9 input operator to use

[jira] [Resolved] (APEXMALHAR-2154) Update kafka 0.9 input operator to use new CheckpointNotificationListener

[ https://issues.apache.org/jira/browse/APEXMALHAR-2154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyuan Hua resolved APEXMALHAR-2154. Resolution: Fixed > Update kafka 0.9 input operator to use

[jira] [Updated] (APEXMALHAR-2168) The setter method for double field is not generated correctly in JdbcPOJOInputOperator.

[ https://issues.apache.org/jira/browse/APEXMALHAR-2168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyuan Hua updated APEXMALHAR-2168: --- Summary: The setter method for double field is not generated correctly

[jira] [Updated] (APEXMALHAR-2168) The in JdbcPOJOInputOperator.

[ https://issues.apache.org/jira/browse/APEXMALHAR-2168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyuan Hua updated APEXMALHAR-2168: --- Summary: The in JdbcPOJOInputOperator. (was: Bug Found in JdbcPOJOInputOperator

[jira] [Updated] (APEXMALHAR-2154) Update kafka 0.9 input operator to use new CheckpointNotificationListener

[ https://issues.apache.org/jira/browse/APEXMALHAR-2154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyuan Hua updated APEXMALHAR-2154: --- Fix Version/s: (was: 3.5.0) > Update kafka 0.9 input operator to use

[jira] [Updated] (APEXMALHAR-2154) Update kafka 0.9 input operator to use new CheckpointNotificationListener

[ https://issues.apache.org/jira/browse/APEXMALHAR-2154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyuan Hua updated APEXMALHAR-2154: --- Assignee: Chaitanya (was: Siyuan Hua) > Update kafka 0.9 input operator to use

[jira] [Created] (APEXMALHAR-2186) Configurable start offset for kafka input operator (0.9)

Siyuan Hua created APEXMALHAR-2186: -- Summary: Configurable start offset for kafka input operator (0.9) Key: APEXMALHAR-2186 URL: https://issues.apache.org/jira/browse/APEXMALHAR-2186 Project: Apache

[jira] [Updated] (APEXMALHAR-2186) Configurable start offset for kafka input operator (0.9)

[ https://issues.apache.org/jira/browse/APEXMALHAR-2186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyuan Hua updated APEXMALHAR-2186: --- Issue Type: Improvement (was: Bug) > Configurable start offset for kafka input opera

[jira] [Updated] (APEXMALHAR-2168) Bug Found in JdbcPOJOInputOperator.

[ https://issues.apache.org/jira/browse/APEXMALHAR-2168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyuan Hua updated APEXMALHAR-2168: --- Fix Version/s: 3.5.0 > Bug Found in JdbcPOJOInputOpera

[jira] [Commented] (APEXMALHAR-2028) Add System.err to ConsoleOutputOperator

[ https://issues.apache.org/jira/browse/APEXMALHAR-2028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15415943#comment-15415943 ] Siyuan Hua commented on APEXMALHAR-2028: For high-level API as well > Add System.

[jira] [Commented] (APEXMALHAR-2169) KafkaInputOperator: Dynamic partition is not working in case of ONE_TO_MANY partition strategy

[ https://issues.apache.org/jira/browse/APEXMALHAR-2169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15411388#comment-15411388 ] Siyuan Hua commented on APEXMALHAR-2169: [~chaithu] Then I think the problem

[jira] [Commented] (APEXMALHAR-2169) KafkaInputOperator: Dynamic partition is not working in case of ONE_TO_MANY partition strategy

[ https://issues.apache.org/jira/browse/APEXMALHAR-2169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1546#comment-1546 ] Siyuan Hua commented on APEXMALHAR-2169: [~chaithu] I'm still not convinced. In your setup

[jira] [Commented] (APEXMALHAR-2169) KafkaInputOperator: Dynamic partition is not working in case of ONE_TO_MANY partition strategy

[ https://issues.apache.org/jira/browse/APEXMALHAR-2169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15396353#comment-15396353 ] Siyuan Hua commented on APEXMALHAR-2169: [~chaithu] Can you elaborate more on this ticket

[jira] [Commented] (APEXMALHAR-2168) Bug Found in JdbcPOJOInputOperator.

[ https://issues.apache.org/jira/browse/APEXMALHAR-2168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15394635#comment-15394635 ] Siyuan Hua commented on APEXMALHAR-2168: Hey [~shubhamp], [~lushun...@gmail.com] found a bug

[jira] [Created] (APEXMALHAR-2165) Implement a useful default Partitioner and/or Unifier for Keyed Windowed Operator

Siyuan Hua created APEXMALHAR-2165: -- Summary: Implement a useful default Partitioner and/or Unifier for Keyed Windowed Operator Key: APEXMALHAR-2165 URL: https://issues.apache.org/jira/browse/APEXMALHAR-2165

Re: Using DSL api to construct sql queries

But is it a duplication of integration with Calcite? On Thu, Jul 21, 2016 at 9:26 AM, Timothy Farkas < timothytiborfar...@gmail.com> wrote: > I see, cool :) > > On Thu, Jul 21, 2016 at 9:21 AM, Priyanka Gugale > wrote: > > > Hi Tim, > > > > We are not creating our own DSL,

Re: Bleeding edge branch ?

Ok, whether branches or forks. I still think we should have at least some materialized version of malhar/core for the big influencer like java, hadoop or even kafka. Java 8, for example, is actually not new. We don't have to be aggressive to try out new features from those right now. But we can

[jira] [Updated] (APEXMALHAR-2135) Upgrade Kafka 0.8 input operator to support 0.8.2 client

[ https://issues.apache.org/jira/browse/APEXMALHAR-2135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyuan Hua updated APEXMALHAR-2135: --- Fix Version/s: 3.5.0 > Upgrade Kafka 0.8 input operator to support 0.8.2 cli

The first cut of high-level API for windowed transform is ready, please review

The first cut of high-level API for windowed transform is ready, please review. https://github.com/apache/apex-malhar/pull/339 Thanks! Regards, Siyuan

[jira] [Created] (APEXCORE-492) The exception from ExitCondition should not be swallowed

Siyuan Hua created APEXCORE-492: --- Summary: The exception from ExitCondition should not be swallowed Key: APEXCORE-492 URL: https://issues.apache.org/jira/browse/APEXCORE-492 Project: Apache Apex Core

[jira] [Created] (APEXMALHAR-2154) Update kafka 0.9 input operator to use new CheckpointNotificationListener

Siyuan Hua created APEXMALHAR-2154: -- Summary: Update kafka 0.9 input operator to use new CheckpointNotificationListener Key: APEXMALHAR-2154 URL: https://issues.apache.org/jira/browse/APEXMALHAR-2154

[jira] [Created] (APEXMALHAR-2155) Make high-level api support multiple ports

Siyuan Hua created APEXMALHAR-2155: -- Summary: Make high-level api support multiple ports Key: APEXMALHAR-2155 URL: https://issues.apache.org/jira/browse/APEXMALHAR-2155 Project: Apache Apex Malhar

[jira] [Updated] (APEXMALHAR-2149) ApexStream.filter() not working properly.

[ https://issues.apache.org/jira/browse/APEXMALHAR-2149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyuan Hua updated APEXMALHAR-2149: --- Assignee: Shunxin Lu > ApexStream.filter() not working prope

[jira] [Created] (APEXMALHAR-2148) Reduce the noise of kafka input operator

Siyuan Hua created APEXMALHAR-2148: -- Summary: Reduce the noise of kafka input operator Key: APEXMALHAR-2148 URL: https://issues.apache.org/jira/browse/APEXMALHAR-2148 Project: Apache Apex Malhar

[jira] [Commented] (APEXMALHAR-2142) High-level API window support

[ https://issues.apache.org/jira/browse/APEXMALHAR-2142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15373783#comment-15373783 ] Siyuan Hua commented on APEXMALHAR-2142: https://github.com/apache/apex-malhar/pull/339

[jira] [Commented] (APEXMALHAR-2142) High-level API window support

[ https://issues.apache.org/jira/browse/APEXMALHAR-2142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15373760#comment-15373760 ] Siyuan Hua commented on APEXMALHAR-2142: Basically use windowed operator to do windowed

[jira] [Created] (APEXMALHAR-2142) High-level API window support

Siyuan Hua created APEXMALHAR-2142: -- Summary: High-level API window support Key: APEXMALHAR-2142 URL: https://issues.apache.org/jira/browse/APEXMALHAR-2142 Project: Apache Apex Malhar Issue

[jira] [Commented] (APEXMALHAR-2141) An efficient Accumulation interface for primitive type

[ https://issues.apache.org/jira/browse/APEXMALHAR-2141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15373694#comment-15373694 ] Siyuan Hua commented on APEXMALHAR-2141: A stateless accumulation vs stateful accumulation

[jira] [Created] (APEXMALHAR-2141) An efficient Accumulation interface for primitive type

Siyuan Hua created APEXMALHAR-2141: -- Summary: An efficient Accumulation interface for primitive type Key: APEXMALHAR-2141 URL: https://issues.apache.org/jira/browse/APEXMALHAR-2141 Project: Apache

Re: Bleeding edge branch ?

+1 On Mon, Jul 11, 2016 at 8:59 AM, Munagala Ramanath wrote: > We've had a number of issues recently related to dependencies on old > versions > of various packages/libraries such as Hadoop itself, Google guava, > HTTPClient, > mbassador, etc. > > How about we create a

Re: Windowed Operator PR

+1 We should merge this ASAP. I don't think we could solve all the problems in one PR and I think David's PR is good enough that we can keep working on this incrementally and in parallel. Regards, Siyuan On Fri, Jul 8, 2016 at 4:10 PM, David Yan wrote: > Hi all, > > The

[jira] [Created] (APEXMALHAR-2135) Upgrade Kafka 0.8 input operator to support both 0.8.1 and 0.8.2

Siyuan Hua created APEXMALHAR-2135: -- Summary: Upgrade Kafka 0.8 input operator to support both 0.8.1 and 0.8.2 Key: APEXMALHAR-2135 URL: https://issues.apache.org/jira/browse/APEXMALHAR-2135 Project

Suggestions for WindowedStream interface in the next phase

Hi Community, Right now, the WindowedStream in the pull request has following "window" transformations: count countByKey top topByKey combine combineByKey fold foldByKey group groupByKey Do you have other suggestions that are nice to have in the WindowedStream interface. Also I think it might

[jira] [Created] (APEXMALHAR-2132) Rename Manifest attributes from DT-App-xxxx to Apex-App-xxxx

Siyuan Hua created APEXMALHAR-2132: -- Summary: Rename Manifest attributes from DT-App- to Apex-App- Key: APEXMALHAR-2132 URL: https://issues.apache.org/jira/browse/APEXMALHAR-2132 Project

[jira] [Closed] (APEXMALHAR-2131) Change the default container log name from dt.log to apex.log

[ https://issues.apache.org/jira/browse/APEXMALHAR-2131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyuan Hua closed APEXMALHAR-2131. -- Resolution: Won't Fix Sorry wrong project name > Change the default container log n

  1   2   >