[ANNOUNCE] Apache Apex Core 3.4.0 released

The Apache Apex community is pleased to announce release 3.4.0 (Apex Core). This is the first release after graduation. It adds the support for (anti-)affinity of operators, several documentation and other improvements and important bug fixes. The release has 63 resolved JIRAs. There is a

Re: YARN memory settings and the Apex memory model

Ananth, Please have a look at: http://docs.datatorrent.com/troubleshooting/#configuring-memory Thanks, Thomas On Thu, May 12, 2016 at 4:00 AM, Ananth Gundabattula < agundabatt...@gmail.com> wrote: > Thanks Shubham. I shall bump up the memory a bit more. > > I was wondering how the operator

Re: Set schemaRequired differently on different operator implementations

;> Okay. I tried this using dummy classes. But if the behaviour is >>> different in case of ports in Apex, then it might solve the problem. >>> I'll try it out. >>> >>> Thanks. >>> ~Bhupesh >>> >>> On Mon, May 2, 2016 at 5

Re: Set schemaRequired differently on different operator implementations

Yes, you can override the port with a new port field with the same name. On Mon, May 2, 2016 at 4:22 PM, Bhupesh Chawda wrote: > Hi All, > > I have a base operator which is parametrized: > > > > *class OperatorBase extends BaseOperator{* > > *public final transient

Apache Apex announced as Top-Level Project

Dear Community, Apex graduation was approved by the ASF board last week and the announcement went out this morning: https://blogs.apache.org/foundation/entry/the_apache _software_foundation_announces90 https://twitter.com/TheASF/status/724538689993474048 Congratulations everyone and we are

Re: Error finding KafkaSinglePortStringInputOperator (NoClassDefFoundError)

Suhas, Do not copy any operator libraries into the lib folder. These dependencies need to be packaged with the application into the .apa application package. The .apa will also need to contain the Kafka dependencies. Can you please share what .jar files are in your app package (unzip -l

Re: Kinesis Operator Help

Ram, The recovery path, when under the application directory, will be automatically copied to the new app directory when relaunch option is used. This is how the previous instance data is available to the new app. Thomas On Tue, Feb 16, 2016 at 5:23 PM, Munagala Ramanath

Re: What is the backpressure story ?

That's incorrect. Backpressure works when spooling is enabled (which is default). It's not handled only when you turn spooling off explicitly. On Sun, Jan 31, 2016 at 3:50 PM, Sandesh Hegde wrote: > According to Vlad, disabling the spooling will crash the buffer server

Re: read from multiple kafka topics

The new operator for Kafka 0.9 can read multiple topics. On Wed, Jan 27, 2016 at 5:02 PM, Munagala Ramanath wrote: > Since a single AbstractKafkaInputOperator has a single KafkaConsumer and > the latter has only a single topic, > it appears that the only option is to have

Re: Stateless operator and Properties

Properties are part of the operator state. So if the intention is to change properties after the application was launched the operator cannot be marked stateless. On Fri, Jan 22, 2016 at 9:11 AM, Sandesh Hegde wrote: > Hello Team, > > Is it possible mark the operators

Re: Making inherited operator port optional

You should be able to override the port. On Thu, Jan 21, 2016 at 7:18 AM, Munagala Ramanath wrote: > In OutputPortFieldAnnotation.java we have this: > > public boolean optional() default true; > > So looks like output ports are optional by default. If A annotates the >