Re: Restricting emit speed of AbstractFileInputOperator.

Oh Okay. i couldn't find this mentioned clearly in the docs, that is why I misinterpreted it. Thank You. On Sat, Apr 8, 2017 at 7:23 AM, Bhupesh Chawda wrote: > I think the understanding is wrong. > > Platform calls emitTuples multiple times in a window. This number is

Re: Restricting emit speed of AbstractFileInputOperator.

I think the understanding is wrong. Platform calls emitTuples multiple times in a window. This number is unknown; it depends on the window time. We can limit this to x. emitBatchSize controls the number of tuples emitted in one such call. Set this to 1. This should result in at most x tuples

Re: Restricting emit speed of AbstractFileInputOperator.

Hello Bhupesh Sir, But does that mean I am emitting only 'x' lines from the file?. Because from what I understood, emitTuples() emits multiple lines in a single call and emitBatchSize controls number of times emitTuples is called in a window. Am I right?. I inferred this from the following The

apex on emr?

Hey guys, Any of you running Apex in production on EMR? -- Regards, Ashwin.

Re: Restricting emit speed of AbstractFileInputOperator.

Ambarish, What you are asking for would be useful for others as well. Would you mind contributing this change to the community? If you are interested, please create JIRA on https://issues.apache.org/jira/browse/APEXMALHAR for your request. For any dev discussions, please use dev@apex mailing

Re: Setting variables of Application class using properties.xml

oh. Got it. Thank You.

Re: Setting variables of Application class using properties.xml

You can access properties defined in properties.xml in populateDAG. You can set variables Application.java by reading conf in populateDAG() ~ Yogi On 7 April 2017 at 11:02, Ambarish Pande wrote: > Hello, > > Is there a way by which i can set some variable

Setting variables of Application class using properties.xml

Hello, Is there a way by which i can set some variable declared in my Application.java through properties.xml. I know i can set Operator variables using properties.xml like dt.app.operator.prop. I want to do the same thing to set a variable of my Application Class which has the populateDag