Re: I can't deploy my application package

Guiherme, This is DataTorrent specific question. You should take it up on DataTorrent user list. Thks, Amol E:a...@datatorrent.com | M: 510-449-2606 | Twitter: @*amolhkekre* www.datatorrent.com On Tue, Jun 27, 2017 at 2:07 PM, Guilherme Hott wrote: > Hi guys, I am

Re: Is there a way to schedule an operator?

The only thing missing is to kick off a job, in case the ask is to use resources the batch way "use and terminate once done". An operator that keeps an eye and has ability to kick off a job suffices. Kicking off a batch job can be done via any of the following 1. Files -> Start post all data

Re: how to decide no of operator partitions

Rishi, How much time elapses between old app and new app? It may an issue of resource needs to catch up. Have you benchmarked your operators/app? Thks Amol E:a...@datatorrent.com | M: 510-449-2606 | Twitter: @*amolhkekre* www.datatorrent.com On Sun, May 7, 2017 at 11:02 AM, rishi

Re: Wait until setup completes prior to dag execution

ps thread local could work.. > > ~ Bhupesh > > > ___ > > Bhupesh Chawda > > E: bhup...@datatorrent.com | Twitter: @bhupeshsc > > www.datatorrent.com | apex.apache.org > > > > On Sat, Apr 22, 201

Re: Wait until setup completes prior to dag execution

lin, Ilya wrote: > > Yes, Amol – basically wanted to know how to sensibly handle the case where > there’s a big back-buffer to work through. > > > > - Ilya Ganelin > > [image: id:image001.png@01D1F7A4.F3D42980] > > > > *From: *Amol Kekre <a...@datatorrent.com> <

Re: JSONObject Error when attempting to configure properties in UI

Ilya, This question should be on datatorrent users alias. I am moving apex@users to bcc Thks Amol E:a...@datatorrent.com | M: 510-449-2606 | Twitter: @*amolhkekre* www.datatorrent.com On Tue, Apr 18, 2017 at 3:19 PM, Ganelin, Ilya wrote: > I get the following

Re: Rest call to Data Torrent package deploy failing

Surya, Moving users@apex to bcc. Do take this up on dt-users google group. Thks Amol E:a...@datatorrent.com | M: 510-449-2606 | Twitter: @*amolhkekre* www.datatorrent.com *Join us at Apex Big Data World Mt View , April 4, 2017!* [image:

Re: apex metrics integration into monitoring system

Mohammad, Apex metrics/stats are available via webservice. You can write another apex app to simply call this webservice and write to JMX or any external system. Thks Amol On Tue, Feb 28, 2017 at 5:06 PM, Mohammad Kargar wrote: > Is there any way to integrate Apex

Re: High Availability of Data Torrent

Chiranjeevi, Please take this up on dt-us...@googlegroups.com as it is DataTorrent related. I have moved users@apex to bcc Thks Amol *Join us at Apex Big Data World-San Jose , April 4, 2017!* [image: http://www.apexbigdata.com/san-jose-register.html]

Re: One-time Initialization of in-memory data using a data file

Roger, I am guessing here. The ask seems to be for an Apex app that otherwise would query data from Mainframe to not do so. The aim being to offload key-val lookup from Mainframe. Instead you are looking to see if the query can be from an operator that does what a key-val store would do for you

Re: PARTITION_PARALLEL Vs Regular mode

Arvindan, Based on what you have it looks like shuffle is not needed between Kafka->ParquetWriter. The decision to use parallel partiion should be ideally based the need to shuffle. If so option [1] should not be used per se. Why even bother to shuffle if you do not need to. Assuming the ask is

Re: Ab initio vs Apex

Ananth, Customers have talked about Ab initio vs Hadoop-Apex, but there is no data available on any benchmarking or feature compare that I know of. You may want to look at Hadoop vs Ab initio to find data on internet. Thks Amol On Fri, Dec 9, 2016 at 2:19 AM, Ananth G

Re: Apex Communication Protocols

Max, Between two operators the communication depends on stream locality. For thread local, the tuple is passed via thread stack; for container local there is a queue in between. For the rest there is a buffer server. This is effectively a pub-sub mechanism built over tcp-ip. Default is kryo

Re: balanced of Stream Codec

Sunil, Round robin in an internal operator could be used in exactly once writes to external system for certain operations. I do know what your business logic is, but in case it can be split into partitions and then unified (for example aggregates), you have a situation where you can use round

Re: Support for dynamic topology

>> Is my understanding correct? If so is there any reason why we cannot >> re-use existing operators downstream? >> >> -hs >> >> >> On Tue, Aug 30, 2016 at 2:46 PM, Amol Kekre <a...@datatorrent.com> wrote: >> >>> >>> Hyunseok,

Re: can operators emit on a different from the operator itself thread?

Should be have this as an utility ? Thks Amol On Wed, Aug 10, 2016 at 1:57 PM, Munagala Ramanath wrote: > For cases where use of a different thread is needed, it can write tuples > to a queue from where the operator thread pulls them -- > JdbcPollInputOperator in Malhar

Re: A proposal for Malhar

uses problems with development. I will ask him to lead the > >> discussion on > >>that. > >> > >> Thanks > >> > >> On Fri, May 27, 2016 at 7:47 PM, David Yan <da...@datatorrent.com> > wrote: > >> > >> > The two i