Re: Query

Hi Vishal, The support for such operations is currently being enhanced in Apex. For now, you can do the following: - Have an additional output port in your input operator as well as an input port in the "Writer" operator. - Once the Input operator has read and emitted all the data that it

Re: Example use of Windowed Merge Operator

Chinmay: Not sure whether you have gotten your answer already. The assumption that was made for the KeyedWindowedMergeOperatorImpl was that the merge is on the key itself and that's why there is only one KeyT for the key parameter. InputT1 and InputT2 are the values associated with the

Query

Hi, I am performing a batch operation. My input operator is reading multiple files line by line and then there are bunch of operators manipulating the records to evaluate result. My output operator is supposed to write the final result to external system once all the records from each of the

Re: java.lang.NoClassDefFoundError: com/github/fge/jsonschema/exceptions/ProcessingException

Thanks a lot. I ended up implementing my JSONParser operator. It makes sense as I will likely add some custom stuff fthere. On Fri, Dec 2, 2016 at 12:09 AM, Priyanka Gugale wrote: > Hi Max, > > You need "json-schema-validator" in your project pom as Ashwin suggested. > In

Re: Operators in Pending Deploy

Yes, it did. Thanks. On Fri, Dec 2, 2016 at 3:25 PM, Munagala Ramanath wrote: > Just to be sure, did that change resolve the issue ? > > Ram > > On Fri, Dec 2, 2016 at 11:54 AM, Max Bridgewater < > max.bridgewa...@gmail.com> wrote: > >> OK. Thanks guys. It continued to

Re: Operators in Pending Deploy

Just to be sure, did that change resolve the issue ? Ram On Fri, Dec 2, 2016 at 11:54 AM, Max Bridgewater wrote: > OK. Thanks guys. It continued to fail with min 256 and max 512 or 1024. In > the end I switched off the check of ratio virtual/physical memory. My >

Re: Operators in Pending Deploy

Hi Max/Ashwin The logs have the following lines 2016-12-02 16:53:53,868 INFO com.datatorrent.stram.StreamingAppMasterService: Asking RM for containers: [Capability[]Priority[2], Capability[]Priority[1]] 2016-12-02 16:53:53,868 INFO

Re: Operators in Pending Deploy

Ajay, Can you specify the reason why it did not work before as well? Regards, Ashwin. On Fri, Dec 2, 2016 at 10:55 AM, AJAY GUPTA wrote: > Hi Max, > > Can you try adding the following configurations to yarn-site.xml. Restart > yarn and then try starting wordcount-demo. >

Re: Operators in Pending Deploy

Hi Max, Can you try adding the following configurations to yarn-site.xml. Restart yarn and then try starting wordcount-demo. yarn.scheduler.minimum-allocation-mb 256 yarn.scheduler.maximum-allocation-mb 512 Regards, Ajay On Fri, Dec 2, 2016 at 10:26 PM, Max Bridgewater

Re: Operators in Pending Deploy

Max, Can you check app master logs? If application status changed to running, it means app master is running. You can find operator deployment related logs from app master dt.log. Regards, Ashwin. On Dec 2, 2016 5:25 AM, "Max Bridgewater" wrote: > I deployed the