[GitHub] apex-malhar pull request #545: APEXMALHAR-2376 Add Common Log support in Log...

2017-01-30 Thread akshay-harale
GitHub user akshay-harale opened a pull request: https://github.com/apache/apex-malhar/pull/545 APEXMALHAR-2376 Add Common Log support in LogParser operator https://issues.apache.org/jira/browse/APEXMALHAR-2376 You can merge this pull request into a Git repository by running:

Re: Schema Discovery Support in Apex Applications

2017-01-30 Thread Chinmay Kolhatkar
Consumer of output port operator schema is going next downstream operator. On Tue, Jan 31, 2017 at 4:01 AM, Sergey Golovko wrote: > Sorry, I’m a new person in the APEX team. And I don't understand clearly > who are consumers of the output port operator schema(s). > > 1.

[GitHub] apex-malhar pull request #544: APEXMALHAR-2397 #resolve Removing DAG.GATEWAY...

2017-01-30 Thread sashadt
GitHub user sashadt opened a pull request: https://github.com/apache/apex-malhar/pull/544 APEXMALHAR-2397 #resolve Removing DAG.GATEWAY_CONNECT_ADDRESS which i… …s causing evaluation failures during apex get-app-package-info call You can merge this pull request into a Git

[GitHub] apex-core pull request #461: APEXCORE-504 - Possible race condition in Strea...

2017-01-30 Thread vrozov
GitHub user vrozov opened a pull request: https://github.com/apache/apex-core/pull/461 APEXCORE-504 - Possible race condition in StreamingContainerAgent.getStreamCodec() @PramodSSImmaneni or @tweise Please review You can merge this pull request into a Git repository by running:

Re: Schema Discovery Support in Apex Applications

2017-01-30 Thread Sergey Golovko
Sorry, I’m a new person in the APEX team. And I don't understand clearly who are consumers of the output port operator schema(s). 1. If the consumers are non-run-time callers like the application manager or UI designer, maybe it makes sense to use Java static method(s) to retrieve the output

[GitHub] apex-core pull request #446: APEXCORE-610 Avoid multiple calls to getBytes.

2017-01-30 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/apex-core/pull/446 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

Re: One Yarn with Multiple Apex Applications

2017-01-30 Thread Munagala Ramanath
Are you running on the sandbox (if so, what version ?) or your own cluster ? In either case, please check the following configuration item in capacity-scheduler.xml: yarn.scheduler.capacity.maximum-am-resource-percent 0.1 Maximum percent of resources in the cluster which can

Re: One Yarn with Multiple Apex Applications

2017-01-30 Thread AJAY GUPTA
Hi Santhosh, We can definitely run multiple Apex applications on a single yarn instance. The behaviour in your case is most probably due to shortage of resources that were required by the second application. Once the first application was killed, the resources were released and the second

Re: One Yarn with Multiple Apex Applications

2017-01-30 Thread Chinmay Kolhatkar
Hi Santhosh, It seems that your YARN does not have enough resources available for allocating memory for 2 application. When you kill the first application, the memory is regained by yarn and then allocated to the second application. You can try to give more memory to yarn if your system allows

Re: [DISCUSS] Policy for patches

2017-01-30 Thread Pramod Immaneni
You make some fair points, a contributor may not want to submit patches for all release branches but the community can pick it up as a policy. In many cases, it might be as simple as the reviewer cherry picking the fix onto the other branches. In cases where it is not trivial and the reviewer or

One Yarn with Multiple Apex Applications

2017-01-30 Thread Santhosh Kumari G
Hi, Can we launch more than one (multiple) apex engine in one node with multiple terminals and one yarn running. If yes, what is the process. I tried launching 2 apex apps with 2 apex engine's. First apex app is running without any issue using the port 8042 configured in yarn-default.xml

Re: APEXMALHAR-2261 Python Binding for HighLevel APIs

2017-01-30 Thread vikram patil
Hi Thomas, I had looked at APEXMALHAR-2260 as well and it will also be part of this development. Though Apex provide python script operator, it is actually very limited script implementation. Lambda function or custom python functions which may have to run as scripts in python operator can be

Re: APEXMALHAR-2261 Python Binding for HighLevel APIs

2017-01-30 Thread vikram patil
Hi Thomas, I had looked at APEXMALHAR-2260 as well and it will also be part of this development. Though Apex provide python script operator, it is actually very limited script implementation. Lambda function or custom python functions which may have to run as scripts in python operator can be