Re: Apex Sandbox in Apex Dev Setup documentation

2017-04-06 Thread Thomas Weise
+1 this should be tracked in a JIRA. There are also some improvements that can be done to the instructions on the docker hub (separate activity). I would also suggest to list the Apex binary build on the downloads page for users that have an existing cluster:

Re: open/close ports and active/inactive streams

2017-04-06 Thread Vlad Rozov
It is exactly the same use case with the exception that it is not necessary to write data to files. Consider 3 operators, an input operator, an aggregate operator and an output operator. When the application starts, the output port of the aggregate operator should be in the closed state, the

[jira] [Commented] (APEXMALHAR-2476) Unable to override tupleSeparator property of GenericFileOutputOperator using configurations

2017-04-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15960003#comment-15960003 ] ASF GitHub Bot commented on APEXMALHAR-2476: GitHub user yogidevendra opened a pull

[GitHub] apex-malhar pull request #603: APEXMALHAR-2476-Fix-tupleSeperator-override.

2017-04-06 Thread yogidevendra
GitHub user yogidevendra opened a pull request: https://github.com/apache/apex-malhar/pull/603 APEXMALHAR-2476-Fix-tupleSeperator-override. You can merge this pull request into a Git repository by running: $ git pull https://github.com/yogidevendra/apex-malhar

[GitHub] apex-malhar pull request #602: Inserted "threshold" log property in Log4j.pr...

2017-04-06 Thread prasannapramod
GitHub user prasannapramod opened a pull request: https://github.com/apache/apex-malhar/pull/602 Inserted "threshold" log property in Log4j.properties file. Fixed log4j properties. You can merge this pull request into a Git repository by running: $ git pull

[jira] [Assigned] (APEXMALHAR-2475) CacheStore needn't expire data if it read-only data

2017-04-06 Thread Oliver Winke (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Oliver Winke reassigned APEXMALHAR-2475: Assignee: Oliver Winke > CacheStore needn't expire data if it read-only data

[jira] [Assigned] (APEXMALHAR-2473) Support for global cache meta information in db CacheManager

2017-04-06 Thread Oliver Winke (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Oliver Winke reassigned APEXMALHAR-2473: Assignee: Oliver Winke > Support for global cache meta information in db

Apex Sandbox in Apex Dev Setup documentation

2017-04-06 Thread Dean Lockgaard
All, In the Sandbox section of the Apache Apex Development Environment Setup documentation ( https://apex.apache.org/docs/apex/apex_development_setup/#sandbox), instructions are provided for a vendor-specific Sandbox. I would like to propose that these instructions be changed to reference the

Re: open/close ports and active/inactive streams

2017-04-06 Thread Thomas Weise
You would need to provide more specifics of the use case you are thinking to address to make this a meaningful discussion. An example for APEXCORE-408 (based on real batch use case): I have two stages, first stage produces a set of files that second stage needs as input. Stage 1 operators to be

Re: open/close ports and active/inactive streams

2017-04-06 Thread Vlad Rozov
It is not about a use case difference. My proposal and APEXCORE-408 address the same use case - how to re-allocate resources for batch applications or applications where processing happens in stages. The difference between APEXCORE-408 and the proposal is shift in complexity from application

[jira] [Commented] (APEXCORE-408) Ability to schedule Sub-DAG from running application

2017-04-06 Thread Tushar Gosavi (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15958879#comment-15958879 ] Tushar Gosavi commented on APEXCORE-408: [~thw] I have opened a pull request