[
https://issues.apache.org/jira/browse/ASTERIXDB-2263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16344979#comment-16344979
]
ASF subversion and git services commented on ASTERIXDB-2263:
------------------------------------------------------------
Commit b2abe1e90ee87d49265d696562f91aab6356315a in asterixdb's branch
refs/heads/master from [~mhubail]
[ https://git-wip-us.apache.org/repos/asf?p=asterixdb.git;h=b2abe1e ]
[ASTERIXDB-2263][RT] Use Plan Stages To Estimate Resources
- user model changes: no
- storage format changes: no
- interface changes: no
Details:
- Introduce PlanStagesGenerator that generates
plan stages using blocking/two-phased operators.
- Introduce OperatorResourcesComputer that
calculates the estimated resources for any
logical operator.
- Estimate jobs required resources based on
the stage that requires most resources in
the plan.
Change-Id: Ic715c5733621e27049677f44e1ddaa0dd2c71baf
Reviewed-on: https://asterix-gerrit.ics.uci.edu/2299
Tested-by: Jenkins <[email protected]>
Integration-Tests: Jenkins <[email protected]>
Reviewed-by: Till Westmann <[email protected]>
> Use Job Stages For Estimating Memory Requirement
> ------------------------------------------------
>
> Key: ASTERIXDB-2263
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-2263
> Project: Apache AsterixDB
> Issue Type: Improvement
> Reporter: Murtadha Hubail
> Priority: Major
>
> Currently, we calculate a job's estimated memory usage based on all of its
> operators, which could lead to huge over estimation. It is better to use job
> stages to calculate better estimation.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
