[
https://issues.apache.org/jira/browse/IGNITE-6300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16157047#comment-16157047
]
Anton Vinogradov edited comment on IGNITE-6300 at 9/7/17 3:01 PM:
------------------------------------------------------------------
[~vozerov]
Thanks for your comments.
Some refinements:
{{Estimation should be done based on storage format, not based on binary
object, which is only a part of this format.}}
BinarySizeEstimator should be lightweight and fast way (some seconds) to
determine data set weight.
This feature requested by Analyst, not by Tuners.
We are going to have another Estimator that will calculate memory consumption
using IgniteConfiguration as well.
{{Another major point of concern is that we store object in binary format as is
at the moment}}
Since it will be part of Ignite code it will calculate memory consumption for
current Ignite version, like Yardstick performs benchmarking.
Once you improve something at BinaryMarshaller you'll see profit at
BinarySizeEstimator results.
BinarySizeEstimator can be used as some king of benchmarking tool for
BinaryMarshaller.
was (Author: avinogradov):
[~vozerov]
Thanks for your comments.
Some refinements:
> Estimation should be done based on storage format, not based on binary
> object, which is only a part of this format.
BinarySizeEstimator should be lightweight and fast way (some seconds) to
determine data set weight.
This feature requested by Analyst, not by Tuners.
We are going to have another Estimator that will calculate memory consumption
using IgniteConfiguration as well.
> Another major point of concern is that we store object in binary format as is
> at the moment
Since it will be part of Ignite code it will calculate memory consumption for
current Ignite version, like Yardstick performs benchmarking.
Once you improve something at BinaryMarshaller you'll see profit at
BinarySizeEstimator results.
BinarySizeEstimator can be used as some king of benchmarking tool for
BinaryMarshaller.
> BinaryObject's set size estimator
> ---------------------------------
>
> Key: IGNITE-6300
> URL: https://issues.apache.org/jira/browse/IGNITE-6300
> Project: Ignite
> Issue Type: New Feature
> Reporter: Anton Vinogradov
> Assignee: Dmitriy Sorokin
>
> Need to provide some API to estimate requirements for any data model.
> For example:
> 1) You have classes A,B and C with known fields.
> 2) You know that you have to keep 1M of A, 2M of B and 45K of C.
> 3) BinarySizeEstimator should return you expected memory consumption on
> actual Ignite version without starting a node.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
