Which version of Ignite do you use?
On Mon, Sep 19, 2022 at 11:38 AM 38797715 <[email protected]> wrote:
for example:
start a node by ignite.sh.
then:
CREATE TABLE City (
ID INT,
Name VARCHAR,
CountryCode CHAR(3),
District VARCHAR,
Population INT,
PRIMARY KEY (ID, CountryCode)
) WITH "template=partitioned, backups=1,
affinityKey=CountryCode, CACHE_NAME=City,
KEY_TYPE=demo.model.CityKey, VALUE_TYPE=demo.model.City";
INSERT INTO City(ID, Name, CountryCode, District, Population)
VALUES (1,'Kabul','AFG','Kabol',1780000);
INSERT INTO City(ID, Name, CountryCode, District, Population)
VALUES (2,'Qandahar','AFG','Qandahar',237500);
INSERT INTO City(ID, Name, CountryCode, District, Population)
VALUES (3,'Herat','AFG','Herat',186800);
INSERT INTO City(ID, Name, CountryCode, District, Population)
VALUES (4,'Mazar-e-Sharif','AFG','Balkh',127800);
INSERT INTO City(ID, Name, CountryCode, District, Population)
VALUES (5,'Amsterdam','NLD','Noord-Holland',731200);
INSERT INTO City(ID, Name, CountryCode, District, Population)
VALUES (6,'Rotterdam','NLD','Zuid-Holland',593321);
INSERT INTO City(ID, Name, CountryCode, District, Population)
VALUES (7,'Haag','NLD','Zuid-Holland',440900);
INSERT INTO City(ID, Name, CountryCode, District, Population)
VALUES (8,'Utrecht','NLD','Utrecht',234323);
INSERT INTO City(ID, Name, CountryCode, District, Population)
VALUES (9,'Eindhoven','NLD','Noord-Brabant',201843);
INSERT INTO City(ID, Name, CountryCode, District, Population)
VALUES (10,'Tilburg','NLD','Noord-Brabant',193238);
INSERT INTO City(ID, Name, CountryCode, District, Population)
VALUES (11,'Groningen','NLD','Groningen',172701);
SELECT * FROM sys.metrics WHERE name LIKE
'io.dataregion.default%';
io.dataregion.default.OffHeapSize 104857600
io.dataregion.default.PhysicalMemoryPages 2066
io.dataregion.default.EmptyDataPages 0
io.dataregion.default.UsedCheckpointBufferSize 0
io.dataregion.default.TotalThrottlingTime 0
io.dataregion.default.PagesReplaced 0
io.dataregion.default.EvictionRate 0
io.dataregion.default.InitialSize 104857600
io.dataregion.default.DirtyPages 0
io.dataregion.default.MaxSize 8589934592
io.dataregion.default.PagesWritten 0
io.dataregion.default.PagesReplaceRate 0
io.dataregion.default.PagesRead 0
io.dataregion.default.PagesFillFactor 0.9997031688690186
io.dataregion.default.TotalAllocatedPages 2066
io.dataregion.default.PhysicalMemorySize 8511920
io.dataregion.default.PagesReplaceAge 0
io.dataregion.default.AllocationRate 2066
io.dataregion.default.OffheapUsedSize 8511920
io.dataregion.default.LargeEntriesPagesCount 0
io.dataregion.default.TotalAllocatedSize 8511920
io.dataregion.default.CheckpointBufferSize 0
TotalUsedSize - (TotalAllocatedSize - PagesFillFactor *
TotalAllocatedSize)
= 8511920 - (8511920 - 0.9997031688690186 * 8511920) = 8509392
delete from city;
SELECT * FROM sys.metrics WHERE name LIKE
'io.dataregion.default%';
io.dataregion.default.OffHeapSize 104857600
io.dataregion.default.PhysicalMemoryPages 2075
io.dataregion.default.EmptyDataPages 0
io.dataregion.default.UsedCheckpointBufferSize 0
io.dataregion.default.TotalThrottlingTime 0
io.dataregion.default.PagesReplaced 0
io.dataregion.default.EvictionRate 0
io.dataregion.default.InitialSize 104857600
io.dataregion.default.DirtyPages 0
io.dataregion.default.MaxSize 8589934592
io.dataregion.default.PagesWritten 0
io.dataregion.default.PagesReplaceRate 0
io.dataregion.default.PagesRead 0
io.dataregion.default.PagesFillFactor 1.0
io.dataregion.default.TotalAllocatedPages 2075
io.dataregion.default.PhysicalMemorySize 8549000
io.dataregion.default.PagesReplaceAge 0
io.dataregion.default.AllocationRate 9
io.dataregion.default.OffheapUsedSize 8549000
io.dataregion.default.LargeEntriesPagesCount 0
io.dataregion.default.TotalAllocatedSize 8549000
io.dataregion.default.CheckpointBufferSize 0
TotalUsedSize - (TotalAllocatedSize - PagesFillFactor *
TotalAllocatedSize)
=8549000 - (8549000 - 1.0 * 8549000) = 8549000
Instead, the value becomes larger?
在 2022/9/19 15:13, Alexander Polovtcev 写道:
Sorry, I messed up the metric names a little bit, we should
use the size metrics, not the page metrics. So the correct
formula would be: `TotalUsedSize - (TotalAllocatedSize -
PagesFillFactor * TotalAllocatedSize)`
On Sun, Sep 18, 2022 at 4:29 PM 38797715 <[email protected]>
wrote:
I've checked TotalUsedPages in
ignite.dataRegionMetrics(), it is found that the logic
of this metric is consistent with OffheapUsedSize, that
is, the value will not be updated after data deletion.
在 2022/9/18 19:42, Alexander Polovtcev 写道:
Hello, you can check out "TotalUsedPages" and
"TotalUsedSize" metrics that can be found in the Data
Region metrics. However, please keep in mind that this
does not take page fragmentation into account.
On Sat, Sep 17, 2022 at 2:35 PM 38797715
<[email protected]> wrote:
Hi team,
We found that if the delete operation is executed,
the memory space corresponding to the data will not
be released, and this space will be reused later.
Therefore, metrics such as OffheapUsedSize will
become inaccurate.
So, how to calculate the exact amount of memory
occupied by data in a cache or a dataregion?
--
With regards,
Aleksandr Polovtcev
--
With regards,
Aleksandr Polovtcev
--
With regards,
Aleksandr Polovtcev
