Change in asterixdb[master]: Added more explanations for two config parameters
Jenkins has posted comments on this change. Change subject: Added more explanations for two config parameters .. Patch Set 2: Integration Tests Successful https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/915/ : SUCCESS -- To view, visit https://asterix-gerrit.ics.uci.edu/1281 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: Idea269eec4d89f665772267588ce2b019327de04 Gerrit-PatchSet: 2 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Taewoo KimGerrit-Reviewer: Ian Maxon Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Taewoo Kim Gerrit-HasComments: No
Change in asterixdb[master]: Added more explanations for two config parameters
Taewoo Kim has submitted this change and it was merged. Change subject: Added more explanations for two config parameters .. Added more explanations for two config parameters - Added more planataions for storage.memorycomponent.numpages and storage.memorycomponent.globalbudget Change-Id: Idea269eec4d89f665772267588ce2b019327de04 Reviewed-on: https://asterix-gerrit.ics.uci.edu/1281 Sonar-Qube: JenkinsReviewed-by: Ian Maxon Tested-by: Jenkins --- M asterixdb/asterix-app/src/main/resources/asterix-build-configuration.xml M asterixdb/asterix-docker/docker/asterix-configuration.xml M asterixdb/asterix-experiments/src/main/resources/ingestion-experiment-binary-and-configs/configs/asterix-configuration.xml M asterixdb/asterix-installer/src/main/resources/conf/asterix-configuration.xml M asterixdb/asterix-installer/src/test/resources/integrationts/asterix-configuration.xml M asterixdb/asterix-yarn/src/main/resources/base-asterix-configuration.xml M asterixdb/asterix-yarn/src/main/resources/configs/base-asterix-configuration.xml 7 files changed, 59 insertions(+), 25 deletions(-) Approvals: Ian Maxon: Looks good to me, approved Jenkins: Verified; No violations found diff --git a/asterixdb/asterix-app/src/main/resources/asterix-build-configuration.xml b/asterixdb/asterix-app/src/main/resources/asterix-build-configuration.xml index 142b93a..ef0cdf2 100644 --- a/asterixdb/asterix-app/src/main/resources/asterix-build-configuration.xml +++ b/asterixdb/asterix-app/src/main/resources/asterix-build-configuration.xml @@ -89,7 +89,10 @@ storage.memorycomponent.numpages 8 The number of pages to allocate for a memory component. - (Default = 8) + This budget is shared by all the memory components of the primary + index and all its secondary indexes across all I/O devices on a node. + Note: in-memory components usually has fill factor of 75% since + the pages are 75% full and the remaining 25% is un-utilized. (Default = 256) diff --git a/asterixdb/asterix-docker/docker/asterix-configuration.xml b/asterixdb/asterix-docker/docker/asterix-configuration.xml index ea43da9..fe9827c 100644 --- a/asterixdb/asterix-docker/docker/asterix-configuration.xml +++ b/asterixdb/asterix-docker/docker/asterix-configuration.xml @@ -101,7 +101,10 @@ storage.memorycomponent.numpages 256 The number of pages to allocate for a memory component. - (Default = 256) + This budget is shared by all the memory components of the primary + index and all its secondary indexes across all I/O devices on a node. + Note: in-memory components usually has fill factor of 75% since + the pages are 75% full and the remaining 25% is un-utilized. (Default = 256) @@ -123,9 +126,11 @@ storage.memorycomponent.globalbudget 512MB -The total size of memory in bytes that the sum of all - open memory - components cannot exceed. (Default = "536870192" // 512MB) +The total size of memory in bytes that the sum of all open memory + components cannot exceed. Consider this as the buffer cache for all memory + components of all indexes in a node. When this budget is fully used, a victim + dataset will be chosen. The chosen dataset must be evicted and closed to make + a space for another dataset. (Default = 512MB) diff --git a/asterixdb/asterix-experiments/src/main/resources/ingestion-experiment-binary-and-configs/configs/asterix-configuration.xml b/asterixdb/asterix-experiments/src/main/resources/ingestion-experiment-binary-and-configs/configs/asterix-configuration.xml index c642cbb..f4bb47a 100644 --- a/asterixdb/asterix-experiments/src/main/resources/ingestion-experiment-binary-and-configs/configs/asterix-configuration.xml +++ b/asterixdb/asterix-experiments/src/main/resources/ingestion-experiment-binary-and-configs/configs/asterix-configuration.xml @@ -72,7 +72,11 @@ storage.memorycomponent.numpages 8192 - +The number of pages to allocate for a memory component. + This budget is shared by all the memory components of the primary + index and all its secondary indexes across all I/O devices on a node. + Note: in-memory components usually has fill factor of 75% since + the pages are 75% full and the remaining 25% is un-utilized. (Default = 256) @@ -96,9 +100,11 @@ storage.memorycomponent.globalbudget 4196MB -[4GB + 100MB]The total size of memory in bytes that the sum of all - open memory - components cannot exceed. (Default = "536870192" // 512MB) +The total size of memory in bytes that the sum of all open memory + components cannot exceed. Consider this as the buffer cache for all memory + components of all indexes in a node.
Change in asterixdb[master]: Added more explanations for two config parameters
Jenkins has posted comments on this change. Change subject: Added more explanations for two config parameters .. Patch Set 2: Integration Tests Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/915/ -- To view, visit https://asterix-gerrit.ics.uci.edu/1281 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: Idea269eec4d89f665772267588ce2b019327de04 Gerrit-PatchSet: 2 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Taewoo KimGerrit-Reviewer: Ian Maxon Gerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: Added more explanations for two config parameters
Ian Maxon has posted comments on this change. Change subject: Added more explanations for two config parameters .. Patch Set 2: Code-Review+2 -- To view, visit https://asterix-gerrit.ics.uci.edu/1281 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: Idea269eec4d89f665772267588ce2b019327de04 Gerrit-PatchSet: 2 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Taewoo KimGerrit-Reviewer: Ian Maxon Gerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: Added more explanations for two config parameters
Jenkins has posted comments on this change. Change subject: Added more explanations for two config parameters .. Patch Set 2: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-notopic/3010/ -- To view, visit https://asterix-gerrit.ics.uci.edu/1281 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: Idea269eec4d89f665772267588ce2b019327de04 Gerrit-PatchSet: 2 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Taewoo KimGerrit-Reviewer: Ian Maxon Gerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: Added more explanations for two config parameters
Taewoo Kim has uploaded a new patch set (#2). Change subject: Added more explanations for two config parameters .. Added more explanations for two config parameters - Added more planataions for storage.memorycomponent.numpages and storage.memorycomponent.globalbudget Change-Id: Idea269eec4d89f665772267588ce2b019327de04 --- M asterixdb/asterix-app/src/main/resources/asterix-build-configuration.xml M asterixdb/asterix-docker/docker/asterix-configuration.xml M asterixdb/asterix-experiments/src/main/resources/ingestion-experiment-binary-and-configs/configs/asterix-configuration.xml M asterixdb/asterix-installer/src/main/resources/conf/asterix-configuration.xml M asterixdb/asterix-installer/src/test/resources/integrationts/asterix-configuration.xml M asterixdb/asterix-yarn/src/main/resources/base-asterix-configuration.xml M asterixdb/asterix-yarn/src/main/resources/configs/base-asterix-configuration.xml 7 files changed, 59 insertions(+), 25 deletions(-) git pull ssh://asterix-gerrit.ics.uci.edu:29418/asterixdb refs/changes/81/1281/2 -- To view, visit https://asterix-gerrit.ics.uci.edu/1281 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: newpatchset Gerrit-Change-Id: Idea269eec4d89f665772267588ce2b019327de04 Gerrit-PatchSet: 2 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Taewoo KimGerrit-Reviewer: Ian Maxon Gerrit-Reviewer: Jenkins
Change in asterixdb[master]: Added more explanations for two config parameters
Jenkins has posted comments on this change. Change subject: Added more explanations for two config parameters .. Patch Set 1: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-notopic/3009/ -- To view, visit https://asterix-gerrit.ics.uci.edu/1281 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: Idea269eec4d89f665772267588ce2b019327de04 Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Taewoo KimGerrit-Reviewer: Ian Maxon Gerrit-Reviewer: Jenkins Gerrit-HasComments: No