[jira] [Updated] (IGNITE-21063) Cannot create 1000 tables
[ https://issues.apache.org/jira/browse/IGNITE-21063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirill Tkalenko updated IGNITE-21063: - Reviewer: Kirill Tkalenko > Cannot create 1000 tables > - > > Key: IGNITE-21063 > URL: https://issues.apache.org/jira/browse/IGNITE-21063 > Project: Ignite > Issue Type: Bug >Reporter: Ivan Bessonov >Assignee: Ivan Bessonov >Priority: Major > Labels: ignite-3 > Fix For: 3.0.0-beta2 > > Time Spent: 1.5h > Remaining Estimate: 0h > > Fails with OOM after a while, managing to create about 500 tales locally. We > need to research, why it happens. Is there a leak, or we simply use too much > memory. > Main candidate: thread-local marshallers. For some reason, we use too many > threads, I guess? Meta-storage entries may be up to several megabytes in > current implementation. > We should limit the size of cached buffers, and number of threads in general. > Shared pool (priority-queue) of pre-allocated buffers would solve the issue, > they don't have to be thread-local. It's a bit slower, but it's not a problem > until proven otherwise -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (IGNITE-21063) Cannot create 1000 tables
[ https://issues.apache.org/jira/browse/IGNITE-21063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirill Tkalenko updated IGNITE-21063: - Fix Version/s: 3.0.0-beta2 > Cannot create 1000 tables > - > > Key: IGNITE-21063 > URL: https://issues.apache.org/jira/browse/IGNITE-21063 > Project: Ignite > Issue Type: Bug >Reporter: Ivan Bessonov >Assignee: Ivan Bessonov >Priority: Major > Labels: ignite-3 > Fix For: 3.0.0-beta2 > > Time Spent: 1.5h > Remaining Estimate: 0h > > Fails with OOM after a while, managing to create about 500 tales locally. We > need to research, why it happens. Is there a leak, or we simply use too much > memory. > Main candidate: thread-local marshallers. For some reason, we use too many > threads, I guess? Meta-storage entries may be up to several megabytes in > current implementation. > We should limit the size of cached buffers, and number of threads in general. > Shared pool (priority-queue) of pre-allocated buffers would solve the issue, > they don't have to be thread-local. It's a bit slower, but it's not a problem > until proven otherwise -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (IGNITE-21063) Cannot create 1000 tables
[ https://issues.apache.org/jira/browse/IGNITE-21063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ivan Bessonov updated IGNITE-21063: --- Description: Fails with OOM after a while, managing to create about 500 tales locally. We need to research, why it happens. Is there a leak, or we simply use too much memory. Main candidate: thread-local marshallers. For some reason, we use too many threads, I guess? Meta-storage entries may be up to several megabytes in current implementation. We should limit the size of cached buffers, and number of threads in general. Shared pool (priority-queue) of pre-allocated buffers would solve the issue, they don't have to be thread-local. It's a bit slower, but it's not a problem until proven otherwise was:Fails with OOM after a while, managing to create about 500 tales locally. We need to research, why it happens. Is there a leak, or we simply use too much memory > Cannot create 1000 tables > - > > Key: IGNITE-21063 > URL: https://issues.apache.org/jira/browse/IGNITE-21063 > Project: Ignite > Issue Type: Bug >Reporter: Ivan Bessonov >Priority: Major > Labels: ignite-3 > > Fails with OOM after a while, managing to create about 500 tales locally. We > need to research, why it happens. Is there a leak, or we simply use too much > memory. > Main candidate: thread-local marshallers. For some reason, we use too many > threads, I guess? Meta-storage entries may be up to several megabytes in > current implementation. > We should limit the size of cached buffers, and number of threads in general. > Shared pool (priority-queue) of pre-allocated buffers would solve the issue, > they don't have to be thread-local. It's a bit slower, but it's not a problem > until proven otherwise -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (IGNITE-21063) Cannot create 1000 tables
[ https://issues.apache.org/jira/browse/IGNITE-21063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ivan Bessonov updated IGNITE-21063: --- Description: Fails with OOM after a while, managing to create about 500 tales locally. We need to research, why it happens. Is there a leak, or we simply use too much memory (was: Fails with OOM on TC. We need to research, why it happens. Is there a leak, or we simply use too much memory) > Cannot create 1000 tables > - > > Key: IGNITE-21063 > URL: https://issues.apache.org/jira/browse/IGNITE-21063 > Project: Ignite > Issue Type: Bug >Reporter: Ivan Bessonov >Priority: Major > Labels: ignite-3 > > Fails with OOM after a while, managing to create about 500 tales locally. We > need to research, why it happens. Is there a leak, or we simply use too much > memory -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (IGNITE-21063) Cannot create 1000 tables
[ https://issues.apache.org/jira/browse/IGNITE-21063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ivan Bessonov updated IGNITE-21063: --- Description: Fails with OOM on TC. We need to research, why it happens. Is there a leak, or we simply use too much memory (was: Fails with OOM on TC) > Cannot create 1000 tables > - > > Key: IGNITE-21063 > URL: https://issues.apache.org/jira/browse/IGNITE-21063 > Project: Ignite > Issue Type: Bug >Reporter: Ivan Bessonov >Priority: Major > Labels: ignite-3 > > Fails with OOM on TC. We need to research, why it happens. Is there a leak, > or we simply use too much memory -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (IGNITE-21063) Cannot create 1000 tables
[ https://issues.apache.org/jira/browse/IGNITE-21063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ivan Bessonov updated IGNITE-21063: --- Ignite Flags: (was: Docs Required,Release Notes Required) > Cannot create 1000 tables > - > > Key: IGNITE-21063 > URL: https://issues.apache.org/jira/browse/IGNITE-21063 > Project: Ignite > Issue Type: Bug >Reporter: Ivan Bessonov >Priority: Major > Labels: ignite-3 > > Fails with OOM on TC -- This message was sent by Atlassian Jira (v8.20.10#820010)
