[
https://issues.apache.org/jira/browse/TRAFODION-2738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16167963#comment-16167963
]
ASF GitHub Bot commented on TRAFODION-2738:
-------------------------------------------
GitHub user selvaganesang opened a pull request:
https://github.com/apache/incubator-trafodion/pull/1232
[TRAFODION-2738] Rowset buffer size during insert/upsert should be li…
…mited
Rowset insert includes UnpackRows operator in its query tree. UnPackRows
operator was allocating a larger memory based on rowset size and row size
to flow the data to its parent operator.
Introduced a CQD EXE_MEMORY_FOR_UNPACK_ROWS_IN_MB to limit the amount
of memory allocated in this operator. The default value is 100MB.
In addition, streamlined the NAMemory infrastruture to return NULL or
dump core when more than 2 GB of memory is allocated in one chunk.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/selvaganesang/incubator-trafodion
trafodion-2738
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/incubator-trafodion/pull/1232.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #1232
----
commit 3a15d7c8932fa26b123d4d9c85e41e8d7bf697b0
Author: selvaganesang <[email protected]>
Date: 2017-09-15T14:37:07Z
[TRAFODION-2738] Rowset buffer size during insert/upsert should be limited
Rowset insert includes UnpackRows operator in its query tree. UnPackRows
operator was allocating a larger memory based on rowset size and row size
to flow the data to its parent operator.
Introduced a CQD EXE_MEMORY_FOR_UNPACK_ROWS_IN_MB to limit the amount
of memory allocated in this operator. The default value is 100MB.
In addition, streamlined the NAMemory infrastruture to return NULL or
dump core when more than 2 GB of memory is allocated in one chunk.
----
> Rowset buffer size during insert/upsert should be limited
> ---------------------------------------------------------
>
> Key: TRAFODION-2738
> URL: https://issues.apache.org/jira/browse/TRAFODION-2738
> Project: Apache Trafodion
> Issue Type: Bug
> Reporter: Selvaganesan Govindarajan
>
> Currently, the rowset size for upsert and insert can be given in a such way
> that it would be allocate unlimited buffer size to move the data from client
> to Trafodion SQL engine. This can cause memory corruption and unexpected
> behavior. Hence, we need a way to limit the number of rows in the rowset.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
