[
https://issues.apache.org/jira/browse/TRAFODION-2949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16449283#comment-16449283
]
ASF GitHub Bot commented on TRAFODION-2949:
-------------------------------------------
GitHub user sandhyasun opened a pull request:
https://github.com/apache/trafodion/pull/1538
[TRAFODION-2949] Improve LOB Extract/Update Performance
Removing unneeded CLI call to get lob location and instead using the CQD
value - LOB_STORAGE_FILE_DIR to get/save it in Tdb for use later at runtime.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/sandhyasun/trafodion traf_misc
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/trafodion/pull/1538.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #1538
----
commit ed85d5b805a15f40b763d2309cdbee04cafbf928
Author: Sandhya Sundaresan <sandhya@...>
Date: 2018-04-24T04:45:11Z
Removing unneeded CLI call to get lob location and instead using the CQD
value - LOB_STORAGE_LOCATION to get/save it in Tdb for use later at runtime.
----
> LOB: Address performance issues related to inserts/extracts in tables
> containing LOB columns
> --------------------------------------------------------------------------------------------
>
> Key: TRAFODION-2949
> URL: https://issues.apache.org/jira/browse/TRAFODION-2949
> Project: Apache Trafodion
> Issue Type: Improvement
> Reporter: Sandhya Sundaresan
> Assignee: Sandhya Sundaresan
> Priority: Major
>
> # Investigate bottlenecks in the insert and update code paths.
> A couple of bottlenecks identified initially were hdfsWrite and the LOBCLi
> call.
> # Investigate if lib hdfs write operation is signifincantly slower than a
> direct JNI call. If so consider refactoring code being done for hive inserts
> and reuse for LOB writes as well. Also investigate use of libhdfs3 , a
> lightweight interface by Pivotal for Hawk ,that doesn’t use JNI at all.
> # Investigate if LOB Cli calls that do prepare and execute of statements to
> insert/update the LOB descriptor tables are being cached and reused when
> multiple LOB inserts are being done in the same session.
> # Investigate external LOBs as a solution for faster inserts/extracts for
> usage compared to internal LOBs.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
