[
https://issues.apache.org/jira/browse/TRAFODION-291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14708666#comment-14708666
]
Atanu Mishra commented on TRAFODION-291:
----------------------------------------
Trafodion-Gerrit (neo-devtools) wrote on 2014-09-12: Fix proposed to core
(master) #3
Fix proposed to branch: master
Review: https://review.trafodion.org/422
Trafodion-Gerrit (neo-devtools) wrote on 2014-09-15: Fix merged to core
(master) #4
Reviewed: https://review.trafodion.org/422
Committed:
https://github.com/trafodion/core/commit/3deb3697b83a1235f6eb8514443fc0d9855e04fe
Submitter: Trafodion Jenkins
Branch: master
commit 3deb3697b83a1235f6eb8514443fc0d9855e04fe
Author: Barry Fritchman <email address hidden>
Date: Thu Sep 11 17:57:03 2014 +0000
Provide quick row count estimation for Ustat
Update Statistics needs an estimation of the cardinality of an HBase
table, which to this point has been provided by the result of selecting
count(*) from the table with an internal query. This incurred a
significant overhead for large files, and also occasionally resulted in
an 8448 error due to a known coprocessor problem. The approach
implemented by this fix is to access the HFiles through the FileSystem
interface and read the EntryCount field in the trailer block of each
file. Some sampling of initial data blocks is done to determine the
expected number of missing KevValues due to nulls and the number of
non-PUT KeyValues. The number of rows is estimated by dividing the
adjusted count by the number of columns in the table. The MemStore of
each of the table's regions is checked to get the total storage for
the table outside of HFiles, and the number of rows in memory is
estimated using the total MemStore size and the size-to-rowcount ratio
for the HFiles.
Change-Id: I7435ec3c765992084947b9dc7f8540c779f1f5d3
Closes-Bug: #1321857
Changed in trafodion:
status: In Progress → Fix Committed
Stacey Johnson (sjohnson-w) on 2014-10-16
Changed in trafodion:
status: Fix Committed → Fix Released
> LP Bug: 1321857 - Update statistics fails with error 8448.
> ----------------------------------------------------------
>
> Key: TRAFODION-291
> URL: https://issues.apache.org/jira/browse/TRAFODION-291
> Project: Apache Trafodion
> Issue Type: Bug
> Components: sql-cmp
> Reporter: Guy Groulx
> Assignee: Barry Fritchman
> Priority: Critical
> Fix For: 0.9 (pre-incubation)
>
>
> After loading tables, we do update statistics on our debitcredit tables.
> Here's the output of the upd stats on ACCOUNT_2048.
> SQLEXCEPTION on Statement, Error Code = -9200
> update statistics for table trafodion.debitcredit.account_2048 on every
> key sample
> *** ERROR[9200] UPDATE STATISTICS for table
> TRAFODION.DEBITCREDIT.ACCOUNT_2048 encountered an error (8448) from statement
> getRow(). [2014-05-21 06:52:30]
> *** ERROR[8448] Unable to access Hbase interface. Call to
> ExpHbaseInterface::coProcAggr returned error HBASE_ACCESS_ERROR(-705). Cause:
> org.apache.hadoop.hbase.client.RetriesExhaustedException: Failed after
> attempts=10, exceptions:
> Wed May 21 06:42:18 PDT 2014,
> org.apache.hadoop.hbase.ipc.ExecRPCInvoker$1@1c387843,
> java.net.SocketTimeoutException: Call to
> lava-31.hpl.hp.com/15.25.115.188:60020 failed on socket timeout exception:
> java.net.SocketTimeoutException: 60000 millis timeout while waiting for
> channel to be ready for read. ch : java.nio.channels.SocketChannel[connected
> local=/15.25.115.185:53508 remote=lava-31.hpl.hp.com/15.25.115.188:60020]
> Wed May 21 06:43:19 PDT 2014,
> org.apache.hadoop.hbase.ipc.ExecRPCInvoker$1@1c387843,
> java.net.SocketTimeoutException: Call to
> lava-31.hpl.hp.com/15.25.115.188:60020 failed on socket timeout exception:
> java.net.SocketTimeoutException: 60000 millis timeout while waiting for
> channel to be ready for read. ch : java.nio.channels.SocketChannel[connected
> local=/15.25.115.185:53610 remote=lava-31.hpl.hp.com/15.25.115.188:60020]
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
