[
https://issues.apache.org/jira/browse/GORA-23?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13696505#comment-13696505
]
Hudson commented on GORA-23:
----------------------------
Integrated in goraOracle #6 (See [https://builds.apache.org/job/goraOracle/6/])
GORA-23 | Limit result set in store reads | Patch by Alexis Detreglode
(Revision abc97fedb0093a2d899d685451a75bcf56c9b967)
GORA-239 Add null checks and better message in AccumuloStore. By David Medinets
(thanks) (Revision 48efefc5c2664e5289f8665da31d7234cf79556a)
GORA-230 Change logging behavior in AccumuloStore to pass exception object to
LOG.error method. (Revision 08939c94d233587a7b31cb56d1372d61904b95c7)
GORA-237 Gora Compiler usage message for LPGL v3 mentions v2.1 (Revision
d173a80bd2147c6d771e2272035a39dde1b4b227)
Result = FAILURE
hsaputra :
Files :
* gora-core/src/main/java/org/apache/gora/mapreduce/GoraRecordReader.java
* gora-core/src/main/java/org/apache/gora/mapreduce/GoraRecordCounter.java
* gora-core/src/main/java/org/apache/gora/mapreduce/GoraInputFormat.java
* gora-core/src/main/java/org/apache/gora/mapreduce/GoraRecordWriter.java
* CHANGES.txt
hsaputra :
Files :
* gora-accumulo/src/main/java/org/apache/gora/accumulo/store/AccumuloStore.java
* CHANGES.txt
lewismc :
Files :
* gora-accumulo/src/main/java/org/apache/gora/accumulo/store/AccumuloStore.java
* CHANGES.txt
lewismc :
Files :
* CHANGES.txt
* gora-core/src/main/java/org/apache/gora/compiler/GoraCompiler.java
> Limit result set in store reads
> -------------------------------
>
> Key: GORA-23
> URL: https://issues.apache.org/jira/browse/GORA-23
> Project: Apache Gora
> Issue Type: Bug
> Components: storage
> Environment: MySQL
> Reporter: Alexis
> Fix For: 0.1-incubating
>
> Attachments: gora.patch, gora.patch, mapred-site.xml
>
>
> Once again, whatever the capacity of our system, we have a limited amount of
> RAM. Sooner or later, we will eventually run out of memory.
> Please refer to
> http://techvineyard.blogspot.com/2010/12/build-nutch-20.html#Gora for the
> description of the issue:
> When using MySQL as Gora backend, with the parse command, the execution hangs
> then crashes because it runs out of memory, because of this query:
> SELECT
> id,content,status,outlinks,baseUrl,typ,parseStatus,metadata,signature,markers
> FROM webpage;
> We are running exactly into the same issue that GORA-20. Except that we are
> not writing to the store, but reading it. Currently the code loads the entire
> webpage table into memory. We want to set a limit to the system call that
> pulls data from the database.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
