[
https://issues.apache.org/jira/browse/JCR-1250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12550089
]
Thomas Mueller commented on JCR-1250:
-------------------------------------
Hi,
The problem is that the MS SQL Server JDBC driver tries to load the whole
result set in memory by default (including the BLOB). There is a solution:
- Use version 1.2 of the MS SQL Server JDBC driver
- Apend ;responseBuffering=adaptive to the database URL:
jdbc:sqlserver://localhost:4220;DatabaseName=test;responseBuffering=adaptive
- Don't append ;selectMethod=cursor (if you do, it will run out of memory)
For more information see:
http://blogs.msdn.com/jdbcteam/archive/2007/05/02/what-is-adaptive-response-buffering-and-why-should-i-use-it.aspx
Download the 1.2 driver from here:
http://msdn2.microsoft.com/en-us/data/aa937724.aspx
It looks like this solves the problem. The sample app I have used is:
public class BigBinaryTest extends JUnitTest {
public void testBigBinary() throws Throwable {
try {
final Repository repository = (Repository) new
TransientRepository();
Session session = repository.login(new SimpleCredentials(
"username", "password".toCharArray()));
Node root = session.getRootNode();
System.out.println("setProperty...");
root.setProperty("bin", getStream());
System.out.println("save...");
session.save();
System.out.println("done...");
System.out.println("getProperty...");
Property prop = root.getProperty("bin");
System.out.println("getStream...");
InputStream in = prop.getStream();
System.out.println("compareStreams...");
RandomInputStream.compareStreams(in, getStream());
System.out.println("close...");
in.close();
System.out.println("logout...");
session.logout();
System.out.println("done");
} catch(Throwable e) {
e.printStackTrace();
throw e;
}
}
private InputStream getStream() {
int size = 100 * 1024 * 1024;
return new RandomInputStream(0, size, Integer.MAX_VALUE);
}
}
> When adding a large (100MB) binary to the DbDataStore, it fails with an
> insufficient memory exception
> -----------------------------------------------------------------------------------------------------
>
> Key: JCR-1250
> URL: https://issues.apache.org/jira/browse/JCR-1250
> Project: Jackrabbit
> Issue Type: Bug
> Components: jackrabbit-core
> Affects Versions: 1.4
> Environment: Windows XP x64 client, SQL Server 2005
> Reporter: Esteban Franqueiro
> Attachments: BigBinaryTest.java
>
>
> Attached is a small test case. It fails during save(). I think this is
> related to what I mentioned in
> http://mail-archives.apache.org/mod_mbox/jackrabbit-dev/200711.mbox/[EMAIL
> PROTECTED]
> The full stacktrace is the following:
> javax.jcr.RepositoryException: /: unable to update item.: failed to write
> property state: cafebabe-cafe-babe-cafe-babecafebabe/{}bin: failed to write
> property state: cafebabe-cafe-babe-cafe-babecafebabe/{}bin
> at org.apache.jackrabbit.core.ItemImpl.save(ItemImpl.java:1252)
> at org.apache.jackrabbit.core.SessionImpl.save(SessionImpl.java:858)
> at
> org.apache.jackrabbit.core.data.BigBinaryTest.testBigBinary(BigBinaryTest.java:16)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:585)
> at junit.framework.TestCase.runTest(TestCase.java:154)
> at junit.framework.TestCase.runBare(TestCase.java:127)
> at junit.framework.TestResult$1.protect(TestResult.java:106)
> at junit.framework.TestResult.runProtected(TestResult.java:124)
> at junit.framework.TestResult.run(TestResult.java:109)
> at junit.framework.TestCase.run(TestCase.java:118)
> at
> org.apache.jackrabbit.test.AbstractJCRTest.run(AbstractJCRTest.java:404)
> at junit.framework.TestSuite.runTest(TestSuite.java:208)
> at junit.framework.TestSuite.run(TestSuite.java:203)
> at
> org.eclipse.jdt.internal.junit.runner.junit3.JUnit3TestReference.run(JUnit3TestReference.java:128)
> at
> org.eclipse.jdt.internal.junit.runner.TestExecution.run(TestExecution.java:38)
> at
> org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.runTests(RemoteTestRunner.java:460)
> at
> org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.runTests(RemoteTestRunner.java:673)
> at
> org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.run(RemoteTestRunner.java:386)
> at
> org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.main(RemoteTestRunner.java:196)
> Caused by: org.apache.jackrabbit.core.state.ItemStateException: failed to
> write property state: cafebabe-cafe-babe-cafe-babecafebabe/{}bin
> at
> org.apache.jackrabbit.core.persistence.db.DatabasePersistenceManager.store(DatabasePersistenceManager.java:487)
> at
> org.apache.jackrabbit.core.persistence.AbstractPersistenceManager.store(AbstractPersistenceManager.java:75)
> at
> org.apache.jackrabbit.core.persistence.db.DatabasePersistenceManager.store(DatabasePersistenceManager.java:282)
> at
> org.apache.jackrabbit.core.state.SharedItemStateManager$Update.end(SharedItemStateManager.java:687)
> at
> org.apache.jackrabbit.core.state.SharedItemStateManager.update(SharedItemStateManager.java:856)
> at
> org.apache.jackrabbit.core.state.LocalItemStateManager.update(LocalItemStateManager.java:324)
> at
> org.apache.jackrabbit.core.state.XAItemStateManager.update(XAItemStateManager.java:313)
> at
> org.apache.jackrabbit.core.state.LocalItemStateManager.update(LocalItemStateManager.java:300)
> at
> org.apache.jackrabbit.core.state.SessionItemStateManager.update(SessionItemStateManager.java:306)
> at org.apache.jackrabbit.core.ItemImpl.save(ItemImpl.java:1244)
> ... 21 more
> Caused by: org.apache.jackrabbit.core.data.DataStoreException: Can not read
> identifier a2ada2d96d0b05214288efa03be9005a5bb98c9b: Memoria insuficiente.
> Utilice cursores del servidor para result sets grandes:Java heap space.
> Tamaño de result set:104.857.723. Tamaño memoria total JVM:66.650.112.:
> Memoria insuficiente. Utilice cursores del servidor para result sets
> grandes:Java heap space. Tamaño de result set:104.857.723. Tamaño memoria
> total JVM:66.650.112.
> at
> org.apache.jackrabbit.core.data.db.DbDataStore.convert(DbDataStore.java:438)
> at
> org.apache.jackrabbit.core.data.db.DbDataStore.getInputStream(DbDataStore.java:481)
> at
> org.apache.jackrabbit.core.data.db.DbDataRecord.getStream(DbDataRecord.java:61)
> at
> org.apache.jackrabbit.core.value.BLOBInDataStore.getStream(BLOBInDataStore.java:93)
> at
> org.apache.jackrabbit.core.persistence.util.Serializer.serialize(Serializer.java:198)
> at
> org.apache.jackrabbit.core.persistence.db.DatabasePersistenceManager.store(DatabasePersistenceManager.java:476)
> ... 30 more
> Caused by: com.microsoft.sqlserver.jdbc.SQLServerException: Memoria
> insuficiente. Utilice cursores del servidor para result sets grandes:Java
> heap space. Tamaño de result set:104.857.723. Tamaño memoria total
> JVM:66.650.112.
> at
> com.microsoft.sqlserver.jdbc.SQLServerException.makeFromDriverError(Unknown
> Source)
> at com.microsoft.sqlserver.jdbc.DBComms.receive(Unknown Source)
> at
> com.microsoft.sqlserver.jdbc.SQLServerPreparedStatement.doExecutePreparedStatement(Unknown
> Source)
> at
> com.microsoft.sqlserver.jdbc.SQLServerPreparedStatement$PreparedStatementExecutionRequest.executeStatement(Unknown
> Source)
> at com.microsoft.sqlserver.jdbc.CancelableRequest.execute(Unknown
> Source)
> at
> com.microsoft.sqlserver.jdbc.SQLServerConnection.executeRequest(Unknown
> Source)
> at
> com.microsoft.sqlserver.jdbc.SQLServerPreparedStatement.execute(Unknown
> Source)
> at
> org.apache.jackrabbit.core.persistence.bundle.util.ConnectionRecoveryManager.executeStmtInternal(ConnectionRecoveryManager.java:362)
> at
> org.apache.jackrabbit.core.persistence.bundle.util.ConnectionRecoveryManager.executeStmtInternal(ConnectionRecoveryManager.java:292)
> at
> org.apache.jackrabbit.core.persistence.bundle.util.ConnectionRecoveryManager.executeStmt(ConnectionRecoveryManager.java:257)
> at
> org.apache.jackrabbit.core.persistence.bundle.util.ConnectionRecoveryManager.executeStmt(ConnectionRecoveryManager.java:237)
> at
> org.apache.jackrabbit.core.data.db.DbDataStore.getInputStream(DbDataStore.java:474)
> ... 34 more
> org.apache.jackrabbit.core.state.ItemStateException: failed to write property
> state: cafebabe-cafe-babe-cafe-babecafebabe/{}bin
> at
> org.apache.jackrabbit.core.persistence.db.DatabasePersistenceManager.store(DatabasePersistenceManager.java:487)
> at
> org.apache.jackrabbit.core.persistence.AbstractPersistenceManager.store(AbstractPersistenceManager.java:75)
> at
> org.apache.jackrabbit.core.persistence.db.DatabasePersistenceManager.store(DatabasePersistenceManager.java:282)
> at
> org.apache.jackrabbit.core.state.SharedItemStateManager$Update.end(SharedItemStateManager.java:687)
> at
> org.apache.jackrabbit.core.state.SharedItemStateManager.update(SharedItemStateManager.java:856)
> at
> org.apache.jackrabbit.core.state.LocalItemStateManager.update(LocalItemStateManager.java:324)
> at
> org.apache.jackrabbit.core.state.XAItemStateManager.update(XAItemStateManager.java:313)
> at
> org.apache.jackrabbit.core.state.LocalItemStateManager.update(LocalItemStateManager.java:300)
> at
> org.apache.jackrabbit.core.state.SessionItemStateManager.update(SessionItemStateManager.java:306)
> at org.apache.jackrabbit.core.ItemImpl.save(ItemImpl.java:1244)
> at org.apache.jackrabbit.core.SessionImpl.save(SessionImpl.java:858)
> at
> org.apache.jackrabbit.core.data.BigBinaryTest.testBigBinary(BigBinaryTest.java:16)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:585)
> at junit.framework.TestCase.runTest(TestCase.java:154)
> at junit.framework.TestCase.runBare(TestCase.java:127)
> at junit.framework.TestResult$1.protect(TestResult.java:106)
> at junit.framework.TestResult.runProtected(TestResult.java:124)
> at junit.framework.TestResult.run(TestResult.java:109)
> at junit.framework.TestCase.run(TestCase.java:118)
> at
> org.apache.jackrabbit.test.AbstractJCRTest.run(AbstractJCRTest.java:404)
> at junit.framework.TestSuite.runTest(TestSuite.java:208)
> at junit.framework.TestSuite.run(TestSuite.java:203)
> at
> org.eclipse.jdt.internal.junit.runner.junit3.JUnit3TestReference.run(JUnit3TestReference.java:128)
> at
> org.eclipse.jdt.internal.junit.runner.TestExecution.run(TestExecution.java:38)
> at
> org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.runTests(RemoteTestRunner.java:460)
> at
> org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.runTests(RemoteTestRunner.java:673)
> at
> org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.run(RemoteTestRunner.java:386)
> at
> org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.main(RemoteTestRunner.java:196)
> Caused by: org.apache.jackrabbit.core.data.DataStoreException: Can not read
> identifier a2ada2d96d0b05214288efa03be9005a5bb98c9b: Memoria insuficiente.
> Utilice cursores del servidor para result sets grandes:Java heap space.
> Tamaño de result set:104.857.723. Tamaño memoria total JVM:66.650.112.:
> Memoria insuficiente. Utilice cursores del servidor para result sets
> grandes:Java heap space. Tamaño de result set:104.857.723. Tamaño memoria
> total JVM:66.650.112.
> at
> org.apache.jackrabbit.core.data.db.DbDataStore.convert(DbDataStore.java:438)
> at
> org.apache.jackrabbit.core.data.db.DbDataStore.getInputStream(DbDataStore.java:481)
> at
> org.apache.jackrabbit.core.data.db.DbDataRecord.getStream(DbDataRecord.java:61)
> at
> org.apache.jackrabbit.core.value.BLOBInDataStore.getStream(BLOBInDataStore.java:93)
> at
> org.apache.jackrabbit.core.persistence.util.Serializer.serialize(Serializer.java:198)
> at
> org.apache.jackrabbit.core.persistence.db.DatabasePersistenceManager.store(DatabasePersistenceManager.java:476)
> ... 30 more
> Caused by: com.microsoft.sqlserver.jdbc.SQLServerException: Memoria
> insuficiente. Utilice cursores del servidor para result sets grandes:Java
> heap space. Tamaño de result set:104.857.723. Tamaño memoria total
> JVM:66.650.112.
> at
> com.microsoft.sqlserver.jdbc.SQLServerException.makeFromDriverError(Unknown
> Source)
> at com.microsoft.sqlserver.jdbc.DBComms.receive(Unknown Source)
> at
> com.microsoft.sqlserver.jdbc.SQLServerPreparedStatement.doExecutePreparedStatement(Unknown
> Source)
> at
> com.microsoft.sqlserver.jdbc.SQLServerPreparedStatement$PreparedStatementExecutionRequest.executeStatement(Unknown
> Source)
> at com.microsoft.sqlserver.jdbc.CancelableRequest.execute(Unknown
> Source)
> at
> com.microsoft.sqlserver.jdbc.SQLServerConnection.executeRequest(Unknown
> Source)
> at
> com.microsoft.sqlserver.jdbc.SQLServerPreparedStatement.execute(Unknown
> Source)
> at
> org.apache.jackrabbit.core.persistence.bundle.util.ConnectionRecoveryManager.executeStmtInternal(ConnectionRecoveryManager.java:362)
> at
> org.apache.jackrabbit.core.persistence.bundle.util.ConnectionRecoveryManager.executeStmtInternal(ConnectionRecoveryManager.java:292)
> at
> org.apache.jackrabbit.core.persistence.bundle.util.ConnectionRecoveryManager.executeStmt(ConnectionRecoveryManager.java:257)
> at
> org.apache.jackrabbit.core.persistence.bundle.util.ConnectionRecoveryManager.executeStmt(ConnectionRecoveryManager.java:237)
> at
> org.apache.jackrabbit.core.data.db.DbDataStore.getInputStream(DbDataStore.java:474)
> ... 34 more
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
