Question/observations on purged rows and insert rates

2010-08-06 Thread Bergquist, Brett
I posted the following to the users list but saw no response, so I thought I would post here as it may be more relevant to developers. After some testing, it seems that Derby is reusing the space of deleted records before allocating more space from the file system. If this is the case then

RE: Question/observations on purged rows and insert rates

2010-08-06 Thread Bergquist, Brett
-dev@db.apache.org Subject: Re: Question/observations on purged rows and insert rates Bergquist, Brett wrote: I posted the following to the users list but saw no response, so I thought I would post here as it may be more relevant to developers. After some testing, it seems that Derby

RE: Question/observations on purged rows and insert rates

2010-08-06 Thread Bergquist, Brett
Bergquist, Brett wrote: Also after testing we are seeing the following. With a database with no deleted rows, my test application is inserting about 150 records/second into a table. I let this run for about 2 million records and the insert rate is consistent. Now I purge out 1.5 million

RE: Derby 10.5.3.0

2010-11-16 Thread Bergquist, Brett
10:22 AM To: derby-dev@db.apache.org Subject: Re: Derby 10.5.3.0 On 16.11.10 14:47, Bergquist, Brett wrote: I am using Derby as a database as part of a Glassfish installation. I am processing JMS messages with each one causing access to the Derby database via Eclipselink. After about 80K

RE: Derby 10.5.3.0

2010-11-16 Thread Bergquist, Brett
this. Much appreciated. Brett -Original Message- From: Kristian Waagan [mailto:kristian.waa...@oracle.com] Sent: Tuesday, November 16, 2010 10:57 AM To: derby-dev@db.apache.org Subject: Re: Derby 10.5.3.0 On 16.11.10 16:27, Bergquist, Brett wrote: Okay, thanks for the feedback

RE: Derby 10.5.3.0

2010-11-16 Thread Bergquist, Brett
Admin Console. The hang has not happened through 140K transactions and previously it would hang before this point. So I am going to change back to using the XA data sources and see if the problem occurs again. -Original Message- From: Bergquist, Brett [mailto:br...@canoga.com] Sent

Question on cardinality, statistics, and when things go stale

2010-11-18 Thread Bergquist, Brett
I have read as much as I can about this subject and am a little confused. I understand the cardinality statistics are not computed if the tables are empty when indexes are created and I can work around that. Say I have a table with 15 million records in it and there is a main index that I

RE: Question on cardinality, statistics, and when things go stale

2010-11-18 Thread Bergquist, Brett
to ever not pick the index. But usually the choice is not as clear. Bergquist, Brett wrote: I have read as much as I can about this subject and am a little confused. I understand the cardinality statistics are not computed if the tables are empty when indexes are created and I can work around

Question about an OutOfMemory PermGen that is happening

2010-11-30 Thread Bergquist, Brett
A system running Solaris 10 using Derby 10.5.3 and JDK 1.6.0_05 has had a OutOfMemory PermGen reported in derby.log a couple of times of the past few months. This system has been running for over a year now with no problems but the last few months this has been reported and the system needed

Can someone tell me if syscs_util.update_statistics locks table/indexes being updated

2010-12-01 Thread Bergquist, Brett
If I have a table with millions of rows and I invoke syscs_util.update_statistics on it, will the table/indexes be lock such that inserts or updates will fail while this is being done. The documentation is not clear if this is the case (at least to me). Thanks. Brett

RE: Can someone tell me if syscs_util.update_statistics locks table/indexes being updated

2010-12-01 Thread Bergquist, Brett
if syscs_util.update_statistics locks table/indexes being updated On 01.12.2010 15:32, Bryan Pendleton wrote: On 12/01/2010 05:26 AM, Bergquist, Brett wrote: If I have a table with millions of rows and I invoke syscs_util.update_statistics on it, will the table/indexes be lock such that inserts or updates will fail while

RE: opinions on a less aggressive release of the istats feature?

2011-03-14 Thread Bergquist, Brett
Just from the peanut gallery, this new istat feature will be greatly appreciated when available. At least from me it will be ;) It is the one thing missing for a truly no dba system. We have a system installed that provisions and measures network performance for a large wireless

Question about TRUNCATE TABLE and freeing disk space

2011-03-29 Thread Bergquist, Brett
I have to do a poor man's partitioning because I have a table where records are constantly being added (right now about 1.7 million per day) and I need to purge older records out. My plan is to partition incoming records into separate tables for a week and then to drop a week's worth of data

RE: Question about TRUNCATE TABLE and freeing disk space

2011-03-29 Thread Bergquist, Brett
on the effect of TRUNCATE TABLE. -Original Message- From: Rick Hillegas [mailto:rick.hille...@oracle.com] Sent: Tuesday, March 29, 2011 9:25 AM To: derby-dev@db.apache.org Subject: Re: Question about TRUNCATE TABLE and freeing disk space On 3/29/11 5:02 AM, Bergquist, Brett wrote: I have to do

RE: Question about TRUNCATE TABLE and freeing disk space

2011-03-29 Thread Bergquist, Brett
H. Wanvik [mailto:dag.wan...@oracle.com] Sent: Tuesday, March 29, 2011 10:32 AM To: derby-dev@db.apache.org Subject: Re: Question about TRUNCATE TABLE and freeing disk space Bergquist, Brett bbergqu...@canoga.com writes: immediately brought this down to 46Gb of disk space. I do not have

RE: Question about TRUNCATE TABLE and freeing disk space

2011-03-29 Thread Bergquist, Brett
system with the system running flat out you are automatically generating the checkpoints in the background and this is the difference between what you and rick are seeing. /mikem Bergquist, Brett wrote: My point Dag is that even though I did not checkpoint the database, Derby released

Question on a new reserved word maybe?

2011-05-31 Thread Bergquist, Brett
We had been using Derby 10.5.3.1 and just upgrade to 10.8.2.1 and a DDL statement that used to work in Derby 10.5.3.1 no longer works and complains about a syntax error . Here is the statement: create table JIDataType ( id bigint not null, type smallint, maxLength integer, decimals integer,

RE: Question on a new reserved word maybe?

2011-05-31 Thread Bergquist, Brett
, Bergquist, Brett wrote: We had been using Derby 10.5.3.1 and just upgrade to 10.8.2.1 and a DDL statement that used to work in Derby 10.5.3.1 no longer works and complains about a syntax error . Here is the statement: create table JIDataType ( id bigint not null, type smallint, maxLength

RE: Question on a new reserved word maybe?

2011-05-31 Thread Bergquist, Brett
...@oracle.com] Sent: Tuesday, May 31, 2011 12:07 PM To: derby-dev@db.apache.org Subject: Re: Question on a new reserved word maybe? I have logged DERBY-5254 to track this issue. Thanks again for finding it, -Rick On 5/31/11 8:15 AM, Bergquist, Brett wrote: We had been using Derby 10.5.3.1 and just

RE: Question on a new reserved word maybe?

2011-05-31 Thread Bergquist, Brett
the product jars according to the instructions here: http://db.apache.org/derby/dev/derby_source.html#How+to+build+Derby The real core of the process is documented here: http://svn.apache.org/viewvc/db/derby/code/trunk/BUILDING.html?view=co Hope this helps, -Rick On 5/31/11 9:25 AM, Bergquist, Brett

RE: Question on a new reserved word maybe?

2011-06-01 Thread Bergquist, Brett
be able to test-drive the fix. Regards, -Rick On 5/31/11 10:32 AM, Bergquist, Brett wrote: Thanks. -Original Message- From: Rick Hillegas [mailto:rick.hille...@oracle.com] Sent: Tuesday, May 31, 2011 1:31 PM To: derby-dev@db.apache.org Subject: Re: Question on a new reserved word

Question on log directory of a derby database

2011-07-18 Thread Bergquist, Brett
I have a database in production that has been running fine for a few years. It started out having about 100K inserts per day into it and now is up to about 4.6M inserts per day and this has been working fine. Tonight the customer called because the system was chewing up disk space. I had

RE: Question on log directory of a derby database

2011-07-19 Thread Bergquist, Brett
and about 12 files. DAT files are created and then removed as expected. The system is currently doing about 50 inserts/second and the DAT files do not build up. Brett -Original Message- From: Bergquist, Brett [mailto:bbergqu...@canoga.com] Sent: Tuesday, July 19, 2011 1:03 AM To: derby

RE: Question on log directory of a derby database

2011-07-19 Thread Bergquist, Brett
To: derby-dev@db.apache.org Subject: Re: Question on log directory of a derby database Bergquist, Brett bbergqu...@canoga.com writes: I have a database in production that has been running fine for a few years. It started out having about 100K inserts per day into it and now is up to about 4.6M

RE: Question on log directory of a derby database

2011-07-19 Thread Bergquist, Brett
in the log file. These can stay around after clients crash or exit if not properly committed or aborted. Bergquist, Brett wrote: Thanks for taking the time to respond Knut. It is much appreciated. Some information: The log files total 64Gb of disk space. So this clearly went way past

RE: Question on log directory of a derby database

2011-07-19 Thread Bergquist, Brett
[mailto:knut.hat...@oracle.com] Sent: Tuesday, July 19, 2011 9:41 AM To: derby-dev@db.apache.org Subject: Re: Question on log directory of a derby database Bergquist, Brett bbergqu...@canoga.com writes: I have a database in production that has been running fine for a few years. It started out

RE: Question on log directory of a derby database

2011-07-19 Thread Bergquist, Brett
to keep a very old transaction in the log file. These can stay around after clients crash or exit if not properly committed or aborted. Bergquist, Brett wrote: Thanks for taking the time to respond Knut. It is much appreciated. Some information: The log files total 64Gb of disk space. So

RE: Question on log directory of a derby database

2011-07-19 Thread Bergquist, Brett
after taking them. So at least they should be booted after making them to verify they have no errors. Also useful is to run the consistency checker on them. This can be done on a different machine if necessary, Derby databases are portable across devices/machines. Bergquist, Brett wrote: I did

RE: Question on log directory of a derby database

2011-07-20 Thread Bergquist, Brett
on your log device. Derby does not have many tools to help with I/O performance, it mostly counts on the OS to provide those. So to get write performance it may help to stripe the disk by the OS. Derby does allow you to split Data I/O and log I/O across multiple disks. Bergquist, Brett wrote

Question on Derby Style Table Functions

2011-07-22 Thread Bergquist, Brett
I am implementing a poor man's data partitioning with data being inserted into different tables depending on the week of the year. I want to bring these tables back together as single virtual unified table that can be queried up only, no inserts or updates required. I am looking at maybe

Problem in trying to get a Restricted Table Function loaded

2011-07-24 Thread Bergquist, Brett
My class looks like: public class NpaResultsTableFunction extends VTITemplate implements RestrictedVTI { public static NpaResultsTableFunction read() throws SQLException { return new NpaResultsTableFunction(); } public NpaResultsTableFunction() throws SQLException {

Re: Problem in trying to get a Restricted Table Function loaded

2011-07-25 Thread Bergquist, Brett
not find the class. Brett Bergquist Principal Software Engineer Phone: 203 888 7914 Ext 204 Email: bbergqu...@canoga.com - Reply message - From: Bergquist, Brett bbergqu...@canoga.com Date: Sun, Jul 24, 2011 11:19 am Subject: Problem in trying to get a Restricted Table Function loaded

RE: Question on Derby Style Table Functions

2011-07-25 Thread Bergquist, Brett
From: Dag H. Wanvik [dag.wan...@oracle.com] Sent: Monday, July 25, 2011 12:14 PM To: derby-dev@db.apache.org Subject: Re: Question on Derby Style Table Functions Bergquist, Brett bbergqu...@canoga.com writes: I am implementing a poor man's data partitioning with data

Code loaded through SQL.INSTALL_JAR does not have access to derby API code. Is this expected?

2011-07-25 Thread Bergquist, Brett
in the documentation does it say that this cannot be done, but it does not work. Should I write up an issue in JIRA? From: Bergquist, Brett Sent: Monday, July 25, 2011 9:23 AM To: Bergquist, Brett; derby-dev@db.apache.org Subject: Re: Problem in trying to get

RE: Code loaded through SQL.INSTALL_JAR does not have access to derby API code. Is this expected?

2011-07-25 Thread Bergquist, Brett
org.apache.derby.vti.RestrictedVTI? This seems to prevent Restricted Table functions from being loaded jar files stored in the database. From: Bergquist, Brett Sent: Monday, July 25, 2011 12:44 PM To: Bergquist, Brett; derby-dev@db.apache.org Subject: Code loaded

RE: Code loaded through SQL.INSTALL_JAR does not have access to derby API code. Is this expected?

2011-07-26 Thread Bergquist, Brett
. From: Knut Anders Hatlen [knut.hat...@oracle.com] Sent: Monday, July 25, 2011 2:47 PM To: derby-dev@db.apache.org Cc: Bergquist, Brett Subject: Re: Code loaded through SQL.INSTALL_JAR does not have access to derby API code. Is this expected? Bergquist, Brett bbergqu...@canoga.com writes: I found

RE: Code loaded through SQL.INSTALL_JAR does not have access to derby API code. Is this expected?

2011-07-26 Thread Bergquist, Brett
So it seems that DERBY-2331 disables access to org.apache.derby.* namespace but the comment says except for public apis. It seems to me that the RestrictedVTI and VTICosting are public API's now. From: Bergquist, Brett [bbergqu...@canoga.com] Sent

Questions on using a View or a Restricted Table Function

2011-07-27 Thread Bergquist, Brett
Some background. I am implementing a poor man's partitioning mechanism to solve a database deleting and space cleanup problem. I have records being inserted into a table at the rate of about 50/second right now and these need to stay around for a while and then are aged out. We found that

What do I need to change to affect the derby release build number

2011-08-01 Thread Bergquist, Brett
I need to build a private copy of Derby 10.8.1.2 with a fix for: https://issues.apache.org/jira/browse/DERBY-5352 And I want to uniquely identify that this is my private build and not build 10.8.1.2. Where should I make a change so that this can easily be seen. I would really like this to

RE: What do I need to change to affect the derby release build number

2011-08-01 Thread Bergquist, Brett
] Sent: Monday, August 01, 2011 5:51 PM To: derby-dev@db.apache.org Subject: Re: What do I need to change to affect the derby release build number Bergquist, Brett bbergqu...@canoga.com writes: I need to build a private copy of Derby 10.8.1.2 with a fix for: https://issues.apache.org/jira/browse

RE: [jira] [Commented] (DERBY-5352) Derby table functions stored in a jar file inside the database which implement VTICosting or RestrictedVTI fail with ClassNotFoundException

2011-08-02 Thread Bergquist, Brett
I will fax a signed CLA tonight EST. -Original Message- From: Rick Hillegas (JIRA) [mailto:j...@apache.org] Sent: Tuesday, August 02, 2011 2:36 PM To: derby-dev@db.apache.org Subject: [jira] [Commented] (DERBY-5352) Derby table functions stored in a jar file inside the database which

Need help in running tests

2011-08-02 Thread Bergquist, Brett
I am trying to run the current test using the ant target junit-all, but all tests fail. Obviously I have not setup something in my environment. For example in one test, I see the following: error message=org.apache.derbyTesting.functionTests.tests.demo._Suite

RE: Need help in running tests

2011-08-03 Thread Bergquist, Brett
, -Rick On 8/2/11 6:55 PM, Bergquist, Brett wrote: I am trying to run the current test using the ant target junit-all, but all tests fail. Obviously I have not setup something in my environment. For example in one test, I see the following: error message

Need guidance in writing test for (DERBY-5370) The toSQL method of the org.apache.derby.vti.Restriction class does not output correct constants for VARCHAR, Timestamp, Date, Time, or CHAR FOR BIT DATA

2011-08-05 Thread Bergquist, Brett
Where in the testing packages should this type of test go. The RestrictedVTI is tested as part of org.apache.derbyTesting.functionTests.tests.lang but this really is an API test, not a language test. So where would the appropriate place be? From: Brett

Error when running SYSCS_UTIL.SYSCS_CHECK_TABLE

2011-08-09 Thread Bergquist, Brett
Database engine is 10.8.1.2 (built from source with a patch for Restricted table support) and I am running this in embedded mode. Am getting the following error: ERROR 38000: The exception 'java.lang.NullPointerException' was thrown while evaluating an expression. ERROR XJ001: Java exception:

RE: Error when running SYSCS_UTIL.SYSCS_CHECK_TABLE

2011-08-09 Thread Bergquist, Brett
a complete stack trace with line numbers. Thanks, -Rick On 8/9/11 8:24 AM, Bergquist, Brett wrote: Database engine is 10.8.1.2 (built from source with a patch for Restricted table support) and I am running this in embedded mode. Am getting the following error: ERROR 38000: The exception

RE: Error when running SYSCS_UTIL.SYSCS_CHECK_TABLE

2011-08-11 Thread Bergquist, Brett
running SYSCS_UTIL.SYSCS_CHECK_TABLE Hi Brett, Is there anything in derby.log? If you run with the debug/sane jars, I would expect that derby.log would hold a complete stack trace with line numbers. Thanks, -Rick On 8/9/11 8:24 AM, Bergquist, Brett wrote: Database engine is 10.8.1.2 (built from

RE: Error when running SYSCS_UTIL.SYSCS_CHECK_TABLE

2011-08-12 Thread Bergquist, Brett
SYSCS_UTIL.SYSCS_CHECK_TABLE Thanks, Brett. Some comments inline... On 8/11/11 4:12 AM, Bergquist, Brett wrote: Ran it again. It took quite a bit longer with the sane jars, almost 24 hours this time. However, the same error is reported. Derby.log has no stack trace either. I ran the check

Question on unloading in an embedded environment

2011-08-16 Thread Bergquist, Brett
I am writing a database copy utility that is built upon the dblook utility and using the SYSCS_UTIL.SYSCS_EXPORT_TABLE and SYSCS_UTIL.SYSCS_IMPORT_TABLE procedures and I have this mostly working. When running this on a large database (110Gb) I am getting an OutOfMemory exception. I have the

RE: Question on unloading in an embedded environment

2011-08-17 Thread Bergquist, Brett
...@oracle.com] Sent: Tuesday, August 16, 2011 9:20 AM To: derby-dev@db.apache.org Subject: Re: Question on unloading in an embedded environment On 8/16/11 5:56 AM, Bergquist, Brett wrote: I am writing a database copy utility that is built upon the dblook utility and using

RE: Question on unloading in an embedded environment

2011-08-17 Thread Bergquist, Brett
This was run with 8gb of heap available. The system is a Oracle M3000 with 32Gb of real ram. It did not run out of swap while running, so it hit the heap max. Why would the sorter be called when doing a SYSCS_IMPORT_TABLE? That is all this application is doing. It exports a table from one

RE: Question on unloading in an embedded environment

2011-08-17 Thread Bergquist, Brett
Here is the whole application. It is still in a rough format but on a smaller database it does indeed work correctly. The only thing that it cannot do when copying the database is handle GENERATED ALWAYS columns. For these, it turns them into GENERATED BY DEFAULT and as the last step

RE: Question on unloading in an embedded environment

2011-08-17 Thread Bergquist, Brett
and with a smaller heap dump to be able to get a allocation traceback. -Original Message- From: Bergquist, Brett [mailto:bbergqu...@canoga.com] Sent: Wednesday, August 17, 2011 10:49 AM To: derby-dev@db.apache.org Subject: RE: Question on unloading in an embedded environment This was run

RE: Features page

2011-08-17 Thread Bergquist, Brett
Okay, I am going to open a new JIRA issue for this. -Original Message- From: Rick Hillegas [mailto:rick.hille...@oracle.com] Sent: Wednesday, August 17, 2011 2:55 PM To: derby-dev@db.apache.org Subject: Re: Features page On 8/17/11 11:30 AM, dag.wan...@oracle.com wrote: Hi folks, I

RE: Features page

2011-08-17 Thread Bergquist, Brett
Wrong reply to. Sorry ;) -Original Message- From: Bergquist, Brett [mailto:bbergqu...@canoga.com] Sent: Wednesday, August 17, 2011 3:17 PM To: derby-dev@db.apache.org Subject: RE: Features page Okay, I am going to open a new JIRA issue for this. -Original Message- From: Rick

RE: Question on unloading in an embedded environment

2011-08-17 Thread Bergquist, Brett
, 2011 2:57 PM To: derby-dev@db.apache.org Subject: Re: Question on unloading in an embedded environment On 8/17/11 11:03 AM, Bergquist, Brett wrote: I have a report generated by MemoryAnalyzer (Eclipse) tool. The report is stored as a zip file that contains the HTML and images. Can I attach

Have a database that has a phantom transaction even after booting the database clean in embedded mode

2011-08-18 Thread Bergquist, Brett
I have a database that shows a phantom transaction even after booting the database in embedded mode.This is Derby 10.8.1.2. The database has 600 log files in the log directory. I connect to the database using IJ in embedded mode and it takes a while for the database to boot. Using truss

RE: [jira] [Commented] (DERBY-5387) Memory leak or unbounded consumption problem when running a utility to copy one database to another using SYSCS_EXPORT_TABLE and SYSCS_IMPORT_TABLE

2011-08-19 Thread Bergquist, Brett
Can you point me to the docs on how to do a debug build. I have build derby recently both sane and insane builds and know how to run the tests now, so point me in the correct direction and I will investigate more. Also, I believe you are correct on the leaking. Good catch! I will fix that

RE: Have a database that has a phantom transaction even after booting the database clean in embedded mode

2011-08-23 Thread Bergquist, Brett
mode Bergquist, Brett bbergqu...@canoga.com writes: I have a database that shows a phantom transaction even after booting the database in embedded mode. This is Derby 10.8.1.2. The database has 600 log files in the log directory. I connect to the database using IJ in embedded mode and it takes

RE: Have a database that has a phantom transaction even after booting the database clean in embedded mode

2011-08-23 Thread Bergquist, Brett
Thanks Kathy. I will do some reading on this. -Original Message- From: Kathey Marsden [mailto:kmarsdende...@sbcglobal.net] Sent: Tuesday, August 23, 2011 9:19 AM To: derby-dev@db.apache.org Cc: Bergquist, Brett Subject: Re: Have a database that has a phantom transaction even after

RE: Have a database that has a phantom transaction even after booting the database clean in embedded mode

2011-08-23 Thread Bergquist, Brett
Sorry Kathey I spelt your name wrong in the previous response :( -Original Message- From: Bergquist, Brett [mailto:bbergqu...@canoga.com] Sent: Tuesday, August 23, 2011 9:33 AM To: Kathey Marsden; derby-dev@db.apache.org Subject: RE: Have a database that has a phantom transaction even

RE: [jira] [Commented] (DERBY-5387) Memory leak or unbounded consumption problem when running a utility to copy one database to another using SYSCS_EXPORT_TABLE and SYSCS_IMPORT_TABLE

2011-08-30 Thread Bergquist, Brett
Will try to get to it today. But power issues here in the east coast of the US because of the hurricane are making this difficult. From: Kristian Waagan (JIRA) [j...@apache.org] Sent: Tuesday, August 30, 2011 4:56 AM To: derby-dev@db.apache.org Subject:

RE: Performance problem with derby

2011-08-30 Thread Bergquist, Brett
Take a look at using the runtime statistics to retrieve the query plan and make sure your index is being used. http://db.apache.org/derby/docs/10.8/tuning/tuningderby.pdf I think that maybe the index is not being used for the ordering and a disk based sort is being done.

RE: Performance problem with derby

2011-08-31 Thread Bergquist, Brett
Do it this way: CALL SYSCS_UTIL.SYSCS_SET_RUNTIMESTATISTICS(1); SELECT * FROM ; VALUES SYSCS_UTIL.SYSCS_GET_RUNTIMESTATISTICS(); CALL SYSCS_UTIL.SYSCS_SET_RUNTIMESTATISTICS(0); Replace the SELECT * FROM ... with your query. The VALUES SYS... will return one row, one column that contains

RE: Performance problem with derby

2011-09-01 Thread Bergquist, Brett
Yes, Squirrel does strip away the comments. I have had this problem in the past. -Original Message- From: Knut Anders Hatlen [mailto:knut.hat...@oracle.com] Sent: Thursday, September 01, 2011 5:04 AM To: derby-dev@db.apache.org Subject: Re: Performance problem with derby mogoye

RE: [jira] [Commented] (DERBY-5387) Memory leak or unbounded consumption problem when running a utility to copy one database to another using SYSCS_EXPORT_TABLE and SYSCS_IMPORT_TABLE

2011-09-01 Thread Bergquist, Brett
Finally with power restored here (hurricane Irene here on the east coast of the U.S. put me out of commission for a while) I fixed the connection leak and with a -Xmx4096 -d64 I was able to get this to work whereas before I fixed the connection leak with up to 24Gb of memory it would always

Got an error doing an online backup and don't know where to look

2011-11-28 Thread Bergquist, Brett
Got this error two nights in a row now while doing an online backup: [sql] Failed to execute: CALL SYSCS_UTIL.SYSCS_BACKUP_DATABASE('/containe r1/backup/database/2011-11-28_00-15') [sql] java.sql.SQLException: Cannot backup the database, got an I/O Except ion while writing to the

RE: Got an error doing an online backup and don't know where to look

2011-11-28 Thread Bergquist, Brett
on the ant command line in order to tell Derby to write more information to derby.log. Hope this helps, -Rick On 11/28/11 6:08 AM, Bergquist, Brett wrote: Got this error two nights in a row now while doing an online backup: [sql] Failed to execute: CALL SYSCS_UTIL.SYSCS_BACKUP_DATABASE

RE: Got an error doing an online backup and don't know where to look

2011-11-30 Thread Bergquist, Brett
It appears this problem was a disk space issue so for now I am good with the error that was reported. Thanks for the feedback. Brett -Original Message- From: Bergquist, Brett [mailto:bbergqu...@canoga.com] Sent: Monday, November 28, 2011 9:44 AM To: derby-dev@db.apache.org Subject: RE

Question about online backup

2011-12-02 Thread Bergquist, Brett
We currently use the SYSCS_UTIL.SYSCS_BACKUP_DATABASE procedure to perform an online backup of the database. This has been working well. We are wondering however, if we can control the relative priority of this backup to have less of an impact on the normal concurrent operation of the

how can I force a rollback of an XA transaction

2011-12-06 Thread Bergquist, Brett
The JVM that derby was running in crashed with a SEGV. There application server also went down. When I brought both up, the database shows two XA transactions in the PREPARE state (looking at syscs_diag.transaction_table) but the application server has no reference to these transactions to

RE: how can I force a rollback of an XA transaction

2011-12-06 Thread Bergquist, Brett
longer to come up with this myself. Brett -Original Message- From: Knut Anders Hatlen [mailto:knut.hat...@oracle.com] Sent: Tuesday, December 06, 2011 9:27 AM To: derby-dev@db.apache.org Subject: Re: how can I force a rollback of an XA transaction Bergquist, Brett bbergqu...@canoga.com

RE: how can I force a rollback of an XA transaction

2011-12-06 Thread Bergquist, Brett
. The utility is basically what you suggested Knut. Any ideas on where to go from here? -Original Message- From: Bergquist, Brett [mailto:bbergqu...@canoga.com] Sent: Tuesday, December 06, 2011 9:50 AM To: derby-dev@db.apache.org Subject: RE: how can I force a rollback of an XA transaction I

RE: how can I force a rollback of an XA transaction - is there a way to get the database into this same state

2011-12-06 Thread Bergquist, Brett
(2)); //rs.close(); //con.close(); } // Handle any errors that may have occurred. catch (Exception e) { e.printStackTrace(); } System.exit(1); -Original Message- From: Bergquist, Brett [mailto:bbergqu...@canoga.com] Sent

Seeing something like DERBY-2220 (marked closed/fixed) happening

2011-12-06 Thread Bergquist, Brett
In a previous email I discussed that I have a database with 44 XA transactions in the ACTIVE state associated with no connections. In trying to find out the cause and a possible solution, I tried writing a test case that would put the database into the same state. Below is the code to get the

RE: Seeing something like DERBY-2220 (marked closed/fixed) happening

2011-12-06 Thread Bergquist, Brett
transaction should be rolled back implicitly. Any thoughts? From: Bergquist, Brett [bbergqu...@canoga.com] Sent: Tuesday, December 06, 2011 3:29 PM To: derby-dev@db.apache.org Subject: Seeing something like DERBY-2220 (marked closed/fixed) happening

RE: Problem with a deadlock with Derby 10.8.1.2 and Glassfish V2.1.1

2011-12-21 Thread Bergquist, Brett
am going to enable tracing and see what I find. From: Katherine Marsden [mailto:kmarsdende...@sbcglobal.net] Sent: Wednesday, December 21, 2011 11:14 AM To: derby-dev@db.apache.org Subject: Re: Problem with a deadlock with Derby 10.8.1.2 and Glassfish V2.1.1 On 12/21/2011 6:14 AM, Bergquist

RE: Problem with a deadlock with Derby 10.8.1.2 and Glassfish V2.1.1

2011-12-21 Thread Bergquist, Brett
if the socketOutputStream passed to sendBytes is null. Note that the Glassfish database connection pool is setup to close all connection on a connection error. From: Bergquist, Brett [mailto:bbergqu...@canoga.com] Sent: Wednesday, December 21, 2011 11:34 AM To: derby-dev@db.apache.org Subject: RE: Problem

RE: Problem with a deadlock with Derby 10.8.1.2 and Glassfish V2.1.1

2011-12-21 Thread Bergquist, Brett
[mailto:kmarsdende...@sbcglobal.net] Sent: Wednesday, December 21, 2011 2:46 PM To: derby-dev@db.apache.org Subject: Re: Problem with a deadlock with Derby 10.8.1.2 and Glassfish V2.1.1 On 12/21/2011 11:20 AM, Bergquist, Brett wrote: I'm having some trouble getting client side tracing to work. The connections

RE: Problem with a deadlock with Derby 10.8.1.2 and Glassfish V2.1.1

2011-12-21 Thread Bergquist, Brett
))) From: Katherine Marsden [mailto:kmarsdende...@sbcglobal.net] Sent: Wednesday, December 21, 2011 2:46 PM To: derby-dev@db.apache.org Subject: Re: Problem with a deadlock with Derby 10.8.1.2 and Glassfish V2.1.1 On 12/21/2011 11:20 AM, Bergquist, Brett wrote: I'm having some trouble getting client

RE: Problem with a deadlock with Derby 10.8.1.2 and Glassfish V2.1.1

2011-12-21 Thread Bergquist, Brett
://issues.apache.org/jira/browse/DERBY-4109 From: Bergquist, Brett [mailto:bbergqu...@canoga.com] Sent: Wednesday, December 21, 2011 3:33 PM To: derby-dev@db.apache.org Subject: RE: Problem with a deadlock with Derby 10.8.1.2 and Glassfish V2.1.1 After shutting down the application server but leaving the database

RE: Problem with a deadlock with Derby 10.8.1.2 and Glassfish V2.1.1

2011-12-21 Thread Bergquist, Brett
Subject: Re: Problem with a deadlock with Derby 10.8.1.2 and Glassfish V2.1.1 On 12/21/2011 12:04 PM, Bergquist, Brett wrote: Nothing in the Derby log other than it logging a deadlock with the statements and a lock timeout with its statements and it indicating that cleanup had started

RE: Problem with a deadlock with Derby 10.8.1.2 and Glassfish V2.1.1

2011-12-22 Thread Bergquist, Brett
with Derby 10.8.1.2 and Glassfish V2.1.1 On 12/21/2011 3:14 PM, Bergquist, Brett wrote: Will get to this tomorrow but I do see one comment in the code that I don't understand: In DRDAConnThread.java, I see: if (severity CodePoint.SVRCOD_ERROR

RE: [jira] [Commented] (DERBY-5552) Derby threads hanging when using ClientXADataSource and a deadlock or lock timeout occurs

2011-12-23 Thread Bergquist, Brett
Well, I see that at the start of the execution, even on the next retry, the isValid is true for the statement. Something comes along and changes the state of isValid. I am having trouble finding out what with the debugger because there are quite a few threads running (statistics daemon for

RE: [jira] [Commented] (DERBY-5552) Derby threads hanging when using ClientXADataSource and a deadlock or lock timeout occurs

2011-12-23 Thread Bergquist, Brett
threads :( -Original Message- From: Bergquist, Brett [mailto:bbergqu...@canoga.com] Sent: Friday, December 23, 2011 10:54 AM To: derby-dev@db.apache.org Subject: RE: [jira] [Commented] (DERBY-5552) Derby threads hanging when using ClientXADataSource and a deadlock or lock timeout occurs Well

RE: [jira] [Commented] (DERBY-5552) Derby threads hanging when using ClientXADataSource and a deadlock or lock timeout occurs

2011-12-23 Thread Bergquist, Brett
, 2011 5:08 PM To: derby-dev@db.apache.org Subject: Re: [jira] [Commented] (DERBY-5552) Derby threads hanging when using ClientXADataSource and a deadlock or lock timeout occurs On 23.12.2011 17:49, Bergquist, Brett wrote: It is the IndexStatisticsDaemonImpl that is invalidating the statement

How does one retreive the exact source from SVN that corresponds to the 10.8.2.2 release

2011-12-27 Thread Bergquist, Brett
I need to patch this release for https://issues.apache.org/jira/browse/DERBY-5552 and I find it easier to track any local changes using source code control. So I was wondering how to get the exact source for Derby 10.8.2.2 from SVN? I know how to get the 10.8 branch, but I believe that has

RE: How does one retreive the exact source from SVN that corresponds to the 10.8.2.2 release

2011-12-27 Thread Bergquist, Brett
, Bergquist, Brett wrote: I need to patch this release for https://issues.apache.org/jira/browse/DERBY-5552 and I find it easier to track any local changes using source code control. So I was wondering how to get the exact source for Derby 10.8.2.2 from SVN? I know how to get the 10.8 branch, but I

RE: How does one retreive the exact source from SVN that corresponds to the 10.8.2.2 release

2011-12-27 Thread Bergquist, Brett
:10 AM, Bergquist, Brett bbergqu...@canoga.com wrote: I need to patch this release for https://issues.apache.org/jira/browse/DERBY-5552 and I find it easier to track any local changes using source code control.   So I was wondering how to get the exact source for Derby 10.8.2.2 from SVN?  I know

RE: How does one retreive the exact source from SVN that corresponds to the 10.8.2.2 release

2011-12-27 Thread Bergquist, Brett
, Bergquist, Brett bbergqu...@canoga.com wrote: I need to patch this release for https://issues.apache.org/jira/browse/DERBY-5552 and I find it easier to track any local changes using source code control.   So I was wondering how to get the exact source for Derby 10.8.2.2 from SVN?  I know how

Could someone give me some guidance on DERBY-5560

2011-12-28 Thread Bergquist, Brett
I created https://issues.apache.org/jira/browse/DERBY-5560 and am seeing this in production. Basically what is happening is that the LogicalConnection.close() is being called which attempts to recycle the physical connection by calling ClientPooledConnection.recycleConnection(). At the same

RE: [jira] [Commented] (DERBY-5561) Race conditions in LogicalConnection checking for a null physical connection

2011-12-28 Thread Bergquist, Brett
There are two threads accessing the same connection but this is because of the connection pool. When you configure a connection pool in Glassfish you can configure error handling on the pool. One option that can be configured is to configure the connection pool such that any error on any

RE: [jira] [Commented] (DERBY-5561) Race conditions in LogicalConnection checking for a null physical connection

2011-12-28 Thread Bergquist, Brett
I have to get in the habit of putting the responses and stuff in the Jira. I did not realize that your message was from updating the Jira and just hit Reply. I will be better in the future but I am still an egg :) -Original Message- From: Kathey Marsden (Commented) (JIRA)

Where can I find information on how to turn on tracing

2011-12-28 Thread Bergquist, Brett
I am pursuing a bug where when the Network Client receives a Lock Timeout exception in PreparedStatement.java: public int executeUpdate() throws SQLException { try { synchronized (connection_) { if (agent_.loggingEnabled()) {

I see what might be a problem in the code handling lock timeout exceptions

2011-12-29 Thread Bergquist, Brett
In the code in various places there are calls such as: // 2 kinds of errors here expected here. Either container not // found or could not obtain lock (LOCK_TIMEOUT or DEADLOCK). // // It is possible by the time this post commit work gets scheduled

Patches attached to issues DERBY-5552, DERBY-5560, DERBY-5561, DERBY-5562, DERBY-5564

2012-01-03 Thread Bergquist, Brett
I have attached patches to the issues: https://issues.apache.org/jira/browse/DERBY-5552 https://issues.apache.org/jira/browse/DERBY-5560 https://issues.apache.org/jira/browse/DERBY-5561 https://issues.apache.org/jira/browse/DERBY-5562 https://issues.apache.org/jira/browse/DERBY-5564 The patches

Can anyone help with predicting how long/how big a transaction log will be when updating 10 Million records

2012-01-09 Thread Bergquist, Brett
I have a database upgrade that is currently running at a customer site. Little did I know that their database table has between 10 and 11 million records. The upgrade is a updating one column with a fixed value. It is doing UPDATE WEEK_TABLE SET WEEK = 2 The column is a small integer.

RE: Can anyone help with predicting how long/how big a transaction log will be when updating 10 Million records

2012-01-09 Thread Bergquist, Brett
Got my own answer :) 1859 log files and 1 hour 45 minutes. Ouch, don't know if I will do that one again. From: Bergquist, Brett Sent: Monday, January 09, 2012 8:57 AM To: derby-dev@db.apache.org Subject: Can anyone help with predicting how long/how big

Quetion on out memory usage

2012-02-15 Thread Bergquist, Brett
I had a user in our production server that performed a query through a web service interface that requested to retrieve and perform a multi-level sort on probably 30 million records. The tables being queried on are in a UNION (basically one table for each week of the year and the query was

RE: Quetion on out memory usage

2012-02-15 Thread Bergquist, Brett
I forgot this is Derby 10.8.2.2 From: Bergquist, Brett [mailto:bbergqu...@canoga.com] Sent: Wednesday, February 15, 2012 11:46 AM To: derby-dev@db.apache.org Subject: Quetion on out memory usage I had a user in our production server that performed a query through a web service interface

  1   2   3   >