RE: Any idea why a sequence is getting "Derby could not obtain the locks needed to release the unsused preallocated values for the sequence" error

2017-09-20 Thread Bergquist, Brett
on statement logging to make sure and see if I can get this into a smaller reproducible case. From: Rick Hillegas [mailto:rick.hille...@gmail.com] Sent: Tuesday, September 19, 2017 7:55 PM To: derby-dev@db.apache.org; Bergquist, Brett Subject: Re: Any idea why a sequence is getting "Derby

Any idea why a sequence is getting "Derby could not obtain the locks needed to release the unsused preallocated values for the sequence" error

2017-09-19 Thread Bergquist, Brett
I have a simple application that is running with no other access to the database. A sequence is defined CREATE SEQUENCE LOG_ENTRY_SEQUENCE AS BIGINT START WITH 1 MINVALUE 1 CYCLE The application is retrieving the next sequence number with a "VALUES (NEXT VALUE FOR LOG_ENTRY_SEQUENCE)"

RE: Could use some thoughts on a problem with a query in production

2017-06-09 Thread Bergquist, Brett
I agree Bryan. I am trying both routes in going to provide some more detailed monitor at the customer site as well as working on trying to simulate the same access pattern and hopefully get something reproducible. So more insight. This table would have had a high insert rate and probably

Re: Could use some thoughts on a problem with a query in production

2017-06-06 Thread Bergquist, Brett
Thanks Bryan. I am looking at all things :) The fact that it is not reproducible with a copy of the database is a hinderance but also can indicate something external. The interesting thing is that the same query with the same parameters was run 40 times over about an 8 hour period with

RE: Could use some thoughts on a problem with a query in production

2017-06-06 Thread Bergquist, Brett
looking at what triggers the statistics update and if it might be at play here. Thanks Katherine Sent from my iPhone On Jun 5, 2017, at 12:04 PM, Bergquist, Brett <bbergqu...@canoga.com<mailto:bbergqu...@canoga.com>> wrote: Background: · A large database approx

Could use some thoughts on a problem with a query in production

2017-06-05 Thread Bergquist, Brett
Background: * A large database approximately 750G * derby.storage.pageCacheSize=64000 * Inserts going into the database about 125/second * Other database updates and deletes are being performed at a lower rate. A query is run by the customer that does not

RE: Need some help in trying to figure out a corrupt database

2016-08-08 Thread Bergquist, Brett
'm glad to hear that this tool was useful on an old database. Some comments inline... On 8/7/16, 5:33 PM, Bergquist, Brett wrote: > Mike, Rick, Bryan, others. There was definite corruption in one page for > one table: > > 421677 |HARDWARE

Re: Need some help in trying to figure out a corrupt database

2016-08-07 Thread Bergquist, Brett
w if describe prints the columns in the order they are > actually stored in the db? > > if you have unique keys and the indexes are good, there may be some ways to > better get at the data. > > /mikem > > On 7/27/2016 7:16 AM, Bergquist, Brett wrote: >> I wrote a tool

RE: Need some help in trying to figure out a corrupt database

2016-07-27 Thread Bergquist, Brett
l Message----- From: Bergquist, Brett [mailto:bbergqu...@canoga.com] Sent: Wednesday, July 27, 2016 2:18 PM To: derby-dev@db.apache.org Subject: RE: Need some help in trying to figure out a corrupt database More info. I looked to see what filenames are for a newly created database and 'c470.dat' co

RE: Need some help in trying to figure out a corrupt database

2016-07-27 Thread Bergquist, Brett
that I am having issues with. So it appears the tool is looking for a 'SYSUSERS' table, that does not exist when the database is old and upgraded many times. -Original Message- From: Bergquist, Brett [mailto:bbergqu...@canoga.com] Sent: Wednesday, July 27, 2016 1:57 PM To: derby-dev

RE: Need some help in trying to figure out a corrupt database

2016-07-27 Thread Bergquist, Brett
I will try to get that Brian. Unfortunately, the database is 470GB so moving it around and accessing it is not trivial. I also tried to use the tool from https://issues.apache.org/jira/browse/DERBY-6136 When I run this tool I get an error that looks like: ij> connect

Need some help in trying to figure out a corrupt database

2016-07-27 Thread Bergquist, Brett
I wrote a tool to call SYSCS_UTIL.SYSCS_CHECK_TABLE on each table in the database and not just stop on error. I have a database returns the error: Checking CORE_V1.DEVICE_ENTITY failed with exception: Restore of a serializable or SQLData object of class , attempted to read more data

RE: [Java DB - testing] Failure continuous trunk (rev 1753333)

2016-07-20 Thread Bergquist, Brett
Thanks for the explanation Bryan. -Original Message- From: Bryan Pendleton [mailto:bpendleton.de...@gmail.com] Sent: Tuesday, July 19, 2016 9:53 AM To: derby-dev@db.apache.org Subject: Re: [Java DB - testing] Failure continuous trunk (rev 175) > So the message from

RE: [Java DB - testing] Failure continuous trunk (rev 1753333)

2016-07-19 Thread Bergquist, Brett
16 5:57 AM, Bergquist, Brett wrote: > Where does one find this build job so that the failures can be looked at? > Hi Brett, It's a little bit tricky. You can find information about the Apache build and test system here: http://db.apache.org/derby/derby_tests.html If you follow

RE: [Java DB - testing] Failure continuous trunk (rev 1753333)

2016-07-19 Thread Bergquist, Brett
Where does one find this build job so that the failures can be looked at? -Original Message- From: ingemar.ab...@oracle.com [mailto:ingemar.ab...@oracle.com] Sent: Tuesday, July 19, 2016 2:20 AM To: derby-dev@db.apache.org Subject: [Java DB - testing] Failure continuous trunk (rev

Re: Can someone comment on my understanding of the code relating to DERBY-6879

2016-07-04 Thread Bergquist, Brett
Thanks Kristian for pointing me in the right direction. I believe I have found some of the examples that you mentioned and can progress from there. > On Jul 2, 2016, at 6:15 AM, Kristian Waagan <krist...@apache.org> wrote: > > Den 02.07.2016 00.08, skrev Bergquist, Bre

Re: Can someone comment on my understanding of the code relating to DERBY-6879

2016-07-01 Thread Bergquist, Brett
I opened: https://issues.apache.org/jira/browse/DERBY-6896 I wrote that i need some help writing a test case whereby the test case needs to connect to the network server, perform some XA transaction work without completing, and abnormally exiting. I don’t know how to do this within the

Can someone comment on my understanding of the code relating to DERBY-6879

2016-06-30 Thread Bergquist, Brett
Resending because I did not see this appear on the list probably because I sent from my home account. — While coming up with a fix for I see this code in XATransactionState.java: /** * This function is called from the timer task when the transaction * times out. * * @see

Re: How should one handle a test case that when it fails will cause a deadlock in Derby Netwok Server

2016-06-26 Thread Bergquist, Brett
I figured to write a test to show the failure which is the case with the current release of Derby and then once I have the fix, then the test will pass. I attached a patch with the changes for the test for the issue along with the supporting DerbyWatchdog.java that detects the Java level

RE: How should one handle a test case that when it fails will cause a deadlock in Derby Netwok Server

2016-06-24 Thread Bergquist, Brett
a causes the deadlock and the watchdog detects the deadlock and then does a System.exit(1) to kill the test for now. From: Bergquist, Brett [mailto:bbergqu...@canoga.com] Sent: Friday, June 24, 2016 5:06 PM To: derby-dev@db.apache.org Subject: RE: How should one handle a test case that when it fails

RE: How should one handle a test case that when it fails will cause a deadlock in Derby Netwok Server

2016-06-24 Thread Bergquist, Brett
return false; } } But this is failing with an "java.security.AccessControlException: access denied ("java.lang.management.ManagementPermission" "monitor") Any ideas? There is probably a security policy that I need to update but have no idea where that would be? From: Bergquist

How should one handle a test case that when it fails will cause a deadlock in Derby Netwok Server

2016-06-24 Thread Bergquist, Brett
I am writing a test case for https://issues.apache.org/jira/browse/DERBY-6879 Which if written correctly will cause a deadlock in the derby network server. How should this test case recover from this? System.exit(1)? The test case will never continue because of the deadlock and the derby

RE: Need some help with getting tests to run

2016-06-23 Thread Bergquist, Brett
uot;clean" seem to remove the built jars and had to search though the ant build script to find the target "cleanjars". From: Bergquist, Brett [mailto:bbergqu...@canoga.com] Sent: Thursday, June 23, 2016 11:52 AM To: derby-dev@db.apache.org Subject: Need some help with getting tests to

Need some help with getting tests to run

2016-06-23 Thread Bergquist, Brett
I have to say I am always confused when I try to figure out how to run tests. For just a quick burn test, I downloaded the trunk source, did ant all ant build-test-jars ant junit-all And I get: C:\src\derby>ant junit-all Buildfile: C:\src\derby\build.xml junit-init-nocp: [mkdir] Created

Re: Looking at DERBY-3908 (Add a mechanism for cancelling runaway transactions)

2016-06-23 Thread Bergquist, Brett
So thoughts and some questions. Looking at the derby network client code, the Connection is synchronized on while a statement is being executed. For example from ClientConnection.java: public ResultSet executeQuery(String sql) throws SQLException { try {

Looking at DERBY-3908 (Add a mechanism for cancelling runaway transactions)

2016-06-22 Thread Bergquist, Brett
https://issues.apache.org/jira/browse/DERBY-3908 I have been researching how this can be done as well and I do follow how it could be done in embed mode. However I really need this to work in network mode. To do so seems to require that the DRDAConnThread be able to receive a message from

Possible fix for DERBY-6879

2016-06-21 Thread Bergquist, Brett
Could someone take a look at the comment that I added for https://issues.apache.org/jira/browse/DERBY-6879 Basically if we change the XATransactionState.run method to synchronize first on the "xaState.conn" (ie. the EmbedConnection) first, then this problem does not occur. This is a very

RE: Is there any debug logging available when a database is being recovered

2016-04-25 Thread Bergquist, Brett
are. -Original Message- From: Kristian Waagan [mailto:kristwaa.apa...@gmail.com] Sent: Saturday, April 23, 2016 4:22 PM To: derby-dev@db.apache.org Subject: Re: Is there any debug logging available when a database is being recovered Den 20.04.2016 16.46, skrev Bergquist, Brett: > It took lon

RE: Is there any debug logging available when a database is being recovered

2016-04-20 Thread Bergquist, Brett
It took longer (and never finished) to process the recovery logs file that it did to restore the database from the previous night from backup (that took 6 hours to "untar") At about 14 hours, the recovery log files were not finished processing so we had to give up and restore from backup.

Re: Is there any debug logging available when a database is being recovered

2016-04-19 Thread Bergquist, Brett
We are doing a “truss -p 2>&1 | grep open” but what I am seeing right now is that one complete pass was made through the logs and I thought that it was about done. Now it is going into a pattern where it processes something like log359.dat log358.dat …

Is there any debug logging available when a database is being recovered

2016-04-19 Thread Bergquist, Brett
Another issue with about 1100 log files needing to be processed after a restart of the database network server. What I would like to know is if there is any logging that can tell when pass the database recovery is on, what percentage is done, etc. Some feedback that can be used to determine

RE: Need help with clearing a XA transaction ! Important

2016-03-28 Thread Bergquist, Brett
On 3/25/2016 12:35 PM, Bergquist, Brett wrote: Shutdown would not work. It was hung on the shutdown as well. Actually the time to recover is going to be 50 hours which we don’t have. We have had to go back to a backup of the database two days ago since the backup of the database done last

Re: Need help with clearing a XA transaction ! Important

2016-03-25 Thread Bergquist, Brett
. So what is ever going to clean that up. The XAResource.recover never sees those transactions. On Mar 25, 2016, at 1:35 PM, Katherine Marsden <kmars...@apache.org<mailto:kmars...@apache.org>> wrote: On 3/25/2016 9:39 AM, Bergquist, Brett wrote: Hey Kathey, that for taking the tim

RE: Need help with clearing a XA transaction ! Important

2016-03-25 Thread Bergquist, Brett
ache.org Subject: Re: Need help with clearing a XA transaction ! Important It's been quite a while, and I don't even have Derby setup but I'll ask some questions. Do you see the same behavior with embedded? With Network Server, in your test environment, does the transaction persist if you bounce

Need help with clearing a XA transaction ! Important

2016-03-25 Thread Bergquist, Brett
I have a database with a stuck XA transaction. Derby 10.9. I am able to reproduce this problem with two test programs. In the first program I do: try { System.out.println("Connection to the database"); XAConnection xaConnection = null; Connection

RE: Derby received an error "ERROR XSDG0: Page Page(1325564,Container(0, 30832)) could not be read from disk."

2015-10-22 Thread Bergquist, Brett
t happened in your case, but i would always consistency check if there is a problem. /mikem On 9/4/2015 7:56 AM, Bergquist, Brett wrote: > Thanks for the input! > > There is no possibility of running the consistency check on the customer's > database on their system as it ne

RE: Derby received an error "ERROR XSDG0: Page Page(1325564,Container(0, 30832)) could not be read from disk."

2015-10-22 Thread Bergquist, Brett
Answering my own question. I was able to use ALTER TABLE DROP PRIMARY KEY on the table and then ALTER TABLE ADD PRIMARY KEY to recreate the backing index. -Original Message- From: Bergquist, Brett [mailto:bbergqu...@canoga.com] Sent: Thursday, October 22, 2015 9:13 AM To: derby-dev

RE: Derby received an error "ERROR XSDG0: Page Page(1325564,Container(0, 30832)) could not be read from disk."

2015-09-04 Thread Bergquist, Brett
e (like backup/virus/... vs the sever), but mostly on windows OS vs unix based ones. Getting a partial page read is a very weird error for derby as it goes out of its way to write only full pages. On 9/3/2015 5:39 PM, Bryan Pendleton wrote: > On 9/3/2015 3:35 PM, Bergquist, Brett wrote: >&

Derby received an error "ERROR XSDG0: Page Page(1325564,Container(0, 30832)) could not be read from disk."

2015-09-03 Thread Bergquist, Brett
A production system with a database of about 400G received this error today and it appears that Derby shutdown parts of itself because from that point on it was spitting out errors saying it could not find the database. The system was restarted and came up clean and is working with no issues

RE: Need help understanding a database deadlock that was detected

2015-09-03 Thread Bergquist, Brett
I will try to update that shortly. Thanks. -Original Message- From: Bryan Pendleton [mailto:bpendleton.de...@gmail.com] Sent: Wednesday, September 02, 2015 11:08 PM To: derby-dev@db.apache.org Subject: Re: Need help understanding a database deadlock that was detected > I guess what I

Re: Need help understanding a database deadlock that was detected

2015-09-02 Thread Bergquist, Brett
Thanks Bryan. I guess what I was expecting to see was the statement(s) were 50631 was getting a lock on the MANAGED_HARDWARE_SUMMARY. I turned on statement logging and see the issue. Your help here on how to read this output has help quite a bit though. I did not understand that the

Need help understanding a database deadlock that was detected

2015-09-02 Thread Bergquist, Brett
Derby 10.9.1.0 Here is the output from the derby.log: Wed Sep 02 16:42:17 EDT 2015 Thread[DRDAConnThread_14,5,main] (XID = 50633), (SESSIONID = 2110), (DATABASE = csemdb), (DRDAID = NF01.D5E2-4183279662650783751{166}), Cleanup action starting Wed Sep 02 16:42:17 EDT 2015

Need help understanding how ContextManager.cleanupOnError could create a 835MB errorStringBuilder

2015-06-17 Thread Bergquist, Brett
Derby 10.9.1.0 I am battling an OutOfMemory error that periodically occurs. I believe it is triggered by a problem in my code that keeps a set of locks for too long and another thread from another client interaction fails to acquire the locks that it needs and triggers an lock timeout error.

Having an out of memory condition on Derby 10.9.2.0

2015-05-19 Thread Bergquist, Brett
I am having an out of memory condition on Derby 10.9.2.0 in our production environment. Derby is given 8G maximum heap but I am able to get a heap dump periodically and analyze it via Eclipse Memory Analyzer. I see a couple of strange things and was wondering if I can attach a screen shot

RE: Having an out of memory condition on Derby 10.9.2.0

2015-05-19 Thread Bergquist, Brett
| 240 | 4,104 From: Bergquist, Brett [mailto:bbergqu...@canoga.com] Sent: Tuesday, May 19, 2015 1:39 PM To: derby-dev@db.apache.org Subject: Having an out of memory condition on Derby 10.9.2.0 I am having

Re: [jira] [Commented] (DERBY-6707) Inadequate error messages for configuration errors in Derby

2014-08-14 Thread Bergquist, Brett
I am not speaking for the Derby developers but I do know that contributions are most welcome. I have reported a few bugs and also recently decided that I wished (and others as well) that Derby had a rolling log file feature. So with the help of the developers, I was able to implement such a

Question on why the statement cache is saying a statement is invalid

2014-08-07 Thread Bergquist, Brett
I am trying to figure out an issue where the optimizer is taking a long time to compile a statement and want to make sure that the subsequent times through it will use the cached statement if present in the statement cache. I prepare the statement and then I look at the cache with: SELECT *

RE: Question on why the statement cache is saying a statement is invalid

2014-08-07 Thread Bergquist, Brett
happen. Rick, Knut? The invalid statement is a gigantic piece of sql which depends on a lot of objects. The invalidation of any of those objects could have made the statement invalid. Dag On 07. aug. 2014 18:51, Bergquist, Brett wrote: I am trying to figure out an issue where the optimizer

Question on how to debug two instances of derby off the trunk

2014-04-22 Thread Bergquist, Brett
I am starting on a project to add the capability to the derby replication to be able to acquire the database to replicate automatically by the slave and I would like to be able to run two instances of the network server so that I can debug the protocol between the two when the slave is going to

RE: Question on how to debug two instances of derby off the trunk

2014-04-22 Thread Bergquist, Brett
@db.apache.org Cc: Bergquist, Brett Subject: Re: Question on how to debug two instances of derby off the trunk On 4/22/14 7:31 AM, Bergquist, Brett wrote: I am starting on a project to add the capability to the derby replication to be able to acquire the database to replicate automatically by the slave

RE: Question on how to debug two instances of derby off the trunk

2014-04-22 Thread Bergquist, Brett
the trunk On 22. april 2014 16:31, Bergquist, Brett wrote: I am starting on a project to add the capability to the derby replication to be able to acquire the database to replicate automatically by the slave and I would like to be able to run two instances of the network server so that I can

Why are some bugs not going to make it into 10.10.2.1 release

2014-03-28 Thread Bergquist, Brett
Just wondering as some of the bugs that I reported and have been fixed are not going to be in this release. Basically without these, the release is not useful to me at least and i will have to continue to build and patch myself. Take these for example:

What official release will the rolling log file support be in?

2014-03-28 Thread Bergquist, Brett
I guess it will be 10.11, right? Is there a roadmap when that might be produced? Just wondering as I will have to patch 10.10.2.1 with this feature myself I guess. Brett

Re: Why are some bugs not going to make it into 10.10.2.1 release

2014-03-28 Thread Bergquist, Brett
Thanks for your time Rick. On Mar 28, 2014, at 1:36 PM, Rick Hillegas rick.hille...@oracle.com wrote: On 3/28/14 10:10 AM, Bergquist, Brett wrote: Just wondering as some of the bugs that I reported and have been fixed are not going to be in this release. Basically without these, the release

Re: I need help diagnosing a Derby engine problem where threads are not progressing

2014-03-14 Thread Bergquist, Brett
or make no progress for a very long period of time. Thanks for any insight that you might provide. On Mar 13, 2014, at 3:32 PM, Bergquist, Brett bbergqu...@canoga.commailto:bbergqu...@canoga.com wrote: See https://issues.apache.org/jira/browse/DERBY-6510 Basically it looks like for some reason

RE: I need help diagnosing a Derby engine problem where threads are not progressing

2014-03-14 Thread Bergquist, Brett
a chance to look at the code to verify either of these theories. Hopefully, others can comment also. On 03/14/2014 12:33 PM, Bergquist, Brett wrote: Sorry to be a persistent but the this is a very serious issue that I am seeing in production and would just like some guidance on where to look

RE: I need help diagnosing a Derby engine problem where threads are not progressing

2014-03-14 Thread Bergquist, Brett
of these theories. Hopefully, others can comment also. On 03/14/2014 12:33 PM, Bergquist, Brett wrote: Sorry to be a persistent but the this is a very serious issue that I am seeing in production and would just like some guidance on where to look in the source for a possible issue. My assumption

RE: I need help diagnosing a Derby engine problem where threads are not progressing

2014-03-14 Thread Bergquist, Brett
Unfortunately, introducing something into the production environment is not possible. I am in the process of trying to build a simulation of that environment but that is also difficult as the application is an Element Management System and in the network there are about 40K pieces of our

RE: I need help diagnosing a Derby engine problem where threads are not progressing

2014-03-14 Thread Bergquist, Brett
Brian, after reading and reading and reading, I am going to investigate this patch more. Amy's comment in DERBY-1905 As described more in the discussions for DERBY-2130, I removed an if-block from OptimizerImpl that actually causes an infinite loop in lang/innerjoin.sql (I

RE: [jira] [Commented] (DERBY-6510) Deby engine threads not making progress

2014-03-14 Thread Bergquist, Brett
Mike, I am going to spend some time investigating the code. From you developers help I think I have satisfied it to myself that there is some condition where there a looping or something similar and will investigate the code in this area. I much appreciate the help that you have given. Brett

I need help diagnosing a Derby engine problem where threads are not progressing

2014-03-13 Thread Bergquist, Brett
See https://issues.apache.org/jira/browse/DERBY-6510 Basically it looks like for some reason the system gets stuck in trying to create the query plan. Copied from the JIRA: We had an issue today in a production environment at a large customer site. Basically 5 database interactions became

RE: Question on recoverying after replication break because of a system failure

2014-01-21 Thread Bergquist, Brett
replication break because of a system failure Rick Hillegas rick.hille...@oracle.com writes: On 1/15/14 8:19 AM, Bergquist, Brett wrote: Any thoughts on this? Is this an approach that is worth looking at? Hi Brett, I haven't studied the internals of Derby's online backup, but from a high level

RE: Question on recoverying after replication break because of a system failure

2014-01-15 Thread Bergquist, Brett
- From: Bergquist, Brett [mailto:bbergqu...@canoga.com] Sent: Tuesday, January 14, 2014 12:49 PM To: derby-dev@db.apache.org Subject: RE: Question on recoverying after replication break because of a system failure Actually the expensive part is having the master system down to ensure a completely

RE: Question on recoverying after replication break because of a system failure

2014-01-14 Thread Bergquist, Brett
of the database up to the point where it is consistent with the master, replication would be performed. Any thoughts on this? From: Bergquist, Brett [mailto:bbergqu...@canoga.com] Sent: Friday, January 10, 2014 4:45 PM To: derby-dev@db.apache.org Subject: Question on recoverying after

RE: Question on recoverying after replication break because of a system failure

2014-01-14 Thread Bergquist, Brett
proposal. Some comments inline... On 1/10/14 1:45 PM, Bergquist, Brett wrote: The reason I am posting to the dev list is that I might want to look into improving Derby in this area. Just so that I am understand correctly, the steps for replication are: *Make a copy of the database

Question on recoverying after replication break because of a system failure

2014-01-10 Thread Bergquist, Brett
The reason I am posting to the dev list is that I might want to look into improving Derby in this area. Just so that I am understand correctly, the steps for replication are: * Make a copy of the database to the slave * Start replication on the slave and on the master Now

RE: some questions regarding backups...

2013-10-30 Thread Bergquist, Brett
as the database from which it was taken? Thanks, Myrna On Mon, Oct 28, 2013 at 1:54 PM, Bergquist, Brett bbergqu...@canoga.commailto:bbergqu...@canoga.com wrote: I have always assumed that a backup create by SYSCS_UTIL.SYSCS_BACKUP_DATABASE system procedure creates a fully functional backup copy

RE: What is the procedure for supplying a patch for the tests for issue DERBY-6350

2013-10-28 Thread Bergquist, Brett
, so if the test patch is related I’d say go ahead and attach it to the existing issue. D On 27. okt. 2013, at 23:19, Bergquist, Brett bbergqu...@canoga.com wrote: I modified the ErrorStreamTest.java to cleanup the log files that are causing an error because of the order the tests

RE: some questions regarding backups...

2013-10-28 Thread Bergquist, Brett
I have always assumed that a backup create by SYSCS_UTIL.SYSCS_BACKUP_DATABASE system procedure creates a fully functional backup copy of the database. I have used it as such with no issues. I have replaced the original database with the backup and the continued. Not that I did not try

What is the procedure for supplying a patch for the tests for issue DERBY-6350

2013-10-27 Thread Bergquist, Brett
I modified the ErrorStreamTest.java to cleanup the log files that are causing an error because of the order the tests are run. Do I supply this as a patch to DERBY-6350 or is another JIRA opened and the patch attached there? Thanks for the help Brett

Can someone take look at the patch for DERBY-6350

2013-09-30 Thread Bergquist, Brett
After some fits and starts and learning, I believe the patch is complete. It applies cleanly against the trunk and the tests including the new rolling log file tests run with no errors. https://issues.apache.org/jira/browse/DERBY-6350 The patch file to use is the one

Re: A couple of questions on building derby on the trunk and using that built version

2013-09-26 Thread Bergquist, Brett
Thanks Rick I appreciate the time you take to answer my questions! On Sep 25, 2013, at 9:45 PM, Rick Hillegas rick.hille...@oracle.com wrote: Hi Brett, Some responses inline... On 9/25/13 5:55 PM, Bergquist, Brett wrote: When trying to open an existing database with the derby that I

Need pointers on running tests on built versoin of trunk

2013-09-26 Thread Bergquist, Brett
I am trashing about trying to figure out how to correctly run the tests after building the trunk code. I want to run the engine/ErrorStreamTest as a single test. How do I go about doing that? I followed the procedure on

A couple of questions on building derby on the trunk and using that built version

2013-09-25 Thread Bergquist, Brett
When trying to open an existing database with the derby that I built from the trunk I get: ERROR XJ040: Failed to start database '/Users/brett/.netbeans-derby/csemdb' with class loader sun.misc.Launcher$AppClassLoader@39172e08, see the next exception for details. ERROR XCW00: Unsupported

How can I get a new class into derby.jar?

2013-09-19 Thread Bergquist, Brett
I am trying to implement a new rolling file error log handler and have added a class to org.apache.derby.impl.services.stream package. I do a ant clobber ant buildsource ant buildjars and my class does not end up in the derby.jar under jars/sane. I think it has to do with something about

RE: How can I get a new class into derby.jar?

2013-09-19 Thread Bergquist, Brett
Perfect. Thanks as I would not have found that I don't think. From: Katherine Marsden [mailto:kmarsdende...@sbcglobal.net] Sent: Thursday, September 19, 2013 12:55 PM To: derby-dev@db.apache.org Subject: Re: How can I get a new class into derby.jar? On 9/19/2013 8:07 AM, Bergquist, Brett wrote

I implemented a rolling derby.log (DERBY-6350)

2013-09-19 Thread Bergquist, Brett
https://issues.apache.org/jira/browse/DERBY-6350 I implemented this as part of the Derby core engine. I put my classes in: java/engine/org/apache/derby/impl/services/stream/RollingFileStream.java java/engine/org/apache/derby/impl/services/stream/RollingFileStreamProvider.java As there really

RE: Is there some way an external class can find where derby.system.home points to

2013-09-18 Thread Bergquist, Brett
Hillegas [mailto:rick.hille...@oracle.com] Sent: Thursday, September 12, 2013 10:39 AM To: derby-dev@db.apache.org Subject: Re: Is there some way an external class can find where derby.system.home points to On 9/10/13 5:42 PM, Bergquist, Brett wrote: Sorry for taking so long to get back

Re: Is there some way an external class can find where derby.system.home points to

2013-09-10 Thread Bergquist, Brett
/13 5:35 AM, Bergquist, Brett wrote: I finally broke down and wrote RollingFileStream which provides (and borrows) most of the functionality of java.logger.FileHandler to provide a rolling file stream. Having derby.log grow forever on long running systems is just not acceptable anymore

Re: Is there some way an external class can find where derby.system.home points to

2013-09-10 Thread Bergquist, Brett
...@sbcglobal.net wrote: On 9/6/2013 5:35 AM, Bergquist, Brett wrote: I finally broke down and wrote RollingFileStream which provides (and borrows) most of the functionality of java.logger.FileHandler to provide a rolling file stream. Having derby.log grow forever on long running systems

Is there some way an external class can find where derby.system.home points to

2013-09-06 Thread Bergquist, Brett
I finally broke down and wrote RollingFileStream which provides (and borrows) most of the functionality of java.logger.FileHandler to provide a rolling file stream. Having derby.log grow forever on long running systems is just not acceptable anymore ;) Realistically, I would like to provide

Should the optimizer ever have a cost of 0.0?

2013-08-27 Thread Bergquist, Brett
I am just wondering if while the optimizer is producing a plan if a cost of 0.0 should ever be seen. Thinking naively, it seems to me that all join plans and all access paths have some sort of cost which should be greater than 0.0. From my testing over the last few days, when a plan comes up

Re: Should the optimizer ever have a cost of 0.0?

2013-08-27 Thread Bergquist, Brett
). On Aug 27, 2013, at 12:46 PM, mike matrigali mikema...@gmail.com wrote: On 8/27/2013 9:43 AM, Rick Hillegas wrote: On 8/27/13 8:18 AM, Bergquist, Brett wrote: I am just wondering if while the optimizer is producing a plan if a cost of 0.0 should ever be seen. Thinking naively, it seems to me

Re: I need help on getting Derby to use a primary key index on a query

2013-08-24 Thread Bergquist, Brett
, Bergquist, Brett wrote: Mike I would love to open a Jira but having a reproducible case is important as I realize. Right now, the reproducible database is 2Gb compressed which is really not practical to upload. My goal right now is to fix the problem. The problem is in production

Re: I need help on getting Derby to use a primary key index on a query

2013-08-23 Thread Bergquist, Brett
Thanks for taking the time to respond Mamta. I am running a patched version of 10.9.1.0. The patches have to do with issues that I provided patches for to Derby relating to LogicalConnection deadlocks. These patches were just incorporated as I saw emails indicating so just the other day.

Re: I need help on getting Derby to use a primary key index on a query

2013-08-23 Thread Bergquist, Brett
I just enabled the derby.storage.indexStats.debug.keepDisposableStats=true in derby.properties and restarted the network server. I am running with straight 10.9.1.0 right now and have a database with exactly two tables. I have used the syscs_util.syscs_drop_statistics to drop the statistics

RE: I need help on getting Derby to use a primary key index on a query

2013-08-23 Thread Bergquist, Brett
11:04 AM, Bergquist, Brett wrote: I just enabled the derby.storage.indexStats.debug.keepDisposableStats=true in derby.properties and restarted the network server. I am running with straight 10.9.1.0 right now and have a database with exactly two tables. I have used

Is there a way to disable the change made by DERBY-3790

2013-08-21 Thread Bergquist, Brett
.COSEDDROPPROFILEDSCPTABLEBUNDLE_COSEDDROPPROFILEDSCPTABLEENTRY. COSEDDROPPROFILEDSCPTABLEBUNDLE_ID value from that row is the unique CORE_V1.CONFIGURATION_BUNDLE2.ID value of the row to look up. Why would Derby decide to do a table scan on CORE_V1.CONFIGURATION_BUNDLE2 in this case? On Aug 20, 2013, at 8:29 PM, Bergquist, Brett

Re: Is there a way to disable the change made by DERBY-3790

2013-08-21 Thread Bergquist, Brett
in this type of query which is going to find exactly row in the line times table and from that row, the order ID is obtained which is the unique value to lookup in the orders table? On Aug 21, 2013, at 9:13 AM, Rick Hillegas rick.hille...@oracle.com wrote: On 8/21/13 5:20 AM, Bergquist, Brett wrote: I am

I need help on getting Derby to use a primary key index on a query

2013-08-20 Thread Bergquist, Brett
I need some help. I have a database that is old and has been through multiple upgrades of Derby. Now we are using Derby 10.9.1.0. I have the following query which is not using an index that it should and is instead using a table scan. Here is the query: SELECT * FROM

RE: Is there a unit test in Derby for the XPLAIN feature

2013-05-17 Thread Bergquist, Brett
. -Original Message- From: Rick Hillegas [mailto:rick.hille...@oracle.com] Sent: Saturday, May 11, 2013 8:43 AM To: derby-dev@db.apache.org Subject: Re: Is there a unit test in Derby for the XPLAIN feature On 5/11/13 4:28 AM, Bergquist, Brett wrote: Is there a unit test in Derby for the XPLAIN

RE: need some advice about regular expression syntax in ant

2013-05-17 Thread Bergquist, Brett
It depends :) If the property ant.regexp.regexpimpl is not defined, it will default use the org.apache.tools.ant.util.regexp.Jdk14RegexpRegexp implementation which is a wrapper for java.util.regex package. http://docs.oracle.com/javase/6/docs/api/java/util/regex/package-summary.html and the

Is there a unit test in Derby for the XPLAIN feature

2013-05-11 Thread Bergquist, Brett
Is there a unit test in Derby for the XPLAIN feature? I would be interested in know if it is passing if there is. From: Bergquist, Brett [bbergqu...@canoga.com] Sent: Tuesday, May 07, 2013 8:11 PM To: derby-dev@db.apache.org Subject: RE: Does the XPLAIN

RE: Does the XPLAIN feature work in Derby 10.9.1.0

2013-05-08 Thread Bergquist, Brett
Created https://issues.apache.org/jira/browse/DERBY-6216 -Original Message- From: Bergquist, Brett [mailto:bbergqu...@canoga.com] Sent: Tuesday, May 07, 2013 8:11 PM To: derby-dev@db.apache.org Subject: RE: Does the XPLAIN feature work in Derby 10.9.1.0 Okay, thanks. I will open

Does the XPLAIN feature work in Derby 10.9.1.0

2013-05-07 Thread Bergquist, Brett
I am running Derby 10.9.1.0 and am trying to figure out a performance problem with query taking too long. I don't actually want to run the query so from the documentation, I try: call syscs_util.syscs_set_runtimestatistics(1); call syscs_util.syscs_set_xplain_schema('STATS'); call

RE: Does the XPLAIN feature work in Derby 10.9.1.0

2013-05-07 Thread Bergquist, Brett
Okay, thanks. I will open a JIRA on it. From: Bryan Pendleton [bpendleton.de...@gmail.com] Sent: Tuesday, May 07, 2013 7:54 PM To: derby-dev@db.apache.org Subject: Re: Does the XPLAIN feature work in Derby 10.9.1.0 I get the same result: $ java -cp

RE: Why is the optimizer choosing such a bad path

2013-04-01 Thread Bergquist, Brett
: Re: Why is the optimizer choosing such a bad path On 3/29/13 9:30 AM, Mike Matrigali wrote: On 3/29/2013 5:28 AM, Bergquist, Brett wrote: Mike I have a reproducible case but the database is 132GB so it is not practical. I am willing to dig in and try to help debug this. On the issue

RE: Why is the optimizer choosing such a bad path

2013-03-29 Thread Bergquist, Brett
Matrigali [mailto:mikem_...@sbcglobal.net] Sent: Thursday, March 28, 2013 5:11 PM To: derby-dev@db.apache.org Subject: Re: Why is the optimizer choosing such a bad path On 3/28/2013 6:38 AM, Bergquist, Brett wrote: I tried adding: derby.storage.indexStats.debug.keepDisposableStats=true

RE: Why is the optimizer choosing such a bad path

2013-03-28 Thread Bergquist, Brett
optimizer estimated row count: 0.00 optimizer estimated cost: 0.00 -Original Message- From: Bergquist, Brett [mailto:bbergqu...@canoga.com] Sent: Wednesday, March 27, 2013 8:42 PM To: derby-dev@db.apache.org Subject: RE: Why is the optimizer choosing

RE: Why is the optimizer choosing such a bad path

2013-03-28 Thread Bergquist, Brett
optimizer estimated cost: 14.34 -Original Message- From: Bergquist, Brett [mailto:bbergqu...@canoga.com] Sent: Thursday, March 28, 2013 8:33 AM To: derby-dev@db.apache.org Subject: RE: Why is the optimizer choosing such a bad path Okay, I finally figured out that CALL

  1   2   3   >