Re: [sqlite] Odd exception when creating a connection object

2019-05-15 Thread Roberts, Barry
Hi Joe, We are not using multiple app domains within a process. Within the process where the errors are coming from we have * N databases being accessed, typically between 5-100 separate databases * Each database has a dedicated handler, to ensure we only ever invoke 1 writer at a time to a

[sqlite] [Re] Odd exception when creating a connection object

2019-05-14 Thread Roberts, Barry
Hi, I have just taken a look at the source code between the 1.0.107.0 and 1.0.110.0 drivers, and there are a lot of changes in the SQLiteLog.Initialize code area, and how the SQLiteConnection now calls into it. We are seeing more of the same exceptions thrown during testing with 110 (we never

[sqlite] Odd exception when creating a connection object

2019-05-01 Thread Roberts, Barry
Hi, We have a large C# application which uses the System.Data.SQLite.Core NuGet package. We have been running with version 1.0.107.0 since it was released without any issues. Last week we updated to version 1.0.110.0, and now we are seeing occasional odd errors appearing (fortunately we are

Re: [sqlite] C# pragma integrity_check call throwing exception

2017-10-26 Thread Roberts, Barry (FINTL)
Simon, > Your text makes it look like you think that that kind of corruption affects > only existing rows. This is not the case. If you continue to write to a > database which shows this problem, you can lose more of the existing rows > and/or the new data you're trying to write. The

[sqlite] C# pragma integrity_check call throwing exception

2017-10-24 Thread Roberts, Barry (FINTL)
Hi, I asked the following question a few weeks ago, but did not get any responses, hoping someone may have an idea. We are currently running System.Data.SQLite.dll 1.0.80.0 and would like to upgrade to a newer version. However there are a variety of issues we have run into, most of which I

[sqlite] pragma integrity_check throwing exception

2017-10-03 Thread Roberts, Barry (FINTL)
Hi, Assume I have a database which is "malformed" due to rowid xxx missing from a table index. In the System.Data.SQLite.dll 1.0.80.0 C# driver the following code would return the reason, I would get a list of the rowid problems allowing me to log them. private static IEnumerable

Re: [sqlite] When is db size an issue?

2017-10-02 Thread Roberts, Barry (FINTL)
We have logged live data into databases that are over 200GB without any issues. I don't think SQLite will be the issue itself, as it is merely limited by the file system. The more likely issue is when you need to transfer or backup the file, it can get unwieldy if it is too large. Kind

Re: [sqlite] ADO.NET driver upgrade puzzle

2017-09-27 Thread Roberts, Barry (FINTL)
Hi, I am aware of the sqlite FAQ, and especially the comments regarding file systems. We only ever use NTFS file system, and never have any FAT or FAT32 file systems. Given that the old 1.0.80.0 driver is totally stable, and the newer one is not, on the same exact hardware, I do not think the

Re: [sqlite] ADO.NET driver upgrade puzzle

2017-09-25 Thread Roberts, Barry (FINTL)
Hi Clemens, As per my original post, all C# access code is making extensive use of "using" statements. However we do obviously rely on the connection pool being thread safe, because many threads are writing to different databases (connections) concurrently. There is no direct relationship

[sqlite] ADO.NET driver upgrade puzzle

2017-09-25 Thread Roberts, Barry (FINTL)
Hi, We have a C# application which logs data in real-time to sqlite files. The application is multi-threaded, and typically logs 200-500 data streams simultaneously. The logging rate per stream is 1Hz to 1000Hz, depending on the type of data coming in. Each data stream is logged to its own db3