Re: [sqlite] Network file system that support sqlite3 well

2019-10-17 Thread Warren Young
On Oct 17, 2019, at 4:33 AM, Warren Young wrote: > > $ echo 'select count(*) from MyTable where rowid > 1234' | > nc dbserver Clarification: that echo line should begin with “Query: “ and end in a semicolon, which is a short form method of querying a Bedrock DB over the network. See

Re: [sqlite] Network file system that support sqlite3 well

2019-10-17 Thread Warren Young
On Oct 16, 2019, at 11:42 PM, Peng Yu wrote: > > Suppose A is a sqlite3 db file, B is some other file which is > generated based on the content in A. When A is not changed, there is > no need to change B, otherwise, B will need to be regenerated. In > other words, B depends on A, and can be handl

Re: [sqlite] Network file system that support sqlite3 well

2019-10-17 Thread Gary R. Schmidt
On 17/10/2019 16:42, Peng Yu wrote: I will need to use the actual files to test for dependency (just as the dependency that can be used by GNU make) I don’t understand what that means. You want to use a makefile that checks the mod date of the database? Suppose A is a sqlite3 db file, B is s

Re: [sqlite] Network file system that support sqlite3 well

2019-10-16 Thread Peng Yu
> > I will need to use the actual files to test for dependency (just as > > the dependency that can be used by GNU make) > > I don’t understand what that means. You want to use a makefile that checks > the mod date of the database? Suppose A is a sqlite3 db file, B is some other file which is gen

Re: [sqlite] Network file system that support sqlite3 well

2019-10-16 Thread Jens Alfke
—Jens > On Oct 16, 2019, at 3:37 AM, Peng Yu wrote: > > I will need to use the actual files to test for dependency (just as > the dependency that can be used by GNU make) I don’t understand what that means. You want to use a makefile that checks the mod date of the database? —Jens

Re: [sqlite] Network file system that support sqlite3 well

2019-10-16 Thread Warren Young
On Oct 16, 2019, at 4:08 PM, Warren Young wrote: > > I think this project needs someone to fork it. Sorry, that’s immoderate. It looks like they’ve still got active committers, so the software isn’t abandonware. Still, that long list of old issues is a problem. I wonder if the real issue is

Re: [sqlite] Network file system that support sqlite3 well

2019-10-16 Thread Warren Young
On Oct 16, 2019, at 8:45 AM, Graham Holden wrote: > > ...write a pair of what could be relatively simple > client-server programs that police access to the SQLite DB (which the > server will be accessing as a local file). > > ... > > ** I believe someone has tried/succeeded in doing something l

Re: [sqlite] Network file system that support sqlite3 well

2019-10-16 Thread Alek Paunov
On 2019-10-16 01:47, Peng Yu wrote: Is there a solution that are known to fill in this niche? Thanks. Would be clusteded SQLite (distributed SQLite instead of central shared DB) be a good option for your project? - Bellow, I am pasting my bookmarks for few well established projects developing

Re: [sqlite] Network file system that support sqlite3 well

2019-10-16 Thread Donald Griggs
Regarding: > Why not use an actual client-server database system like MySQL? It's > optimized for this use case, so it incurs a lot less disk (network) I/O. "I will need to use the actual files to test for dependency (just as the dependency that can be used by GNU make).

Re: [sqlite] Network file system that support sqlite3 well

2019-10-16 Thread Roman Fleysher
...@aldurslair.com] Sent: Wednesday, October 16, 2019 10:45 AM To: SQLite mailing list Subject: Re: [sqlite] Network file system that support sqlite3 well Wednesday, October 16, 2019, 1:22:58 AM, Gary R. Schmidt wrote: > On 16/10/2019 10:38, Jens Alfke wrote: >> >>> On Oct 15,

Re: [sqlite] Network file system that support sqlite3 well

2019-10-16 Thread Graham Holden
Wednesday, October 16, 2019, 1:22:58 AM, Gary R. Schmidt wrote: > On 16/10/2019 10:38, Jens Alfke wrote: >> >>> On Oct 15, 2019, at 3:47 PM, Peng Yu wrote: >>> >>> I'd like to use sqlite3 db files on many compute nodes. But they >>> should access the same storage device for the sqlite3 db files

Re: [sqlite] Network file system that support sqlite3 well

2019-10-16 Thread Gary R. Schmidt
On 16/10/2019 10:38, Jens Alfke wrote: On Oct 15, 2019, at 3:47 PM, Peng Yu wrote: I'd like to use sqlite3 db files on many compute nodes. But they should access the same storage device for the sqlite3 db files. Why not use an actual client-server database system like MySQL? It's optimize

Re: [sqlite] Network file system that support sqlite3 well

2019-10-16 Thread Roman Fleysher
-Mobile 4G LTE Device Original message From: Peng Yu Date: 10/16/19 6:41 AM (GMT-05:00) To: SQLite mailing list Subject: Re: [sqlite] Network file system that support sqlite3 well > I know for sure that IBM's GPFS guarantees locking. I think GPFS is "global > pa

Re: [sqlite] Network file system that support sqlite3 well

2019-10-16 Thread Jose Isaias Cabrera
Peng Yu, on Tuesday, October 15, 2019 06:47 PM, wrote... > > Hi, > > I'd like to use sqlite3 db files on many compute nodes. But they > should access the same storage device for the sqlite3 db files. The > directory storing the db files looks the same on any compute node > logically---the storage

Re: [sqlite] Network file system that support sqlite3 well

2019-10-16 Thread Graham Holden
Wednesday, October 16, 2019, 11:43:25 AM, Peng Yu wrote: > On 10/16/19, Simon Slavin wrote: >> Unfortunately, no. Multiuser SQLite depends on locking being implemented >> correctly. The developers haven't found any Network File Systems which do >> this. Unless one of the readers of this list

Re: [sqlite] Network file system that support sqlite3 well

2019-10-16 Thread Peng Yu
On 10/16/19, Simon Slavin wrote: > On 15 Oct 2019, at 11:47pm, Peng Yu wrote: > >> Is there a solution that are known to fill in this niche? Thanks. > > Unfortunately, no. Multiuser SQLite depends on locking being implemented > correctly. The developers haven't found any Network File Systems wh

Re: [sqlite] Network file system that support sqlite3 well

2019-10-16 Thread Peng Yu
> I know for sure that IBM's GPFS guarantees locking. I think GPFS is "global > parallel file system". It is a distributed file system. But it will be > rather slow. If only few jobs run in parallel, all will be ok. Locking will > always guarantee database integrity. > > With lots of jobs, you wi

Re: [sqlite] Network file system that support sqlite3 well

2019-10-16 Thread Peng Yu
> Why not use an actual client-server database system like MySQL? It's > optimized for this use case, so it incurs a lot less disk (network) I/O. I will need to use the actual files to test for dependency (just as the dependency that can be used by GNU make). With just database tables in MySQL, th

Re: [sqlite] Network file system that support sqlite3 well

2019-10-15 Thread Roman Fleysher
e] Network file system that support sqlite3 well On 15 Oct 2019, at 11:47pm, Peng Yu wrote: > Is there a solution that are known to fill in this niche? Thanks. Unfortunately, no. Multiuser SQLite depends on locking being implemented correctly. The developers haven't found any Network File

Re: [sqlite] Network file system that support sqlite3 well

2019-10-15 Thread Simon Slavin
On 15 Oct 2019, at 11:47pm, Peng Yu wrote: > Is there a solution that are known to fill in this niche? Thanks. Unfortunately, no. Multiuser SQLite depends on locking being implemented correctly. The developers haven't found any Network File Systems which do this. Unless one of the readers o

Re: [sqlite] Network file system that support sqlite3 well

2019-10-15 Thread Jens Alfke
> On Oct 15, 2019, at 3:47 PM, Peng Yu wrote: > > I'd like to use sqlite3 db files on many compute nodes. But they > should access the same storage device for the sqlite3 db files. Why not use an actual client-server database system like MySQL? It's optimized for this use case, so it incurs a

[sqlite] Network file system that support sqlite3 well

2019-10-15 Thread Peng Yu
Hi, I'd like to use sqlite3 db files on many compute nodes. But they should access the same storage device for the sqlite3 db files. The directory storing the db files looks the same on any compute node logically---the storage is mounted at the same mount point on the compute nodes. To achieve th