NFS is not a good idea as you have discovered.
http://www.sqlite.org/faq.html#q5
Here's what I'd do for starters. Have your grid processes write their SQL
statements (or data) to a flat file...one file for each grid member.
Then have a process that reads all those files using pipes like this, each pipe
inside it's own thread. And then you only use 1 database connection shared
amongst the threads.
FILE *data1 = popen("tail -F gridfile1","r");
This way your grid processes won't have any wait states for the database and
your database can be on NFS too (local is preferable though).
Michael D. Black
Senior Scientist
NG Information Systems
Advanced Analytics Directorate
From: [email protected] [[email protected]] on
behalf of Thorsten Kersting [[email protected]]
Sent: Tuesday, August 30, 2011 7:39 AM
To: General Discussion of SQLite Database
Subject: EXT :Re: [sqlite] writing data in wrong table
this is not possible. i have to run the programm on the bw-grid cluster,
else it is not fast enough.
if i try the program on my work-pc it works fine. only the mass
parallel-starting brings the mistake.
On 08/30/2011 02:34 PM, Simon Slavin wrote:
> On 30 Aug 2011, at 1:31pm, Thorsten Kersting wrote:
>
>> is it possible that this mistake is coming from the nfs?
> Try your program operating on a local file instead of one on a volume mounted
> using NFS.
>
> Simon.
> _______________________________________________
> sqlite-users mailing list
> [email protected]
> http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users
>
_______________________________________________
sqlite-users mailing list
[email protected]
http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users
_______________________________________________
sqlite-users mailing list
[email protected]
http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users
