Ivan et al,
OK, so changing the context of the process invoking
file_to_string_output() did not fix the problem.
The temp session files are still written to:
09:28:30 Can't write to file /home/virtuoso/database//sesbPyLvU
I invoked the command from:
/data/virtuoso/dbpediaLoad
The session files always appear to be written to
${VIRTUOSO_HOME}/database
I think it might be nice to make the location of tempory files
configurable.
The process context isn't always a desirable location.
The default could still be the process context using an ini override if
required.
I have also used ttlp_mt_local_file which also fails with the same
errors.
Hugh,
I have downloaded the dbpedia script. Thanks.
However this script fails in the same manner as it again uses
file_to_string_output
ttlp_mt
The main problem I have is that the virtuoso installation is located on
dir/mount with limited space.
All the data should be on a different mount which has lots of space.
I think I will need to move the installation to /data (lots of space) to
fix this.
Not ideal as our sysadmins won't like this very much.
I will let you know if this fixes the problem.
Thanks for your help
Jem
-----Original Message-----
From: Ivan Mikhailov [mailto:imikhai...@openlinksw.com]
Sent: 14 April 2009 21:45
To: Jem Rayfield
Cc: virtuoso-users@lists.sourceforge.net
Subject: Re: [Virtuoso-users] ttlp_mt problem
Hello Jem,
file_to_string_output() can flush part of string session to a temporary
file if the session is too long to keep it in memory. On almost all OSes
it makes the file in the working directory of the process, say, in the
current directory of the shell that launched the executable. It's
advisable to start from writable directory.
In this particular case, it is better to use DB.DBA.TTLP_MT_LOCAL_FILE (
'/data/virtuoso/dbpediaLoad/longabstract_en.nt', '',
'http://*****.newsonline.tc.nca.bbc.co.uk/test', 17) that will parse the
file directly, without wasting time and disk for temporary copy.
Best Regards,
Ivan Mikhailov
OpenLink Software
http://virtuoso.openlinksw.com
On Tue, 2009-04-14 at 17:21 +0100, Jem Rayfield wrote:
> To clarify.
>
> My question is...
>
> Why is virtuoso trying to use
>
> /home/virtuoso/database//sestmE28h
>
> When my virtuoso.ini is not specifying this?
>
> How can I configure Virtuoso to use a different directory. I gues this
> will fix my problems?
>
> I need all data temp or otherwise to go on a different mount. /data.
>
> Cheers
> Jem
>
>
>
>
> ______________________________________________________________________
> From: Jem Rayfield
> Sent: 14 April 2009 17:15
> To: virtuoso-users@lists.sourceforge.net List
> Subject: ttlp_mt problem
>
>
>
> Hi,
>
> I am trying to upload dbpedia N3 triples... using:
>
> isql 1111 dba ****** verbose=on banner=off prompt=off echo=ON
> errors=stdout exec="ttlp_mt (file_to_string_output
> ('/data/virtuoso/dbpediaLoad/longabstract_en.nt'), '',
> 'http://*****.newsonline.tc.nca.bbc.co.uk/test', 17); checkpoint;"
>
>
> However I am getting the following errors (many):
>
> 17:05:14 Can't write to file /home/virtuoso/database//sestmE28h
>
> My virtuoso.ini is as follows and has no references to
> /home/virtuoso/database.
>
> My dir structure is
>
> /data/virtuoso/<db/trx/etc>
> /home/virtuoso/<install>
>
> Any ideas appreciated
>
> Thanks
> Jem
>
>
>
> /home/virtuoso/database/virtuoso.ini -->
>
> ;
> ; virtuoso.ini
> ;
> ; Configuration file for the OpenLink Virtuoso VDBMS Server ; ; To
> learn more about this product, or any other product in our ;
> portfolio, please check out our web site at:
> ;
> ; http://www.openlinksw.com
> ;
> ; or contact us at:
> ;
> ; general.informat...@openlinksw.com
> ;
> ; If you have any technical questions, please contact our support ;
> staff at:
> ;
> ; technical.supp...@openlinksw.com
> ;
> ;
> ; Database setup
> ;
> [Database]
> DatabaseFile = /data/virtuoso/virtuoso.db
> ErrorLogFile = /data/virtuoso/virtuoso.log
> LockFile = /data/virtuoso/virtuoso.lck
> TransactionFile = /data/virtuoso/virtuoso.trx
> ErrorLogLevel = 7
> FileExtend = 200
> MaxCheckpointRemap = 1000000
> MaxMemPoolSize = 0
> StopCompilerWhenXOverRunTime = 1
> DefaultIsolation = 2
> Striping = 0
> xa_persistent_file = /data/virtuoso/virtuoso.pxa
>
> [TempDatabase]
> DatabaseFile = /data/virtuoso/virtuoso-temp.db
> TransactionFile = /data/virtuoso/virtuoso-temp.trx
> MaxCheckpointRemap = 2000
>
> ;
> ; Server parameters
> ;
> [Parameters]
> ServerPort = 1111
> DisableUnixSocket = 1
> ;SSLServerPort = 2111
> ;SSLCertificate = cert.pem
> ;SSLPrivateKey = pk.pem
> ;X509ClientVerify = 0
> ;X509ClientVerifyDepth = 0
> ;X509ClientVerifyCAFile = ca.pem
> ServerThreads = 10
> CheckpointInterval = 60
> O_DIRECT = 0
> NumberOfBuffers = 550000
> MaxDirtyBuffers = 320000
> CaseMode = 2
> MaxStaticCursorRows = 5000
> CheckpointAuditTrail = 0
> AllowOSCalls = 0
> SchedulerInterval = 10
> DirsAllowed = ., ../vad, /data/virtuoso/dbpediaLoad/
> ThreadCleanupInterval = 0
> ThreadThreshold = 10
> ResourcesCleanupInterval = 0
> FreeTextBatchSize = 100000
> SingleCPU = 0
> VADInstallDir = ../vad/
> PrefixResultNames = 0
> MacSpotLight = 0
>
> [HTTPServer]
> ServerPort = 8890
> ServerRoot = ../vsp
> DavRoot = DAV
> EnabledDavVSP = 0
> HTTPProxyEnabled = 0
> TempASPXDir = 0
> DefaultMailServer = localhost:25
> ServerThreads = 5
> MaxKeepAlives = 10
> KeepAliveTimeout = 10
> MaxCachedProxyConnections = 10
> ProxyConnectionCacheTimeout = 15
> HTTPThreadSize = 280000
> HttpPrintWarningsInOutput = 0
> Charset = UTF-8
> HttpProxyServer = http://*****.****.bbc.co.uk:80
>
> [AutoRepair]
> BadParentLinks = 0
>
> [Client]
> SQL_PREFETCH_ROWS = 100
> SQL_PREFETCH_BYTES = 16000
> SQL_QUERY_TIMEOUT = 0
> SQL_TXN_TIMEOUT = 0
> ;SQL_NO_CHAR_C_ESCAPE = 1
> ;SQL_UTF8_EXECS = 0
> ;SQL_NO_SYSTEM_TABLES = 0
> ;SQL_BINARY_TIMESTAMP = 1
> ;SQL_ENCRYPTION_ON_PASSWORD = -1
>
> [VDB]
> ArrayOptimization = 0
> NumArrayParameters = 10
> VDBDisconnectTimeout = 1000
> KeepConnectionOnFixedThread = 0
>
> [Replication]
> ServerName = virtuoso-NOLAPPS34
> ServerEnable = 1
> QueueMax = 50000
>
> ;
> ; Striping setup
> ;
> ; These parameters have only effect when Striping is set to 1 in the
> ; [Database] section, in which case the DatabaseFile parameter is
> ignored.
> ;
> ; With striping, the database is spawned across multiple segments ;
> where each segment can have multiple stripes.
> ;
> ; Format of the lines below:
> ; Segment<number> = <size>, <stripe file name> [, <stripe file
> name> .. ]
> ;
> ; <number> must be ordered from 1 up.
> ;
> ; The <size> is the total size of the segment which is equally
> divided ; across all stripes forming the segment. Its specification
> can be in ; gigabytes (g), megabytes (m), kilobytes (k) or in
> database blocks ; (b, the default) ; ; Note that the segment size
> must be a multiple of the database page size ; which is currently 8k.
> Also, the segment size must be divisible by the ; number of stripe
> files forming the segment.
> ;
> ; The example below creates a 200 meg database striped on two
> segments ; with two stripes of 50 meg and one of 100 meg.
> ;
> ; You can always add more segments to the configuration, but once ;
> added, do not change the setup.
> ;
> [Striping]
> Segment1 = 100M, db-seg1-1.db, db-seg1-2.db
> Segment2 = 100M, db-seg2-1.db
> ;...
> ;[TempStriping]
> ;Segment1 = 100M, db-seg1-1.db, db-seg1-2.db
> ;Segment2 = 100M, db-seg2-1.db
> ;...
> ;[Ucms]
> ;UcmPath = <path>
> ;Ucm1 = <file>
> ;Ucm2 = <file>
> ;...
>
> [Zero Config]
> ServerName = virtuoso (NOLAPPS34)
> ;ServerDSN = ZDSN
> ;SSLServerName =
> ;SSLServerDSN =
>
> [Mono]
> ;MONO_TRACE=Off
> ;MONO_PATH=<path_here>
> ;MONO_ROOT=<path_here>
> ;MONO_CFG_DIR=<path_here>
> ;virtclr.dll=
>
> [URIQA]
> DynamicLocal = 1
> DefaultHost = localhost:8890
>
> [SPARQL]
> ;ExternalQuerySource = 1
> ;ExternalXsltSource = 1
> ResultSetMaxRows = 100000
> ;DefaultGraph = http://localhost:8890/dataspace
> ;MaxQueryCostEstimationTime = 120 ; in seconds
> ;MaxQueryExecutionTime = 10 ; in seconds
>
> [Plugins]
> LoadPath = ../hosting
> Load1 = plain, wikiv
> Load2 = plain, mediawiki
> Load3 = plain, creolewiki
> Load4 = plain, im
> Load5 = plain, wbxml2
> Load6 = attach, libphp5.so
> Load7 = Hosting, hosting_php.so
> ;Load8 = Hosting,hosting_perl.so
> ;Load9 = Hosting,hosting_python.so
> ;Load10 = Hosting,hosting_ruby.so
> ;Load11 = msdtc,msdtc_sample
>
>
>
>
> ----------------------------------------------------------------------
> --------
> This SF.net email is sponsored by:
> High Quality Requirements in a Collaborative Environment.
> Download a free trial of Rational Requirements Composer Now!
> http://p.sf.net/sfu/www-ibm-com
> _______________________________________________ Virtuoso-users mailing
> list Virtuoso-users@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/virtuoso-users
