[PHP-DB] databases and XML
Hi List, I was wondering what strategies people are using to handle large volumes of XML data: How do you store the data? e.g.: Text-files, databases (which one)...? How big are your datasets? e.g.: MB, GB, TB...? What do you use to query the data? e.g.: PHP w/ text-files, SQLServer with for xml clause...? Finally, what limitations do you experience currently when handling XML? Thanks in advance, Yves
Re: [PHP-DB] databases and XML
Yves Sucaet wrote: Hi List, I was wondering what strategies people are using to handle large volumes of XML data: How do you store the data? e.g.: Text-files, databases (which one)...? How big are your datasets? e.g.: MB, GB, TB...? What do you use to query the data? e.g.: PHP w/ text-files, SQLServer with for xml clause...? Finally, what limitations do you experience currently when handling XML? Take a look at openstreetmap.org http://wiki.openstreetmap.org/index.php/Planet is several GB of XML data. The only way of handling it to use it IS via a database, and it has scripts to dump it to various databases. So what large volume are you thinking about? -- Lester Caine - G8HFL - Contact - http://lsces.co.uk/lsces/wiki/?page=contact L.S.Caine Electronic Services - http://lsces.co.uk EnquirySolve - http://enquirysolve.com/ Model Engineers Digital Workshop - http://medw.co.uk// Firebird - http://www.firebirdsql.org/index.php -- PHP Database Mailing List (http://www.php.net/) To unsubscribe, visit: http://www.php.net/unsub.php
Re: [PHP-DB] databases and XML
Well, we're actually in the process of developing a DB that's only accessible through XML/XQuery. But before we add new features it would be good to get an idea of what the needs are in the field, sort of speak. So instead of artifically trying to map a DTD to an RDBMS scheme, our engine can accept any XML-content that you want to put into it. After that, it's simply a matter of firing XQuery statements to the engine to get the data you want. We're thinking about building a PHP driver in order to offer outside connectivity (right now GUI and engine are too tightly coupled). Ideas, considerations, thoughts, suggestions...? -- Original Message -- Received: Tue, 09 Sep 2008 10:29:57 AM CDT From: Lester Caine [EMAIL PROTECTED] To: php-db@LISTS.PHP.NET Subject: Re: [PHP-DB] databases and XML Yves Sucaet wrote: Hi List, I was wondering what strategies people are using to handle large volumes of XML data: How do you store the data? e.g.: Text-files, databases (which one)...? How big are your datasets? e.g.: MB, GB, TB...? What do you use to query the data? e.g.: PHP w/ text-files, SQLServer with for xml clause...? Finally, what limitations do you experience currently when handling XML? Take a look at openstreetmap.org http://wiki.openstreetmap.org/index.php/Planet is several GB of XML data. The only way of handling it to use it IS via a database, and it has scripts to dump it to various databases. So what large volume are you thinking about? -- Lester Caine - G8HFL - Contact - http://lsces.co.uk/lsces/wiki/?page=contact L.S.Caine Electronic Services - http://lsces.co.uk EnquirySolve - http://enquirysolve.com/ Model Engineers Digital Workshop - http://medw.co.uk// Firebird - http://www.firebirdsql.org/index.php -- PHP Database Mailing List (http://www.php.net/) To unsubscribe, visit: http://www.php.net/unsub.php -- PHP Database Mailing List (http://www.php.net/) To unsubscribe, visit: http://www.php.net/unsub.php
Re: [PHP-DB] databases and XML
XML handles hierarchical structuring of data, a relational database system handles relational structuring of data. Imho, usage of any of these methods depend on the requirements of the system to be built. That being said, I'm not sure what the real need would be for, like you say, a database only accessible through XML/XQuery (with which I assume you mean storing XML and retrieving it through XQuery). I say this because this is exactly what an XML file is: it stores the XML - in a file on your HD - and many interfaces provide access to it through XQuery - like javascript. What would be very cool is to see a fast PHP module implementing XQuery. As for as I know there is no such solution at this moment, just a couple of PHP libraries - so a solution on a level too high to be considered useful for production. On the other hand, development of these standards is going very very fast... Intersting subject though. On Tue, Sep 9, 2008 at 5:51 PM, YVES SUCAET [EMAIL PROTECTED] wrote: Well, we're actually in the process of developing a DB that's only accessible through XML/XQuery. But before we add new features it would be good to get an idea of what the needs are in the field, sort of speak. So instead of artifically trying to map a DTD to an RDBMS scheme, our engine can accept any XML-content that you want to put into it. After that, it's simply a matter of firing XQuery statements to the engine to get the data you want. We're thinking about building a PHP driver in order to offer outside connectivity (right now GUI and engine are too tightly coupled). Ideas, considerations, thoughts, suggestions...? -- Original Message -- Received: Tue, 09 Sep 2008 10:29:57 AM CDT From: Lester Caine [EMAIL PROTECTED] To: php-db@LISTS.PHP.NET Subject: Re: [PHP-DB] databases and XML Yves Sucaet wrote: Hi List, I was wondering what strategies people are using to handle large volumes of XML data: How do you store the data? e.g.: Text-files, databases (which one)...? How big are your datasets? e.g.: MB, GB, TB...? What do you use to query the data? e.g.: PHP w/ text-files, SQLServer with for xml clause...? Finally, what limitations do you experience currently when handling XML? Take a look at openstreetmap.org http://wiki.openstreetmap.org/index.php/Planet is several GB of XML data. The only way of handling it to use it IS via a database, and it has scripts to dump it to various databases. So what large volume are you thinking about? -- Lester Caine - G8HFL - Contact - http://lsces.co.uk/lsces/wiki/?page=contact L.S.Caine Electronic Services - http://lsces.co.uk EnquirySolve - http://enquirysolve.com/ Model Engineers Digital Workshop - http://medw.co.uk// Firebird - http://www.firebirdsql.org/index.php -- PHP Database Mailing List (http://www.php.net/) To unsubscribe, visit: http://www.php.net/unsub.php -- PHP Database Mailing List (http://www.php.net/) To unsubscribe, visit: http://www.php.net/unsub.php -- PHP Database Mailing List (http://www.php.net/) To unsubscribe, visit: http://www.php.net/unsub.php
