Re: [Firebird-devel] Firebird 2.1 External Table Files Internal Format

2013-09-25 Thread Huan Ruan
Any suggestions, guys? Can anyone please point us to the right place in the source code so we can have a closer look? Also, it appears that external table doesn't like a row being over 32k (including padding) in the external file. When we have rows over 32k, select from the external table just ret

Re: [Firebird-devel] Firebird 2.1 External Table Files Internal Format

2013-09-14 Thread Huan Ruan
Hi All > > We are trying to implement a bulk data importer by writing our own > external table files. We've tried storing all fields as text, but due to > the volume of data, this put us well over the 2GB external file size limit > in Firebird 2.1. So we've resorted to saving the files in Firebird'

Re: [Firebird-devel] Firebird 2.1 External Table Files Internal Format

2013-09-13 Thread Norman Dunbar
Morning Dimitry, On 13/09/13 11:12, Dimitry Sibiryakov wrote: > 13.09.2013 12:08, Norman Dunbar wrote: >> Are you aware that the character data in a row is compressed? > > It is compressed in database, but not in external tables. Sigh! Thanks very much, I reread the original posting and reali

Re: [Firebird-devel] Firebird 2.1 External Table Files Internal Format

2013-09-13 Thread Dimitry Sibiryakov
13.09.2013 12:08, Norman Dunbar wrote: > Are you aware that the character data in a row is compressed? It is compressed in database, but not in external tables. -- WBR, SD. -- How ServiceNow helps IT people transf

Re: [Firebird-devel] Firebird 2.1 External Table Files Internal Format

2013-09-13 Thread Norman Dunbar
Hi Huan, On 13/09/13 03:00, Huan Ruan wrote: > Is this right? Is there anything I'm missing? We didn't get very far > digging around in the source code. Are you aware that the character data in a row is compressed? See here for details http://www.firebirdsql.org/file/documentation/reference_ma