On 16 Oct 2019, at 7:03pm, Mitar <mmi...@gmail.com> wrote:

> On Wed, Oct 16, 2019 at 3:16 PM Hick Gunter <h...@scigames.at> wrote:
>> 100k distinct column names? Or is that 10000 repeats of 10 attributes?
> 
> 100k distinct names. Like each column a different gene expression.

Don't do that.  It's an abuse of how relational databases are meant to work.

One reason you shouldn't do that in SQLite is that all the data for a row is 
stored together, in a sequence.  If you ask for the data in the 3756th column 
of a row, SQLite has to read the data for the first 3755 columns of that row to 
find it.  As you can imagine, this is slow and involves a lot of I/O.

Dr Hipp posted how to maintain this kind of data in a SQL database: instead of 
maintaining a database with 100k columns, you use the gene expression as a 
column name and make that column part of the PRIMARY KEY of the table.
_______________________________________________
sqlite-users mailing list
sqlite-users@mailinglists.sqlite.org
http://mailinglists.sqlite.org/cgi-bin/mailman/listinfo/sqlite-users

Reply via email to