Re: [topbraid-users] importing a very large tab delimited file

[Sina Madani]

Thank you Irene. I’ll try 16/32Gb RAM. Also, the resultant file will be loaded 
into a triple store; no need to open it in TB 

> On Feb 2, 2018, at 7:18 PM, Irene Polikoff  wrote:
> 
> When TBC works with files, it loads them into memory in order to display 
> them. You will not have enough RAM on a laptop or a desktop to load a file of 
> this size. The resulting RDF graph will have 81M triples. You need to convert 
> it using some process that does not involve TBC UI. 
> 
> Further, if you have a file of this size, you will not able to open in with 
> TBC as a file - you will run out of memory. You would need to first stream ii 
> into a TDB. To do so, use Import->TopBraid Composer->Import RDF files into a 
> new TDB. This will stream the file into a TDB. Once TDB is created, you 
> should be able to open it with TBC.
> 
>> On Feb 2, 2018, at 7:45 AM, Sina > > wrote:
>> 
>> Eight columns & thanks for looking into this
>> 
>> On Friday, February 2, 2018 at 1:55:43 AM UTC-5, Irene Polikoff wrote:
>> How many columns?
>> 
>> Sent from my iPhone
>> 
>> On Feb 1, 2018, at 3:35 PM, Sina > wrote:
>> 
>>> Hi, 
>>> 
>>> Do you have a recommended setting/memory/etc. for importing an 800Mb tab 
>>> delimited text file (9 million rows) into an ontology through the TB import 
>>> spreadsheet function? 
>>> 
>>> Thanks! 
>>> 
>>> Sina
>>> 
>>> -- 
>>> You received this message because you are subscribed to the Google Groups 
>>> "TopBraid Suite Users" group.
>>> To unsubscribe from this group and stop receiving emails from it, send an 
>>> email to topbraid-user...@googlegroups.com .
>>> For more options, visit https://groups.google.com/d/optout 
>>> .
>> 
>> 
>> -- 
>> You received this message because you are subscribed to the Google Groups 
>> "TopBraid Suite Users" group.
>> To unsubscribe from this group and stop receiving emails from it, send an 
>> email to topbraid-users+unsubscr...@googlegroups.com 
>> .
>> For more options, visit https://groups.google.com/d/optout 
>> .
> 
> 
> -- 
> You received this message because you are subscribed to a topic in the Google 
> Groups "TopBraid Suite Users" group.
> To unsubscribe from this topic, visit 
> https://groups.google.com/d/topic/topbraid-users/p3x4Kbaamp8/unsubscribe 
> .
> To unsubscribe from this group and all its topics, send an email to 
> topbraid-users+unsubscr...@googlegroups.com 
> .
> For more options, visit https://groups.google.com/d/optout 
> .

-- 
You received this message because you are subscribed to the Google Groups 
"TopBraid Suite Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to topbraid-users+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Re: [topbraid-users] importing a very large tab delimited file

[Irene Polikoff]

When TBC works with files, it loads them into memory in order to display them. 
You will not have enough RAM on a laptop or a desktop to load a file of this 
size. The resulting RDF graph will have 81M triples. You need to convert it 
using some process that does not involve TBC UI. 

Further, if you have a file of this size, you will not able to open in with TBC 
as a file - you will run out of memory. You would need to first stream ii into 
a TDB. To do so, use Import->TopBraid Composer->Import RDF files into a new 
TDB. This will stream the file into a TDB. Once TDB is created, you should be 
able to open it with TBC.

> On Feb 2, 2018, at 7:45 AM, Sina  wrote:
> 
> Eight columns & thanks for looking into this
> 
> On Friday, February 2, 2018 at 1:55:43 AM UTC-5, Irene Polikoff wrote:
> How many columns?
> 
> Sent from my iPhone
> 
> On Feb 1, 2018, at 3:35 PM, Sina > wrote:
> 
>> Hi, 
>> 
>> Do you have a recommended setting/memory/etc. for importing an 800Mb tab 
>> delimited text file (9 million rows) into an ontology through the TB import 
>> spreadsheet function? 
>> 
>> Thanks! 
>> 
>> Sina
>> 
>> -- 
>> You received this message because you are subscribed to the Google Groups 
>> "TopBraid Suite Users" group.
>> To unsubscribe from this group and stop receiving emails from it, send an 
>> email to topbraid-user...@googlegroups.com .
>> For more options, visit https://groups.google.com/d/optout 
>> .
> 
> 
> -- 
> You received this message because you are subscribed to the Google Groups 
> "TopBraid Suite Users" group.
> To unsubscribe from this group and stop receiving emails from it, send an 
> email to topbraid-users+unsubscr...@googlegroups.com 
> .
> For more options, visit https://groups.google.com/d/optout 
> .

-- 
You received this message because you are subscribed to the Google Groups 
"TopBraid Suite Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to topbraid-users+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Re: [topbraid-users] importing a very large tab delimited file

[Sina]

Eight columns & thanks for looking into this

On Friday, February 2, 2018 at 1:55:43 AM UTC-5, Irene Polikoff wrote:
>
> How many columns?
>
> Sent from my iPhone
>
> On Feb 1, 2018, at 3:35 PM, Sina > wrote:
>
> Hi, 
>
> Do you have a recommended setting/memory/etc. for importing an 800Mb tab 
> delimited text file (9 million rows) into an ontology through the TB import 
> spreadsheet function? 
>
> Thanks! 
>
> Sina
>
> -- 
> You received this message because you are subscribed to the Google Groups 
> "TopBraid Suite Users" group.
> To unsubscribe from this group and stop receiving emails from it, send an 
> email to topbraid-user...@googlegroups.com .
> For more options, visit https://groups.google.com/d/optout.
>
>

-- 
You received this message because you are subscribed to the Google Groups 
"TopBraid Suite Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to topbraid-users+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Re: [topbraid-users] importing a very large tab delimited file

[Irene Polikoff]

How many columns?

Sent from my iPhone

> On Feb 1, 2018, at 3:35 PM, Sina  wrote:
> 
> Hi, 
> 
> Do you have a recommended setting/memory/etc. for importing an 800Mb tab 
> delimited text file (9 million rows) into an ontology through the TB import 
> spreadsheet function? 
> 
> Thanks! 
> 
> Sina
> -- 
> You received this message because you are subscribed to the Google Groups 
> "TopBraid Suite Users" group.
> To unsubscribe from this group and stop receiving emails from it, send an 
> email to topbraid-users+unsubscr...@googlegroups.com.
> For more options, visit https://groups.google.com/d/optout.

-- 
You received this message because you are subscribed to the Google Groups 
"TopBraid Suite Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to topbraid-users+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Re: [topbraid-users] importing a very large tab delimited file

[Aaron Kesler]

Hi Sina,
That's a very large file! I'd recommend allocating your entire machine and
shutting every other unnecessary process down. If this doesn't work you'll
probably have to split up the file into two separate files.

Let me know if this works!

Aaron
ᐧ

On Thu, Feb 1, 2018 at 3:35 PM, Sina  wrote:

> Hi,
>
> Do you have a recommended setting/memory/etc. for importing an 800Mb tab
> delimited text file (9 million rows) into an ontology through the TB import
> spreadsheet function?
>
> Thanks!
>
> Sina
>
> --
> You received this message because you are subscribed to the Google Groups
> "TopBraid Suite Users" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to topbraid-users+unsubscr...@googlegroups.com.
> For more options, visit https://groups.google.com/d/optout.
>

-- 
You received this message because you are subscribed to the Google Groups 
"TopBraid Suite Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to topbraid-users+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.