Re: [Wikireader]Full spanish wikipedia successfully packed but...

2009-11-21 Thread David Reyes Samblas Martinez
 how to obtain a spanished wikireader without waiting 20 hours :)
http://www.tuxbrain.com/content/wikireader-ya-en-espa%C3%B1-y-en-castellano

David Reyes Samblas Martinez
http://www.tuxbrain.com
Open ultraportable  embedded solutions
Openmoko, Openpandora,  Arduino
Hey, watch out!!! There's a linux in your pocket!!!




2009/11/20 David Reyes Samblas Martinez da...@tuxbrain.com:
 Intel(R) Core(TM)2 Quad CPU    Q6600  @ 2.40GHz
 RAM 3029MiB DDR2
 HDD:SATA Seagate Barracuda 7200.11 1Tb

 Final size of image directory 918M
 FInal size of  work  directory 3,0G
 Size of downloaded es_xml uncompressed 5,3G
 Size of downloaded es_xml compressed 1.5G

 Total time aprox 20h,  30% parsing  70% rendering, indexing and
 hashing time is negligible

 Total amount of articles 650.000 real and about 1.100.000 counting
 redirections (as far I remember no time to make a full recount :P)

 David Reyes Samblas Martinez
 http://www.tuxbrain.com
 Open ultraportable  embedded solutions
 Openmoko, Openpandora,  Arduino
 Hey, watch out!!! There's a linux in your pocket!!!




 2009/11/20 Nelson Castillo arhu...@freaks-unidos.net:
 On Thu, Nov 19, 2009 at 2:28 PM, David Reyes Samblas Martinez
 da...@tuxbrain.com wrote:
 I have achive to run the full proccess sucsessfully, all articles are

 David, just out of curiosity:

 How long did it take? What computer did you use for this task (CPU
 type/speed/RAM/disk space needed)?

 N.-

 ___
 Openmoko community mailing list
 community@lists.openmoko.org
 http://lists.openmoko.org/mailman/listinfo/community



___
Openmoko community mailing list
community@lists.openmoko.org
http://lists.openmoko.org/mailman/listinfo/community


Re: [Wikireader]Full spanish wikipedia successfully packed but...

2009-11-20 Thread Thomas HOCEDEZ

 On Fri, Nov 20, 2009 at 3:28 AM, David Reyes Samblas Martinez 
 da...@tuxbrain.com mailto:da...@tuxbrain.com wrote:

 I have achive to run the full proccess sucsessfully, all articles are
 there but...


Hi Everybody, does anyone knows where the compiling archive is ? I 
managed to compile application, but I'm on building the french Wikipedia...

Thanks

___
Openmoko community mailing list
community@lists.openmoko.org
http://lists.openmoko.org/mailman/listinfo/community


Re: [Wikireader]Full spanish wikipedia successfully packed but...

2009-11-20 Thread Thomas HOCEDEZ
Thomas HOCEDEZ a écrit :
 On Fri, Nov 20, 2009 at 3:28 AM, David Reyes Samblas Martinez 
 da...@tuxbrain.com mailto:da...@tuxbrain.com wrote:

 I have achive to run the full proccess sucsessfully, all articles are
 there but...

 

 Hi Everybody, does anyone knows where the compiling archive is ? I 
 managed to compile application, but I'm on building the french Wikipedia...

 Thanks

 ___
 Openmoko community mailing list
 community@lists.openmoko.org
 http://lists.openmoko.org/mailman/listinfo/community
   
RTFM would I say ! In fact a simple nano 00Run.sh answered me...

FRench Wiki is 2 400 000 articles long, and took 20 minutes to parse on 
a 1.8Ghz quadcore (only 1used) with 2Gigs ram . 4 more for sorting 
titles, and now it's writing the matrix (??) : pedia.fnd

The long part is being processed.

AstHro,Too-fast-for-you poster



___
Openmoko community mailing list
community@lists.openmoko.org
http://lists.openmoko.org/mailman/listinfo/community


Re: [Wikireader]Full spanish wikipedia successfully packed but...

2009-11-20 Thread Nelson Castillo
On Thu, Nov 19, 2009 at 2:28 PM, David Reyes Samblas Martinez
da...@tuxbrain.com wrote:
 I have achive to run the full proccess sucsessfully, all articles are

David, just out of curiosity:

How long did it take? What computer did you use for this task (CPU
type/speed/RAM/disk space needed)?

N.-

___
Openmoko community mailing list
community@lists.openmoko.org
http://lists.openmoko.org/mailman/listinfo/community


Re: [Wikireader]Full spanish wikipedia successfully packed but...

2009-11-20 Thread David Reyes Samblas Martinez
Intel(R) Core(TM)2 Quad CPUQ6600  @ 2.40GHz
RAM 3029MiB DDR2
HDD:SATA Seagate Barracuda 7200.11 1Tb

Final size of image directory 918M
FInal size of  work  directory 3,0G
Size of downloaded es_xml uncompressed 5,3G
Size of downloaded es_xml compressed 1.5G

Total time aprox 20h,  30% parsing  70% rendering, indexing and
hashing time is negligible

Total amount of articles 650.000 real and about 1.100.000 counting
redirections (as far I remember no time to make a full recount :P)

David Reyes Samblas Martinez
http://www.tuxbrain.com
Open ultraportable  embedded solutions
Openmoko, Openpandora,  Arduino
Hey, watch out!!! There's a linux in your pocket!!!




2009/11/20 Nelson Castillo arhu...@freaks-unidos.net:
 On Thu, Nov 19, 2009 at 2:28 PM, David Reyes Samblas Martinez
 da...@tuxbrain.com wrote:
 I have achive to run the full proccess sucsessfully, all articles are

 David, just out of curiosity:

 How long did it take? What computer did you use for this task (CPU
 type/speed/RAM/disk space needed)?

 N.-

 ___
 Openmoko community mailing list
 community@lists.openmoko.org
 http://lists.openmoko.org/mailman/listinfo/community


___
Openmoko community mailing list
community@lists.openmoko.org
http://lists.openmoko.org/mailman/listinfo/community


Re: [Wikireader]Full spanish wikipedia successfully packed but...

2009-11-19 Thread Sean Moss-Pultz
On Fri, Nov 20, 2009 at 3:28 AM, David Reyes Samblas Martinez 
da...@tuxbrain.com wrote:

 I have achive to run the full proccess sucsessfully, all articles are
 there but... (why has allways to be a but...:() I can't use search
 with more than three letters, when I write down the forth letter, it
 allways print a No entries found. I can search the words presing 3
 letters, press the search button again to make the keyboard disappear
 and scrolling but this is far than optimal :P
 Any clues where the problem can be?


Hi David

You need to generate a hash file (pedia.hsh). Look at hash-gen. It's run
from the Make file when you run combine.

Sean
___
Openmoko community mailing list
community@lists.openmoko.org
http://lists.openmoko.org/mailman/listinfo/community