[wikireader] French image available !
Hi WikiReaders ! I'm proud to tell you the french image of the Wikireader is (finally) released ! It is based on the dump of 20th december 2009. It is 1.4Gb weigth (nice baby) and contains 898 000 articles. A beginning of picture support (math formulas for now). It took 18 hours to parse 20 hours to render. (an automated process is being thought). No more blahblah, here's the link : ftp://alionet-repository.no-ip.info/Linux/OpenMoko/wikireader/wr_fr_20100120.tar.gz Bonne Lecture. AstHrO ___ Openmoko community mailing list community@lists.openmoko.org http://lists.openmoko.org/mailman/listinfo/community
Re: [wikireader] French image available !
Hi, I don't have a WikiReader but congratulation for your work and Cocorico ! Mickael Thomas HOCEDEZ a écrit : Hi WikiReaders ! I'm proud to tell you the french image of the Wikireader is (finally) released ! It is based on the dump of 20th december 2009. It is 1.4Gb weigth (nice baby) and contains 898 000 articles. A beginning of picture support (math formulas for now). It took 18 hours to parse 20 hours to render. (an automated process is being thought). No more blahblah, here's the link : ftp://alionet-repository.no-ip.info/Linux/OpenMoko/wikireader/wr_fr_20100120.tar.gz Bonne Lecture. AstHrO ___ Openmoko community mailing list community@lists.openmoko.org http://lists.openmoko.org/mailman/listinfo/community ___ Openmoko community mailing list community@lists.openmoko.org http://lists.openmoko.org/mailman/listinfo/community
Re: [WikiReader] French Image
Tilman Baumann wrote: David Reyes Samblas Martinez wrote: 2009/12/1 Thomas HOCEDEZ thomas.hoce...@free.fr: No, I didn't. What would be the interest to do so ? it generate the index from the final filesto be able to search them correctly generating a hash file that must be included, in the image directory: $../host-tools/has-gen/has-gen --fnd=pedia.fnd --pfx=pedia.pfx --hsh=pedia.hsh I suspect there is still something wrong with my modification to the script. Indeed there was. I forgot to append the parser output instead I overwrote it. see http://github.com/tbaumann/wikireader/commit/e5f95508476b34c6c381fa5fec16f1986010f5b4 Now it is much much better. But unfortunately still not 100% correct. At least one link/keyword points to the wrong article. I found the problem with the Walt Kelly keyword which points to a jpeg file article. I suppose if we skip articles we have to also remove them from the index? I will investigate this, but I have little time and my python foo is weak. Regards Tilman Baumann ___ Openmoko community mailing list community@lists.openmoko.org http://lists.openmoko.org/mailman/listinfo/community
Re: [WikiReader] French Image
David Reyes Samblas Martinez wrote: 2009/12/1 Thomas HOCEDEZ thomas.hoce...@free.fr: No, I didn't. What would be the interest to do so ? it generate the index from the final filesto be able to search them correctly generating a hash file that must be included, in the image directory: $../host-tools/has-gen/has-gen --fnd=pedia.fnd --pfx=pedia.pfx --hsh=pedia.hsh I suspect there is still something wrong with my modification to the script. Building of my German wikipedia finally finished, but it does not work correctly. No link or even search points to the right article. Some articles are not even found. I removed all files that started with pedia* and copied the following files from my image dir on it. pedia0.dat pedia0.idx-tmp pedia.fnd pedia.hsh pedia.idx pedia.pfx Any ideas? I think I jinxed the PARSER_COMMAND and it re-writes the output file every time I restart it. But to test that I need two or three days again. :) Regards Tilman Baumann ___ Openmoko community mailing list community@lists.openmoko.org http://lists.openmoko.org/mailman/listinfo/community
Re: [WikiReader] French Image
No, I didn't. What would be the interest to do so ? I used ArticleIndex, ArticleParser and ArticleRenderer individually (not the 00run shell script.) This time, I use the script, but a huge articles0.html file is being generated. I think it is not a good thing, but I will see this midday, the parsing will be over and rendering started. About the French application, I managed to compile with french sentences, but the keybord refuses to be changed (though I redraw it !) For now, one of my priority will be to find parts to replace my touch area (or whole screen, all seems to be glued). David Reyes Samblas Martinez a écrit : Had you generated a hash file? using hash-gen utility? , regards. David Reyes Samblas Martinez 2009/12/1 Thomas Hocedez thomas.hoce...@free.fr: Hi people. I manage to generate a French image for the wikireader .. but it is not usable. A sad Failed to load article is always displayed. My image strangely a single 1.4Go file ... any idea ? ___ Openmoko community mailing list community@lists.openmoko.org http://lists.openmoko.org/mailman/listinfo/community
Re: [WikiReader] French Image
Thomas Hocedez wrote: Hi people. I manage to generate a French image for the wikireader .. but it is not usable. A sad Failed to load article is always displayed. My image strangely a single 1.4Go file ... any idea ? I'm regenerating an image. using lasts scripts. We'll see tomorrow. Tilmasn did you manage to generate something good ? Unfortunately not. I'm building in a virtual machine. So it's slow. :) And I still missed a bug in the code. The programme does not terminate correctly because I left crap in the cleanup routine. Damn runtime errors after 10 hours or so. :) Keep you posted... ___ Openmoko community mailing list community@lists.openmoko.org http://lists.openmoko.org/mailman/listinfo/community
Re: [WikiReader] French Image
2009/12/1 Thomas HOCEDEZ thomas.hoce...@free.fr: No, I didn't. What would be the interest to do so ? it generate the index from the final filesto be able to search them correctly generating a hash file that must be included, in the image directory: $../host-tools/has-gen/has-gen --fnd=pedia.fnd --pfx=pedia.pfx --hsh=pedia.hsh I used ArticleIndex, ArticleParser and ArticleRenderer individually (not the 00run shell script.) This time, I use the script, but a huge articles0.html file is being generated. I think it is not a good thing, parsing is precisely the generation of this html files :) it transform from wiki code to html , so is normal that file is generated is about the sizes of the original xml file but I will see this midday, the parsing will be over and rendering started. About the French application, I managed to compile with french sentences, but the keybord refuses to be changed (though I redraw it !) For now, one of my priority will be to find parts to replace my touch area (or whole screen, all seems to be glued). Regarding just one pedia0.dat file is normal cause you use only one machine to do that, OM has generated varios dat files because they paralelize the process , with different peaces of the xml to parse/render David Reyes Samblas Martinez a écrit : Had you generated a hash file? using hash-gen utility? , regards. David Reyes Samblas Martinez 2009/12/1 Thomas Hocedez thomas.hoce...@free.fr: Hi people. I manage to generate a French image for the wikireader .. but it is not usable. A sad Failed to load article is always displayed. My image strangely a single 1.4Go file ... any idea ? ___ Openmoko community mailing list community@lists.openmoko.org http://lists.openmoko.org/mailman/listinfo/community David Reyes Samblas Martinez http://www.tuxbrain.com Open ultraportable embedded solutions Openmoko, Openpandora, Arduino Hey, watch out!!! There's a linux in your pocket!!! ___ Openmoko community mailing list community@lists.openmoko.org http://lists.openmoko.org/mailman/listinfo/community
Re: [WikiReader] French Image
David Reyes Samblas Martinez a écrit : 2009/12/1 Thomas HOCEDEZ thomas.hoce...@free.fr: No, I didn't. What would be the interest to do so ? it generate the index from the final filesto be able to search them correctly generating a hash file that must be included, in the image directory: $../host-tools/has-gen/has-gen --fnd=pedia.fnd --pfx=pedia.pfx --hsh=pedia.hsh I used ArticleIndex, ArticleParser and ArticleRenderer individually (not the 00run shell script.) This time, I use the script, but a huge articles0.html file is being generated. I think it is not a good thing, parsing is precisely the generation of this html files :) it transform from wiki code to html , so is normal that file is generated is about the sizes of the original xml file but I will see this midday, the parsing will be over and rendering started. About the French application, I managed to compile with french sentences, but the keybord refuses to be changed (though I redraw it !) For now, one of my priority will be to find parts to replace my touch area (or whole screen, all seems to be glued). Regarding just one pedia0.dat file is normal cause you use only one machine to do that, OM has generated varios dat files because they paralelize the process , with different peaces of the xml to parse/render Well thanks for all thoses lights ! I'll bee able to go to sleep less stupid tonight ! ;-) I'll try your tricks, and give you back my answers. Thanks again. THomas ___ Openmoko community mailing list community@lists.openmoko.org http://lists.openmoko.org/mailman/listinfo/community
[WikiReader] French Image
Hi people. I manage to generate a French image for the wikireader .. but it is not usable. A sad Failed to load article is always displayed. My image strangely a single 1.4Go file ... any idea ? Second bad news for tonight : as I dismantle the WR to be more convenient to change SD card (by soldering batteries outside), I check for some room to add leds to backlight the screen. In one hand there is no way to backlight screen (with AAA batteries I mean), in the other hand, my touchscreen doesn't respond anymore ! I will only use the random button 'till I found some spare parts (I think the ribbon might be broken) and I don't want to let the project down right now ! I'm regenerating an image. using lasts scripts. We'll see tomorrow. Tilmasn did you manage to generate something good ? Regards Thomas ___ Openmoko community mailing list community@lists.openmoko.org http://lists.openmoko.org/mailman/listinfo/community
Re: [WikiReader] French Image
Had you generated a hash file? using hash-gen utility? , regards. David Reyes Samblas Martinez http://www.tuxbrain.com Open ultraportable embedded solutions Openmoko, Openpandora, Arduino Hey, watch out!!! There's a linux in your pocket!!! 2009/12/1 Thomas Hocedez thomas.hoce...@free.fr: Hi people. I manage to generate a French image for the wikireader .. but it is not usable. A sad Failed to load article is always displayed. My image strangely a single 1.4Go file ... any idea ? Second bad news for tonight : as I dismantle the WR to be more convenient to change SD card (by soldering batteries outside), I check for some room to add leds to backlight the screen. In one hand there is no way to backlight screen (with AAA batteries I mean), in the other hand, my touchscreen doesn't respond anymore ! I will only use the random button 'till I found some spare parts (I think the ribbon might be broken) and I don't want to let the project down right now ! I'm regenerating an image. using lasts scripts. We'll see tomorrow. Tilmasn did you manage to generate something good ? Regards Thomas ___ Openmoko community mailing list community@lists.openmoko.org http://lists.openmoko.org/mailman/listinfo/community ___ Openmoko community mailing list community@lists.openmoko.org http://lists.openmoko.org/mailman/listinfo/community
