Re: [GNUnet-developers] New gnunet bibliography
Schanzenbach, Martin transcribed 3.9K bytes: > > > > On 17. May 2018, at 21:13, Nils Gillmann wrote: > > > > Schanzenbach, Martin transcribed 3.1K bytes: > >> I do not want to hijack the other thread so I open this. > >> I can help with the bib, but when I do a "make" in the gnunetbib (after I > >> fix all the quote errors) I get 2295 "ERROR"s a la: > >> > >> ERROR: Misformed pages in 1962 > >> ERROR: reed60polynomial has no www_section field > >> ERROR: Misformed pages in reed60polynomial > >> ERROR: 1959 has no www_section field > >> ERROR: Misformed pages in 1959 > >> ERROR: 368907 has no www_section field > >> ERROR: Misformed pages in 368907 > >> ERROR: 1950 has no www_section field > >> ERROR: Misformed pages in 1950 > >> ERROR: 1944 has no www_section field > >> ERROR: Misformed pages in 1944 > > > > Yep, that's expected as www_section is required (this is how anonbib is > > setup), > > and > > > Oh it still generates the "full" folder. So the html is actually there. > Basically the final "chore" is to sift through gnunet.org and tag the GNUnet > papers in the gnunetbib.bib with an appropriate www_section. > This has to be done manually, more or less. I think for the papers which are not gnunet.org located we can save some time and write a crawler which searches from a seed of all URLs in the bibtex + well-known locations and a fallback to ski-hub + libgen for a cached / hosted location of document URLs that broke over the years. At least my motivation to fix links by hand is not high. Sure, it is fun and rewarding, but you progress slowly. > > > >> before it then crashes with: > > > > ...the crash happens because the processing of the bib file failed. > > This is normal. > > > >> Traceback (most recent call last): > >> File "writeHTML.py", line 249, in > >>writePageSet(config, bib, tag) > >> File "writeHTML.py", line 157, in writePageSet > >>cache_url_path=cache_url_path) > >> File "writeHTML.py", line 109, in writeHTML > >>base_url=root) > >> File "writeHTML.py", line 49, in writeBody > >>print >>f, e.to_html(cache_path=cache_path, base_url=base_url) > >> File "/Users/schanzen/gnunet/gnunetbib/BibTeX.py", line 603, in to_html > >>htmlAuthors = [ a.htmlizeWithLink() for a in self.parsedAuthor ] > >> TypeError: 'NoneType' object is not iterable > >> > >> Must we fix all of those? This seems to be _a lot_ of tedious, manual > >> labour. > > > > Yeah... If you come up with a script to fix it, commit it to the > > repo or just do it. So far I have fixed it with manual search and > > replace (and sometimes emacs tools). > > > >> Am I doing it wrong? > >> > >> BR > >> Martin > > ___ > GNUnet-developers mailing list > GNUnet-developers@gnu.org > https://lists.gnu.org/mailman/listinfo/gnunet-developers signature.asc Description: PGP signature ___ GNUnet-developers mailing list GNUnet-developers@gnu.org https://lists.gnu.org/mailman/listinfo/gnunet-developers
Re: [GNUnet-developers] New gnunet bibliography
Schanzenbach, Martin transcribed 3.7K bytes:
> Ok. Commit 2902e10ead621f4b2172edbc7161e36af9bfb42f should make it build the
> full bib now.
> I had to add a few "author" fields as "author = {TODO}", else it failed. I
> did not bother to find the actual authors for now. Unfortunately you cannot
> leave the field blank.
>
> The selectors do not work, yet. Not sure how they work anyway though.
>
> BR
> Martin
Sounds good
> > On 17. May 2018, at 20:04, Schanzenbach, Martin
> > wrote:
> >
> > I do not want to hijack the other thread so I open this.
> > I can help with the bib, but when I do a "make" in the gnunetbib (after I
> > fix all the quote errors) I get 2295 "ERROR"s a la:
> >
> > ERROR: Misformed pages in 1962
> > ERROR: reed60polynomial has no www_section field
> > ERROR: Misformed pages in reed60polynomial
> > ERROR: 1959 has no www_section field
> > ERROR: Misformed pages in 1959
> > ERROR: 368907 has no www_section field
> > ERROR: Misformed pages in 368907
> > ERROR: 1950 has no www_section field
> > ERROR: Misformed pages in 1950
> > ERROR: 1944 has no www_section field
> > ERROR: Misformed pages in 1944
> >
> > before it then crashes with:
> >
> > Traceback (most recent call last):
> > File "writeHTML.py", line 249, in
> >writePageSet(config, bib, tag)
> > File "writeHTML.py", line 157, in writePageSet
> >cache_url_path=cache_url_path)
> > File "writeHTML.py", line 109, in writeHTML
> >base_url=root)
> > File "writeHTML.py", line 49, in writeBody
> >print >>f, e.to_html(cache_path=cache_path, base_url=base_url)
> > File "/Users/schanzen/gnunet/gnunetbib/BibTeX.py", line 603, in to_html
> >htmlAuthors = [ a.htmlizeWithLink() for a in self.parsedAuthor ]
> > TypeError: 'NoneType' object is not iterable
> >
> > Must we fix all of those? This seems to be _a lot_ of tedious, manual
> > labour.
> > Am I doing it wrong?
> >
> > BR
> > Martin
> > ___
> > GNUnet-developers mailing list
> > GNUnet-developers@gnu.org
> > https://lists.gnu.org/mailman/listinfo/gnunet-developers
>
> ___
> GNUnet-developers mailing list
> GNUnet-developers@gnu.org
> https://lists.gnu.org/mailman/listinfo/gnunet-developers
___
GNUnet-developers mailing list
GNUnet-developers@gnu.org
https://lists.gnu.org/mailman/listinfo/gnunet-developers
Re: [GNUnet-developers] New gnunet bibliography
> On 17. May 2018, at 21:13, Nils Gillmann wrote: > > Schanzenbach, Martin transcribed 3.1K bytes: >> I do not want to hijack the other thread so I open this. >> I can help with the bib, but when I do a "make" in the gnunetbib (after I >> fix all the quote errors) I get 2295 "ERROR"s a la: >> >> ERROR: Misformed pages in 1962 >> ERROR: reed60polynomial has no www_section field >> ERROR: Misformed pages in reed60polynomial >> ERROR: 1959 has no www_section field >> ERROR: Misformed pages in 1959 >> ERROR: 368907 has no www_section field >> ERROR: Misformed pages in 368907 >> ERROR: 1950 has no www_section field >> ERROR: Misformed pages in 1950 >> ERROR: 1944 has no www_section field >> ERROR: Misformed pages in 1944 > > Yep, that's expected as www_section is required (this is how anonbib is > setup), > and Oh it still generates the "full" folder. So the html is actually there. Basically the final "chore" is to sift through gnunet.org and tag the GNUnet papers in the gnunetbib.bib with an appropriate www_section. This has to be done manually, more or less. > >> before it then crashes with: > > ...the crash happens because the processing of the bib file failed. > This is normal. > >> Traceback (most recent call last): >> File "writeHTML.py", line 249, in >>writePageSet(config, bib, tag) >> File "writeHTML.py", line 157, in writePageSet >>cache_url_path=cache_url_path) >> File "writeHTML.py", line 109, in writeHTML >>base_url=root) >> File "writeHTML.py", line 49, in writeBody >>print >>f, e.to_html(cache_path=cache_path, base_url=base_url) >> File "/Users/schanzen/gnunet/gnunetbib/BibTeX.py", line 603, in to_html >>htmlAuthors = [ a.htmlizeWithLink() for a in self.parsedAuthor ] >> TypeError: 'NoneType' object is not iterable >> >> Must we fix all of those? This seems to be _a lot_ of tedious, manual labour. > > Yeah... If you come up with a script to fix it, commit it to the > repo or just do it. So far I have fixed it with manual search and > replace (and sometimes emacs tools). > >> Am I doing it wrong? >> >> BR >> Martin signature.asc Description: Message signed with OpenPGP ___ GNUnet-developers mailing list GNUnet-developers@gnu.org https://lists.gnu.org/mailman/listinfo/gnunet-developers
Re: [GNUnet-developers] New gnunet bibliography
Ok. Commit 2902e10ead621f4b2172edbc7161e36af9bfb42f should make it build the
full bib now.
I had to add a few "author" fields as "author = {TODO}", else it failed. I did
not bother to find the actual authors for now. Unfortunately you cannot leave
the field blank.
The selectors do not work, yet. Not sure how they work anyway though.
BR
Martin
> On 17. May 2018, at 20:04, Schanzenbach, Martin
> wrote:
>
> I do not want to hijack the other thread so I open this.
> I can help with the bib, but when I do a "make" in the gnunetbib (after I fix
> all the quote errors) I get 2295 "ERROR"s a la:
>
> ERROR: Misformed pages in 1962
> ERROR: reed60polynomial has no www_section field
> ERROR: Misformed pages in reed60polynomial
> ERROR: 1959 has no www_section field
> ERROR: Misformed pages in 1959
> ERROR: 368907 has no www_section field
> ERROR: Misformed pages in 368907
> ERROR: 1950 has no www_section field
> ERROR: Misformed pages in 1950
> ERROR: 1944 has no www_section field
> ERROR: Misformed pages in 1944
>
> before it then crashes with:
>
> Traceback (most recent call last):
> File "writeHTML.py", line 249, in
>writePageSet(config, bib, tag)
> File "writeHTML.py", line 157, in writePageSet
>cache_url_path=cache_url_path)
> File "writeHTML.py", line 109, in writeHTML
>base_url=root)
> File "writeHTML.py", line 49, in writeBody
>print >>f, e.to_html(cache_path=cache_path, base_url=base_url)
> File "/Users/schanzen/gnunet/gnunetbib/BibTeX.py", line 603, in to_html
>htmlAuthors = [ a.htmlizeWithLink() for a in self.parsedAuthor ]
> TypeError: 'NoneType' object is not iterable
>
> Must we fix all of those? This seems to be _a lot_ of tedious, manual labour.
> Am I doing it wrong?
>
> BR
> Martin
> ___
> GNUnet-developers mailing list
> GNUnet-developers@gnu.org
> https://lists.gnu.org/mailman/listinfo/gnunet-developers
signature.asc
Description: Message signed with OpenPGP
___
GNUnet-developers mailing list
GNUnet-developers@gnu.org
https://lists.gnu.org/mailman/listinfo/gnunet-developers
Re: [GNUnet-developers] New gnunet bibliography
Schanzenbach, Martin transcribed 3.1K bytes: > I do not want to hijack the other thread so I open this. > I can help with the bib, but when I do a "make" in the gnunetbib (after I fix > all the quote errors) I get 2295 "ERROR"s a la: > > ERROR: Misformed pages in 1962 > ERROR: reed60polynomial has no www_section field > ERROR: Misformed pages in reed60polynomial > ERROR: 1959 has no www_section field > ERROR: Misformed pages in 1959 > ERROR: 368907 has no www_section field > ERROR: Misformed pages in 368907 > ERROR: 1950 has no www_section field > ERROR: Misformed pages in 1950 > ERROR: 1944 has no www_section field > ERROR: Misformed pages in 1944 Yep, that's expected as www_section is required (this is how anonbib is setup), and > before it then crashes with: ...the crash happens because the processing of the bib file failed. This is normal. > Traceback (most recent call last): > File "writeHTML.py", line 249, in > writePageSet(config, bib, tag) > File "writeHTML.py", line 157, in writePageSet > cache_url_path=cache_url_path) > File "writeHTML.py", line 109, in writeHTML > base_url=root) > File "writeHTML.py", line 49, in writeBody > print >>f, e.to_html(cache_path=cache_path, base_url=base_url) > File "/Users/schanzen/gnunet/gnunetbib/BibTeX.py", line 603, in to_html > htmlAuthors = [ a.htmlizeWithLink() for a in self.parsedAuthor ] > TypeError: 'NoneType' object is not iterable > > Must we fix all of those? This seems to be _a lot_ of tedious, manual labour. Yeah... If you come up with a script to fix it, commit it to the repo or just do it. So far I have fixed it with manual search and replace (and sometimes emacs tools). > Am I doing it wrong? > > BR > Martin ___ GNUnet-developers mailing list GNUnet-developers@gnu.org https://lists.gnu.org/mailman/listinfo/gnunet-developers
