Re: [Rd] Fwd: Re: RSiteSearch, sos, rdocumentation.org, ...?

2016-12-22 Thread Jonathan Baron
The site is working again, although for some reason it did not download any vignettes. I think that is OK. On 12/21/16 18:22, Jonathan Baron wrote: Unfortunately, I am unable to get this search site working again. (The message below explains why I had to rebuild it.) -- Jonathan Baron,

Re: [Rd] Fwd: Re: RSiteSearch, sos, rdocumentation.org, ...?

2016-12-21 Thread Jonathan Baron
Unfortunately, I am unable to get this search site working again. (The message below explains why I had to rebuild it.) The computer worked for the better part of a day downloading and installing all the help files from all CRAN packages. Somehow it failed to get the vignettes this time. But I

Re: [Rd] Fwd: Re: RSiteSearch, sos, rdocumentation.org, ...?

2016-12-17 Thread Jonathan Baron
Spencer and others. I am going to have to take down the server for RSiteSearch, which is finzi.psych.upenn.edu, for at least a couple of days starting Sunday morning. It has been hacked. And I have another server that has also been hacked, which is higher priority (sjdm.org). On Monday, I will

Re: [Rd] Fwd: Re: RSiteSearch, sos, rdocumentation.org, ...?

2016-12-17 Thread Spencer Graves
Hi, Jonathan: Thanks for letting us know. I can't imagine that the unavailability of RSiteSearch would be more than an inconvenience. When you get time, I'd like to know more about what you know about how it was hacked, the host operating system, any anti-virus / Internet

Re: [Rd] Fwd: Re: RSiteSearch, sos, rdocumentation.org, ...?

2016-09-08 Thread John Merrill
That would work, although it would entail standing up a server to front the elasticsearch module. The strikes me a huge investment of time which would, in addition, recreate the current key man risk. On Thu, Sep 8, 2016 at 7:51 AM, Kevin Coombes wrote: > Would it

Re: [Rd] Fwd: Re: RSiteSearch, sos, rdocumentation.org, ...?

2016-09-08 Thread Kevin Coombes
Would it make sense to recreate the "searchable R help pages" by feeding them all into elasticsearch, which will automatically index them and also provides an extensive (HTTP+JSON-based) API to perform complex searches? On 9/8/2016 10:31 AM, Jonathan Baron wrote: On 09/08/16 07:09, John

Re: [Rd] Fwd: Re: RSiteSearch, sos, rdocumentation.org, ...?

2016-09-08 Thread Dirk Eddelbuettel
Jonathan, FWIW I mentored a Google Summer of Code student (who was more than highly self-sufficient and needed next to no help, apart from some small R packaging tricks) as part of the Xapian project in order to write RXapian: https://github.com/amandaJayanetti/RXapian which is an R

Re: [Rd] Fwd: Re: RSiteSearch, sos, rdocumentation.org, ...?

2016-09-08 Thread Jonathan Baron
On 09/08/16 07:09, John Merrill wrote: Given Google's commitment to R, I don't think that they'd be at all averse to supporting a custom search box on the package page. It might well be a good thing for "someone" to examine the API for setting up such a page and to investigate how to mark the

Re: [Rd] Fwd: Re: RSiteSearch, sos, rdocumentation.org, ...?

2016-09-08 Thread Jonathan Baron
I looked at rdocumentation.org. At first I thought it was a superior replacement for namazu, but after I tried a few things I decided that it wasn't. I could not find any documentation about how to search, and the various things I tried seemed to yield very strange responses, e.g., a search for

Re: [Rd] Fwd: Re: RSiteSearch, sos, rdocumentation.org, ...?

2016-09-08 Thread Spencer Graves
On 9/8/2016 5:01 AM, Jonathan Baron wrote: OK. It is sort of fixed and sort of works. We'll keep it for now, but this is not going to work forever. When namazu fails completely I will not have the time to install a new search engine. One option is to use google. For a site like this, I

Re: [Rd] Fwd: Re: RSiteSearch, sos, rdocumentation.org, ...?

2016-09-08 Thread Spencer Graves
On 9/8/2016 3:30 AM, Joris Meys wrote: > > Hi Jonathan, > > I have neither the resources nor the skills to take over, but whatever > happens I want to thank you for all the work. Too often people forget > that all these nice tools keep working due to the devotion of people > like you. > > So

Re: [Rd] Fwd: Re: RSiteSearch, sos, rdocumentation.org, ...?

2016-09-08 Thread Dirk Eddelbuettel
On 8 September 2016 at 06:01, Jonathan Baron wrote: | We have over 10,000 packages now. I wonder if searching all help files | is really helpful anymore. Yes it is. I go to http://rdocumentation.org a lot for quick look-ups. So thanks to Datacamp for running that. Dirk --

Re: [Rd] Fwd: Re: RSiteSearch, sos, rdocumentation.org, ...?

2016-09-08 Thread Michael Dewey
I have mixed feelings about this. I used to find the sos package very useful when I first started using it but as the number of packages has grown I now find it gives me a huge list which takes a lot of time to digest. This may of course reflect my rudimentary search term selection skills.

Re: [Rd] Fwd: Re: RSiteSearch, sos, rdocumentation.org, ...?

2016-09-08 Thread Jonathan Baron
OK. It is sort of fixed and sort of works. We'll keep it for now, but this is not going to work forever. When namazu fails completely I will not have the time to install a new search engine. One option is to use google. For a site like this, I think they will want some money, but I'm not sure,

Re: [Rd] Fwd: Re: RSiteSearch, sos, rdocumentation.org, ...?

2016-09-07 Thread Jonathan Baron
Don't do anything yet. I may have found the problem by accident. I tried to use the computer from something else, and it was being drastically slowed down by some leftover processes, which turned out to be xlhtml. That is something that converts Excel files. Apparently, some excel files got into

Re: [Rd] Fwd: Re: RSiteSearch, sos, rdocumentation.org, ...?

2016-09-07 Thread Jonathan Baron
Spencer, Thanks for the quick reply. I am open to someone who knows Perl getting an account on my site and trying to get it working. It will probably involve fixing more than one thing, as mknmz depends on some perl modules that also generate errors. My main contribution is figuring out how to

[Rd] Fwd: Re: RSiteSearch, sos, rdocumentation.org, ...?

2016-09-07 Thread Spencer Graves
Hello, All: Jonathan Baron is "giving up" maintaining the RSiteSearch database. This breaks three things: (1) The R Site Search web service that Baron has maintained. (2) The RSiteSearch function in the utils package. (3) The sos package, for which I'm the maintainer and