[PHP] php search engine
Hi, I am looking for a php search engine that provides a suggested words (soundex?) when items are misspelt, the way google does. I have used http://www.site-search-pro.com/ i n the past which is great but as far as I know this feature is not included. Ross -- PHP General Mailing List (http://www.php.net/) To unsubscribe, visit: http://www.php.net/unsub.php
Re: [PHP] php search engine
On 3/19/07, Ross [EMAIL PROTECTED] wrote: Hi, I am looking for a php search engine that provides a suggested words (soundex?) when items are misspelt, the way google does. I have used http://www.site-search-pro.com/ i n the past which is great but as far as I know this feature is not included. Ross I've never heard of such search machine, except from google then. But i know the google code was released on warez boards. I'm not giving you a link where to download, as it is illegal to have that code. Tijnema -- PHP General Mailing List (http://www.php.net/) To unsubscribe, visit: http://www.php.net/unsub.php -- PHP General Mailing List (http://www.php.net/) To unsubscribe, visit: http://www.php.net/unsub.php
Re: [PHP] php search engine
At 4:50 PM +0100 3/19/07, Tijnema ! wrote: On 3/19/07, Ross [EMAIL PROTECTED] wrote: Hi, I am looking for a php search engine that provides a suggested words (soundex?) when items are misspelt, the way google does. I have used http://www.site-search-pro.com/ i n the past which is great but as far as I know this feature is not included. Ross I've never heard of such search machine, except from google then. But i know the google code was released on warez boards. I'm not giving you a link where to download, as it is illegal to have that code. Tijnema Ross: I may be off-base here, (not a soundex example) but if a site search is all your after, try this one: http://sperling.com/examples/search/ Cheers, tedd -- --- http://sperling.com http://ancientstones.com http://earthstones.com -- PHP General Mailing List (http://www.php.net/) To unsubscribe, visit: http://www.php.net/unsub.php
Re: [PHP] php search engine
On Mon, March 19, 2007 5:21 am, Ross wrote: I am looking for a php search engine that provides a suggested words (soundex?) when items are misspelt, the way google does. I have used http://www.site-search-pro.com/ i n the past which is great but as far as I know this feature is not included. I suppose you could hack your own with http://php.net/soundex or any of the other 3 or 4 similar packages available in PHP... -- Some people have a gift link here. Know what I want? I want you to buy a CD from some starving artist. http://cdbaby.com/browse/from/lynch Yeah, I get a buck. So? -- PHP General Mailing List (http://www.php.net/) To unsubscribe, visit: http://www.php.net/unsub.php
[PHP] PHP Search Engine - Synonyms
Hi, Is it possible to automatically search for synonyms related to a word in a search engine for example if I create a search engine and search for the word 'Horse', it would automatically search for other words such as 'Pony' etc? Has anyone had any experience on how this would be implemented? Thanks Kevin -- PHP General Mailing List (http://www.php.net/) To unsubscribe, visit: http://www.php.net/unsub.php
Re: [PHP] PHP Search Engine - Synonyms
Another idea from what I just sent: try googling synonym database. It looks like there are a few leads in there as well. On Oct 30, 2006, at 6:26 AM, Kevin wrote: Hi, Is it possible to automatically search for synonyms related to a word in a search engine for example if I create a search engine and search for the word 'Horse', it would automatically search for other words such as 'Pony' etc? Has anyone had any experience on how this would be implemented? -- PHP General Mailing List (http://www.php.net/) To unsubscribe, visit: http://www.php.net/unsub.php
Re: [PHP] PHP Search Engine - Synonyms
On Oct 30, 2006, at 6:26 AM, Kevin wrote: Hi, Is it possible to automatically search for synonyms related to a word in a search engine for example if I create a search engine and search for the word 'Horse', it would automatically search for other words such as 'Pony' etc? It is possible: http://www.google.com/help/refinesearch.html Has anyone had any experience on how this would be implemented? I haven't done it, but it seems straight forward. Start with one word, query a database for it's synonyms, and then use the resulting words (including the original word) in the final search query. It just seems like it would take a lot of work to create a database of words and their synonyms. You'll also need to add weight and sort the results so that your initial keyword scores higher. Honestly, if I were you, I'd run this question by the MySQL mailing list. PHP just works with the results of the search, so you still end up having to figure out how to do this in MySQL (or whatever database you're using). Another thing that might help is to Google keywords like synonym search programming technique. I had to sort through the results, but it did look like there were a few interesting articles. Here's one of them: http://developer.apple.com/documentation/ UserExperience/Conceptual/SearchKitConcepts/searchKit_basics/ chapter_2_section_2.html -Ed -- PHP General Mailing List (http://www.php.net/) To unsubscribe, visit: http://www.php.net/unsub.php
Re: [PHP] PHP Search Engine
Richard Lynch wrote: On Tue, November 8, 2005 11:20 pm, Leonard Burton wrote: Has anyone on here created a search engine in PHP? Sure, of sorts, now and again, here and there, to some degree. I am reasonably certain that if you Googled for: PHP web spider framework you would find several packages that would have at least 99% of what you need... Because these simply have to exist out there. From you description it seems like writing search engine (full text) is simple task for three or four nights. It's not true. Writing quality full text search engine is very complex task and you can stuck at lots of problems. If you don't understand the theory of text searching, you can finish it somehow, but it will not search the way people are used to. The results will be wrong. You think there have to be something written in PHP. There is not. Lots of dead experiments - yes. Something good, working and in active developement - no. There is even not much open source search engines written in other languages. You just cannot stick to PHP - but it doesn't matter in which language is the spider. You need only some interface to the search part. Here's my list: mysql fulltext - toy for children phpdig - lots of little problems here and there, unusable htdig - dead, buggy swish-e - dead? swish++ - one man show? aspseek - dead mnogosearch - try it, it's not google, but usable, php interface lucene - top quality, best query syntax egothor - people says it's usable did I forgot something good? Petr -- PHP General Mailing List (http://www.php.net/) To unsubscribe, visit: http://www.php.net/unsub.php
RE: [PHP] PHP Search Engine
-Original Message- From: Petr Smith [mailto:[EMAIL PROTECTED] Sent: 09 November 2005 11:27 To: php-general@lists.php.net Subject: Re: [PHP] PHP Search Engine Richard Lynch wrote: On Tue, November 8, 2005 11:20 pm, Leonard Burton wrote: Has anyone on here created a search engine in PHP? Sure, of sorts, now and again, here and there, to some degree. I am reasonably certain that if you Googled for: PHP web spider framework you would find several packages that would have at least 99% of what you need... Because these simply have to exist out there. From you description it seems like writing search engine (full text) is simple task for three or four nights. It's not true. Writing quality full text search engine is very complex task and you can stuck at lots of problems. If you don't understand the theory of text searching, you can finish it somehow, but it will not search the way people are used to. The results will be wrong. You think there have to be something written in PHP. There is not. Lots of dead experiments - yes. Something good, working and in active developement - no. There is even not much open source search engines written in other languages. You just cannot stick to PHP - but it doesn't matter in which language is the spider. You need only some interface to the search part. Here's my list: mysql fulltext - toy for children phpdig - lots of little problems here and there, unusable htdig - dead, buggy swish-e - dead? swish++ - one man show? aspseek - dead mnogosearch - try it, it's not google, but usable, php interface lucene - top quality, best query syntax egothor - people says it's usable did I forgot something good? Petr -- It sounds like this is specifically for html pages, or am I assuming wrong? Do any of these or other search engines index html content held in a MySQL database? Arno -- PHP General Mailing List (http://www.php.net/) To unsubscribe, visit: http://www.php.net/unsub.php
Re: [PHP] PHP Search Engine
It sounds like this is specifically for html pages, or am I assuming wrong? Do any of these or other search engines index html content held in a MySQL database? Arno It depends.. Some products are based around web spider (mnogosearch), some are only engines without spider part (lucene). There are ways to add web spider to engine (nutch for lucene) or use only engine part of web spider (you can always generate local content [file structure] from database, it's not very clever but it works). So the answer is yes, you can always index MySQL content somehow. Petr -- PHP General Mailing List (http://www.php.net/) To unsubscribe, visit: http://www.php.net/unsub.php
[PHP] PHP Search Engine
HI All, Has anyone on here created a search engine in PHP? I have project to create a search engine that will search about 50K or so pages of information on 100 or so various domain names. What have you all done in the past? PHPdig was a failure. Do you recommend any of the ones that are for sale? Thanks, -- Leonard Burton, N9URK [EMAIL PROTECTED] The prolonged evacuation would have dramatically affected the survivability of the occupants. -- PHP General Mailing List (http://www.php.net/) To unsubscribe, visit: http://www.php.net/unsub.php
Re: [PHP] PHP Search Engine
HI All, Has anyone on here created a search engine in PHP? I have project to create a search engine that will search about 50K or so pages of information on 100 or so various domain names. What have you all done in the past? PHPdig was a failure. Do you recommend any of the ones that are for sale? http://www.php.net/manual/en/ref.mnogosearch.php don't know much about it though... -- PHP General Mailing List (http://www.php.net/) To unsubscribe, visit: http://www.php.net/unsub.php
Re: [PHP] PHP Search Engine
On Tue, November 8, 2005 11:20 pm, Leonard Burton wrote: Has anyone on here created a search engine in PHP? Sure, of sorts, now and again, here and there, to some degree. Though it was at the lower end of search engine, possible devolving to web-scraping, when you get right down to it... I have project to create a search engine that will search about 50K or so pages of information on 100 or so various domain names. What have you all done in the past? http://php.net/file_get_contents http://php.net/mysql http://php.net/strstr http://php.net/preg_match and a cron job (several, actually) How fancy does it need to be? Are you going to attempt to search all of those in real-time? Surely not. You'd be slamming each domain name to the tune of: 50K pages / 100 domain names == 5000 page hits per domain So you HAVE to rule that out right from the get-go. Which means you're going to have to cache that many pages somehow/somewhere. You know that, right? Because, basically, you could write a crude simplistic search engine in a few days with the functions linked above, assuming you are familiar with most of them, and know MySQL (or other DB) fairly well. You'd want to queue up links to be indexed, and time/stagger them based on domain name (actually, probably IP address of domains) so that you don't visit any site too heavily. I'd also recommend breaking the process up into several stages: TASK #1: 1. Choosing a URL to index, based on IP and least-recently-visited with a minimum time between visits. 2. Just snarf and cache the raw HTML data for that URL, and mark it done with a time-stamp, so step 1 above won't do it again, and won't hit the same IP too soon. TASK #2: 1. Parse one downloaded file and index the interesting words (data, content, images, whatever) inside it, and store that data in a format/schema which allows quick search/access of likely queries, ignoring useless words/data/content (the word the is not worth indexing, really) 2. Mark that downloaded/cached file done as far as indexing goes. TASK #3: 1. Search the downloaded file for interesting URLs to be indexed, and queue them up for TASK #1 to handle later 2. Mark the downloaded/cached file done as far as spidering goes. TASK #4: 1. Purge downloaded/cached files (or db records or whatever) that have been marked done by both TASK #2 and #3 You can then set up cron jobs with varying frequency to perform each TASK as needed. Possibly even with more resources devoted to TASK #1 during low-bandwidth hours (typically late-night US time, for US-based sites) but bumping up the cron intervals for TASKS 2/3 in the daytime. None of this is Rocket Science, really, except indexing the interesting content, and that is so domain-specific, we can't help much with that, other than the general principles... MySQL fulltext indexing would possibly take care of that for you, if you don't really want to sweat on it too hard for now. PHPdig was a failure. In what way[s] did it fail? Speed performance? Caching? URL equivalence identification? Identifying embedded links? Accessing password-protected resources? JavaScript execution? (Not that I think any search engine has that, but what do I know?) Other? I have no idea what PHPdig does or how it works, but telling us it failed is not particularly useful, other than to rule it out as a possible suggestion. I am reasonably certain that if you Googled for: PHP web spider framework you would find several packages that would have at least 99% of what you need... Because these simply have to exist out there. -- Like Music? http://l-i-e.com/artists.htm -- PHP General Mailing List (http://www.php.net/) To unsubscribe, visit: http://www.php.net/unsub.php
[PHP] php search engine
I am looking to install a php site search on one of my sites. Looking at http://www.site-search-pro.com/ has anyoner used this? what do I need to do to get it working? do the files reside on my server? Any alternatives free or paid let me know.. R. -- PHP General Mailing List (http://www.php.net/) To unsubscribe, visit: http://www.php.net/unsub.php
Re: [PHP] php search engine
Ross wrote: I am looking to install a php site search on one of my sites. Looking at http://www.site-search-pro.com/ has anyoner used this? what do I need to do to get it working? do the files reside on my server? Any alternatives free or paid let me know.. I'm partial to mnogoSearch http://search.mnogo.ru/ http://us3.php.net/mnogosearch It has to be compiled into your PHP, so if you're on shared hosting, it may not be an option. -- John C. Nichel ÜberGeek KegWorks.com 716.856.9675 [EMAIL PROTECTED] -- PHP General Mailing List (http://www.php.net/) To unsubscribe, visit: http://www.php.net/unsub.php
[suspicious - maybe spam] [PHP] [suspicious - maybe spam] RE: [PHP] php search engine
hi Ross Any alternatives free or paid let me know.. http://www.isearchthenet.com/isearch/ is a good 'un, so long as you don't have thousands of pages. R -- PHP General Mailing List (http://www.php.net/) To unsubscribe, visit: http://www.php.net/unsub.php
[PHP] php, search engine that index via local filesystem?
Do you know any? --- - Thanks, Louie Miranda -- PHP General Mailing List (http://www.php.net/) To unsubscribe, visit: http://www.php.net/unsub.php
Re: [PHP] php, search engine that index via local filesystem?
Hi, Do you want to provide a web interface to your local file system? well the easiest would then be to just exec locate, which will make use of the slocate db. Alternatively you can try to exec find. These can be done painlessly and you don't have to install any software. If you need a more sophisticated solution i belive htdig has the facility to index from local files. If you are looking to build a full fledged search engine aspseek and mnogosearch (both open source) are some of the best around. all the best Louie Miranda wrote: Do you know any? --- - Thanks, Louie Miranda -- Raditha Dissanayake - http://www.radinks.com/sftp/ Lean and mean Secure FTP applet with Graphical User Inteface. just 150 Kilo Bytes -- PHP General Mailing List (http://www.php.net/) To unsubscribe, visit: http://www.php.net/unsub.php
RE: [PHP] php, search engine that index via local filesystem?
Might want to take a look at: http://www.htdig.org/ Using the PHP wrapper class: http://sourceforge.net/projects/htphp/ -Original Message- From: Louie Miranda [mailto:[EMAIL PROTECTED] Sent: Friday, August 15, 2003 12:42 AM To: [EMAIL PROTECTED] Subject: [PHP] php, search engine that index via local filesystem? Do you know any? --- - Thanks, Louie Miranda -- PHP General Mailing List (http://www.php.net/) To unsubscribe, visit: http://www.php.net/unsub.php -- PHP General Mailing List (http://www.php.net/) To unsubscribe, visit: http://www.php.net/unsub.php
[PHP] Php Search Engine
I am in need of a search engine. I'd rather do one in PhP. Is there one available that I can see or at least get the code for? I'm a newbie to php. :) Krystal -- PHP General Mailing List (http://www.php.net/) To unsubscribe, visit: http://www.php.net/unsub.php
Re: [PHP] Php Search Engine
Can you be a bit more specific as to what you need to search on? Is it a database, a set of web documents or do you want to create a search engine like Google, which crawls websites as needed? Let us know! Marco -- php|architect - The magazine for PHP Professionals The first monthly worldwide magazine dedicated to PHP programmers Come visit us at http://www.phparch.com! ---BeginMessage--- I am in need of a search engine. I'd rather do one in PhP. Is there one available that I can see or at least get the code for? I'm a newbie to php. :) Krystal -- PHP General Mailing List (http://www.php.net/) To unsubscribe, visit: http://www.php.net/unsub.php ---End Message--- -- PHP General Mailing List (http://www.php.net/) To unsubscribe, visit: http://www.php.net/unsub.php
Re: [PHP] Php Search Engine
On Mon, 2002-11-25 at 08:31, [EMAIL PROTECTED] wrote: I am in need of a search engine. I'd rather do one in PhP. Is there one available that I can see or at least get the code for? This article might help. http://www.onlamp.com/pub/a/php/2002/10/24/simplesearchengine.html Brad -- PHP General Mailing List (http://www.php.net/) To unsubscribe, visit: http://www.php.net/unsub.php
[PHP] PHP Search Engine?
Hello, I've picked up a book called the PHP Developer's Cookbook, specifically for the search engine that was featured in it. It required the use of PEAR's File/Find.php, which my host hasn't installed, ..and very likely will not. Is there another way of coming up with a search engine in PHP that doesn't require the use of subscription services? Laurie M. Landry http://www.lmlweb.com voicemail/fax: (604) 693-1120 -- PHP General Mailing List (http://www.php.net/) To unsubscribe, visit: http://www.php.net/unsub.php
Re: [PHP] PHP Search Engine?
So just put that file in your own directory and use it from there. It is just a PHP script. On Sat, 23 Mar 2002, lmlweb wrote: Hello, I've picked up a book called the PHP Developer's Cookbook, specifically for the search engine that was featured in it. It required the use of PEAR's File/Find.php, which my host hasn't installed, ..and very likely will not. Is there another way of coming up with a search engine in PHP that doesn't require the use of subscription services? Laurie M. Landry http://www.lmlweb.com voicemail/fax: (604) 693-1120 -- PHP General Mailing List (http://www.php.net/) To unsubscribe, visit: http://www.php.net/unsub.php -- PHP General Mailing List (http://www.php.net/) To unsubscribe, visit: http://www.php.net/unsub.php
RE: [PHP] PHP Search Engine?
I don't think my server even has PEAR installed, so even if I just put the script on my own directory, it still needs the PEAR.php - will I need to do that too? -Original Message- From: Rasmus Lerdorf [mailto:[EMAIL PROTECTED]] Sent: Saturday, March 23, 2002 1:56 PM To: lmlweb Cc: [EMAIL PROTECTED] Subject: Re: [PHP] PHP Search Engine? So just put that file in your own directory and use it from there. It is just a PHP script. On Sat, 23 Mar 2002, lmlweb wrote: Hello, I've picked up a book called the PHP Developer's Cookbook, specifically for the search engine that was featured in it. It required the use of PEAR's File/Find.php, which my host hasn't installed, ..and very likely will not. Is there another way of coming up with a search engine in PHP that doesn't require the use of subscription services? Laurie M. Landry http://www.lmlweb.com voicemail/fax: (604) 693-1120 -- PHP General Mailing List (http://www.php.net/) To unsubscribe, visit: http://www.php.net/unsub.php -- PHP General Mailing List (http://www.php.net/) To unsubscribe, visit: http://www.php.net/unsub.php
RE: [PHP] PHP Search Engine?
My correction - there is a Pear, and it was just a matter of finding the location (/root/php-4.1.2/pear/File/Find.php) - so I tried to use the full path - owrked, but then the Find.php required the PEAR.php, which was one level. So what I've done so far is to put the Find.php in my directory, and then make the path to the PEAR.php in the Find.php. I don't know if this will work for the search application from the PHP Dev's Cookbook but so far it seem to be working this way. -Original Message- From: lmlweb [mailto:[EMAIL PROTECTED]] I don't think my server even has PEAR installed, so even if I just put the script on my own directory, it still needs the PEAR.php - will I need to do that too? -Original Message- From: Rasmus Lerdorf [mailto:[EMAIL PROTECTED]] Sent: Saturday, March 23, 2002 1:56 PM Subject: Re: [PHP] PHP Search Engine? -- PHP General Mailing List (http://www.php.net/) To unsubscribe, visit: http://www.php.net/unsub.php
