Re: [PHP-DB] Search engine
Hi Ron
This doesn't sound like a Db problem then.
You could open each page and use a regex to search for the links.
Something like:
preg_match_all("/(.*)<\a>/", $page, $matches,
PREG_PATTERN_ORDER);
which would produce an array ($matches[1]) of the addresses and a array
($matches[2]) of corresponding link text, but only for a basic link, without
additional attributes
Niel
--
PHP Database Mailing List (http://www.php.net/)
To unsubscribe, visit: http://www.php.net/unsub.php
Re: [PHP-DB] Search engine
It's not that complicated, after crawling your website at a specific time you can check for content created in your database after that time. Then you can search specific fields from that content for words and index them. If you need to find tags you'ld best use regular expressions to search through the text and then follow those links. You can keep an index of links crawled and date they were crawled to ensure you don't crawl pages that haven't changed. I wrote a crawling engine for bittorrent site so if you need some sample code let me know. Ron Piggott (PHP) wrote: What I haven't figured out is how to crawl my site. If I knew how to crawl my site I could write a basic search engine and develop it over time. This is the crucial issue I need help with. I have a really basic search engine I wrote last year. I told my web site what pages the user could search ... as in I keyed in the URL's I am giving my site a face lift and making some serious changes to it ... I have my database out of date ... I would like to crawl my site once a day to update what changes I made during the past 24 hours and delete HTML files which no longer exist. If someone knew how to retrieve various then I could start with something and build on it over time ... Ron -- PHP Database Mailing List (http://www.php.net/) To unsubscribe, visit: http://www.php.net/unsub.php
Re: [PHP-DB] Search engine
Truth be told, Google's free slap-it-on-your-web site search tool (http://www.google.com/services/websearch.html) will do everything you want and save you a lot of coding. Assuming this is for actsministries.org which seems to be a useful resource of information; it is probably well indexed by Google and updates will be reflected reasonably quickly. On my most popular site, which is sort of a resource, Google is usually 24-48 hours behind changes. Doing your own search coding is best when you want to allow users to search data in a database (rather than on web pages). Good luck, Jeffrey Ron Piggott (PHP) wrote: What I haven't figured out is how to crawl my site. If I knew how to crawl my site I could write a basic search engine and develop it over time. This is the crucial issue I need help with. I have a really basic search engine I wrote last year. I told my web site what pages the user could search ... as in I keyed in the URL's I am giving my site a face lift and making some serious changes to it ... I have my database out of date ... I would like to crawl my site once a day to update what changes I made during the past 24 hours and delete HTML files which no longer exist. If someone knew how to retrieve various then I could start with something and build on it over time ... Ron On Thu, 2006-09-28 at 11:44 +0100, Shaun A Riches wrote: What about the MySQL "LIKE" command? Research it. This is assuming your data is stored properly without redundant data and in a MySQL database. ___ Shaun Riches Computer Science Student -Original Message- From: Ron Piggott (PHP) [mailto:[EMAIL PROTECTED] Sent: Thu 28/09/2006 03:44 To: PHP DB Subject: [PHP-DB] Search engine ___ Shaun Riches Computer Science Student -Original Message- From: Ron Piggott (PHP) [mailto:[EMAIL PROTECTED] Sent: Thu 28/09/2006 03:44 To: PHP DB Subject: [PHP-DB] Search engine Has anyone wrote a search engine for the web site? I am wondering if someone has the time to help me walk through doing this. Ron -- PHP Database Mailing List (http://www.php.net/) To unsubscribe, visit: http://www.php.net/unsub.php
RE: [PHP-DB] Search engine
What I haven't figured out is how to crawl my site. If I knew how to crawl my site I could write a basic search engine and develop it over time. This is the crucial issue I need help with. I have a really basic search engine I wrote last year. I told my web site what pages the user could search ... as in I keyed in the URL's I am giving my site a face lift and making some serious changes to it ... I have my database out of date ... I would like to crawl my site once a day to update what changes I made during the past 24 hours and delete HTML files which no longer exist. If someone knew how to retrieve various then I could start with something and build on it over time ... Ron On Thu, 2006-09-28 at 11:44 +0100, Shaun A Riches wrote: > What about the MySQL "LIKE" command? Research it. > > This is assuming your data is stored properly without redundant data > and in a MySQL database. > > ___ > Shaun Riches > Computer Science Student > > > > -Original Message- > From: Ron Piggott (PHP) [mailto:[EMAIL PROTECTED] > Sent: Thu 28/09/2006 03:44 > To: PHP DB > Subject: [PHP-DB] Search engine > > > > ___ > Shaun Riches > Computer Science Student > > > > -Original Message- > From: Ron Piggott (PHP) [mailto:[EMAIL PROTECTED] > Sent: Thu 28/09/2006 03:44 > To: PHP DB > Subject: [PHP-DB] Search engine > > Has anyone wrote a search engine for the web site? I am wondering if > someone has the time to help me walk through doing this. Ron > > > >
Re: [PHP-DB] Search engine
Hi > What about the MySQL "LIKE" command? Research it. An excellent start for searching a db, but did you miss the point of the question. He wanted to know if anyone had experience with this to save him building from the ground up. I haven't, l so didn't reply If no other help is forthcoming, you might start by looking at the Service_Google package on PEAR. At the very least, it should allow you to have Google search your pages for you. Niel -- PHP Database Mailing List (http://www.php.net/) To unsubscribe, visit: http://www.php.net/unsub.php
RE: [PHP-DB] Search engine
Title: RE: [PHP-DB] Search engine What about the MySQL "LIKE" command? Research it. This is assuming your data is stored properly without redundant data and in a MySQL database. ___ Shaun Riches Computer Science Student -Original Message- From: Ron Piggott (PHP) [mailto:[EMAIL PROTECTED]] Sent: Thu 28/09/2006 03:44 To: PHP DB Subject: [PHP-DB] Search engine ___ Shaun Riches Computer Science Student -Original Message- From: Ron Piggott (PHP) [mailto:[EMAIL PROTECTED]] Sent: Thu 28/09/2006 03:44 To: PHP DB Subject: [PHP-DB] Search engine Has anyone wrote a search engine for the web site? I am wondering if someone has the time to help me walk through doing this. Ron -- PHP Database Mailing List (http://www.php.net/) To unsubscribe, visit: http://www.php.net/unsub.php
Re: [PHP-DB] search engine for database driven site?
1. use WYSIWYG html editor to make the initial HTM page with a search form with 2 text boxes. 2. the action for the form is the PHP page. 3. connect the two (using the variables in the sql query statement that's what i do... andrew hill wrote: > > Hi, > > Can anyone recommend either a general approach or sample scripts to create a > search-box on my site? > It's an existing site being dynamically generated from a database - I want > to specify a couple of fields in my main page table to be searched on. > > cheers, > duirfire > > _ > Get your FREE download of MSN Explorer at http://explorer.msn.com/intl.asp > > -- > PHP Database Mailing List (http://www.php.net/) > To unsubscribe, e-mail: [EMAIL PROTECTED] > For additional commands, e-mail: [EMAIL PROTECTED] > To contact the list administrators, e-mail: [EMAIL PROTECTED] -- Leo G. Divinagracia III [EMAIL PROTECTED] -- PHP Database Mailing List (http://www.php.net/) To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED] To contact the list administrators, e-mail: [EMAIL PROTECTED]
Re: [PHP-DB] search engine
Hi,
Databases tend not to be the best solution for text index
searching what you want. There are better products like glimpse
that do what you want.
M.
On Wed, Jan 10, 2001 at 03:08:14PM +0100, Luescher Samuel (MMVZSLU) wrote :
> hi there. i am currently developing an active contant engine for fully
> dynamic web sites (php4/mysql). now what is a db-powered site without search
> functionality? nothing. thus, i want to implement an internal search engine.
>
> in a nutshell, i have all my content ("pages") stored in a table. the
> columns "name" (unique entry title) and "body" are interesting here. now
> searches on a topic are no problem, i can simply perform "name LIKE .."
> queries. the thing is, if there are no exact matches, how can i return a
> virtually unlimited list of near matches, using nothing but sql queries?
> furthermore, i want full-text search. the bodies are blobs. is there a way
> to get all the items containing a string, most hits on top? what's the
> trick, maybe regular expressions?
--
Markus Fischer, http://josefine.ben.tuwien.ac.at/~mfischer/
EMail: [EMAIL PROTECTED]
PGP Public Key: http://josefine.ben.tuwien.ac.at/~mfischer/C2272BD0.asc
PGP Fingerprint: D3B0 DD4F E12B F911 3CE1 C2B5 D674 B445 C227 2BD0
--
PHP Database Mailing List (http://www.php.net/)
To unsubscribe, e-mail: [EMAIL PROTECTED]
For additional commands, e-mail: [EMAIL PROTECTED]
To contact the list administrators, e-mail: [EMAIL PROTECTED]
