UdmSearch: Direct injection into Database

2001-02-15 Thread Briggs, Gary
Has anyone got a way that I can directly inject information into the mySQL database that Mnogo is using as it's backend, and then ensure that the spider won't change it? I'm after a system whereby I can go and collect XML from a server, then have mnogo search return urls based on that. This is

RE: UdmSearch: Webboard: Process in background!

2000-12-18 Thread Briggs, Gary
use screen... $ screen $ cd to-the-dir $ ./indexer -a $ Push ctrl+a, ctrl+d When you want it back, $ exec screen -r or similar. That way you can get back to it. Unlike ye olde "nohup indexer /dev/null " Gary (-; -Original Message- From: Anonymous [SMTP:[EMAIL PROTECTED]] Sent:

RE: UdmSearch: Webboard: How to see what indexer is upto at any give time

2000-11-14 Thread Briggs, Gary
I use the command "screen" for everything... including standard log ins... It's SERIOUSLY useful... including the ability to disconnect terminals, reconnect them, and if your telnet session accidentally dies [for eg, your NT workstation blue screens...], you can get back anythign you WERE doing,

RE: UdmSearch: Webboard: How to see what indexer is upto at any give time

2000-11-14 Thread Briggs, Gary
-Original Message- From: Alexander Barkov [SMTP:[EMAIL PROTECTED]] Sent: Tuesday, November 14, 2000 9:08 AM To: [EMAIL PROTECTED] Subject: UdmSearch: Webboard: How to see what indexer is upto at any give time 2). Redirect stdout and stderr to files or /dev/null:

UdmSearch: Server tables

2000-11-10 Thread Briggs, Gary
I'm working a few web pages whereby users can put information into a webpage, and their website is added to my search engine. It's all fine, exacpt for the fact that this is open to some forms of abuse. Is it safe to just add a "added by..." column to the server table? Or does this break

UdmSearch: Yet more questions

2000-11-10 Thread Briggs, Gary
I really hate just asking questions this much, but it's kinda important; I'm wondering if anyone can help me: I want to be able to use the basic_auth abilities of udmsearch. My problem is that unless a user is able to authenticate themselves to the same site as the basic_auth was necessary for,

RE: UdmSearch: Webboard: How many indexer ?

2000-11-10 Thread Briggs, Gary
Empirical testing. It kinda depends on a few things, including the storage method and back end you're using. Just try it; between 4 and 8, probably. Gary (-; -Original Message- From: FL [SMTP:[EMAIL PROTECTED]] Sent: Friday, November 10, 2000 10:27 AM To: [EMAIL PROTECTED]

RE: UdmSearch: Webboard: FTP Search with Passwords

2000-11-08 Thread Briggs, Gary
Just add a line above it in the indexer.conf: AuthBasic username:passwd It takes effect for just one URL below it, eg... ftp://site.com Hope this helps, Gary (-; PS If you're using a database to tell indexer all your URLS, there's an AuthBasic table column... -Original Message-

UdmSearch: Alias Question:

2000-11-06 Thread Briggs, Gary
When I have these in my indexer.conf file, It isn't recognising stuff properly. It's a MASSIVE [8G] collection of PDF files, just in a boring directory structure: AddType application/pdf \.pdf$ Mime application/pdftext/plain "/opt/udmsearch/sbin/pdftotext $1 -" Mime

UdmSearch: Some questions

2000-11-03 Thread Briggs, Gary
I'm not getting much luck, here; I'm hoping if you could answer a couple of questions for me: 1) Security: I'm using the mySQL backend; how can I set up a user called udm_ro [or similar] so that if the password is stolen, they person who stole it can't delete any of the database. It's not

UdmSearch: Strange error:

2000-11-03 Thread Briggs, Gary
I just did a search for "chunky", and this happened: Search Time: 2.56s Search results: looking for: chunky; chunky: 26; Sorry, but search returned no results. Please try a different query. You can try to search this words: Argh! I'm using mySQL, and the PHP front-end Gary (-;

UdmSearch: Reindexing only documents of a certain type?

2000-11-02 Thread Briggs, Gary
I'm running into problems with certain file types not being indexed properly [namely, postscript and pdf] I've been examinging my Mime type from/to/application entries in indexer.conf, and I think I've got the problem solved... unfortunately, I need to reindex all the ps and pdf files... but not

RE: UdmSearch: New message on the WebBoard #1: removing references from MySQL

2000-11-01 Thread Briggs, Gary
indexer -C -uwww.foo.com/bar -Original Message- From: Martin Perst [SMTP:[EMAIL PROTECTED]] Sent: Wednesday, November 01, 2000 3:44 PM To: [EMAIL PROTECTED] Subject: UdmSearch: New message on the WebBoard #1: removing references from MySQL Author: Martin Perst Email:

UdmSearch: MySQL security questions

2000-10-30 Thread Briggs, Gary
Question: how does anyone using mySQL keep their tables safe? I've got two users I'd like mnogo to be using: one, "udm", with a password that no-one but me [and the indexer] knows, that's going to be used to index stuff, including writing it to the database. I want another user, "udm_ro" with a

UdmSearch: an I'm feeling lucky button

2000-10-30 Thread Briggs, Gary
I'm using the php front-end... does anyone know an easy way to put one in? Gary (-; __ If you want to unsubscribe send "unsubscribe udmsearch" to [EMAIL PROTECTED]

UdmSearch: PDF indexing being strange

2000-10-27 Thread Briggs, Gary
Does anyone here index LARGE volumes of PDF files? I'm tring to index roughly 7 or 8G of them, and I've come across a couple of problems: I'm using parse_doc.pl with pdftotext Indexer.conf contains the following: Mime application/msword text/plain "/opt/udmsearch/sbin/catdoc $1"

UdmSearch: Optimal MySQL settings?

2000-10-26 Thread Briggs, Gary
Currently my MySQL config looks something like: --- [client] port= 54000 [mysqld] port= 54000 socket = /tmp/mysql.sock log - Which, I feel, isn't as fast as it could be. I'm using crc-multi to store stuff. The box

RE: UdmSearch: Skinnable interface

2000-10-24 Thread Briggs, Gary
To: Briggs, Gary Cc: '[EMAIL PROTECTED]' Subject: Re: UdmSearch: Skinnable interface Hi! Gary, please add little README then we can put it on Download page in Tools section. "Briggs, Gary" wrote: Well, I have one kinda working. It involves a few files, it wo

RE: UdmSearch: Skinnable interface

2000-10-20 Thread Briggs, Gary
Well, I have one kinda working. It involves a few files, it would be way better, but it's a proof of concept thing... Have a look and tell me what you all think of it... skin.zip As a quick explanation, it contains 5 parts: a template, based on search.htm, but with certain parts turned into

RE: UdmSearch: Question: way to compile for more performance

2000-10-09 Thread Briggs, Gary
I think that "can take two minutes" thing is what caused my server to fall over... Here's the arrangement of whatI'm trying to do: one server, called host20, is trying to index a few other servers, called playpen, test/test, test/TradingServices, and a couple of others on test [names changed

UdmSearch: Continuously indexing

2000-10-05 Thread Briggs, Gary
I'm getting UDM continuously indexing everything; I want it to just index everything once, then stop. I'm using a file system for it to store all it's indexes, etc, which I think MAY be my problem, but I'm not sure... If anyone could tell me if I'm just being incredibly stupid ,that would be