Thanks Michael for your quick response. Of course, I did delete as you
instructed, but to no avail. I do have a home file
(/home/matt/.plucker/home.html):
------------------------------
<HTML>
<HEAD>
<TITLE>Targeted Stuff</TITLE>
</HEAD>
<BODY>
<H1>Target</H1>
<A HREF="http://www.fbi.gov/mostwant/terrorists/fugitives.htm"; MAXDEPTH=2
STAYONHOST>Target</A><P>
</BODY>
</HTML>
-------------------------------
The script looks like this:
#!/bin/bash
#this is script for using spider to grab web and place in target.pdb in .plucker
file
cd /home/matt/.plucker
cp /home/matt/.plucker/target.html /home/matt/.plucker/home.html
python /usr/local/PyPlucker/Spider.py -f /home/matt/.plucker/target
-------------------------------
The output is this:
matt@vaio:~/plucker-1.1.12 > target
Working for pluckerdir /home/matt/.plucker
ZLib compression turned on
Using exclusion list /home/matt/.plucker/exclusionlist.txt
Using exclusion list /home/matt/.plucker/exclusionlist.txt
Processing plucker:/home/matt/.plucker/home.html.
0 collected, 0 still to do
Retrieved failed: 404 -- File not found
Fetching the home document failed. Aborting all!
Fatal error while processing. Nothing written.
-----------------------------
My environment looks like this:
PWD=/home/matt/plucker-1.1.12
LTDL_LIBRARY_PATH=/home/matt/.kde2/lib:/opt/kde2/lib
konq_sm_file=/opt/kde2/share/config/SuSE/config/konqueror:1054d0ebe2000097566852400000014220002
PAGER=less
HOSTNAME=vaio
LD_LIBRARY_PATH=/home/matt/.kde2/lib:/opt/kde2/lib
LS_OPTIONS=-N --color=tty -T 0
ignoreeof=0
ECIINI=/usr/lib/ViaVoiceTTS/eci.ini
KDEDIRS=/etc/opt/kde2:/opt/kde2
KDEHOME=/home/matt/.kde2
POVRAYOPT=-l/usr/lib/povray/include
SUSE_DOC_HOST=localhost
QTDIR=/usr/lib/qt2/
OPENWINHOME=/usr/openwin
D=16
LESSKEY=/etc/lesskey.bin
LESSOPEN=|lesspipe.sh %s
MANPATH=/usr/local/man:/usr/share/man:/usr/man:/usr/X11R6/man:/usr/openwin/man
LANGUAGE=english
PS1=\u@\h:\w >
PS2=>
NNTPSERVER=news
LESS=-M -S -I
USER=matt
LS_COLORS=
HISTCONTROL=ignoredups
XSESSION_IS_UP=yes
MACHTYPE=i386-suse-linux
XKEYSYMDB=/usr/X11R6/lib/X11/XKeysymDB
OLDPWD=/usr/local/PyPlucker
LANG=en_US
GNOMEDIR=/opt/gnome
COLORTERM=1
X=1024
INFOPATH=/usr/local/info:/usr/share/info:/usr/info
Y=768
DISPLAY=:0
LOGNAME=matt
SHLVL=2
TEXINPUTS=::::~/.TeX:/usr/share/doc/.TeX:/usr/doc/.TeX:~/.TeX:/usr/share/doc/.TeX:/usr/doc/.TeX:~/.TeX:/usr/share/doc/.TeX:/usr/doc/.TeX:~/.TeX:/usr/share/doc/.TeX:/usr/doc/.TeX
MINICOM=-c on
INFODIR=/usr/local/info:/usr/share/info:/usr/info
SESSION_MANAGER=local/vaio:/tmp/.ICE-unix/683
KDE_INITIAL_DESKTOP=1
SHELL=/bin/bash
PRINTER=lp
HOSTTYPE=i386
QT_XFT=Y
OSTYPE=linux
WINDOWMANAGER=/usr/X11R6/bin/kde
HOME=/home/matt
TERM=kvt
XNLSPATH=/usr/X11R6/lib/X11/nls
no_proxy=localhost
PATH=/home/matt/bin:/usr/local/bin:/usr/bin:/usr/X11R6/bin:/bin:/usr/lib/java/bin:/usr/games/bin:/usr/games:/opt/gnome/bin:/opt/kde2/bin:.:/opt/pilotsdk/bin
LESSCHARSET=latin1
FROM_HEADER=vaio.va.net
LC_COLLATE=POSIX
_=/usr/bin/env
----------------------------
My .pluckerrc file is like this:
;;
;; This is a sample config file.
;;
;; Under OS/2 and Windows this should be called 'plucker.ini'.
;; For Windows, put this in the pluckerhome directory or in the
;; pluckerdir directory.
;;
;; Under unix, this should be called 'pluckerrc' if it is the system
;; wide config file and '.pluckerrc' if it is a user config file.
;; This should have been installed in the correct place.
;;
;;
;; Entries are key = value pairs ordered into section. A section is
;; named and begins with a line in square bracket, where the brackets
;; contain the section name.
;;
;; General entries can go into the [DEFAULT] section.
;;
;; Under Windows, the [WINDOWS] section is also searched.
;; Under OS/2 the [OS2] and [POSIX] sections are searched
;; Everywhere else [POSIX] is searched.
;;
;; --------------------------------------------------------------------
[DEFAULT]
;;
;; In the general section you can set the following items:
;;
;;
;; Verbosity level:
;;
;; 0 - silent except for errors
;; 1 - progress status
;; 2 - debugging
;;
;;verbosity = 1
;;
;; Path to the plucker dir.
;;
pluckerdir = /home/matt/.plucker
;;
;; Name of the directory where cache files will be stored
;; (relative to pluckerdir)
;;
;;cache_dir_name = cache
;;
;; Document name
;;
;;doc_name =
;;
;; Filename for the document
;;
;;doc_file =
;;
;; Compression type
;;
;; doc - use the DOC compression (works on all supported versions)
;; zlib - use ZLib compression (doesn't work on 2.x devices)
;;
;; Zlib compression is typically much better than DOC compression.
compression = zlib
;;
;; Default category for the created document (you can assign several
;; categories separated by ';')
;;
;;category = Unfiled
;;
;; Document attributes
;;
;; If the copy prevention attribute is set it will not be
;; possible to beam a copy of the document to another device.
;; The backup attribute will indicate that the document should
;; be backed up (requires a desktop tool that checks this
;; attribute) and the launchable attribute will make the
;; document visible so that the user can tap on it to launch
;; the viewer with the selected document.
;;
;;copyprevention_bit = false
;;backup_bit = false
;;launchable_bit = false
;;
;; The URL to the document and the max depth to
;; spider this document. It is also possible to specify
;; that the spider should only follow links on the same
;; host (site) and/or fetch pages below the home URL
;; whose URLs starts with the given STAYBELOW value.
;;
home_url = plucker:/home/matt/.plucker/home.html
;;home_maxdepth = 2
;;home_stayonhost = false
;;home_staybelow =
;;
;; Bits per pixel for images (0 to means 'no images')
;;
bpp = 16
;;
;; Max width and height for the images. Alternative maximum width
;; and height can also be specified. These values are used for 'big'
;; versions of inlined images that had to be scaled down in size to
;; obey the maxwidth and maxheight parameters.
;;
;;maxwidth = 150
;;maxheight = 250
;;alt_maxwidth =
;;alt_maxheight =
maxwidth = 150
maxheight = 200
alt_maxwidth = 150
alt_maxheight = 200
;;
;; If an image is smaller or equal to the given limit (in bytes)
;; the image will not be compressed.
;;
;;image_compression_limit = 0
;; Specify which parser to use to convert images. Defaults to
;; whatever the system determines to be the default parser.
;;
;; imagemagick - ImageMagick image parser
;; netpbm - NetPbm image parser
;; pil - PIL image parser
;; windows - Windows image parser
;;
;;image_parser = netpbm
;; A string specifying a command to be executed before spidering.
;;
;;before_command =
;;before_command1 =
;; :
;;before_command9 =
;;
;; A string specifying a command to be executed after spidering.
;;
;;after_command =
;;after_command1 =
;; :
;;after_command9 =
;;
;; Store an icon in AppInfo block. If no big or small icons
;; are specified default icons will be used.
;;
;;icon = false
;;big_icon =
;;small_icon =
;;
;; Specify proxy (http://proxy:port) and username and password for
;; basic proxy authentication if that is used. The environment variables
;; HTTP_PROXY, HTTP_PROXY_USER and HTTP_PROXY_PASS will be used as
;; default values.
;;
;;http_proxy =
;;http_proxy_user =
;;http_proxy_pass =
;; -----------------------------------------------------------------
[POSIX]
;; In the POSIX section you can set the following items:
;;
;; Name (and maybe path) for the image tools:
;;
;;ppmquant_program = ppmquant
;;ppmtoTbmp_program = ppmtoTbmp
;;pnmscale_program = pnmscale
;;pnmfile_program = pnmfile
;;giftopnm_program = giftopnm
;;djpeg_program = djpeg
;;pngtopnm_program = pngtopnm
;;convert_program = convert
;;
;; Name (and maybe path) for the color maps used by
;; ppmquant:
;;
;;palm1bit_graymap_file = palmgray1.map
;;palm2bit_graymap_file = palmgray2.map
;;palm4bit_graymap_file = palmgray4.map
;;palm8bit_stdcolormap_file = palmcolor8.map
palm1bit_graymap_file = /usr/local/netpbm/lib/palmgray1.map
palm2bit_graymap_file = /usr/local/netpbm/lib/palmgray2.map
palm4bit_graymap_file = /usr/local/netpbm/lib/palmgray4.map
palm8bit_stdcolormap_file = /usr/local/netpbm/lib/palmcolor8.map
;;
;; List of filename specifying exclusion lists to be
;; inspected. Names are separated by colons.
;;
;;exclusion_lists =
;; -------------------------------------------------------------------
[OS2]
;; For OS/2, you can also set the following items:
;;
;; List of filename specifying exclusion lists to be
;; inspected. Names are separated by semicolons.
;;
;;exclusion_lists =
;; --------------------------------------------------------------------
[WINDOWS]
;; For Windows, you can also set the following items:
;;
;; List of filename specifying exclusion lists to be
;; inspected. Names are separated by semicolons.
;;
;;exclusion_lists =
;;
;; Name (and maybe path) for the ImageMagick convert tool
;; and the command line parameters.
;;
;;convert_program = convert.exe
;;convert_program_parameter = "%input% bmp:%output%"
;;
;; Name (and maybe path) for the Bmp2Tbmp tool and the
;; command line parameters.
;;
;;bmp_to_tbmp = Bmp2Tbmp.exe
;;bmp_to_tbmp_parameter = "-i=%input% -o=%output% -maxwidth=%maxwidth%
-maxheight=%maxheight% -compress=%compress% -bpp=%colors%"
;;
;; Specify the value for the %compress% parameter.
;;
;;tbmp_compression_type = yes
;;
;; The following parameters can be specified for 'convert_program' and
;; 'bmp_to_tbmp':
;;
;; %compress% = will be equal to the 'tbmp_compression_type' key if
;; compression is used, otherwise 'no'
;; %colors% = '1', '2', '4' or '8'
;; %maxwidth% = maxwidth value
;; %maxheight% = maxheight value
;; %input% = the input filename
;; %output% = the output filename
;;
;; These keys control the way that the images are converted to the Palm Tbmp
;; format.
;;
;; The maximum size of an Tbmp bitmap is 60,000 bytes (before Plucker's
;; document compression); you can set the max_tbmp_size key to an lower
;; value to save memory on your device.
;;
;; The tbmp_compression key controls the internal Tbmp compression (not
;; related to Plucker's document compression); if set to true, the Tbmp's
;; are smaller, and you can use pictures that normally exceed the maximum
;; size (as set by max_tbmp_size). However, this will not work on all OS
;; versions; if your OS does not support this, the viewer will display a
;; warning message and not show the pictures.
;;
;; If a bitmap exceeds the maximum size, and try_reduce_bpp is set to
;; true, the parser will try to reduce the BPP (bits/pixel) until the
;; size is OK; if it's still too big with bpp=1, the dimension of the
;; bitmap will be reduced in 10% steps if the try_reduce_dimension key
;; is set.
;;
;; How big a Tbmp will be after a bpp or dimensions reduce are calculated,
;; but this won't work if you use tbmp compression. To still get the
;; maximum quality (highest possible bpp and size), set the guess_tbmp_size
;; to false. In this case the bitmap will be converted in every step
;; to get the resulting size. This could need some more time.
;;
;;max_tbmp_size = 60000
;;tbmp_compression = no
;;try_reduce_bpp = true
;;try_reduce_dimension = true
;;guess_tbmp_size = true
;;
;; The following items are currently only used if the Installer is
;; used to setup the desktop tools:
;;
;; HotSync user name:
;;
;;user =
;;
;; Name (and maybe path) for the Python executable.
;;
;;python_program =
;;
;; Set close_on_exit to true to close the terminal window when PyPlucker
;; is finished. Set close_on_error to true to close the terminal windows
;; if the parser exit with an error.
;;
;;close_on_exit = false
;;close_on_error = false
;;
;; Specify if the conduit.exe should be use to build the PDB or
;; if PyPlucker should be used instead (only for debugging)
;;
;;use_conduit = true
;;
;; Play a sound when the spider finish building the document.
;;
;; Valid parameters:
;;
;; - Drive:\Path\Filename.wav : A filename (with full path) for a
;; WAV file.
;;
;; - *MELODY:<notes to play> : Playing a list of notes using the
;; computer speaker
;;
;; Format of <notes to play>:
;;
;; <note><octave><space><duration>|<note><octave><space><duration>|...
;;
;; <note> : One of [C;C#;D;D#;E;F;F#;G;G#;A;A#;H] or 'P' for Pause
;; <octave> : 2, 3, 4 or 5
;; <space> : A space char (' ')
;; <duration> : The duration in 1/100 seconds
;;
;; - *BEEP : Standard beep using the computer speaker
;;
;; - *ICONASTERISK : System sound "SystemAsterisk"
;;
;; - *ICONEXCLAMATION : System sound "SystemExclamation"
;;
;; - *ICONHAND : System sound "SystemHand"
;;
;; - *ICONQUESTION : System sound "SystemQuestion"
;;
;; - *OK : System sound "SystemDefault"
;;
;; Example: ready_sound = "*MELODY:C5 18|A4 18|P 37|C5 18|A5 18|P 37|C5 18"
;;
;;ready_sound =
;;
;; Editor to use for HTML files.
;;
;;html_editor = "Notepad.exe %s"
;;
;; Editor to use for INI files.
;;
;;ini_editor = "Notepad.exe %s"
;;
;; Editor to use for text files.
;;
;;text_editor = "Notepad.exe %s"
;;
;; Program to use for HTML files stored on the web. (%s is
;; the placeholder for the path and filename for the file)
;;
;;url_editor = "%s"
;;
;; Program used to view HTML files (local and web). (%s is
;; the placeholder for the path and filename for the file)
;;
;;html_viewer = "%s"
;;
;; These items are only available in the 'MAIN' config file:
;;
;; Path to the Plucker Program Group.
;;
;;group_path =
------------------------------
Ideas?? I was playing with php. May I have changed some internal variables??
Matt
-----------------------------
Michael Nordstr�m wrote:
>
> On Sun, Oct 14, 2001, matt neibaur wrote:
>
> > How do I uninstall plucker?
>
> Depends on how you installed it. If you used the rpm package then
> it is just a matter of running "rpm -e plucker". However, the
> "/usr/local/PyPlucker" in the output you included seems to indicate
> that you used the tar package.
>
> Assuming that you used the default locations you should remove the
> symlinks for plucker-build et.al. in /usr/local/bin, the whole
> /usr/local/share/plucker directory (will remove the documentation
> and some shared data) and the /usr/local/PyPlucker directory (removes
> the parser files).
>
> > Can I just do that and reinstall it?
>
> Sure, but before you do that maybe you should make sure that it really
> is a problem with the parser installation.
>
> The errors seems to indicate that the home.html file is missing. That
> file is not required, but if it isn't available then you must enter
> a different home url either on the command line with -H or in your
> ~/.pluckerrc file using the home_url entry.
>
> /Mike
