
To configure the Jumping Spider, simply edit the Macros in the Makefile.
You will need to have the libwww package from CPAN (and that needs the
MIME64 package) but otherwise, everything should work correctly right
out of the box.

Currently the spider is set up to just search one URL. 

To run the spider (after editing the Makefile macros) do the following.

     make runRobot

This runs the Robot on the indicated URL.  It will tell you which links
it is testing as it runs (it will report links in restricted areas, but
will not follow those links).

     make newIndex

This will create the index from the result of the robot run.  Whenever
you want to recreate the index, just do a 'make newIndex'.  There is
also a 'make addIndex' which will add to the index rather than recreating
it from scratch.

     make query1

Will do a canned query.
