Picking out a Web Spider

Web Spiders are an important tool for a Directory builder like myself.

There are several uses for Web Spiders:

  1. Data mining
    • Discovery
    • Validating, real?
    • ?Describing
    • Email extraction
  2. Reciprocal link checking.
  3. Dead Link checking (see Validating)

Features include:

  1. Extracts URL
  2. Extracts Title
  3. Extracts Description
  4. Extracts email

Programs: