sup3rcewl

Sup3rCeWL

Clone of shellhunter's sup3rcewl improved.

• Crawl websites concurrently and extract words into a wordlist
• Should be faster as the original CeWL, as requests and parsing are performed concurrently.
• static binary available, so no dependencies required
• lower memory fooprint

Installation

  go install github.com/aituglo/sup3rcewl@latest

Or

  git clone https://github.com/Aituglo/sup3rcewl
  cd sup3rcewl
  go build

Usage

Run sup3rcewl --help to display the commandline options.

Examples

Crawl https://en.wikipedia.org with default parameters.

sup3rcewl https://en.wikipedia.org

Crawl https://en.wikipedia.org with depth of 2, 10 threads and write the output to wiki.txt sup3rcewl -d 2 -t 10 -w wiki.txt https://en.wikipedia.org