PenCrawLer: An Advanced Web Crawler and DirBuster
PenCrawLer
An Advanced Web Crawler and DirBuster PeNCrawLer is an advanced webcrawler and dirbuster designed to use in penetration testing based on Windows Os.
Web Crawler Features:
- Follow Redirects
- Rendering Javascript
- Extract links from custom HTML-Elements
- Extract links with Regex-Pattern
- Black-List extensions
- White-List extensions
- Download files from white-list extensions
- Setting-Up limit for crawling similar links
- Searching for a string in:
- Url
- Response
- Automatic Form Submission
- Support Http-Proxy
- Supported Authentication:
- Basic
- Digest
- Throttling mode
DirBuster Features:
- Dictionary attack
- Bruteforce attack
- Custom bruteforce charset
- Custom request method:
- GET ONLY
- Auto-Switch( GET and HEAD )
- Recursive mode
- Bruteforce directories
- Bruteforce files with custom extensions
- Automatic page detection by:
- Failure status-code
- Success status-code
- Regex pattern
- HTML source