PenCrawLer: An Advanced Web Crawler and DirBuster
![PenCrawLer](https://cdn-0.securityonline.info/wp-content/uploads/2018/06/Crawler-1320x500.jpg)
PenCrawLer
An Advanced Web Crawler and DirBuster PeNCrawLer is an advanced webcrawler and dirbuster designed to use in penetration testing based on Windows Os.
Web Crawler Features:
- Follow Redirects
- Rendering Javascript
- Extract links from custom HTML-Elements
- Extract links with Regex-Pattern
- Black-List extensions
- White-List extensions
- Download files from white-list extensions
- Setting-Up limit for crawling similar links
- Searching for a string in:
- Url
- Response
- Automatic Form Submission
- Support Http-Proxy
- Supported Authentication:
- Basic
- Digest
- Throttling mode
DirBuster Features:
- Dictionary attack
- Bruteforce attack
- Custom bruteforce charset
- Custom request method:
- GET ONLY
- Auto-Switch( GET and HEAD )
- Recursive mode
- Bruteforce directories
- Bruteforce files with custom extensions
- Automatic page detection by:
- Failure status-code
- Success status-code
- Regex pattern
- HTML source