sniff-paste: Pastebin OSINT Harvester
Sniff-Paste: OSINT Pastebin Harvester
Multithreaded Pastebin scraper, scrapes to MySQL database, then reads pastes for noteworthy information.
Use sniff-paste.py to go through the entire process of collection, logging, and harvest automatically. The scraper can be set to a paste limit of 0 to scrape indefinitely. If scraped indefinitely, press Ctrl + c to stop scraping, any useful information will be in the database, along with a link back to the original paste it was found in.
Database Structure
- sniff_paste — root db
- pastes — stores paste with full text, date, link, title, and language
- emails — stores emails with extension to paste
- links — stores urls with extension to paste
- ip — stores ip with connectivity and extension to paste
- phones — stores phone numbers with extension to paste
- secrets — stores secret type with extension to paste
Install
sudo apt install libxslt-dev python3-lxml nmap xsltproc fping mysql-server
git clone https://github.com/needmorecowbell/sniff-paste.git
cd sniff-paste
pip install -r requirements.txt
- Create a database named sniff_paste in MySQL server
- Fill in settings.ini
Use
python3 sniff-paste.py
This will scrape Pastebin for the latest number of pastes, then run an analysis for ip addresses, emails, and phone numbers. It filters out duplicates and runs scans on some of the harvested data.
