maigret v0.4.4 releases: OSINT username checker

Maigret

Purpose of Maigret – collect a dossier on a person by username only, checking for accounts on a huge number of sites.

This is a sherlock fork with cool features under heavy development. Don’t forget to regularly update source code from the repo.

Currently supported more than 2000 sites (full list), by default search is launched against 500 popular sites in descending order of popularity.

Main features

• Profile pages parsing, extracting personal info, links to other profiles, etc.
• Recursive search by new usernames found
• Search by tags (site categories, countries)
• Censorship and captcha detection
• Very few false positives

Changelog v0.4.4

• Fixed some false positives by @soxoj in #433
• Drop Python 3.6 support by @soxoj in #434
• Bump xhtml2pdf from 0.2.5 to 0.2.7 by @dependabot in #409
• Bump reportlab from 3.6.6 to 3.6.9 by @dependabot in #403
• Bump markupsafe from 2.0.1 to 2.1.1 by @dependabot in #389
• Bump pycountry from 22.1.10 to 22.3.5 by @dependabot in #384
• Bump pypdf2 from 1.26.0 to 1.27.4 by @dependabot in #438
• Update GH actions by @soxoj in #439
• Bump tqdm from 4.63.0 to 4.64.0 by @dependabot in #440
• Bump jinja2 from 3.0.3 to 3.1.1 by @dependabot in #441
• Bump soupsieve from 2.3.1 to 2.3.2 by @dependabot in #436
• Bump pypdf2 from 1.26.0 to 1.27.4 by @dependabot in #442
• Bump pyvis from 0.1.9 to 0.2.0 by @dependabot in #443
• Bump pypdf2 from 1.27.4 to 1.27.6 by @dependabot in #448
• Bump typing-extensions from 4.1.1 to 4.2.0 by @dependabot in #447
• Bump soupsieve from 2.3.2 to 2.3.2.post1 by @dependabot in #444
• Bump pypdf2 from 1.27.6 to 1.27.7 by @dependabot in #449
• Bump pypdf2 from 1.27.7 to 1.27.8 by @dependabot in #450
• XMind 8 report warning and some docs update by @soxoj in #452
• False positive fixes 24.04.22 by @soxoj in #455
• Bump pypdf2 from 1.27.8 to 1.27.9 by @dependabot in #456
• Bump pytest from 7.0.1 to 7.1.2 by @dependabot in #457
• Bump jinja2 from 3.1.1 to 3.1.2 by @dependabot in #460
• Ubisoft forums addition by @fen0s in #461
• Add BYOND, Figma, BeatStars by @fen0s in #462
• fix Figma username definition, add a bunch of sites by @fen0s in #464
• Bump pypdf2 from 1.27.9 to 1.27.10 by @dependabot in #465
• Bump pypdf2 from 1.27.10 to 1.27.12 by @dependabot in #466
• Sites fixes 05 05 22 by @soxoj in #469
• Bump pyvis from 0.2.0 to 0.2.1 by @dependabot in #472
• Social analyzer websites, also fixing presense strs by @fen0s in #471
• Updated logic of false positive risk estimating by @soxoj in #475
• Improved usability of external progressbar func by @soxoj in #476
• New sites added, some tags/rank update by @soxoj in #477
• Added new sites by @soxoj in #480
• Added new forums, updated ranks, some utils improvements by @soxoj in #481
• Disabled sites with false positives results by @soxoj in #482
• Bump certifi from 2021.10.8 to 2022.5.18.1 by @dependabot in #488
• Bump psutil from 5.9.0 to 5.9.1 by @dependabot in #490
• Bump pypdf2 from 1.27.12 to 1.28.1 by @dependabot in #491
• Bump pypdf2 from 1.28.1 to 1.28.2 by @dependabot in #493
• added and fixed some websites in data.json by @kustermariocoding in #494
• Bump pypdf2 from 1.28.2 to 2.0.0 by @dependabot in #504
• Bump pefile from 2021.9.3 to 2022.5.30 by @dependabot in #499
• Updated sites list, added disabled Anilist by @soxoj in #502
• Bump lxml from 4.8.0 to 4.9.0 by @dependabot in #503
• Compatibility with Python 10 by @soxoj in #509
• feat: add *.log & *.bak files to gitignore in #511
• fix some sites and delete abandoned by @fen0s in #526
• Fixesjulyfirst by @fen0s in #533
• yazbel, aboutcar, zhihu by @fen0s in #531
• Fixes july third by @fen0s in #535
• Update data.json by @fen0s in #539
• Update data.json by @fen0s in #540
• Bump reportlab from 3.6.9 to 3.6.11 by @dependabot in #543
• Bump requests from 2.27.1 to 2.28.1 by @dependabot in #530
• Bump pypdf2 from 2.0.0 to 2.5.0 by @dependabot in #542
• Bump xhtml2pdf from 0.2.7 to 0.2.8 by @dependabot in #522
• Bump lxml from 4.9.0 to 4.9.1 by @dependabot in #538
• disable yandex music + set utf8 encoding by @fen0s in #562
• fix false positives by @fen0s in #577
• disable Instagram, fix two false positives by @fen0s in #578
• Bump certifi from 2022.5.18.1 to 2022.6.15 by @dependabot in #551
• August15 by @fen0s in #591
• Bump pytest-httpserver from 1.0.4 to 1.0.5 by @dependabot in #583
• Bump typing-extensions from 4.2.0 to 4.3.0 by @dependabot in #549
• Bump colorama from 0.4.4 to 0.4.5 by @dependabot in #548
• Bump chardet from 4.0.0 to 5.0.0 by @dependabot in #550
• Bump cloudscraper from 1.2.60 to 1.2.63 by @dependabot in #600
• Bump flake8 from 4.0.1 to 5.0.4 by @dependabot in #598
• Bump attrs from 21.4.0 to 22.1.0 by @dependabot in #597
• Bump pytest-asyncio from 0.18.2 to 0.19.0 by @dependabot in #601
• Bump pypdf2 from 2.5.0 to 2.10.4 by @dependabot in #606
• Bump pytest from 7.1.2 to 7.1.3 by @dependabot in #613
• Update sites.md -Gitmemory.com suppression by @C3n7ral051nt4g3ncy in #610
• Bump cloudscraper from 1.2.63 to 1.2.64 by @dependabot in #614
• Bump pycountry from 22.1.10 to 22.3.5 by @dependabot in #607
• add ProtonMail, disable 3 broken sites by @fen0s in #619
• Bump tqdm from 4.64.0 to 4.64.1 by @dependabot in #618
• Bump to 0.4.4 by @soxoj in #621

Installation

NOTE: Python 3.6 or higher and pip is required.

Python 3.8 is recommended.

# install from pypi

$ pip3 install maigret

# or clone and install manually

$ git clone https://github.com/soxoj/maigret && cd maigret
$ pip3 install .

Use

Run flags

--tags – Filter sites for searching by tags: sites categories and two-letter country codes. E.g. photo, dating, sport; jp, us, global. Multiple tags can be associated with one site. Warning: tags markup is not stable now.

-n, --max-connections – Allowed number of concurrent connections. 100 by default.

-a, --all-sites – Use all sites for scan. 500 top sites by default are used.

--top-sites – Count of sites for scan ranked by Alexa Top. 500 by default.

--timeout – Time (in seconds) to wait for responses from sites. The default timeout is 10s. A longer timeout will be more likely to get results from slow sites. On the other hand, this may cause a long delay to gather all results. The choice of the right timeout should be carried out taking into account the bandwidth of the Internet connection.

--parse – Parse page by URL and extract username and IDs to use for search.

--print-not-found – Print sites where the username was not found.

--no-recursion – Disable parsing pages for other usernames and recursive search by them.

--print-errors – Print errors messages: connection, captcha, site country ban, etc.

--use-disabled-sites – Use disabled sites to search (may cause many false positives).

Reports

-P, --pdf – Generate a PDF report (general report on all usernames).

-H, --html – Generate an HTML report file (general report on all usernames).

-X, --xmind – Generate an XMind 8 mindmap (one report per username).

-C, --csv – Generate a CSV report (one report per username).

-T, --txt – Generate a TXT report (one report per username).

-fo, --folderoutput – Results will be saved to this folder, results by default. Will be created if doesn’t exist.

Verbose settings

-v, --verbose – Display extra information and metrics. (loglevel=WARNING)

-vv, --info – Display service information. (loglevel=INFO)

-vvv, --debug, -d – Display debugging information and site responses. (loglevel=DEBUG)

Service flags

--version – Display version information and dependencies.

--self-check – Do self-checking for sites and database and disable non-working ones for current search session by default. Useful for testing new internet connection (it depends on provider/hosting on which sites there will be censorship stub or captcha display). After checking Maigret asks if you want to save updates, answering y/Y will rewrite the local database.

-j, --json – Load data from a JSON file or an online, valid, JSON file.

Copyright (c) 2019 Soxoj

Source: https://github.com/soxoj/