The release of project Snoop 1.3.3 has been published, developing a forensic OSINT tool that searches for user accounts in publicly available data (open-source intelligence). The program analyzes various websites, forums, and social networks for the presence of the desired username, that is, it allows you to determine on which sites a user with the specified nickname exists. The project is developed based on research materials in the field of scraping public data. Builds are prepared for Linux and Windows.
The code is written in Python and is distributed under a license that restricts its use to personal purposes only. The project is a branch of the Sherlock project codebase, which is provided under the MIT license (the fork was created due to the inability to expand the website database).
Snoop has been included in the Russian Unified Register of Russian Programs for Electronic Computing Machines and Databases with the declared code 26.30.11.16: "Software that ensures the execution of established actions during operational search activities:: No7012 order 07.10.2020 No515". Currently, Snoop tracks the presence of users on 2,279 internet resources in the full version and on the most popular resources in the Demo version.
Key Changes:
- Video hints for quickly launching Snoop for novice users who have not worked with CLI have been added to the archive.
- A text report has been added: the file ‘bad_nicknames.txt’ in which missed data/nickname(s) (invalid names/phones/some_special_characters) are recorded, updating the file (append mode) during the search, for example, with the ‘-u’ option.
- A proper shutdown mode with resource release for different versions/platforms of the Snoop Project (ctrl+c) has been added.
- A new option ‘—headers’ ‘-H’: manually set a custom user-agent. By default, a random but real user agent is created for each site or selected/overridden from the Snoop database with an extended header to bypass some ‘CF’ protections.
- A Snoop splash screen and some emoji have been added when the nickname(s) for search are not specified or conflicting parameters are chosen in the CLI arguments (exception: Snoop for Windows OS — old CLI OS Windows 7).
- Various information panels have been added: in the display of the database list-all; in verbose mode; a new block ‘snoop-info’ with the ‘-V’ option; with the -u option, segmentation into groups of nickname(s): valid/invalid/duplicates; in CLI Yandex_parser-a (full version).
- The search mode with the ‘—userlist’ ‘-u’ option has been updated, and the algorithm for detecting nickname(s)/email has been expanded (just try using it again).
- The database output in CLI has been accelerated significantly for the 'list-all' option methods.
- For Snoop for Termux (Android), auto-opening of search results in an external browser has been added, without obscuring the results in CLI (users can choose to ignore opening results in an external web browser).
- The appearance of the output results in CLI when searching for nickname(s) has been updated. The license output has been styled like Windows XP. The progress output has been revised (previously it updated as data came in, making it seem like it was hanging in full versions); now progress updates multiple times per second or with incoming data in the verbosity mode option ‘-v’.
- A new 'Doc' button has been added to the HTML reports, linking to the 'Snoop Project General Guide.pdf'/online documentation.
- The ‘session’ parameter has been added to txt reports, just like in html/csv reports.
- All Snoop Project options have been updated to be closer to POSIX recommendations (see snoop —help). The old method of using arguments in CLI with confirmation [y] is backward compatible.
- Yandex_parser has been updated to version 0.5: Я.коллекции (resource inactive) has been removed. Я.аватар: logina/email has been added. Multi-user mode in txt; cli; html has added/updated metrics: 'valid logins/unregistered_users/unprocessed data/duplicates', login labels.
- Subdirectories of saved reports/results are grouped: plugin(s) in one directory, nickname(s) in another.
- A proper exit from the software has been established when attempting to test the network with the ‘-v’ option in the absence/failure of the network.
- Fixed in CLI: individual session/traffic/time when searching for multiple names in a single session or with the ‘-u’ option or with the ‘-v’ option.
- Fixed in csv reports: website response time is divided by 'correct decimal separator': point or comma according to the user's locale (i.e., the number in the table is always a digit regardless of the decimal separator, which directly impacts the sorting of results by parameter. Data under 1 Kb is rounded more precisely, above 1 Kb no fractional part. Total time (previously in ms., now in s./hundreds). When saving reports with the ‘-S’ option or in regular mode for sites using a specific nickname detection method: (username.salt), the size of session data is now also counted.
- Migration of Snoop Project build versions from Python 3.7 to Python 3.8 has been completed (except for EN versions).
Source: opennet.ru
