Hey Habr! Probably, each of us has such a file where we hide something useful and interesting for ourselves. Some links to articles, books, repositories, manuals. It can be bookmarks in the browser or even just open tabs left for later. Over time, all this swells, links stop opening, and most of the material simply becomes outdated.
But what if you share this goodness with the community and put this file on github? Then your work can be useful to someone else, and you can keep up to date together, accepting updates from those who wish through the good old PR's. That's what the project is for. . It is in the TOP-10 github repositories, has 138K stars, and a link to your work can be right in its root README, which will attract a huge audience to your work. True, this will take a little effort. I want to share my experience of such efforts with you.
My name is Maxim Gramin. At CROC, I am engaged in Java development and database research. In this post, I will explain what Awesome Lists are and how to make your own official awesome repo.
What are Awesome Lists
When I have to deal with some new technology or programming language, the first thing I do is go here - I find the right section, and there are suitable sheets in it. And judging by the number of stars and their constant growth, I'm not the only one doing this.
In fact, this is an ordinary flat readme.md that lives in a separate , ranks 8th among all GitHub repositories and includes links to other sheets devoted to any subject. For example, in the Programming Languages section, you can find Awesome Python and Awesome Go sheets, and Front-End Development has a huge amount of resources on WEB development. And, of course, the section (we will return to it a little later). And yes, it's not just limited to technical topics. For example, in the Entertainment and Gaming sections, you can also find a lot of interesting things (I was personally pleased ).
The main feature is that all these lists are maintained not personally by the author, but by the community and are compiled in accordance with a special and very strict . Each such sheet is an independent community of specialists, lives its own life and is open to your pull requests, which will make it even better. And also anyone can make their own sheet, if some topic has not yet been covered.
The author of the idea and coordinator of this entire economy is the legendary Sindre Sorhus, , author of more , and it is he who will receive your PRs.
How to get on the awesome-list
If suddenly you did not find a suitable sheet on the topic that interests you, then this is the first sign that you need to do it yourself!
Let me tell you about my child - From project to project, I have to work with a variety of databases, and therefore I got such a file in which I collected useful tools for working with them, all sorts of database migrators, IDEs, admin panels, monitoring tools and everything miscellaneous. Tools that I have already used, or just planned to start using. I shared this file with colleagues at CROC and beyond. It helped a lot and was interesting. In the end, I wanted more glory when I noticed one day that the Databases section did not have a sheet on this topic. And I decided to add mine there.
What do you need?
- We register a regular GitHub repo with a name like awesome-something-there. In my case it was awesome-database-tools
- We bring our sheet to the awesome format, this will help us , which will generate all the desired files in the desired format
- Setting up the real CI. and travis ci help us control our sheet
- Waiting 30 days
- We review at least 2 other people's PRs
- And finally, we make a PR to the main repo, where we add a link to our repo. Here you need to carefully read everything and carefully fulfill all the numerous requirements for a new sheet and the PR itself.
My first pancake
But a little time passed, I collected even more material, worked on the mistakes and ventured into .
But I forgot about a very important thing, which was gently hinted to me:
I was not very careful and did not add a unicorn as a sign of confirmation that all conditions were met
Then a little more time passed, a few more edits on the comments, and the long-awaited that my PR was accepted.
So I became the author of my first sheet, and I began to receive from the community to add new tools. And many of them are already included in . If you're too lazy to follow the link,
Here is the current selection at the time of posting.
Awesome Database Tools
Community driven list of database tools
Here we will collect information about awesome useful and awesome experimental tools that simplify with databases for DBA, DevOps, Developers and mere mortals.
Feel free to add information about your own db-tools or your favorite third-party db-tools.
Contents
IDE
- - Premier multi-purpose admin tool for database management, control and development.
- — Aqua Data Studio is productivity software for Database Developers, DBAs, and Analysts.
- - Multiple database management tool with support for 20+ databases.
- - Cross-Platform IDE for Databases & SQL by JetBrains.
- - Free universal database manager and SQL client.
- - Universal IDE for MySQL and MariaDB database development, management, and administration.
- - Powerful IDE for Oracle management, administration, and development.
- — GUI tool for managing and developing databases and objects.
- - Powerful integrated development environment for SQL Server development, management, administration, data analysis, and reporting.
- - Modern (JavaScript/Electron framework), open source IDE for MongoDB. It has features to support development, administration and performance tuning on MongoDB databases.
- — Comprehensive GUI tool for Firebird and InterBase.
- — A lightweight client for managing MySQL, MSSQL and PostgreSQL, written in Delphi.
- — MySQL Workbench is a unified visual tool for database architects, developers, and DBAs.
- - A database development tool that allows you to simultaneously connect to MySQL, MariaDB, SQL Server, Oracle, PostgreSQL, and SQLite databases from a single application.
- - Oracle SQL Developer is a free, integrated development environment that simplifies the development and management of Oracle Database in both traditional and Cloud deployments.
- — The most popular and feature rich Open Source administration and development platform for PostgreSQL, the most advanced Open Source database in the world.
- - Long Term Support for pgAdmin3.
- - IDE that is specifically targeted at the development of stored program units for Oracle Databases.
- - Complete and powerful database management, admin and development tool for PostgreSQL.
- — Toad is the premier database solution for developers, admins and data analysts. Manage complex database changes with a single database management tool.
- - Simplified database development tool for MySQL and Postgres.
- — TOra is an open source SQL IDE for Oracle, MySQL and PostgreSQL dbs.
- — Create, administer, query and explore Valentina DB, MySQL, MariaDB, PostgreSQL and SQLite databases for FREE.
GUI Managers/Clients
- - Database management in a single PHP file.
- — Universal database tool for developers, DBAs and analysts.
- - Enterprise ClickHouse Ops UI for you run queries, monitoring ClickHouse health and make a lot of others thinks.
- - Direct SQL access to all your data, no matter where it lives.
- — Web tool for database management.
- — Web-based database browser for PostgreSQL, written in Go and works on macOS, Linux and Windows machines.
- - Web-based SQLite database admin tool written in PHP with support for SQLite3 and SQLite2.
- — A web interface for MySQL and MariaDB.
- — PSequel provides a clean and simple interface for you to perform common PostgreSQL tasks quickly.
- — Modern, collaborative SQL editor for your team.
- - A Modern PostgreSQL Client for the Mac.
- - Robo 3T (formerly Robomongo) is a shell-centric cross-platform MongoDB management tool.
- — Sequel Pro is a fast, easy-to-use Mac database management application for working with MySQL & MariaDB databases.
- - A data management tool that enables working with SQL Server, Azure SQL DB and SQL DW from Windows, macOS and Linux.
- - Graphical interface supports all SQLite features.
- - Web-based SQL editor run in your own private cloud.
- — A simple, powerful Postgres manager for macOS.
- — Graphical SQL client written in Java that will allow you to view the structure of a JDBC compliant database, browse the data in tables, issue SQL commands etc.
- - Database management for VSCode.
- - The most complete and easy to use MySQL GUI.
- — SQL Editor & Open source simple business intelligence for Clickhouse.
- - Modern, native, and friendly GUI tool for relational databases: MySQL, PostgreSQL, SQLite & more.
- - PostgreSQL Web Administration GUI - use your PostgreSQL databases from anywhere, with rich, lightning-fast AJAX web interface.
CLI tools
- — Connect to a database for issue SQL commands within IPython or IPython Notebook.
- - A Cli for Redis with AutoCompletion and Syntax Highlighting.
- - Top-like admin tool for PostgreSQL.
- - Top like application for PostgreSQL server activity monitoring.
- — 'top' for PostgreSQL.
- — PostgreSQL Pager.
- - Oracle SQL Developer Command Line (SQLcl) is a free command line interface for Oracle Database.
- - A universal command-line interface for PostgreSQL, MySQL, Oracle Database, SQLite3, Microsoft SQL Server, including NoSQL and non-relational databases!
dbcli
- - AthenaCLI is a CLI tool for AWS Athena service that can do auto-completion and syntax highlighting.
- - CLI for SQLite Databases with auto-completion and syntax highlighting.
- - A command-line client for SQL Server with auto-completion and syntax highlighting.
- - A Terminal Client for MySQL with AutoCompletion and Syntax Highlighting.
- - Postgres CLI with autocompletion and syntax highlighting.
- - Vertica CLI with auto-completion and syntax highlighting.
DB schema navigation and visualization
- — Quick and simple tool to help you draw your database relationship diagrams and flow quickly using simple DSL language.
- - Entity Relation Diagrams generation tool.
- — A free database schema discovery and comprehension tool.
- - Generating your database to HTML documentation, including Entity Relationship diagrams.
- - CI-Friendly tool for document a database, written in Go.
Modelers
- - A powerful and cost-effective database design tool which helps you build high-quality conceptual, logical and physical data models.
- - Oracle SQL Developer Data Modeler is a free graphical tool that enhances productivity and simplifies data modeling tasks.
- — Data modeling tool designed for PostgreSQL.
Migration tools
- - Database configuration-as-code tool that utilizes the concept of idempotent DDL scripts.
- - Database migration tool.
- - Online schema migration for MySQL.
- - Database-independent library for tracking, managing and applying database schema changes.
- — Like diff but for PostgreSQL schemas.
- - Node.js database migration management built exclusively for postgres. (But can also be used for other DBs conforming to SQL standard—eg CockroachDB.)
- - Provides utilities to describe a PostgreSQL database schema as YAML.
- - A Kubernetes operator for declarative database schema management (gitops for database schemas).
- - Sensible database-native change management for framework-free development and dependable deployment.
- - Yet another schema versioning and migration tool just made with native .NET Core 3.0+ and hopefully better.
Code generation tools
- — Infers SQL DDL (Data Definition Language) from table data.
- - Command line util for export Oracle schema to set of ddl init scripts with ability to filter undesirable information, separate DDL in different files, pretty format output.
Wrappers
- — A open source REST API backend for mobile, web, and IoT applications.
- - Blazing fast, instant realtime GraphQL APIs on Postgres with fine grained access control, also trigger webhooks on database events.
- - SQL for JSON and CSV streams.
- PostgreSQL foreign data wrapper for MySQL.
- — A mid-tier Java application, ORDS maps HTTP(S) verbs (GET, POST, PUT, DELETE, etc.) to database transactions and returns any results formatted using JSON.
- - Prisma turns your database into a realtime GraphQL API.
- - REST API for any Postgres database.
- - Is a way to serve a RESTful API from any databases written in Go.
- - SQL generator with Java and HTTP APIs, uses a simple RESTful HTTP API with XML or JSON serialization.
- - Easily convert your SQL database into a REST API.
- - Automatically generate a RESTful API service for your legacy database.
- - Advanced REST and UI wrapper for your SQL queries.
backup tools
- - Reliable PostgreSQL Backup & Restore.
- — Backup and Recovery Manager for PostgreSQL.
Replication/Data operation
- — A tool for exploring and publishing data.
- - Distributed Data Transfer Service for MySQL.
- - Sync Postgres data between databases.
- - MySQL to PostgreSQL replica system written in Python 3. The system use the library mysql-replication to pull the row images from MySQL which are stored into PostgreSQL as JSONB.
- - A Golang webserver to stream Postgres changes atleast-once over websockets, using Postgres logical decoding feature.
- — The Most Popular Replication Manager for PostgreSQL.
Scripts
- — A collection of useful little scripts for database analysis and administration, created by our team at PostgreSQL Experts.
- — Queries to measure statistical bloat in indexes and tables for PostgreSQL.
- - SQL test that checks if your database follows rules from .
- - Useful PostgreSQL utilities.
- — Useful SQL-scripts and commands by .
- — The missing set of useful tools for Postgres DBAs and all engineers.
- - Useful PostgreSQL Queries and Commands.
- - These sqlplus scripts are for Oracle Database performance optimization & troubleshooting.
Monitoring/Statistics/Performance
- - Provides a graphical view of active session history data within the Oracle and PostgreSQL DB.
- - Agentless & Cost-effective MySQL Monitoring Tool.
- - Monitor your SQL Server on Linux performance using collectd, InfluxDB and Grafana.
- — A safe, simple and agentless remote server monitoring tool that is packed with powerful features to make your monitoring effective as possible.
- - Open source platform for managing and monitoring MySQL and MongoDB performance.
- - Pganalyze statistics collector for gathering PostgreSQL metrics and log data.
- - New-generation diagnostics tool that allows users to do a deep analysis of the health of Postgres databases.
- - Prometheus exporter for PostgreSQL server metrics.
- - Measure and track every aspect of your PostgreSQL databases.
- - A performance dashboard for Postgres - health checks, suggested indexes, and more.
- - Collect and display information and stats from a running PostgreSQL server.
- - A user interface for Postgres explain plans, plus tips to improve performance.
- - Collects PostgreSQL statistics, and either saves them in CSV files or print them on the stdout.
- - Flexible self-contained PostgreSQL metrics monitoring/dashboarding solution.
- - Provides metrics for your postgres database.
Zabbix
- —Monitoring agent for PostgreSQL.
- — Orabbix is a plugin designed to work with Zabbix Enterprise Monitor to provide multi-tiered monitoring, performance and availability reporting and measurement for Oracle Databases, along with server performance metrics.
- - This is the Zabbix monitoring template for PostgreSQL Database.
- - Python script to monitor Oracle Databases.
- - ZabbixDBA is fast, flexible, and continuously developing plugin to monitor your RDBMS.
Testing
- — A database testing framework that supports easy test-driven development of your database code.
- - Regression Testing your SQL queries.
data generator
- — It is a framework for generating realistic and valid high-volume test data for your system under test (avoiding the Datalite anti-pattern).
- — Powerful GUI tool for creating massive volumes of realistic test data.
- — Small but mighty GUI tool for populating Oracle schemas with tons of realistic test data.
- — Powerful GUI tool for a fast generation of meaningful test data for databases.
Administration
- - A fast PostgreSQL Log Analyzer.
- - Manage a Postgres cluster's roles, role memberships, schema ownership, and privileges.
- Postgres partitioning as easy as pie.
HA/Failover/Sharding
- - Postgres extension that distributes your data and your queries across multiple nodes.
- - A template for PostgreSQL High Availability with ZooKeeper, etcd, or Consul.
- - A High Scalability Solution for MySQL Clustering and High Availability.
- - Cloud native PostgreSQL manager for PostgreSQL high availability.
- - Postgres extension and service for automated failover and high-availability.
- - PostgreSQL replication monitoring and failover daemon.
- - High-Availability for Postgres, based on industry references Pacemaker and Corosync.
- - PostgreSQL High-Availability Cluster (based on "Patroni" and "DCS(etcd)"). Automating deployment with Ansible.
- - Database clustering system for horizontal scaling of MySQL through generalized sharding.
Kubernetes
- — Making running production-grade databases easy on Kubernetes.
- — The Postgres Operator enables highly-available PostgreSQL clusters on Kubernetes (K8s) powered by Patroni.
- - HA PostgreSQL Clusters with Docker.
- - Enterprise-grade, Full Stack PostgreSQL on Kubernetes.
Configuration Tuning
- — Script written in Perl that allows you to review a MySQL installation quickly and make adjustments to increase performance and stability.
- — Free online tool to generate an optimized
postgresql.conf. - - PostgreSQL configuration wizard.
- — Simple script to analyze your PostgreSQL database configuration, and give tuning advice.
DevOps
- — DBmaestro accelerates release cycles & supports agility across the entire IT ecosystem.
- — Toad DevOps Toolkit executes key database development functions within your DevOps workflow —without compromising quality, performance or reliability.
Schema samples
- - Oracle Database Sample Schemas.
Reporting
- - An easy-to-use SQL reporting application built for SQL lovers.
distributions
- - Tool that deploys MySQL database servers easily.
- - PowerShell module that you may think of like a command-line SQL Server Management Studio.
- - Full-featured PostgreSQL installation packaged as a standard Mac app.
- — A developer-friendly distribution of Postgres.
- - Web-based PostgreSQL management front-end that bundles several utilities and applications for use with PostgreSQL.
Security
- - Database security suite. Database proxy with field-level encryption, search through encrypted data, SQL injections prevention, intrusion detection, honeypots. Supports client-side and proxy-side ("transparent") encryption. SQL, NoSQL.
Code formatters
- - Language-agnostic pretty-printing through machine learning.
Contributing
- Your contributions are always welcome! Please read the first.
There are finds for the database - share. I will also be glad to receive feedback - PR's and stars. If you have any questions about creating your own sheets, write too.
Source: habr.com