Hi Habr!
The cryptocurrency market is growing every day, and with it the amount of information is growing.
That's why we decided to launch the project is an aggregator of news and posts from social networks for traders and anyone interested in cryptocurrencies.
The simple, convenient and understandable interface of the service is designed to make it a truly effective tool for monitoring important information.
At the moment, we analyze more than 3 thousand news sources, in English, Russian and Chinese, as a result we receive about 3 thousand new materials daily.
Each material is analyzed by the system for mentions of cryptocurrencies and popularity in social networks.
Using the news filter, you can customize your individual feed, save it in your account and, if necessary, include a broadcast in your Telegram channel.
We constantly monitor important indicators for 2716 cryptocurrencies and monitor the emergence of new currencies on the market.
Using a special interface to view the list of cryptocurrencies, you can see the leaders of growth and decline in the market.
For each currency, you can view the latest news and all indicators on a separate page, for example, Price, Capitalization, etc., as well as a price chart for the entire period of the currency’s existence on the market.
In your personal account, you can create a cryptocurrency portfolio and track its dynamics on a chart.
At the moment we are not thinking about monetization, because... The service is very young and is gaining an audience, but most likely it will be advertising and paid subscription access to PRO functions.
Some technical details
The service can be divided into two parts
- The frontend is an SPA application written in Vue and a backend written in Go, which distributes minimal HTML with content for search engines and code for launching the SPA application. This approach allows you to avoid server rendering and be friendly with search engines. Although Yandex immediately blocked us as a doorway.
- The parser is separated into a separate service with its own database and admin panel, so that it can be moved to a separate server without any problems. Here we used Go, PostgreSQL, Beanstalkd to organize parsing queues and Rotating TOR proxy which allows us to avoid IP blocking. To parse some sites you have to use browserless chrome to bypass security mechanisms. The admin panel for the parser is made in Laravel.
All services run inside Docker, with 19 containers currently running. All this is deployed via GitLab CI. We use Prometheus and Grafana for system monitoring, and Sentry for error logs.
What's planned next?
Development of a mobile application for iOS and Android, creation of a platform for specialists with the ability to post original articles, videos and reviews on cryptocurrencies. Subscribe to the author. And of course, automated regression analysis of the impact of news on currency price movements.
We will be glad to hear criticism or ideas for developing the project.
PS the real author of the post , all questions to him.
Source: habr.com