{"id":53722,"date":"2019-12-08T00:00:00","date_gmt":"2019-12-07T21:00:00","guid":{"rendered":"https:\/\/prohoster.info\/blog\/blog_prohoster\/kompaniya-mozilla-predstavila-dvizhok-raspoznavaniya-rechi-deepspeech-0-6"},"modified":"2020-02-18T14:01:39","modified_gmt":"2020-02-18T11:01:39","slug":"kompaniya-mozilla-predstavila-dvizhok-raspoznavaniya-rechi-deepspeech-0-6","status":"publish","type":"post","link":"https:\/\/prohoster.info\/en\/blog\/news\/kompaniya-mozilla-predstavila-dvizhok-raspoznavaniya-rechi-deepspeech-0-6","title":{"rendered":"In the first part, I briefly talked about the build that allows setting up a computer on which unRAID can run.","gt_translate_keys":[{"key":"rendered","format":"text"}]},"content":{"rendered":"<p><noindex><a rel=\"nofollow\" href=\"https:\/\/hacks.mozilla.org\/2019\/12\/deepspeech-0-6-mozillas-speech-to-text-engine\/\">Introduced<\/a><\/noindex> The release of the speech recognition engine developed by Mozilla <noindex><a rel=\"nofollow\" href=\"https:\/\/github.com\/mozilla\/DeepSpeech\/releases\/v0.6.0\">DeepSpeech 0.6<\/a><\/noindex>, which implements the namesake speech recognition architecture, <noindex><a rel=\"nofollow\" href=\"https:\/\/arxiv.org\/abs\/1412.5567\">proposed by<\/a><\/noindex> researchers from Baidu. The implementation is written in Python using the TensorFlow machine learning platform and <noindex><a rel=\"nofollow\" href=\"https:\/\/github.com\/mozilla\/DeepSpeech\">is distributed<\/a><\/noindex> is licensed under MPL 2.0. It supports operation on Linux, Android, macOS, and Windows. The performance is sufficient for using the engine on LePotato boards, Raspberry Pi 3, and Raspberry Pi 4.<\/p>\n<p>The package also includes <noindex><a rel=\"nofollow\" href=\"https:\/\/github.com\/mozilla\/DeepSpeech\/releases\/download\/v0.6.0\/deepspeech-0.6.0-models.tar.gz\">for installation in WSL<\/a><\/noindex> pre-trained models, <noindex><a rel=\"nofollow\" href=\"https:\/\/github.com\/mozilla\/DeepSpeech\/releases\/download\/v0.6.0\/audio-0.6.0.tar.gz\">examples<\/a><\/noindex> sound files, and command line tools for recognition. Ready-to-use modules for Python, NodeJS, C++, and .NET are provided for integrating speech recognition functionality into applications (third-party developers have separately prepared modules for <noindex><a rel=\"nofollow\" href=\"https:\/\/github.com\/RustAudio\/deepspeech-rs\">Rust<\/a><\/noindex> and <noindex><a rel=\"nofollow\" href=\"https:\/\/github.com\/asticode\/go-astideepspeech\">Go<\/a><\/noindex>). The available model is only for the English language, but for other languages, you can <noindex><a rel=\"nofollow\" href=\"https:\/\/github.com\/mozilla\/DeepSpeech\/wiki#how-can-i-train-using-my-own-data\">train the system yourself using the<\/a><\/noindex> <noindex><a rel=\"nofollow\" href=\"https:\/\/github.com\/mozilla\/DeepSpeech\/blob\/master\/TRAINING.rst#common-voice-training-data\">the instructions<\/a><\/noindex> voice data <noindex><a rel=\"nofollow\" href=\"https:\/\/voice.mozilla.org\/en\/datasets\">, collected by the Common Voice project.<\/a><\/noindex>DeepSpeech is significantly simpler than traditional systems while providing higher recognition quality in the presence of background noise. The development does not use traditional acoustic models and the concept of phonemes; instead, it employs a well-optimized machine learning system based on neural networks, allowing for the absence of separate components for modeling various distortions such as noise, echo, and speech features. <\/p>\n<p>The downside of this approach is that achieving quality recognition and training the neural network requires a large volume of diverse data, recorded in real conditions by different voices and amidst natural noise. <\/p>\n<p>The collection of such data is handled by the Mozilla-created project<br \/>\nCommon Voice <noindex><a rel=\"nofollow\" href=\"https:\/\/voice.mozilla.org\/\">, providing a validated dataset with 780 hours in<\/a><\/noindex>the English language <noindex><a rel=\"nofollow\" href=\"https:\/\/voice.mozilla.org\/en\/datasets\">, 325 in German, 173 in French, and 27 hours in Russian.<\/a><\/noindex>, 325 in German, 173 in French, and 27 hours in Russian. <\/p>\n<p>The ultimate goal of the Common Voice project is to accumulate 10,000 hours of recordings of various pronunciations of standard phrases of human speech, which will allow for an acceptable level of errors in recognition. In its current form, project participants have already recorded a total of 4,300 hours, of which 3,500 hours have been validated. For training the final English language model for DeepSpeech, 3,816 hours of speech were used, in addition to Common Voice, covering data from the LibriSpeech, Fisher, and Switchboard projects, as well as including about 1,700 hours of transcribed radio show recordings.<\/p>\n<p>When using the pre-trained English language model available for download, the error rate in DeepSpeech is 7.5% when evaluated with a test dataset. <noindex><a rel=\"nofollow\" href=\"http:\/\/www.openslr.org\/12\/\">LibriSpeech<\/a><\/noindex>. For comparison, the error rate when recognized by humans <noindex><a rel=\"nofollow\" href=\"https:\/\/arxiv.org\/pdf\/1412.5567v1.pdf\">is estimated<\/a><\/noindex> at 5.83%.<\/p>\n<p>DeepSpeech consists of two subsystems \u2014 the acoustic model and the decoder. The acoustic model uses deep machine learning methods to compute the probability of certain characters in the input sound. The decoder applies a beam search algorithm to transform the character probability data into a text representation.<\/p>\n<p>Key <noindex><a rel=\"nofollow\" href=\"https:\/\/github.com\/mozilla\/DeepSpeech\/releases\/v0.6.0\">innovations<\/a><\/noindex> DeepSpeech 0.6 (branch 0.6 is not compatible with previous releases and requires code and model updates):<\/p>\n<ul>\n<li class=\"l\"> A new streaming decoder has been proposed, providing higher responsiveness and independent of the size of the audio data being processed. As a result, the new version of DeepSpeech has managed to reduce the recognition latency to 260 ms, which is 73% faster than before, allowing for the application of DeepSpeech in real-time speech recognition solutions.\n<li class=\"l\"> Changes have been made to the API, and efforts have been made to unify function names. New functions have been added to obtain additional synchronization metadata, allowing not only for text representation output but also for tracking the alignment of individual symbols and sentences to their positions in the audio stream.\n<li class=\"l\"> The training toolkit modules have added support for using the library <noindex><a rel=\"nofollow\" href=\"https:\/\/developer.nvidia.com\/cudnn\">CuDNN<\/a><\/noindex> to optimize the operation of recurrent neural networks (RNN), which allowed for a significant (approximately twofold) increase in model training performance, but required changes to the code that disrupted compatibility with previously prepared models.\n<li class=\"l\"> The minimum requirements for the TensorFlow version have been raised from 1.13.1 to 1.14.0. Support for the lightweight TensorFlow Lite edition has been added, which reduced the DeepSpeech package size from 98 MB to 3.7 MB. For use on embedded and mobile devices, the packed model file size has been reduced from 188 MB to 47 MB (the quantization method was used after the model training ended).\n<li class=\"l\"> The language model has been converted to a different data structure format, allowing file mapping in memory during loading. Support for the old format has been discontinued.\n<li class=\"l\"> The loading mode of the language model file has been changed, which reduced memory consumption and decreased latency when processing the first request after model creation. DeepSpeech now consumes 22 times less memory during operation and starts 500 times faster.\n<p><center><noindex><a rel=\"nofollow\" href=\"https:\/\/2r4s9p1yi1fa2jd7j43zph8r-wpengine.netdna-ssl.com\/files\/2019\/11\/startup_memory-1.png\"><img decoding=\"async\" alt=\"In the first part, I briefly talked about the build that allows setting up a computer on which unRAID can run.\" src=\"\/wp-content\/uploads\/2019\/12\/113ef11374da37383391cc886c488741.png\" style=\"display:block;margin: 0 auto;\" \/><\/a><\/noindex><\/center><\/p>\n<li class=\"l\"> Rare words in the language model have been filtered. The total number of words has been reduced to 500,000 of the most common words found in the text used for model training. The cleaning conducted allowed for a reduction in the language model size from 1800 MB to 900 MB, with minimal impact on recognition error rates.\n<li class=\"l\"> Support for various <noindex><a rel=\"nofollow\" href=\"https:\/\/github.com\/mozilla\/DeepSpeech\/commit\/58fdd55eea951dabd91a1158207f2228d745e657\">techniques<\/a><\/noindex> for creating additional variations (augmentation) of audio data used in training has been added (for example, adding to the set variations that include distortions or noise).\n<li class=\"l\"> A library with bindings for integration with applications based on the .NET platform has been added.\n<li class=\"l\"> The documentation has been revamped and is now collected on a separate site <noindex><a rel=\"nofollow\" href=\"https:\/\/deepspeech.readthedocs.io\/en\/latest\">deepspeech.readthedocs.io<\/a><\/noindex>.\n<\/ul>\n<p><noindex><a rel=\"nofollow\" name=\"link\"><\/a><\/noindex><\/p>\n<p>Source: <a \ncontent=\"nofollow\" rel=\"nofollow\" href=\"https:\/\/www.opennet.ru\/opennews\/art.shtml?num=51991\">opennet.ru<\/a><\/p>","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"excerpt":{"rendered":"<p>\u041f\u0440\u0435\u0434\u0441\u0442\u0430\u0432\u043b\u0435\u043d \u0432\u044b\u043f\u0443\u0441\u043a \u0440\u0430\u0437\u0432\u0438\u0432\u0430\u0435\u043c\u043e\u0433\u043e \u043a\u043e\u043c\u043f\u0430\u043d\u0438\u0435\u0439 Mozilla \u0434\u0432\u0438\u0436\u043a\u0430 \u0440\u0430\u0441\u043f\u043e\u0437\u043d\u0430\u0432\u0430\u043d\u0438\u044f \u0440\u0435\u0447\u0438 DeepSpeech 0.6, \u043a\u043e\u0442\u043e\u0440\u044b\u0439 \u0440\u0435\u0430\u043b\u0438\u0437\u0443\u0435\u0442 \u043e\u0434\u043d\u043e\u0438\u043c\u0451\u043d\u043d\u0443\u044e \u0430\u0440\u0445\u0438\u0442\u0435\u043a\u0442\u0443\u0440\u0443 \u0440\u0430\u0441\u043f\u043e\u0437\u043d\u0430\u0432\u0430\u043d\u0438\u044f \u0440\u0435\u0447\u0438, \u043f\u0440\u0435\u0434\u043b\u043e\u0436\u0435\u043d\u043d\u0443\u044e \u0438\u0441\u0441\u043b\u0435\u0434\u043e\u0432\u0430\u0442\u0435\u043b\u044f\u043c\u0438 \u0438\u0437 \u043a\u043e\u043c\u043f\u0430\u043d\u0438\u0438 Baidu. \u0420\u0435\u0430\u043b\u0438\u0437\u0430\u0446\u0438\u044f \u043d\u0430\u043f\u0438\u0441\u0430\u043d\u0430 \u043d\u0430 \u044f\u0437\u044b\u043a\u0435 Python \u0441 \u0438\u0441\u043f\u043e\u043b\u044c\u0437\u043e\u0432\u0430\u043d\u0438\u0435\u043c \u043f\u043b\u0430\u0442\u0444\u043e\u0440\u043c\u044b \u043c\u0430\u0448\u0438\u043d\u043d\u043e\u0433\u043e \u043e\u0431\u0443\u0447\u0435\u043d\u0438\u044f TensorFlow \u0438 \u0440\u0430\u0441\u043f\u0440\u043e\u0441\u0442\u0440\u0430\u043d\u044f\u0435\u0442\u0441\u044f \u043f\u043e\u0434 \u0441\u0432\u043e\u0431\u043e\u0434\u043d\u043e\u0439 \u043b\u0438\u0446\u0435\u043d\u0437\u0438\u0435\u0439 MPL 2.0. \u041f\u043e\u0434\u0434\u0435\u0440\u0436\u0438\u0432\u0430\u0435\u0442\u0441\u044f \u0440\u0430\u0431\u043e\u0442\u0430 \u0432 Linux, Android, macOS \u0438 Windows. \u041f\u0440\u043e\u0438\u0437\u0432\u043e\u0434\u0438\u0442\u0435\u043b\u044c\u043d\u043e\u0441\u0442\u0438 \u0434\u043e\u0441\u0442\u0430\u0442\u043e\u0447\u043d\u043e \u0434\u043b\u044f \u0438\u0441\u043f\u043e\u043b\u044c\u0437\u043e\u0432\u0430\u043d\u0438\u044f \u0434\u0432\u0438\u0436\u043a\u0430 \u043d\u0430 \u043f\u043b\u0430\u0442\u0430\u0445 LePotato, [&hellip;]<\/p>\n","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"author":1,"featured_media":53723,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[702],"tags":[],"class_list":["post-53722","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-news"],"aioseo_notices":[],"aioseo_head":"\n\t\t<!-- All in One SEO 5.0.2 - aioseo.com -->\n\t<meta name=\"description\" content=\"\u041f\u0440\u0435\u0434\u0441\u0442\u0430\u0432\u043b\u0435\u043d \u0432\u044b\u043f\u0443\u0441\u043a \u0440\u0430\u0437\u0432\u0438\u0432\u0430\u0435\u043c\u043e\u0433\u043e \u043a\u043e\u043c\u043f\u0430\u043d\u0438\u0435\u0439 Mozilla \u0434\u0432\u0438\u0436\u043a\u0430 \u0440\u0430\u0441\u043f\u043e\u0437\u043d\u0430\u0432\u0430\u043d\u0438\u044f \u0440\u0435\u0447\u0438\" \/>\n\t<meta name=\"robots\" content=\"max-image-preview:large\" \/>\n\t<meta name=\"author\" content=\"Yuri Gagarin\"\/>\n\t<link rel=\"canonical\" href=\"https:\/\/prohoster.info\/en\/blog\/news\/kompaniya-mozilla-predstavila-dvizhok-raspoznavaniya-rechi-deepspeech-0-6\" \/>\n\t<meta name=\"generator\" content=\"All in One SEO (AIOSEO) 5.0.2\" \/>\n\t\t<meta property=\"og:locale\" content=\"en_US\" \/>\n\t\t<meta property=\"og:site_name\" content=\"ProHoster | \u041a\u0443\u043f\u0438\u0442\u044c \u043d\u0430\u0434\u0435\u0436\u043d\u044b\u0439 \u0445\u043e\u0441\u0442\u0438\u043d\u0433 \u0434\u043b\u044f \u0441\u0430\u0439\u0442\u043e\u0432 \u0441 \u0437\u0430\u0449\u0438\u0442\u043e\u0439 \u043e\u0442 DDoS, VPS VDS \u0441\u0435\u0440\u0432\u0435\u0440\u044b\" \/>\n\t\t<meta property=\"og:type\" content=\"article\" \/>\n\t\t<meta property=\"og:title\" content=\"\ud83e\udd47\u041a\u043e\u043c\u043f\u0430\u043d\u0438\u044f Mozilla \u043f\u0440\u0435\u0434\u0441\u0442\u0430\u0432\u0438\u043b\u0430 \u0434\u0432\u0438\u0436\u043e\u043a \u0440\u0430\u0441\u043f\u043e\u0437\u043d\u0430\u0432\u0430\u043d\u0438\u044f \u0440\u0435\u0447\u0438 DeepSpeech 0.6 | ProHoster\" \/>\n\t\t<meta property=\"og:description\" content=\"\u041f\u0440\u0435\u0434\u0441\u0442\u0430\u0432\u043b\u0435\u043d \u0432\u044b\u043f\u0443\u0441\u043a \u0440\u0430\u0437\u0432\u0438\u0432\u0430\u0435\u043c\u043e\u0433\u043e \u043a\u043e\u043c\u043f\u0430\u043d\u0438\u0435\u0439 Mozilla \u0434\u0432\u0438\u0436\u043a\u0430 \u0440\u0430\u0441\u043f\u043e\u0437\u043d\u0430\u0432\u0430\u043d\u0438\u044f \u0440\u0435\u0447\u0438\" \/>\n\t\t<meta property=\"og:url\" content=\"https:\/\/prohoster.info\/en\/blog\/news\/kompaniya-mozilla-predstavila-dvizhok-raspoznavaniya-rechi-deepspeech-0-6\" \/>\n\t\t<meta property=\"og:image\" content=\"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg\" \/>\n\t\t<meta property=\"og:image:secure_url\" content=\"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg\" \/>\n\t\t<meta property=\"og:image:width\" content=\"350\" \/>\n\t\t<meta property=\"og:image:height\" content=\"350\" \/>\n\t\t<meta property=\"article:published_time\" content=\"2019-12-07T21:00:00+00:00\" \/>\n\t\t<meta property=\"article:modified_time\" content=\"2020-02-18T11:01:39+00:00\" \/>\n\t\t<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/prohoster\" \/>\n\t\t<meta property=\"article:author\" content=\"https:\/\/www.facebook.com\/prohoster\" \/>\n\t\t<!-- All in One SEO -->\n\n","aioseo_head_json":{"title":"\ud83e\udd47Mozilla has introduced the DeepSpeech 0.6 speech recognition engine | ProHoster","description":"The release of the speech recognition engine developed by Mozilla has been announced","canonical_url":"https:\/\/prohoster.info\/en\/blog\/news\/kompaniya-mozilla-predstavila-dvizhok-raspoznavaniya-rechi-deepspeech-0-6","robots":"max-image-preview:large","keywords":"","webmasterTools":{"miscellaneous":""},"schema":null,"og:locale":"en_US","og:site_name":"ProHoster | \u041a\u0443\u043f\u0438\u0442\u044c \u043d\u0430\u0434\u0435\u0436\u043d\u044b\u0439 \u0445\u043e\u0441\u0442\u0438\u043d\u0433 \u0434\u043b\u044f \u0441\u0430\u0439\u0442\u043e\u0432 \u0441 \u0437\u0430\u0449\u0438\u0442\u043e\u0439 \u043e\u0442 DDoS, VPS VDS \u0441\u0435\u0440\u0432\u0435\u0440\u044b","og:type":"article","og:title":"\ud83e\udd47\u041a\u043e\u043c\u043f\u0430\u043d\u0438\u044f Mozilla \u043f\u0440\u0435\u0434\u0441\u0442\u0430\u0432\u0438\u043b\u0430 \u0434\u0432\u0438\u0436\u043e\u043a \u0440\u0430\u0441\u043f\u043e\u0437\u043d\u0430\u0432\u0430\u043d\u0438\u044f \u0440\u0435\u0447\u0438 DeepSpeech 0.6 | ProHoster","og:description":"\u041f\u0440\u0435\u0434\u0441\u0442\u0430\u0432\u043b\u0435\u043d \u0432\u044b\u043f\u0443\u0441\u043a \u0440\u0430\u0437\u0432\u0438\u0432\u0430\u0435\u043c\u043e\u0433\u043e \u043a\u043e\u043c\u043f\u0430\u043d\u0438\u0435\u0439 Mozilla \u0434\u0432\u0438\u0436\u043a\u0430 \u0440\u0430\u0441\u043f\u043e\u0437\u043d\u0430\u0432\u0430\u043d\u0438\u044f \u0440\u0435\u0447\u0438","og:url":"https:\/\/prohoster.info\/en\/blog\/news\/kompaniya-mozilla-predstavila-dvizhok-raspoznavaniya-rechi-deepspeech-0-6","og:image":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:secure_url":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:width":350,"og:image:height":350,"article:published_time":"2019-12-07T21:00:00+00:00","article:modified_time":"2020-02-18T11:01:39+00:00","article:publisher":"https:\/\/www.facebook.com\/prohoster","article:author":"https:\/\/www.facebook.com\/prohoster"},"aioseo_meta_data":{"post_id":"53722","title":null,"description":null,"keywords":null,"keyphrases":null,"primary_term":null,"canonical_url":null,"og_title":null,"og_description":null,"og_object_type":"default","og_image_type":"default","og_image_url":null,"og_image_width":null,"og_image_height":null,"og_image_custom_url":null,"og_image_custom_fields":null,"og_video":null,"og_custom_url":null,"og_article_section":null,"og_article_tags":null,"twitter_use_og":false,"twitter_card":"default","twitter_image_type":"default","twitter_image_url":null,"twitter_image_custom_url":null,"twitter_image_custom_fields":null,"twitter_title":null,"twitter_description":null,"schema":{"blockGraphs":[],"customGraphs":[],"default":{"data":{"Article":[],"Course":[],"Dataset":[],"FAQPage":[],"Movie":[],"Person":[],"Product":[],"ProductReview":[],"Car":[],"Recipe":[],"Service":[],"SoftwareApplication":[],"WebPage":[]},"graphName":"","isEnabled":true},"graphs":[]},"schema_type":null,"schema_type_options":null,"pillar_content":false,"robots_default":true,"robots_noindex":false,"robots_noarchive":false,"robots_nosnippet":false,"robots_nofollow":false,"robots_noimageindex":false,"robots_noodp":false,"robots_notranslate":false,"robots_max_snippet":null,"robots_max_videopreview":null,"robots_max_imagepreview":"large","priority":null,"frequency":null,"local_seo":null,"seo_analyzer_scan_date":"2026-01-24 08:28:20","breadcrumb_settings":null,"limit_modified_date":false,"reviewed_by":null,"ai":null,"created":"2021-02-28 20:19:21","updated":"2026-01-24 08:28:20","focus_keyword":null,"additional_keywords":null,"truseo_locale":null},"gt_translate_keys":[{"key":"link","format":"url"}],"_links":{"self":[{"href":"https:\/\/prohoster.info\/en\/wp-json\/wp\/v2\/posts\/53722","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/prohoster.info\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/prohoster.info\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/prohoster.info\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/prohoster.info\/en\/wp-json\/wp\/v2\/comments?post=53722"}],"version-history":[{"count":0,"href":"https:\/\/prohoster.info\/en\/wp-json\/wp\/v2\/posts\/53722\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/prohoster.info\/en\/wp-json\/wp\/v2\/media\/53723"}],"wp:attachment":[{"href":"https:\/\/prohoster.info\/en\/wp-json\/wp\/v2\/media?parent=53722"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/prohoster.info\/en\/wp-json\/wp\/v2\/categories?post=53722"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/prohoster.info\/en\/wp-json\/wp\/v2\/tags?post=53722"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}