{"id":54780,"date":"2020-01-04T00:00:00","date_gmt":"2020-01-03T21:00:00","guid":{"rendered":"https:\/\/prohoster.info\/blog\/blog_prohoster\/nejroseti-kuda-eto-vse-dvizhetsya"},"modified":"2020-02-18T14:02:50","modified_gmt":"2020-02-18T11:02:50","slug":"nejroseti-kuda-eto-vse-dvizhetsya","status":"publish","type":"post","link":"https:\/\/prohoster.info\/en\/blog\/news\/nejroseti-kuda-eto-vse-dvizhetsya","title":{"rendered":"Neural Networks. Where is all this heading","gt_translate_keys":[{"key":"rendered","format":"text"}]},"content":{"rendered":"<p>The article consists of two parts:<\/p>\n<p><\/p>\n<ol>\n<li>A brief overview of some architectures for network object detection in images and image segmentation, along with the most understandable references I could find. I tried to select video explanations, preferably in Russian.<\/li>\n<li>The second part attempts to understand the trajectory of neural network architecture development and the technologies based on them.<\/li>\n<\/ol>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Neural Networks. Where is all this heading\" src=\"\/wp-content\/uploads\/2020\/01\/3e0238547dc956dbb069c11241e4534f.png\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>Figure 1 \u2013 Understanding neural network architectures is not simple.<\/p>\n<p><\/p>\n<p>It all started with me creating two demonstration applications for classification and object detection on an Android phone:<\/p>\n<p><\/p>\n<ul>\n<li><noindex><a rel=\"nofollow\" href=\"https:\/\/github.com\/foobar167\/junkyard\/tree\/master\/object_classifier\">Back-end demo<\/a><\/noindex>, where data is processed on the server and sent to the phone. Image classification (image classification) of three types of bears: brown, black, and teddy.<\/li>\n<li><noindex><a rel=\"nofollow\" href=\"https:\/\/github.com\/foobar167\/android\/tree\/master\/object_detection_demo\">Front-end demo<\/a><\/noindex>, where data is processed on the phone itself. Object detection of three types: hazelnut, fig, and date.<\/li>\n<\/ul>\n<p><noindex><a rel=\"nofollow\" name=\"habracut\"><\/a><\/noindex><\/p>\n<p>There is a difference between tasks of image classification, object detection in images, and <noindex><a rel=\"nofollow\" href=\"https:\/\/medium.com\/analytics-vidhya\/image-classification-vs-object-detection-vs-image-segmentation-f36db85fe81\">image segmentation.<\/a><\/noindex>. Therefore, there was a need to learn which neural network architectures detect objects in images and which can segment them. I found the following examples of architectures with the most understandable references:<\/p>\n<p><\/p>\n<ul>\n<li>A series of architectures based on R-CNN (<strong>R<\/strong>egions with <strong>C<\/strong>onvolution <strong>N<\/strong>eural <strong>N<\/strong>etworks features): R-CNN, Fast R-CNN, <noindex><a rel=\"nofollow\" href=\"https:\/\/medium.com\/@smallfishbigsea\/faster-r-cnn-explained-864d4fb7e3f8\">Faster R-CNN,<\/a><\/noindex>, <noindex><a rel=\"nofollow\" href=\"https:\/\/youtu.be\/0vt05rQqk_I\">Mask R-CNN.<\/a><\/noindex>To detect an object in an image using the Region Proposal Network (RPN) mechanism, limited regions (bounding boxes) are highlighted. Initially, a slower mechanism called Selective Search was used instead of RPN. Then, the highlighted limited regions are fed into a standard neural network for classification. The R-CNN architecture has explicit 'for' loops for iterating over the limited regions, with up to 2000 passes through the internal AlexNet network. Due to the explicit 'for' loops, the image processing speed slows down. The number of explicit loops, passes through the internal neural network, decreases with each new version of the architecture, and dozens of other changes are made to increase speed and to replace the object detection task with object segmentation in Mask R-CNN.<\/li>\n<li><noindex><a rel=\"nofollow\" href=\"https:\/\/youtu.be\/L0tzmv--CGY\">YOLO<\/a><\/noindex> (<strong>Y<\/strong>ou <strong>O<\/strong>nly <strong>L<\/strong>ook <strong>O<\/strong>YOLO (You Only Look Once) is the first neural network that recognized objects in real time on mobile devices. Its distinctive feature is the ability to distinguish objects in a single pass (only one look is enough). This means that the YOLO architecture does not have explicit 'for' loops, which allows the network to operate quickly. For example, a similar analogy can be found in NumPy, where matrix operations also eliminate explicit 'for' loops implemented at lower levels through the C programming language. YOLO uses a grid of predefined windows. To avoid multiple detections of the same object, the Intersection over Union (IoU) coefficient is applied. <strong>I<\/strong>Intersection <strong>o<\/strong>over <strong>U<\/strong>Union). This architecture operates across a wide range and possesses high <noindex><a rel=\"nofollow\" href=\"https:\/\/ru.wikipedia.org\/wiki\/%D0%A0%D0%BE%D0%B1%D0%B0%D1%81%D1%82%D0%BD%D0%BE%D1%81%D1%82%D1%8C\">robustness<\/a><\/noindex>: the model can be trained on photographs but performs well on drawn images.<\/li>\n<li><noindex><a rel=\"nofollow\" href=\"https:\/\/youtu.be\/P8e-G-Mhx4k\">SSD<\/a><\/noindex> (<strong>S<\/strong>Single <strong>S<\/strong>Shot MultiBox <strong>D<\/strong>Detector) \u2014 utilizes the most effective 'hacks' from the YOLO architecture (such as non-maximum suppression) and adds new ones to make the neural network operate faster and more accurately. A distinctive feature is the ability to distinguish objects in a single pass using a designated grid of boxes (default box) on an image pyramid. The image pyramid is encoded in convolutional tensors during sequential convolution and pooling operations (max-pooling reduces spatial dimensions). This allows for the detection of both large and small objects in a single network pass.<\/li>\n<li>MobileSSD (<strong>Mobile<\/strong>NetV2 + <strong>SSD<\/strong>) \u2013 a combination of two neural network architectures. The first network <noindex><a rel=\"nofollow\" href=\"https:\/\/habr.com\/ru\/post\/352804\/\">MobileNetV2<\/a><\/noindex> operates quickly and increases recognition accuracy. MobileNetV2 is used instead of VGG-16, which was originally applied in <noindex><a rel=\"nofollow\" href=\"https:\/\/arxiv.org\/abs\/1512.02325\">the original article<\/a><\/noindex>. The second network SSD detects the location of objects in the image.<\/li>\n<li><noindex><a rel=\"nofollow\" href=\"https:\/\/youtu.be\/ge_RT5wvHvY\">SqueezeNet<\/a><\/noindex> \u2013 a very small yet accurate neural network. It does not solve the object detection task by itself but can be utilized in combination with various architectures and in mobile devices. A distinctive feature is that the data is first compressed into four 1\u00d71 convolutional filters and then expanded into four 1\u00d71 and four 3\u00d73 convolutional filters. One such iteration of data compression and expansion is called a 'Fire Module.'<\/li>\n<li><noindex><a rel=\"nofollow\" href=\"https:\/\/youtu.be\/b6jhopSMit8\">DeepLab<\/a><\/noindex> (Semantic Image Segmentation with Deep Convolutional Nets) \u2013 object segmentation in an image. A distinctive feature of the architecture is the sparse (dilated convolution) convolution, which preserves spatial resolution. This is followed by a post-processing stage using a graphical probabilistic model (conditional random field), which allows for the removal of small noise in segmentation and improves the quality of the segmented image. Behind the daunting name of 'graphical probabilistic model' lies a regular Gaussian filter approximated over five points.<\/li>\n<li>I tried to understand the device <noindex><a rel=\"nofollow\" href=\"https:\/\/arxiv.org\/abs\/1711.06897\">RefineDet<\/a><\/noindex> (Single-Shot <strong>Refine<\/strong>ment Neural Network for Object <strong>Det<\/strong>ection), but didn't understand much.<\/li>\n<li>I also looked at how the attention technology works: <noindex><a rel=\"nofollow\" href=\"https:\/\/youtu.be\/W2rWgXJBZhU\">video1<\/a><\/noindex>, <noindex><a rel=\"nofollow\" href=\"https:\/\/youtu.be\/iDulhoQ2pro\">video2<\/a><\/noindex>, <noindex><a rel=\"nofollow\" href=\"https:\/\/youtu.be\/H6Qiegq_36c\">video3<\/a><\/noindex>. A distinctive feature of the attention architecture is the automatic highlighting of regions of increased interest in an image (RoI, <strong>R<\/strong>egions <strong>o<\/strong>f <strong>I<\/strong>nterest) using a neural network called Attention Unit. Regions of increased interest are similar to bounding boxes, but unlike them, they are not fixed to the image and can have blurred edges. Features are then extracted from the regions of increased interest, which are 'fed' into recurrent neural networks with architectures <noindex><a rel=\"nofollow\" href=\"https:\/\/youtu.be\/5lUUrREboSk\">LSDM, GRU or Vanilla RNN<\/a><\/noindex>. Recurrent neural networks can analyze the relationships between features in a sequence. Recurrent neural networks were originally used for translating text into other languages and now for translating <noindex><a rel=\"nofollow\" href=\"https:\/\/youtu.be\/e-WB4lfg30M\">images into text<\/a><\/noindex> and <noindex><a rel=\"nofollow\" href=\"https:\/\/youtu.be\/rAbhypxs1qQ\">text into images<\/a><\/noindex>.<\/li>\n<\/ul>\n<p><\/p>\n<p>As I studied these architectures <strong>I realized that I understood nothing.<\/strong>. And it's not that my neural network has issues with the attention mechanism. Creating all these architectures resembles some massive hackathon where authors compete in hacks. A hack is a quick solution to a difficult programming problem. That is, there is no visible and understandable logical connection between all these architectures. All that unites them is a set of the most successful hacks that they borrow from one another, plus a common <noindex><a rel=\"nofollow\" href=\"https:\/\/youtu.be\/Ilg3gGewQ5U\">convolution operation with feedback<\/a><\/noindex> (backpropagation). There is no <noindex><a rel=\"nofollow\" href=\"https:\/\/habr.com\/ru\/post\/272473\/\">systematic thinking<\/a><\/noindex>! It's unclear what to change and how to optimize the existing achievements.<\/p>\n<p><\/p>\n<p>As a result of the lack of logical connections between hacks, they are extremely difficult to remember and apply in practice. This leads to fragmented knowledge. At best, a few interesting and unexpected moments are remembered, but most of what is understood and misunderstood fades from memory within a few days. It would be good if the architecture's name comes to mind at least a week later. Yet, reading articles and watching overview videos has consumed several hours and even days of work time!<\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Neural Networks. Where is all this heading\" src=\"\/wp-content\/uploads\/2020\/01\/86f0f24e3be1d0f1a210f3132897d981.png\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>Figure 2 - <noindex><a rel=\"nofollow\" href=\"https:\/\/www.asimovinstitute.org\/neural-network-zoo\/\">The Zoo of Neural Networks<\/a><\/noindex><\/p>\n<p><\/p>\n<p>Most authors of scientific articles, in my personal opinion, do everything possible to ensure that even this fragmented knowledge is not understood by the reader. But participial constructions in ten-line sentences with formulas pulled 'out of thin air' \u2014 that's a topic for a separate article (the problem <noindex><a rel=\"nofollow\" href=\"https:\/\/en.wikipedia.org\/wiki\/Publish_or_perish\">publish or perish<\/a><\/noindex>).<\/p>\n<p><\/p>\n<p>For this reason, there arose a need to systematize information on neural networks and, thus, improve the quality of understanding and memorization. Therefore, the main focus of analyzing specific technologies and architectures of artificial neural networks became the following task: <strong>to determine where it is all heading<\/strong>, rather than the structure of any specific neural network in isolation.<\/p>\n<p><\/p>\n<p>Where it is all heading. Key findings:<\/p>\n<p><\/p>\n<ul>\n<li>The number of startups in the field of machine learning in the last two years <noindex><a rel=\"nofollow\" href=\"https:\/\/habr.com\/ru\/company\/recognitor\/blog\/455676\/\">has sharply declined.<\/a><\/noindex>Possible reason: 'neural networks are no longer something new.'<\/li>\n<li>Anyone can create a working neural network to solve a simple problem. To do this, one can take a ready-made model from the 'model zoo' and train the last layer of the neural network (<noindex><a rel=\"nofollow\" href=\"https:\/\/youtu.be\/yofjFQddwHE\">transfer learning<\/a><\/noindex>) on prepared data from <noindex><a rel=\"nofollow\" href=\"https:\/\/toolbox.google.com\/datasetsearch\">Google Dataset Search<\/a><\/noindex> or from <noindex><a rel=\"nofollow\" href=\"https:\/\/www.kaggle.com\/datasets\">25,000 datasets from Kaggle<\/a><\/noindex> in free <noindex><a rel=\"nofollow\" href=\"https:\/\/www.dataschool.io\/cloud-services-for-jupyter-notebook\/\">Jupyter Notebook cloud.<\/a><\/noindex>.<\/li>\n<li>Major neural network manufacturers have begun to create <strong>'model zoos.'<\/strong> With their help, a commercial application can be quickly built: <noindex><a rel=\"nofollow\" href=\"https:\/\/tfhub.dev\/\">TF Hub<\/a><\/noindex> for TensorFlow, <noindex><a rel=\"nofollow\" href=\"https:\/\/github.com\/open-mmlab\/mmdetection\">MMDetection<\/a><\/noindex> for PyTorch, <noindex><a rel=\"nofollow\" href=\"https:\/\/github.com\/facebookresearch\/Detectron\">Detectron<\/a><\/noindex> for Caffe2, <noindex><a rel=\"nofollow\" href=\"https:\/\/github.com\/wkentaro\/chainer-modelzoo\">chainer-modelzoo<\/a><\/noindex> for Chainer and <noindex><a rel=\"nofollow\" href=\"https:\/\/modelzoo.co\/\">others<\/a><\/noindex>.<\/li>\n<li>Neural networks operating in <strong>real-time<\/strong> (real-time) on mobile devices. From 10 to 50 frames per second.<\/li>\n<li>The use of neural networks in phones (TF Lite), in browsers (TF.js), and in <noindex><a rel=\"nofollow\" href=\"https:\/\/youtu.be\/19ZNz2N79u4\">household items<\/a><\/noindex> (IoT, <strong>I<\/strong>Internet <strong>o<\/strong>f <strong>T<\/strong>of Things). Especially in phones, which already support neural networks at the hardware level (neural accelerators).<\/li>\n<li>\"Every device, clothing items, and perhaps even food will have <strong>an IP-v6 address<\/strong> and communicate with each other\" \u2013 <noindex><a rel=\"nofollow\" href=\"https:\/\/youtu.be\/GG7H8Xa4m8I?t=85\">Sebastian Thrun<\/a><\/noindex>.<\/li>\n<li>The growth in the number of publications on machine learning has begun to <noindex><a rel=\"nofollow\" href=\"http:\/\/data-mining.philippe-fournier-viger.com\/too-many-machine-learning-papers\">exceed Moore's Law<\/a><\/noindex> (doubling every two years) since 2015. Clearly, neural networks for article analysis are needed.<\/li>\n<li>The following technologies are gaining popularity:\n<ul>\n<li><strong>PyTorch<\/strong> \u2013 popularity is rapidly increasing and seems to be outpacing TensorFlow.<\/li>\n<li>Automatic hyperparameter tuning <strong>AutoML<\/strong> \u2013 popularity is growing steadily.<\/li>\n<li>Gradual decrease in accuracy and increase in computing speed: <noindex><a rel=\"nofollow\" href=\"https:\/\/youtu.be\/rln_kZbYaWc\">fuzzy logic<\/a><\/noindex>, algorithms <noindex><a rel=\"nofollow\" href=\"https:\/\/youtu.be\/MIPkK5ZAsms\">boosting<\/a><\/noindex>, approximate computations, quantization (when the weights of neural networks are converted into integers and quantized), neural accelerators.<\/li>\n<li>Translation <noindex><a rel=\"nofollow\" href=\"https:\/\/youtu.be\/e-WB4lfg30M\">images into text<\/a><\/noindex> and <noindex><a rel=\"nofollow\" href=\"https:\/\/youtu.be\/rAbhypxs1qQ\">text into images<\/a><\/noindex>.<\/li>\n<li>Creating <noindex><a rel=\"nofollow\" href=\"https:\/\/youtu.be\/OrHLacCDZVQ\">three-dimensional objects from video<\/a><\/noindex>, now in real time.<\/li>\n<li>The core of DL is a lot of data, but collecting and annotating it is not easy. Therefore, automated annotation (<noindex><a rel=\"nofollow\" href=\"https:\/\/youtu.be\/NcKTn4C91Yc\">automated annotation<\/a><\/noindex>) for neural networks using neural networks is developing.<\/li>\n<\/ul>\n<\/li>\n<li>With neural networks, Computer Science has suddenly become <strong>an experimental science<\/strong> and has encountered <noindex><a rel=\"nofollow\" href=\"https:\/\/habr.com\/ru\/post\/480348\">a reproducibility crisis.<\/a><\/noindex>.<\/li>\n<li>IT money and the popularity of neural networks arose simultaneously when computation became a market value. The economy is transitioning from a gold-backed to a <strong>gold-backed computational economy.<\/strong>See my article on <noindex><a rel=\"nofollow\" href=\"https:\/\/ru.wikipedia.org\/wiki\/%D0%AD%D0%BA%D0%BE%D0%BD%D0%BE%D1%84%D0%B8%D0%B7%D0%B8%D0%BA%D0%B0\">econophysics<\/a><\/noindex> and the reason for the emergence of IT money.<\/li>\n<\/ul>\n<p><\/p>\n<p>Gradually, a new <noindex><a rel=\"nofollow\" href=\"https:\/\/habr.com\/ru\/post\/481844\">programming methodology for ML\/DL<\/a><\/noindex> (Machine Learning &amp; Deep Learning) is emerging, which is based on representing a program as a set of trained neural network models.<\/p>\n<p><\/p>\n<p><img decoding=\"async\" alt=\"Neural Networks. Where is all this heading\" src=\"\/wp-content\/uploads\/2020\/01\/17df76a613191522145abeba177c2685.png\" style=\"display:block;margin: 0 auto;\" \/><\/p>\n<p><\/p>\n<p>Figure 3 \u2013 ML\/DL as a new programming methodology<\/p>\n<p><\/p>\n<p>However, a \"theory of neural networks\" has yet to emerge, <strong>within which one can think and work systematically. What is currently called \"theory\" are actually experimental, heuristic algorithms.<\/strong>Links to my resources and others:<\/p>\n<p><\/p>\n<p>Newsletter on Data Science. Primarily on image processing. Anyone who wants to receive it should send an email (foobar167&lt;woof-woof&gt;gmail&lt;dot&gt;com). Links to articles and videos are sent as material accumulates.<\/p>\n<p><\/p>\n<ul>\n<li>Overall<\/li>\n<li>list of courses and articles <noindex><a rel=\"nofollow\" href=\"https:\/\/github.com\/foobar167\/articles\/blob\/master\/Machine_Learning\/courses_on_machine_learning.md\">, which I have taken and would like to take.<\/a><\/noindex>Courses and videos for beginners<\/li>\n<li><noindex><a rel=\"nofollow\" href=\"https:\/\/github.com\/foobar167\/articles\/blob\/master\/Ubuntu\/13_Keras_and_TensorFlow_how-tos.md#exercises\">, which are a good starting point for studying neural networks. Plus, a brochure<\/a><\/noindex>\"Introduction to Machine Learning and Artificial Neural Networks\" <noindex><a rel=\"nofollow\" href=\"https:\/\/foobar167.github.io\/page\/vvedeniye-v-mashinnoye-obucheniye-i-iskusstvennyye-neyronnyye-seti.html\">Useful tools<\/a><\/noindex>.<\/li>\n<li><noindex><a rel=\"nofollow\" href=\"https:\/\/github.com\/foobar167\/articles\/blob\/master\/Ubuntu\/13_Keras_and_TensorFlow_how-tos.md#tools\">Useful tools<\/a><\/noindex>, where everyone can find something interesting for themselves.<\/li>\n<li>I found it extremely useful <strong>video channels analyzing scientific papers<\/strong> on Data Science. Find, subscribe to them, and share the links with your colleagues and me as well. Examples:\n<ul>\n<li><noindex><a rel=\"nofollow\" href=\"https:\/\/www.youtube.com\/user\/keeroyz\">Two Minute Papers<\/a><\/noindex><\/li>\n<li><noindex><a rel=\"nofollow\" href=\"https:\/\/www.youtube.com\/channel\/UCHB9VepY6kYvZjj0Bgxnpbw\">Henry AI Labs<\/a><\/noindex><\/li>\n<li><noindex><a rel=\"nofollow\" href=\"https:\/\/www.youtube.com\/channel\/UCZHmQk67mSJgfCCTn7xBfew\">Yannic Kilcher<\/a><\/noindex><\/li>\n<li><noindex><a rel=\"nofollow\" href=\"https:\/\/www.youtube.com\/channel\/UC5_6ZD6s8klmMu9TXEB_1IA\">CodeEmporium<\/a><\/noindex><\/li>\n<li><noindex><a rel=\"nofollow\" href=\"https:\/\/www.dlology.com\">Chengwei Zhang's Blog<\/a><\/noindex> aka <noindex><a rel=\"nofollow\" href=\"https:\/\/github.com\/Tony607\">Tony607<\/a><\/noindex> with step-by-step instructions and open source code.<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<p><\/p>\n<p>Thank you for your attention!<\/p>\n<p>Source: <a content=\"nofollow\" rel=\"nofollow\" href=\"https:\/\/habr.com\/ru\/post\/482794\/\">habr.com<\/a><\/p>","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"excerpt":{"rendered":"<p>\u0421\u0442\u0430\u0442\u044c\u044f \u0441\u043e\u0441\u0442\u043e\u0438\u0442 \u0438\u0437 \u0434\u0432\u0443\u0445 \u0447\u0430\u0441\u0442\u0435\u0439: \u041a\u0440\u0430\u0442\u043a\u043e\u0435 \u043e\u043f\u0438\u0441\u0430\u043d\u0438\u0435 \u043d\u0435\u043a\u043e\u0442\u043e\u0440\u044b\u0445 \u0430\u0440\u0445\u0438\u0442\u0435\u043a\u0442\u0443\u0440 \u0441\u0435\u0442\u0435\u0439 \u043f\u043e \u043e\u0431\u043d\u0430\u0440\u0443\u0436\u0435\u043d\u0438\u044e \u043e\u0431\u044a\u0435\u043a\u0442\u043e\u0432 \u043d\u0430 \u0438\u0437\u043e\u0431\u0440\u0430\u0436\u0435\u043d\u0438\u0438 \u0438 \u0441\u0435\u0433\u043c\u0435\u043d\u0442\u0430\u0446\u0438\u0438 \u0438\u0437\u043e\u0431\u0440\u0430\u0436\u0435\u043d\u0438\u0439 \u0441 \u0441\u0430\u043c\u044b\u043c\u0438 \u043f\u043e\u043d\u044f\u0442\u043d\u044b\u043c\u0438 \u0434\u043b\u044f \u043c\u0435\u043d\u044f \u0441\u0441\u044b\u043b\u043a\u0430\u043c\u0438 \u043d\u0430 \u0440\u0435\u0441\u0443\u0440\u0441\u044b. \u0421\u0442\u0430\u0440\u0430\u043b\u0441\u044f \u0432\u044b\u0431\u0438\u0440\u0430\u0442\u044c \u0432\u0438\u0434\u0435\u043e \u043f\u043e\u044f\u0441\u043d\u0435\u043d\u0438\u044f \u0438 \u0436\u0435\u043b\u0430\u0442\u0435\u043b\u044c\u043d\u043e \u043d\u0430 \u0440\u0443\u0441\u0441\u043a\u043e\u043c \u044f\u0437\u044b\u043a\u0435. \u0412\u0442\u043e\u0440\u0430\u044f \u0447\u0430\u0441\u0442\u044c \u0441\u043e\u0441\u0442\u043e\u0438\u0442 \u0432 \u043f\u043e\u043f\u044b\u0442\u043a\u0435 \u043e\u0441\u043e\u0437\u043d\u0430\u0442\u044c \u043d\u0430\u043f\u0440\u0430\u0432\u043b\u0435\u043d\u0438\u0435 \u0440\u0430\u0437\u0432\u0438\u0442\u0438\u044f \u0430\u0440\u0445\u0438\u0442\u0435\u043a\u0442\u0443\u0440 \u043d\u0435\u0439\u0440\u043e\u043d\u043d\u044b\u0445 \u0441\u0435\u0442\u0435\u0439. \u0418 \u0442\u0435\u0445\u043d\u043e\u043b\u043e\u0433\u0438\u0439 \u043d\u0430 \u0438\u0445 \u043e\u0441\u043d\u043e\u0432\u0435. \u0420\u0438\u0441\u0443\u043d\u043e\u043a 1 \u2013 \u041f\u043e\u043d\u0438\u043c\u0430\u0442\u044c [&hellip;]<\/p>\n","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[702],"tags":[],"class_list":["post-54780","post","type-post","status-publish","format-standard","hentry","category-news"],"aioseo_notices":[],"aioseo_head":"\n\t\t<!-- All in One SEO 5.0.2 - aioseo.com -->\n\t<meta name=\"description\" content=\"\u0421\u0442\u0430\u0442\u044c\u044f \u0441\u043e\u0441\u0442\u043e\u0438\u0442 \u0438\u0437 \u0434\u0432\u0443\u0445 \u0447\u0430\u0441\u0442\u0435\u0439: \u041a\u0440\u0430\u0442\u043a\u043e\u0435 \u043e\u043f\u0438\u0441\u0430\u043d\u0438\u0435 \u043d\u0435\u043a\u043e\u0442\u043e\u0440\u044b\u0445 \u0430\u0440\u0445\u0438\u0442\u0435\u043a\u0442\u0443\u0440 \u0441\u0435\u0442\u0435\u0439 \u043f\u043e \u043e\u0431\u043d\u0430\u0440\u0443\u0436\u0435\u043d\u0438\u044e \u043e\u0431\u044a\u0435\u043a\u0442\u043e\u0432 \u043d\u0430 \u0438\u0437\u043e\u0431\u0440\u0430\u0436\u0435\u043d\u0438\u0438 \u0438 \u0441\u0435\u0433\u043c\u0435\u043d\u0442\u0430\u0446\u0438\u0438 \u0438\u0437\u043e\u0431\u0440\u0430\u0436\u0435\u043d\u0438\u0439 \u0441 \u0441\u0430\u043c\u044b\u043c\u0438 \u043f\u043e\u043d\u044f\u0442\u043d\u044b\u043c\u0438 \u0434\u043b\u044f \u043c\u0435\u043d\u044f \u0441\u0441\u044b\u043b\u043a\u0430\u043c\u0438 \u043d\u0430 \u0440\u0435\u0441\u0443\u0440\u0441\u044b.\" \/>\n\t<meta name=\"robots\" content=\"max-image-preview:large\" \/>\n\t<meta name=\"author\" content=\"Yuri Gagarin\"\/>\n\t<link rel=\"canonical\" href=\"https:\/\/prohoster.info\/en\/blog\/news\/nejroseti-kuda-eto-vse-dvizhetsya\" \/>\n\t<meta name=\"generator\" content=\"All in One SEO (AIOSEO) 5.0.2\" \/>\n\t\t<meta property=\"og:locale\" content=\"en_US\" \/>\n\t\t<meta property=\"og:site_name\" content=\"ProHoster | \u041a\u0443\u043f\u0438\u0442\u044c \u043d\u0430\u0434\u0435\u0436\u043d\u044b\u0439 \u0445\u043e\u0441\u0442\u0438\u043d\u0433 \u0434\u043b\u044f \u0441\u0430\u0439\u0442\u043e\u0432 \u0441 \u0437\u0430\u0449\u0438\u0442\u043e\u0439 \u043e\u0442 DDoS, VPS VDS \u0441\u0435\u0440\u0432\u0435\u0440\u044b\" \/>\n\t\t<meta property=\"og:type\" content=\"article\" \/>\n\t\t<meta property=\"og:title\" content=\"\ud83e\udd47\u041d\u0435\u0439\u0440\u043e\u0441\u0435\u0442\u0438. \u041a\u0443\u0434\u0430 \u044d\u0442\u043e \u0432\u0441\u0435 \u0434\u0432\u0438\u0436\u0435\u0442\u0441\u044f | ProHoster\" \/>\n\t\t<meta property=\"og:description\" content=\"\u0421\u0442\u0430\u0442\u044c\u044f \u0441\u043e\u0441\u0442\u043e\u0438\u0442 \u0438\u0437 \u0434\u0432\u0443\u0445 \u0447\u0430\u0441\u0442\u0435\u0439: \u041a\u0440\u0430\u0442\u043a\u043e\u0435 \u043e\u043f\u0438\u0441\u0430\u043d\u0438\u0435 \u043d\u0435\u043a\u043e\u0442\u043e\u0440\u044b\u0445 \u0430\u0440\u0445\u0438\u0442\u0435\u043a\u0442\u0443\u0440 \u0441\u0435\u0442\u0435\u0439 \u043f\u043e \u043e\u0431\u043d\u0430\u0440\u0443\u0436\u0435\u043d\u0438\u044e \u043e\u0431\u044a\u0435\u043a\u0442\u043e\u0432 \u043d\u0430 \u0438\u0437\u043e\u0431\u0440\u0430\u0436\u0435\u043d\u0438\u0438 \u0438 \u0441\u0435\u0433\u043c\u0435\u043d\u0442\u0430\u0446\u0438\u0438 \u0438\u0437\u043e\u0431\u0440\u0430\u0436\u0435\u043d\u0438\u0439 \u0441 \u0441\u0430\u043c\u044b\u043c\u0438 \u043f\u043e\u043d\u044f\u0442\u043d\u044b\u043c\u0438 \u0434\u043b\u044f \u043c\u0435\u043d\u044f \u0441\u0441\u044b\u043b\u043a\u0430\u043c\u0438 \u043d\u0430 \u0440\u0435\u0441\u0443\u0440\u0441\u044b.\" \/>\n\t\t<meta property=\"og:url\" content=\"https:\/\/prohoster.info\/en\/blog\/news\/nejroseti-kuda-eto-vse-dvizhetsya\" \/>\n\t\t<meta property=\"og:image\" content=\"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg\" \/>\n\t\t<meta property=\"og:image:secure_url\" content=\"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg\" \/>\n\t\t<meta property=\"og:image:width\" content=\"350\" \/>\n\t\t<meta property=\"og:image:height\" content=\"350\" \/>\n\t\t<meta property=\"article:published_time\" content=\"2020-01-03T21:00:00+00:00\" \/>\n\t\t<meta property=\"article:modified_time\" content=\"2020-02-18T11:02:50+00:00\" \/>\n\t\t<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/prohoster\" \/>\n\t\t<meta property=\"article:author\" content=\"https:\/\/www.facebook.com\/prohoster\" \/>\n\t\t<!-- All in One SEO -->\n\n","aioseo_head_json":{"title":"\ud83e\udd47Neural Networks. Where is this all going | ProHoster","description":"The article consists of two parts: A brief overview of some network architectures for object detection in images and image segmentation with the clearest resources I found.","canonical_url":"https:\/\/prohoster.info\/en\/blog\/news\/nejroseti-kuda-eto-vse-dvizhetsya","robots":"max-image-preview:large","keywords":"","webmasterTools":{"miscellaneous":""},"schema":null,"og:locale":"en_US","og:site_name":"ProHoster | \u041a\u0443\u043f\u0438\u0442\u044c \u043d\u0430\u0434\u0435\u0436\u043d\u044b\u0439 \u0445\u043e\u0441\u0442\u0438\u043d\u0433 \u0434\u043b\u044f \u0441\u0430\u0439\u0442\u043e\u0432 \u0441 \u0437\u0430\u0449\u0438\u0442\u043e\u0439 \u043e\u0442 DDoS, VPS VDS \u0441\u0435\u0440\u0432\u0435\u0440\u044b","og:type":"article","og:title":"\ud83e\udd47\u041d\u0435\u0439\u0440\u043e\u0441\u0435\u0442\u0438. \u041a\u0443\u0434\u0430 \u044d\u0442\u043e \u0432\u0441\u0435 \u0434\u0432\u0438\u0436\u0435\u0442\u0441\u044f | ProHoster","og:description":"\u0421\u0442\u0430\u0442\u044c\u044f \u0441\u043e\u0441\u0442\u043e\u0438\u0442 \u0438\u0437 \u0434\u0432\u0443\u0445 \u0447\u0430\u0441\u0442\u0435\u0439: \u041a\u0440\u0430\u0442\u043a\u043e\u0435 \u043e\u043f\u0438\u0441\u0430\u043d\u0438\u0435 \u043d\u0435\u043a\u043e\u0442\u043e\u0440\u044b\u0445 \u0430\u0440\u0445\u0438\u0442\u0435\u043a\u0442\u0443\u0440 \u0441\u0435\u0442\u0435\u0439 \u043f\u043e \u043e\u0431\u043d\u0430\u0440\u0443\u0436\u0435\u043d\u0438\u044e \u043e\u0431\u044a\u0435\u043a\u0442\u043e\u0432 \u043d\u0430 \u0438\u0437\u043e\u0431\u0440\u0430\u0436\u0435\u043d\u0438\u0438 \u0438 \u0441\u0435\u0433\u043c\u0435\u043d\u0442\u0430\u0446\u0438\u0438 \u0438\u0437\u043e\u0431\u0440\u0430\u0436\u0435\u043d\u0438\u0439 \u0441 \u0441\u0430\u043c\u044b\u043c\u0438 \u043f\u043e\u043d\u044f\u0442\u043d\u044b\u043c\u0438 \u0434\u043b\u044f \u043c\u0435\u043d\u044f \u0441\u0441\u044b\u043b\u043a\u0430\u043c\u0438 \u043d\u0430 \u0440\u0435\u0441\u0443\u0440\u0441\u044b.","og:url":"https:\/\/prohoster.info\/en\/blog\/news\/nejroseti-kuda-eto-vse-dvizhetsya","og:image":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:secure_url":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:width":350,"og:image:height":350,"article:published_time":"2020-01-03T21:00:00+00:00","article:modified_time":"2020-02-18T11:02:50+00:00","article:publisher":"https:\/\/www.facebook.com\/prohoster","article:author":"https:\/\/www.facebook.com\/prohoster"},"aioseo_meta_data":{"post_id":"54780","title":null,"description":null,"keywords":null,"keyphrases":null,"primary_term":null,"canonical_url":null,"og_title":null,"og_description":null,"og_object_type":"default","og_image_type":"default","og_image_url":null,"og_image_width":null,"og_image_height":null,"og_image_custom_url":null,"og_image_custom_fields":null,"og_video":null,"og_custom_url":null,"og_article_section":null,"og_article_tags":null,"twitter_use_og":false,"twitter_card":"default","twitter_image_type":"default","twitter_image_url":null,"twitter_image_custom_url":null,"twitter_image_custom_fields":null,"twitter_title":null,"twitter_description":null,"schema":{"blockGraphs":[],"customGraphs":[],"default":{"data":{"Article":[],"Course":[],"Dataset":[],"FAQPage":[],"Movie":[],"Person":[],"Product":[],"ProductReview":[],"Car":[],"Recipe":[],"Service":[],"SoftwareApplication":[],"WebPage":[]},"graphName":"","isEnabled":true},"graphs":[]},"schema_type":null,"schema_type_options":null,"pillar_content":false,"robots_default":true,"robots_noindex":false,"robots_noarchive":false,"robots_nosnippet":false,"robots_nofollow":false,"robots_noimageindex":false,"robots_noodp":false,"robots_notranslate":false,"robots_max_snippet":null,"robots_max_videopreview":null,"robots_max_imagepreview":"large","priority":null,"frequency":null,"local_seo":null,"seo_analyzer_scan_date":"2026-01-24 12:43:20","breadcrumb_settings":null,"limit_modified_date":false,"reviewed_by":null,"ai":null,"created":"2021-02-28 19:57:38","updated":"2026-01-24 12:43:20","focus_keyword":null,"additional_keywords":null,"truseo_locale":null},"gt_translate_keys":[{"key":"link","format":"url"}],"_links":{"self":[{"href":"https:\/\/prohoster.info\/en\/wp-json\/wp\/v2\/posts\/54780","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/prohoster.info\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/prohoster.info\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/prohoster.info\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/prohoster.info\/en\/wp-json\/wp\/v2\/comments?post=54780"}],"version-history":[{"count":0,"href":"https:\/\/prohoster.info\/en\/wp-json\/wp\/v2\/posts\/54780\/revisions"}],"wp:attachment":[{"href":"https:\/\/prohoster.info\/en\/wp-json\/wp\/v2\/media?parent=54780"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/prohoster.info\/en\/wp-json\/wp\/v2\/categories?post=54780"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/prohoster.info\/en\/wp-json\/wp\/v2\/tags?post=54780"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}