Matou te faʻapipiʻiina le leo o le copter e faʻaaoga ai Node.js ma ARDrone

Matou te faʻapipiʻiina le leo o le copter e faʻaaoga ai Node.js ma ARDrone

I lenei aʻoaʻoga o le a tatou vaʻavaʻai i le fatuina o se polokalame mo se drone ma le leo e faʻaaoga ai le Node.js ma le Web speech API. Copter - Parrot ARDrone 2.0.

Matou te faʻamanatu atu ia te oe: mo tagata faitau uma o le "Habr" - o se faʻaitiitiga o 10 rubles pe a lesitala i soʻo se vasega Skillbox e faʻaaoga ai le code promotional "Habr".

Ua fautuaina e Skillbox: Kosi fa'ata'ita'i "Mobile Developer PRO".

Faatomuaga

Drones e ofoofogia. Ou te fiafia tele e taʻalo i laʻu quad, puʻeina ata ma vitio, pe na o le fiafia. Ae o taʻavale ea e leʻi faʻaaogaina (UAV) e faʻaaogaina mo le sili atu nai lo na o faʻafiafiaga. Latou te galulue i fale tifaga, suʻesuʻe glaciers, ma faʻaaogaina e le militeri ma sui o le vaega o faʻatoʻaga.

I lenei aʻoaʻoga o le a matou vaʻavaʻai i le fatuina o se polokalame e mafai ai ona e pulea se drone. fa'aoga leo fa'atonuga. Ioe, o le a faia e le copter le mea e te fai atu ai e fai. I le faaiuga o le tusiga o loʻo i ai se polokalame ua saunia ma le vitio o le pulea o le UAV.

Omea

Matou te manaʻomia mea nei:

  • Parrot ARDrone 2.0;
  • Uaea Ethernet;
  • microphone lelei.

O le atina'e ma le pulega o le a faia i luga o fale faigaluega ma Windows/Mac/Ubuntu. O le tagata lava ia, sa ou galue ma Mac ma Ubuntu 18.04.

Polokalame

La'u mai le lomiga lata mai o Node.js mai nofoaga aloaia.

E manaʻomia foʻi lomiga lata mai o Google Chrome.

Malamalama i le copter

Sei o tatou taumafai e malamalama pe faapefea ona galue Parrot ARDrone. O lenei copter e fa afi.

Matou te faʻapipiʻiina le leo o le copter e faʻaaoga ai Node.js ma ARDrone

O loʻo galulue faʻatasi afi i le itu lava e tasi. O le tasi paga e taamilo i le uati, o le isi paga e faafeagai. O le drone e gaoioi e ala i le suia o le maualuga o le faʻaoga e faʻatatau i luga o le fogaeleele, suia le saoasaoa o le taamilosaga o afi ma le tele o isi gaioiga faʻaogaina.

Matou te faʻapipiʻiina le leo o le copter e faʻaaoga ai Node.js ma ARDrone

E pei ona mafai ona tatou vaʻaia i le ata o loʻo i luga, o le suia o taʻiala eseese e taʻitaʻia ai se suiga i le itu o le gaioiga o le copter. Mo se faʻataʻitaʻiga, faʻaitiitia pe faʻateleina le saoasaoa o le taamilosaga o le agavale ma le taumatau rotors e fatuina ai se taʻavale. E mafai ai e le drone ona lele i luma pe tua.

E ala i le suia o le saoasaoa ma le itu o afi, matou te seti ai tulimanu faʻasaga e mafai ai e le copter ona gaoioi i isi itu. O le mea moni, mo le poloketi o loʻo i ai nei e le manaʻomia le suʻesuʻeina o le aerodynamics, e tatau ona e malamalama i mataupu faavae.

Auala e galue ai Parrot ARDrone

O le drone o le Wi-Fi hotspot. Ina ia maua ma auina atu poloaiga i le copter, e tatau ona e faʻafesoʻotaʻi i lenei tulaga. E tele talosaga eseese e mafai ai ona e pulea quadcopters. E foliga uma e pei o lenei:

Matou te faʻapipiʻiina le leo o le copter e faʻaaoga ai Node.js ma ARDrone

O le taimi lava e fesoʻotaʻi ai le drone, tatala le terminal ma le telnet 192.168.1.1 - o le IP a le copter. Mo Linux e mafai ona e faʻaogaina Linux Busybox.

Faiga fa'aoga

O la matou code o le a vaevaeina i vaega nei:

  • fa'aoga fa'aoga ma le tautala API mo le su'eina o leo;
  • fa'amamāina o fa'atonuga ma fa'atusatusa i se tulaga;
  • auina atu o poloaiga i le drone;
  • fa'asalalauga vitiō ola.

E galue le API pe'ā iai se feso'ota'iga Initaneti. Ina ia mautinoa lenei mea, matou te faʻaopoopoina se fesoʻotaʻiga Ethernet.

Ua oo i le taimi e fai ai se talosaga!

Code

Muamua, tatou faia se faila fou ma sui i ai e faʻaaoga ai le faʻamau.

Ona matou faia lea o se poloketi Node e faʻaaoga ai tulafono o loʻo i lalo.

Muamua, matou te faʻapipiʻi mea faʻalagolago e manaʻomia.

npm tāuta 

O le a matou lagolagoina tulafono nei:

  • aveese mai;
  • tulaueleele;
  • i luga - o le drone e alu aʻe i le afa mita ma faʻafefe;
  • lalo - pa'ū afa mita ma malolo;
  • agavale - alu i le afa mita i le agavale;
  • i le itu taumatau - alu i le afa mita i le taumatau;
  • taamilosaga - taamilo i le uati 90 tikeri;
  • i luma - alu i luma afa mita;
  • tua - toe foʻi i tua afa mita;
  • taofi.

O le code lea e mafai ai ona e talia poloaiga, faʻamama ma pulea le drone.

const express = require('express');
const bodyparser = require('body-parser');
var arDrone = require('ar-drone');
const router = express.Router();
const app = express();
const commands = ['takeoff', 'land','up','down','goleft','goright','turn','goforward','gobackward','stop'];
 
var drone  = arDrone.createClient();
// disable emergency
drone.disableEmergency();
// express
app.use(bodyparser.json());
app.use(express.static(__dirname + '/public'));
 
router.get('/',(req,res) => {
    res.sendFile('index.html');
});
 
router.post('/command',(req,res) => {
    console.log('command recieved ', req.body);
    console.log('existing commands', commands);
    let command = req.body.command.replace(/ /g,'');
    if(commands.indexOf(command) !== -1) {
        switch(command.toUpperCase()) {
            case "TAKEOFF":
                console.log('taking off the drone');
                drone.takeoff();
            break;
            case "LAND":
                console.log('landing the drone');
                drone.land();
            break;
            case "UP":
                console.log('taking the drone up half meter');
                drone.up(0.2);
                setTimeout(() => {
                    drone.stop();
                    clearTimeout();
                },2000);
            break;
            case "DOWN":
                console.log('taking the drone down half meter');
                drone.down(0.2);
                setTimeout(() => {
                    drone.stop();
                    clearTimeout();
                },2000);
            break;
            case "GOLEFT":
                console.log('taking the drone left 1 meter');
                drone.left(0.1);
                setTimeout(() => {
                    drone.stop();
                    clearTimeout();
                },1000);
            break;
            case "GORIGHT":
                console.log('taking the drone right 1 meter');
                drone.right(0.1);
                setTimeout(() => {
                    drone.stop();
                    clearTimeout();
                },1000);
            break;
            case "TURN":
                console.log('turning the drone');
                drone.clockwise(0.4);
                setTimeout(() => {
                    drone.stop();
                    clearTimeout();
                },2000);
            break;
            case "GOFORWARD":
                console.log('moving the drone forward by 1 meter');
                drone.front(0.1);
                setTimeout(() => {
                    drone.stop();
                    clearTimeout();
                },2000);
            break;
            case "GOBACKWARD":
                console.log('moving the drone backward 1 meter');
                drone.back(0.1);
                setTimeout(() => {
                    drone.stop();
                    clearTimeout();
                },2000);
            break;
            case "STOP":
                drone.stop();
            break;
            default:
            break;    
        }
    }
    res.send('OK');
});
 
app.use('/',router);
 
app.listen(process.env.port || 3000);

Ma o le HTML ma le JavaScript code lea e faʻalogo i le tagata faʻaoga ma auina atu se poloaiga i le Node server.

<!DOCTYPE html>
    <head>
        <meta charset="utf-8">
        <meta http-equiv="X-UA-Compatible" content="IE=edge">
        <title>Voice Controlled Notes App</title>
        <meta name="description" content="">
        <meta name="viewport" content="width=device-width, initial-scale=1">
        <link rel="stylesheet" href="https://cdnjs.cloudflare.com/ajax/libs/shoelace-css/1.0.0-beta16/shoelace.css">
        <link rel="stylesheet" href="styles.css">
 
    </head>
    <body>
        <div class="container">
 
            <h1>Voice Controlled Drone</h1>
            <p class="page-description">A tiny app that allows you to control AR drone using voice</p>
 
            <h3 class="no-browser-support">Sorry, Your Browser Doesn't Support the Web Speech API. Try Opening This Demo In Google Chrome.</h3>
 
            <div class="app">
                <h3>Give the command</h3>
                <div class="input-single">
                    <textarea id="note-textarea" placeholder="Create a new note by typing or using voice recognition." rows="6"></textarea>
                </div>    
                <button id="start-record-btn" title="Start Recording">Start Recognition</button>
                <button id="pause-record-btn" title="Pause Recording">Pause Recognition</button>
                <p id="recording-instructions">Press the <strong>Start Recognition</strong> button and allow access.</p>
 
            </div>
 
        </div>
 
        <script src="https://cdnjs.cloudflare.com/ajax/libs/jquery/3.2.1/jquery.min.js"></script>
        <script src="script.js"></script>
 
    </body>
</html>

Ma faʻapea foʻi le JavaScript code e galue ai ma le leo, auina atu i le Node server.

try {
 var SpeechRecognition = window.SpeechRecognition || window.webkitSpeechRecognition;
 var recognition = new SpeechRecognition();
 }
 catch(e) {
 console.error(e);
 $('.no-browser-support').show();
 $('.app').hide();
 }
// other code, please refer GitHub source
recognition.onresult = function(event) {
// event is a SpeechRecognitionEvent object.
// It holds all the lines we have captured so far.
 // We only need the current one.
 var current = event.resultIndex;
// Get a transcript of what was said.
var transcript = event.results[current][0].transcript;
// send it to the backend
$.ajax({
 type: 'POST',
 url: '/command/',
 data: JSON.stringify({command: transcript}),
 success: function(data) { console.log(data) },
 contentType: "application/json",
 dataType: 'json'
 });
};

Tatala le talosaga

O le polokalame e mafai ona faʻalauiloa e pei ona taua i lalo (e taua le faʻamautinoa o loʻo fesoʻotaʻi le copter i le Wi-Fi ma le Ethernet cable e fesoʻotaʻi i le komepiuta).

Tatala localhost:3000 i totonu o le suʻega ma kiliki Amata Faʻailoga.

Matou te faʻapipiʻiina le leo o le copter e faʻaaoga ai Node.js ma ARDrone

Matou te taumafai e pulea le drone ma fiafia.

Faasalalauga vitio mai se drone

I le poloketi, fai se faila fou ma kopi le code lea iina:

const http = require("http");
const drone = require("dronestream");
 
const server = http.createServer(function(req, res) {
 
require("fs").createReadStream(__dirname + "/public/video.html").pipe(res);
 });
 
drone.listen(server);
 
server.listen(4000);

Ma o le HTML code lenei, matou te tuʻuina i totonu o le faila lautele.

<!doctype html>
 <html>
 <head>
 <meta http-equiv="content-type" content="text/html; charset=utf-8">
 <title>Stream as module</title>
 <script src="/dronestream/nodecopter-client.js" type="text/javascript" charset="utf-8"></script>
 </head>
 <body>
 <h1 id="heading">Drone video stream</h1>
 <div id="droneStream" style="width: 640px; height: 360px"> </div>
 
<script type="text/javascript" charset="utf-8">
 
new NodecopterStream(document.getElementById("droneStream"));
 
</script>
 
</body>
</html>

Tatala ma faʻafesoʻotaʻi ile localhost:8080 e matamata i le vitio mai le mea pueata pito i luma.

Matou te faʻapipiʻiina le leo o le copter e faʻaaoga ai Node.js ma ARDrone

Fautuaga Fesoasoani

  • Faalele lenei drone i totonu.
  • Tuu i taimi uma le ufiufi puipui i luga o lau drone a'o le'i alu ese.
  • Siaki pe ua uma le maa.
  • Afai e ese le amio a le drone, taofi i lalo ma fuli i luga. O lenei gaioiga o le a tuʻu ai le copter i le faʻalavelave faʻafuaseʻi ma o le a taofi vave le rotors.

Sauni code ma demo

OLA DEMO

Sii mai

Ua tupu!

Tusia tulafono ma matamata i le masini e amata ona usitai o le a e maua ai le fiafia! O lea ua matou iloa le auala e aʻoaʻo ai se drone e faʻalogo i le leo o leo. O le mea moni, e tele atu avanoa: faʻaogaina foliga faʻaoga, vaʻalele tutoʻatasi, faʻaalia taga ma sili atu.

O le a se mea e mafai ona e fautuaina e faaleleia atili ai le polokalame?

Ua fautuaina e Skillbox:

puna: www.habr.com

Faaopoopo i ai se faamatalaga