{"id":36784,"date":"2019-10-31T22:13:47","date_gmt":"2019-10-31T19:13:47","guid":{"rendered":"https:\/\/prohoster.info\/blog\/opyt-ustanovki-apache-airflow-na-windows-10\/"},"modified":"2019-10-31T22:13:47","modified_gmt":"2019-10-31T19:13:47","slug":"opyt-ustanovki-apache-airflow-na-windows-10","status":"publish","type":"post","link":"https:\/\/prohoster.info\/lv\/blog\/administrirovanie\/opyt-ustanovki-apache-airflow-na-windows-10","title":{"rendered":"Pieredze Apache Airflow instal\u0113\u0161an\u0101 oper\u0113t\u0101jsist\u0113m\u0101 Windows 10.","gt_translate_keys":[{"key":"rendered","format":"text"}]},"content":{"rendered":"

Priek\u0161v\u0101rds<\/b>: liktenis apst\u0101k\u013cu d\u0113\u013c no akad\u0113misk\u0101s zin\u0101tnes (medic\u012bnas) es nok\u013cuvu inform\u0101cijas tehnolo\u0123iju pasaul\u0113, kur man j\u0101izmanto savas zin\u0101\u0161anas par eksperimenta izveides metodolo\u0123iju un eksperiment\u0101lo datu anal\u012bzes strat\u0113\u0123ij\u0101m, tom\u0113r j\u0101izmantot man nezin\u0101m\u0101 tehnolo\u0123iju steka. \u0160o tehnolo\u0123iju apguves proces\u0101 saskaros ar daudziem izaicin\u0101jumiem, kurus pagaid\u0101m, par laimi, izdodas p\u0101rvar\u0113t. Iesp\u0113jams, \u0161is ieraksts b\u016bs noder\u012bgs tiem, kas ar\u012b tikko s\u0101k darbu ar Apache projektiem. <\/p>\n

T\u0101tad, pie t\u0113mas<\/b>. Iedvesmojoties no no raksta <\/a><\/noindex> J\u016brija Emelj\u0101nova par Apache Airflow iesp\u0113j\u0101m anal\u012btisko proced\u016bru automatiz\u0101cij\u0101, es v\u0113l\u0113jos s\u0101kt izmantot pied\u0101v\u0101to bibliot\u0113ku komplektu sav\u0101 darb\u0101. Tiem, kas v\u0113l nav iepazin\u0161ies ar Apache Airflow, var\u0113tu b\u016bt interesanta neliela p\u0101rskata raksts <\/a><\/noindex> p\u0101r N. E. Baumanas Nacion\u0101l\u0101s bibliot\u0113kas m\u0101jaslapu. <\/p>\n

T\u0101 k\u0101 parast\u0101s instrukcijas, k\u0101 uzs\u0101kt Airflow, ac\u012bmredzot nav piem\u0113rojamas Windows vid\u0113, un izmantot docker <\/a><\/noindex> man\u0101 gad\u012bjum\u0101 b\u016btu p\u0101rlieku sare\u017e\u0123\u012bti, es s\u0101ku mekl\u0113t citas risin\u0101jumus. Par laimi, es nebiju pirm\u0101 \u0161aj\u0101 ce\u013c\u0101, t\u0101p\u0113c man izdev\u0101s atrast lielisku video instrukciju<\/a><\/noindex> par Apache Airflow instal\u0113\u0161anu Windows 10 bez docker izmanto\u0161anas. Bet, k\u0101 tas bie\u017ei notiek, veicot ieteiktos so\u013cus, rodas gr\u016bt\u012bbas, un uzskatu, ka ne tikai man. T\u0101p\u0113c es grib\u0113tu past\u0101st\u012bt par savu pieredzi Apache Airflow instal\u0113\u0161an\u0101, iesp\u0113jams, tas k\u0101dam ietaup\u012bs nedaudz laika.
\n<\/a><\/noindex>
\nP\u0101riesim pie instrukcijas so\u013ciem (snieg\u0161u spoileri - 5. sol\u012b viss norit\u0113ja lieliski):<\/p>\n

1. Windows subsist\u0113mas instal\u0113\u0161ana Linux, lai v\u0113l\u0101k uzst\u0101d\u012btu Linux izplat\u012bjumus<\/b><\/p>\n

T\u0101 ir maz\u0101ka probl\u0113ma, k\u0101 saka: <\/p>\n

Vad\u012bbas panelis \u2192 Programmas \u2192 Programmas un funkcijas \u2192 Windows komponentu iesl\u0113g\u0161ana un izsl\u0113g\u0161ana \u2192 Windows subsist\u0113ma Linux<\/p>\n

2. Izv\u0113l\u0113t\u0101 Linux izplat\u012bjuma uzst\u0101d\u012b\u0161ana<\/b><\/p>\n

Es izmantoju lietotni Ubuntu<\/a><\/noindex>.<\/p>\n

3. Pip uzst\u0101d\u012b\u0161ana un atjaunin\u0101\u0161ana <\/b><\/p>\n

sudo apt-get install software-properties-common\nsudo apt-add-repository universe\nsudo apt-get update\nsudo apt-get install python-pip<\/code><\/pre>\n
\n4. Apache Airflow uzst\u0101d\u012b\u0161ana<\/b><\/p>\n
export SLUGIFY_USES_TEXT_UNIDECODE=yes\npip install apache-airflow<\/code><\/pre>\n
\n5. Datub\u0101zes inicializ\u0101cija<\/b><\/p>\n
Un tie\u0161i \u0161eit s\u0101k\u0101s manas neliel\u0101s gr\u016bt\u012bbas. Instrukcija prasa ievad\u012bt komandu airflow initdb<\/code> un p\u0101riet uz n\u0101kamo soli. Tom\u0113r es nemit\u012bgi sa\u0146\u0113mu atbildi airflow: command not found<\/code>. Ir ir lo\u0123iski pie\u0146emt, ka rad\u0101s gr\u016bt\u012bbas, instal\u0113jot Apache Airflow, un vienk\u0101r\u0161i nav vajadz\u012bgo failu. P\u0101rbaud\u012bjusi, ka viss ir tur, kur tam j\u0101b\u016bt, nol\u0113mu izm\u0113\u0123in\u0101t nor\u0101d\u012bt pilnu ce\u013cu uz airflow failu (tam b\u016btu j\u0101izskat\u0101s \u0161\u0101di: Pilns\/ce\u013c\u0161\/uz\/failu\/airflow initdb<\/code>). Bet br\u012bnums nenotika, un atbilde bija t\u0101da pati airflow: command not found<\/code>. Izm\u0113\u0123in\u0101ju izmantot relat\u012bvo ce\u013cu uz failu (.\/.local\/bin\/airflow initdb<\/code>), kas noveda pie jaunas k\u013c\u016bdas ModuleNotFoundError: No module named json'<\/code>, ko var apiet, atjauninot bibliot\u0113ku werkzeug<\/i> (man\u0101 gad\u012bjum\u0101 l\u012bdz versijai 0.15.4):<\/p>\n
pip install werkzeug==0.15.4<\/code><\/pre>\n
\nVair\u0101k par werkzeug var izlas\u012bt \u0161eit<\/a><\/noindex>. <\/p>\n
P\u0113c \u0161\u012bs vienk\u0101r\u0161\u0101s manipul\u0101cijas komanda .\/.local\/bin\/airflow initdb<\/code> tika veikta veiksm\u012bgi. <\/p>\n
6. Airflow servera palai\u0161ana<\/b><\/p>\n
\u0160aj\u0101 br\u012bd\u012b gr\u016bt\u012bbas ar piek\u013cuvi airflow v\u0113l nav beigu\u0161\u0101s. Komandas palai\u0161ana .\/.local\/bin\/airflow webserver -p 8080<\/code> noveda pie k\u013c\u016bdas Nav t\u0101da faila vai direktorijas<\/code>. Iesp\u0113jams, pieredz\u0113jis Ubuntu lietot\u0101js b\u016btu uzreiz m\u0113\u0123in\u0101jis p\u0101rvar\u0113t \u0161\u0101das gr\u016bt\u012bbas ar piek\u013cuvi failam, izmantojot komandu export PATH=$PATH:~\/.local\/bin\/<\/code> (citiem v\u0101rdiem sakot, pievienojot eso\u0161ajam izpild\u0101mo failu mekl\u0113\u0161anas ce\u013cam, ko nosaka PATH main\u012bgais, katalogu \/.local\/bin\/), bet \u0161is ieraksts ir paredz\u0113ts tiem, kas galvenok\u0101rt str\u0101d\u0101 ar Windows un, iesp\u0113jams, neuzskata \u0161\u0101du risin\u0101jumu par ac\u012bmredzamu. <\/p>\n
P\u0113c iepriek\u0161 aprakst\u012bt\u0101s manipul\u0101cijas komanda .\/.local\/bin\/airflow webserver -p 8080<\/code> tika veiksm\u012bgi izpild\u012bta.<\/p>\n
7. URL: localhost<\/noindex>:8080\/<\/b><\/p>\n
Ja iepriek\u0161\u0113jie so\u013ci norit\u0113ja veiksm\u012bgi, tad esat gatavs iekarot anal\u012btikas virsotnes.<\/p>\n
Ceru, ka iepriek\u0161 aprakst\u012btais Apache Airflow instal\u0113\u0161anas pieredze Windows 10 b\u016bs noder\u012bga ies\u0101c\u0113jiem un pa\u0101trin\u0101s vi\u0146u ieie\u0161anu modernu anal\u012btikas r\u012bku pasaul\u0113. <\/p>\n
N\u0101kamaj\u0101 reiz\u0113 v\u0113l\u0113tos turpin\u0101t t\u0113mu un past\u0101st\u012bt par pieredzi, izmantojot Apache Airflow lietot\u0101ju uzved\u012bbas anal\u012bz\u0113 mobilo lietot\u0146u jom\u0101.
\n
Avots: habr.com<\/a><\/p>","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"excerpt":{"rendered":"
\u041f\u0440\u0435\u0430\u043c\u0431\u0443\u043b\u0430: \u0432\u043e\u043b\u0435\u044e \u0441\u0443\u0434\u044c\u0431\u044b \u0438\u0437 \u043c\u0438\u0440\u0430 \u0430\u043a\u0430\u0434\u0435\u043c\u0438\u0447\u0435\u0441\u043a\u043e\u0439 \u043d\u0430\u0443\u043a\u0438 (\u043c\u0435\u0434\u0438\u0446\u0438\u043d\u044b) \u044f \u043f\u043e\u043f\u0430\u043b\u0430 \u0432 \u043c\u0438\u0440 \u0438\u043d\u0444\u043e\u0440\u043c\u0430\u0446\u0438\u043e\u043d\u043d\u044b\u0445 \u0442\u0435\u0445\u043d\u043e\u043b\u043e\u0433\u0438\u0439, \u0433\u0434\u0435 \u043c\u043d\u0435 \u043f\u0440\u0438\u0445\u043e\u0434\u0438\u0442\u0441\u044f \u0438\u0441\u043f\u043e\u043b\u044c\u0437\u043e\u0432\u0430\u0442\u044c \u0441\u0432\u043e\u0438 \u0437\u043d\u0430\u043d\u0438\u044f \u043e \u043c\u0435\u0442\u043e\u0434\u043e\u043b\u043e\u0433\u0438\u0438 \u043f\u043e\u0441\u0442\u0440\u043e\u0435\u043d\u0438\u044f \u044d\u043a\u0441\u043f\u0435\u0440\u0438\u043c\u0435\u043d\u0442\u0430 \u0438 \u0441\u0442\u0440\u0430\u0442\u0435\u0433\u0438\u044f\u0445 \u0430\u043d\u0430\u043b\u0438\u0437\u0430 \u044d\u043a\u0441\u043f\u0435\u0440\u0438\u043c\u0435\u043d\u0442\u0430\u043b\u044c\u043d\u044b\u0445 \u0434\u0430\u043d\u043d\u044b\u0445, \u043e\u0434\u043d\u0430\u043a\u043e, \u043f\u0440\u0438\u043c\u0435\u043d\u044f\u0442\u044c \u043d\u043e\u0432\u044b\u0439 \u0434\u043b\u044f \u043c\u0435\u043d\u044f \u0441\u0442\u0435\u043a \u0442\u0435\u0445\u043d\u043e\u043b\u043e\u0433\u0438\u0439. \u0412 \u043f\u0440\u043e\u0446\u0435\u0441\u0441\u0435 \u043e\u0441\u0432\u043e\u0435\u043d\u0438\u044f \u044d\u0442\u0438\u0445 \u0442\u0435\u0445\u043d\u043e\u043b\u043e\u0433\u0438\u0439 \u044f \u0441\u0442\u0430\u043b\u043a\u0438\u0432\u0430\u044e\u0441\u044c \u0441 \u0440\u044f\u0434\u043e\u043c \u0442\u0440\u0443\u0434\u043d\u043e\u0441\u0442\u0435\u0439, \u043a\u043e\u0442\u043e\u0440\u044b\u0435 \u043f\u043e\u043a\u0430, \u043a \u0441\u0447\u0430\u0441\u0442\u044c\u044e, \u0443\u0434\u0430\u0435\u0442\u0441\u044f \u043f\u0440\u0435\u043e\u0434\u043e\u043b\u0435\u0432\u0430\u0442\u044c. \u0412\u043e\u0437\u043c\u043e\u0436\u043d\u043e, \u044d\u0442\u043e\u0442 \u043f\u043e\u0441\u0442 […]<\/p>\n","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[688],"tags":[],"class_list":["post-36784","post","type-post","status-publish","format-standard","hentry","category-administrirovanie"],"aioseo_notices":[],"aioseo_head":"\n\t\t\n\t\n\t\n\t\n\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\n","aioseo_head_json":{"title":"\ud83e\udd47Apache Airflow instal\u0113\u0161anas pieredze Windows 10 | ProHoster","description":"Preambula: liktenis mani no akad\u0113misk\u0101s zin\u0101tnes pasaules (medic\u012bnas) ievilka inform\u0101cijas tehnolo\u0123iju pasaul\u0113, kur man ir j\u0101izmanto savas zin\u0101\u0161anas par eksperimenta veido\u0161anas metodolo\u0123iju un anal\u012bzes strat\u0113\u0123ij\u0101m.","canonical_url":"https:\/\/prohoster.info\/lv\/blog\/administrirovanie\/opyt-ustanovki-apache-airflow-na-windows-10","robots":"max-image-preview:large","keywords":"","webmasterTools":{"miscellaneous":""},"schema":null,"og:locale":"lv_LV","og:site_name":"ProHoster | \u041a\u0443\u043f\u0438\u0442\u044c \u043d\u0430\u0434\u0435\u0436\u043d\u044b\u0439 \u0445\u043e\u0441\u0442\u0438\u043d\u0433 \u0434\u043b\u044f \u0441\u0430\u0439\u0442\u043e\u0432 \u0441 \u0437\u0430\u0449\u0438\u0442\u043e\u0439 \u043e\u0442 DDoS, VPS VDS \u0441\u0435\u0440\u0432\u0435\u0440\u044b","og:type":"article","og:title":"\ud83e\udd47\u041e\u043f\u044b\u0442 \u0443\u0441\u0442\u0430\u043d\u043e\u0432\u043a\u0438 Apache Airflow \u043d\u0430 Windows 10 | ProHoster","og:description":"\u041f\u0440\u0435\u0430\u043c\u0431\u0443\u043b\u0430: \u0432\u043e\u043b\u0435\u044e \u0441\u0443\u0434\u044c\u0431\u044b \u0438\u0437 \u043c\u0438\u0440\u0430 \u0430\u043a\u0430\u0434\u0435\u043c\u0438\u0447\u0435\u0441\u043a\u043e\u0439 \u043d\u0430\u0443\u043a\u0438 (\u043c\u0435\u0434\u0438\u0446\u0438\u043d\u044b) \u044f \u043f\u043e\u043f\u0430\u043b\u0430 \u0432 \u043c\u0438\u0440 \u0438\u043d\u0444\u043e\u0440\u043c\u0430\u0446\u0438\u043e\u043d\u043d\u044b\u0445 \u0442\u0435\u0445\u043d\u043e\u043b\u043e\u0433\u0438\u0439, \u0433\u0434\u0435 \u043c\u043d\u0435 \u043f\u0440\u0438\u0445\u043e\u0434\u0438\u0442\u0441\u044f \u0438\u0441\u043f\u043e\u043b\u044c\u0437\u043e\u0432\u0430\u0442\u044c \u0441\u0432\u043e\u0438 \u0437\u043d\u0430\u043d\u0438\u044f \u043e \u043c\u0435\u0442\u043e\u0434\u043e\u043b\u043e\u0433\u0438\u0438 \u043f\u043e\u0441\u0442\u0440\u043e\u0435\u043d\u0438\u044f \u044d\u043a\u0441\u043f\u0435\u0440\u0438\u043c\u0435\u043d\u0442\u0430 \u0438 \u0441\u0442\u0440\u0430\u0442\u0435\u0433\u0438\u044f\u0445 \u0430\u043d\u0430\u043b\u0438\u0437\u0430.","og:url":"https:\/\/prohoster.info\/lv\/blog\/administrirovanie\/opyt-ustanovki-apache-airflow-na-windows-10","og:image":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:secure_url":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:width":350,"og:image:height":350,"article:published_time":"2019-10-31T19:13:47+00:00","article:modified_time":"2019-10-31T19:13:47+00:00","article:publisher":"https:\/\/www.facebook.com\/prohoster","article:author":"https:\/\/www.facebook.com\/prohoster"},"aioseo_meta_data":{"post_id":"36784","title":null,"description":null,"keywords":null,"keyphrases":null,"primary_term":null,"canonical_url":null,"og_title":null,"og_description":null,"og_object_type":"default","og_image_type":"default","og_image_url":null,"og_image_width":null,"og_image_height":null,"og_image_custom_url":null,"og_image_custom_fields":null,"og_video":null,"og_custom_url":null,"og_article_section":null,"og_article_tags":null,"twitter_use_og":false,"twitter_card":"default","twitter_image_type":"default","twitter_image_url":null,"twitter_image_custom_url":null,"twitter_image_custom_fields":null,"twitter_title":null,"twitter_description":null,"schema":{"blockGraphs":[],"customGraphs":[],"default":{"data":{"Article":[],"Course":[],"Dataset":[],"FAQPage":[],"Movie":[],"Person":[],"Product":[],"ProductReview":[],"Car":[],"Recipe":[],"Service":[],"SoftwareApplication":[],"WebPage":[]},"graphName":"","isEnabled":true},"graphs":[]},"schema_type":null,"schema_type_options":null,"pillar_content":false,"robots_default":true,"robots_noindex":false,"robots_noarchive":false,"robots_nosnippet":false,"robots_nofollow":false,"robots_noimageindex":false,"robots_noodp":false,"robots_notranslate":false,"robots_max_snippet":null,"robots_max_videopreview":null,"robots_max_imagepreview":"large","priority":null,"frequency":null,"local_seo":null,"seo_analyzer_scan_date":"2026-01-22 04:50:19","breadcrumb_settings":null,"limit_modified_date":false,"reviewed_by":null,"ai":null,"created":"2021-03-01 01:39:22","updated":"2026-01-22 04:50:19","focus_keyword":null,"additional_keywords":null,"truseo_locale":null},"gt_translate_keys":[{"key":"link","format":"url"}],"_links":{"self":[{"href":"https:\/\/prohoster.info\/lv\/wp-json\/wp\/v2\/posts\/36784","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/prohoster.info\/lv\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/prohoster.info\/lv\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/prohoster.info\/lv\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/prohoster.info\/lv\/wp-json\/wp\/v2\/comments?post=36784"}],"version-history":[{"count":0,"href":"https:\/\/prohoster.info\/lv\/wp-json\/wp\/v2\/posts\/36784\/revisions"}],"wp:attachment":[{"href":"https:\/\/prohoster.info\/lv\/wp-json\/wp\/v2\/media?parent=36784"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/prohoster.info\/lv\/wp-json\/wp\/v2\/categories?post=36784"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/prohoster.info\/lv\/wp-json\/wp\/v2\/tags?post=36784"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}