{"id":36784,"date":"2019-10-31T22:13:47","date_gmt":"2019-10-31T19:13:47","guid":{"rendered":"https:\/\/prohoster.info\/blog\/opyt-ustanovki-apache-airflow-na-windows-10\/"},"modified":"2019-10-31T22:13:47","modified_gmt":"2019-10-31T19:13:47","slug":"opyt-ustanovki-apache-airflow-na-windows-10","status":"publish","type":"post","link":"https:\/\/prohoster.info\/hu\/blog\/administrirovanie\/opyt-ustanovki-apache-airflow-na-windows-10","title":{"rendered":"Apache Airflow telep\u00edt\u00e9si tapasztalat Windows 10-en","gt_translate_keys":[{"key":"rendered","format":"text"}]},"content":{"rendered":"

El\u0151sz\u00f3<\/b>: a sorsford\u00edt\u00e1sa r\u00e9v\u00e9n az akad\u00e9miai tudom\u00e1ny (orvostudom\u00e1ny) vil\u00e1g\u00e1b\u00f3l az informatikai vil\u00e1gba ker\u00fcltem, ahol a k\u00eds\u00e9rleti tervez\u00e9s m\u00f3dszertan\u00e1val \u00e9s a k\u00eds\u00e9rleti adatok elemz\u00e9s\u00e9nek strat\u00e9gi\u00e1ival kapcsolatos ismereteimet kell haszn\u00e1lnom, ugyanakkor egy \u00faj technol\u00f3giai stacket kell alkalmaznom. Ezeknek a technol\u00f3gi\u00e1knak a megismer\u00e9se sor\u00e1n sz\u00e1mos neh\u00e9zs\u00e9ggel tal\u00e1lkozom, amelyeket egyel\u0151re, h\u00e1la istennek, siker\u00fcl lek\u00fczdenem. Lehet, hogy ez a poszt hasznos lesz azok sz\u00e1m\u00e1ra, akik szint\u00e9n most kezdik az Apache projektek vil\u00e1g\u00e1t. <\/p>\n

Most pedig a l\u00e9nyegre t\u00e9rve<\/b>. Inspir\u00e1lva cikket <\/a><\/noindex> Juri Jemeljanov Apache Airflow lehet\u0151s\u00e9geir\u0151l a analitikai folyamatok automatiz\u00e1l\u00e1s\u00e1ban, szerettem volna elkezdeni a javasolt k\u00f6nyvt\u00e1rak haszn\u00e1lat\u00e1t a munk\u00e1mban. Azok sz\u00e1m\u00e1ra, akik m\u00e9g nem ismerik az Apache Airflow-t, \u00e9rdekes lehet egy r\u00f6vid \u00e1ttekint\u0151 cikk <\/a><\/noindex> a N. E. Baumann Nemzeti K\u00f6nyvt\u00e1ra weboldal\u00e1n. <\/p>\n

Mivel a szok\u00e1sos utas\u00edt\u00e1sok airfow elind\u00edt\u00e1s\u00e1ra \u00fagy t\u0171nik, hogy nem alkalmazhat\u00f3k Windows k\u00f6rnyezetben, \u00e9s az adott feladat megold\u00e1s\u00e1hoz docker <\/a><\/noindex> az \u00e9n esetemben t\u00falz\u00e1s lett volna, m\u00e1s megold\u00e1sokat kezdtem keresni. Szerencs\u00e9re nem \u00e9n voltam az els\u0151 ezen az \u00faton, \u00edgy siker\u00fclt tal\u00e1lnom egy csod\u00e1latos vide\u00f3 utas\u00edt\u00e1st<\/a><\/noindex> az Apache Airflow Windows 10 alatti telep\u00edt\u00e9s\u00e9r\u0151l docker haszn\u00e1lata n\u00e9lk\u00fcl. De, mint gyakran lenni szokott, a javasolt l\u00e9p\u00e9sek v\u00e9grehajt\u00e1sa sor\u00e1n neh\u00e9zs\u00e9gek mer\u00fcltek fel, \u00e9s \u00fagy gondolom, nem csak n\u00e1lam. Ez\u00e9rt szeretn\u00e9m megosztani az Apache Airflow telep\u00edt\u00e9si tapasztalataimat, h\u00e1tha valamelyik\u0151t\u00f6knek ez id\u0151t takar\u00edt meg.
\n<\/a><\/noindex>
\nN\u00e9zz\u00fck meg az utas\u00edt\u00e1s l\u00e9p\u00e9seit (spoiler \u2014 az 5. l\u00e9p\u00e9sig minden rendben ment):<\/p>\n

1. A Windows Linux-alrendszer telep\u00edt\u00e9se a Linux disztrib\u00faci\u00f3k k\u00e9s\u0151bbi telep\u00edt\u00e9s\u00e9hez<\/b><\/p>\n

Ez a legkisebb probl\u00e9ma, ahogy mondani szokt\u00e1k: <\/p>\n

Vez\u00e9rl\u0151pult \u2192 Programok \u2192 Programok \u00e9s szolg\u00e1ltat\u00e1sok \u2192 Windows-szolg\u00e1ltat\u00e1sok bekapcsol\u00e1sa \u00e9s kikapcsol\u00e1sa \u2192 Windows Linux-alrendszer<\/p>\n

2. A kiv\u00e1lasztott Linux disztrib\u00faci\u00f3 telep\u00edt\u00e9se<\/b><\/p>\n

\u00c9n a k\u00f6vetkez\u0151 alkalmaz\u00e1st haszn\u00e1ltam Ubuntu<\/a><\/noindex>.<\/p>\n

3. pip telep\u00edt\u00e9se \u00e9s friss\u00edt\u00e9se <\/b><\/p>\n

sudo apt-get install software-properties-common\nsudo apt-add-repository universe\nsudo apt-get update\nsudo apt-get install python-pip<\/code><\/pre>\n
\n4. Apache Airflow telep\u00edt\u00e9se<\/b><\/p>\n
export SLUGIFY_USES_TEXT_UNIDECODE=yes\npip install apache-airflow<\/code><\/pre>\n
\n5. Az adatb\u00e1zis inicializ\u00e1l\u00e1sa<\/b><\/p>\n
Itt kezd\u0151dtek a kis neh\u00e9zs\u00e9geim. Az utas\u00edt\u00e1s azt \u00edrja el\u0151, hogy be kell vezetni a parancsot airflow initdb<\/code> majd l\u00e9pj\u00fcnk a k\u00f6vetkez\u0151 l\u00e9p\u00e9shez. Azonban \u00e9n mindv\u00e9gig azt a v\u00e1laszt kaptam, hogy airflow: parancs nem tal\u00e1lhat\u00f3<\/code>Logikus felt\u00e9telezni, hogy probl\u00e9m\u00e1k mer\u00fcltek fel az Apache Airflow telep\u00edt\u00e9se sor\u00e1n, \u00e9s egyszer\u0171en nincsenek a sz\u00fcks\u00e9ges f\u00e1jlok. Miut\u00e1n megbizonyosodtam arr\u00f3l, hogy minden a hely\u00e9n van, \u00fagy d\u00f6nt\u00f6ttem, hogy megpr\u00f3b\u00e1lom megadni a f\u00e1jl, az airflow teljes el\u00e9r\u00e9si \u00fatj\u00e1t (ilyennek kell lennie: Teljes\/p\u00e1lya\/az\/f\u00e1jlhoz\/airflow initdb<\/code>). De csoda nem t\u00f6rt\u00e9nt, \u00e9s a v\u00e1lasz ugyanaz volt. airflow: parancs nem tal\u00e1lhat\u00f3<\/code>Megpr\u00f3b\u00e1ltam haszn\u00e1lni a f\u00e1jl relat\u00edv el\u00e9r\u00e9si \u00fatj\u00e1t (.\/.local\/bin\/airflow initdb<\/code>), ami egy \u00faj hiba megjelen\u00e9s\u00e9t eredm\u00e9nyezte. ModuleNotFoundError: No module named json'<\/code>, amelyet \u00e1t lehet hidalni a k\u00f6nyvt\u00e1r friss\u00edt\u00e9s\u00e9vel. werkzeug<\/i> (az \u00e9n esetemben 0.15.4 verzi\u00f3ra):<\/p>\n
pip install werkzeug==0.15.4<\/code><\/pre>\n
\nTov\u00e1bbi inform\u00e1ci\u00f3t a werkzegr\u0151l olvashatsz. itt<\/a><\/noindex>. <\/p>\n
Ezek ut\u00e1n a egyszer\u0171 m\u0171velet ut\u00e1n a parancs .\/.local\/bin\/airflow initdb<\/code> sikeresen v\u00e9grehajt\u00f3dott. <\/p>\n
6. Az Airflow szerver ind\u00edt\u00e1sa<\/b><\/p>\n
Ezzel m\u00e9g nem \u00e9rtek v\u00e9get az Airflow haszn\u00e1lat\u00e1val kapcsolatos neh\u00e9zs\u00e9gek. A parancs ind\u00edt\u00e1sa .\/.local\/bin\/airflow webserver -p 8080<\/code> hib\u00e1t okozott, No such file or directory<\/code>. Val\u00f3sz\u00edn\u0171leg egy tapasztalt Ubuntu felhaszn\u00e1l\u00f3 azonnal megpr\u00f3b\u00e1lta volna megoldani ezeket a f\u00e1jlhozz\u00e1f\u00e9r\u00e9si probl\u00e9m\u00e1kat azzal, hogy alkalmazza a parancsot, export PATH=$PATH:~\/.local\/bin\/<\/code> (azaz hozz\u00e1tette a PATH v\u00e1ltoz\u00f3 \u00e1ltal defini\u00e1lt v\u00e9grehajthat\u00f3 f\u00e1jlok keres\u00e9si \u00fatj\u00e1hoz a \/.local\/bin\/ k\u00f6nyvt\u00e1rat), de ez a poszt azok sz\u00e1m\u00e1ra k\u00e9sz\u00fclt, akik f\u0151k\u00e9nt Windows rendszerrel dolgoznak, \u00e9s esetleg nem tartj\u00e1k nyilv\u00e1nval\u00f3nak ezt a megold\u00e1st. <\/p>\n
A fent eml\u00edtett m\u0171velet v\u00e9grehajt\u00e1sa ut\u00e1n a parancs .\/.local\/bin\/airflow webserver -p 8080<\/code> sikeresen v\u00e9grehajt\u00f3dott.<\/p>\n
7. URL: localhost<\/noindex>:8080\/<\/b><\/p>\n
Ha a kor\u00e1bbi l\u00e9p\u00e9sek sikeresen zajlottak, k\u00e9szen \u00e1llsz, hogy megh\u00f3d\u00edtsd az analitikai cs\u00facsokat.<\/p>\n
Rem\u00e9lem, hogy a fenti tapasztalat az Apache Airflow Windows 10-en val\u00f3 telep\u00edt\u00e9s\u00e9r\u0151l hasznos lesz a kezd\u0151 felhaszn\u00e1l\u00f3k sz\u00e1m\u00e1ra, \u00e9s felgyors\u00edtja bel\u00e9p\u00e9s\u00fcket a modern analitikai eszk\u00f6z\u00f6k univerzum\u00e9ba. <\/p>\n
A k\u00f6vetkez\u0151 alkalommal szeretn\u00e9m folytatni a t\u00e9m\u00e1t, \u00e9s besz\u00e9lni az Apache Airflow haszn\u00e1lat\u00e1nak tapasztalatair\u00f3l a mobilalkalmaz\u00e1sok felhaszn\u00e1l\u00f3i viselked\u00e9s\u00e9nek elemz\u00e9se ter\u00e9n.
\n
Forr\u00e1s: habr.com<\/a><\/p>","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"excerpt":{"rendered":"
\u041f\u0440\u0435\u0430\u043c\u0431\u0443\u043b\u0430: \u0432\u043e\u043b\u0435\u044e \u0441\u0443\u0434\u044c\u0431\u044b \u0438\u0437 \u043c\u0438\u0440\u0430 \u0430\u043a\u0430\u0434\u0435\u043c\u0438\u0447\u0435\u0441\u043a\u043e\u0439 \u043d\u0430\u0443\u043a\u0438 (\u043c\u0435\u0434\u0438\u0446\u0438\u043d\u044b) \u044f \u043f\u043e\u043f\u0430\u043b\u0430 \u0432 \u043c\u0438\u0440 \u0438\u043d\u0444\u043e\u0440\u043c\u0430\u0446\u0438\u043e\u043d\u043d\u044b\u0445 \u0442\u0435\u0445\u043d\u043e\u043b\u043e\u0433\u0438\u0439, \u0433\u0434\u0435 \u043c\u043d\u0435 \u043f\u0440\u0438\u0445\u043e\u0434\u0438\u0442\u0441\u044f \u0438\u0441\u043f\u043e\u043b\u044c\u0437\u043e\u0432\u0430\u0442\u044c \u0441\u0432\u043e\u0438 \u0437\u043d\u0430\u043d\u0438\u044f \u043e \u043c\u0435\u0442\u043e\u0434\u043e\u043b\u043e\u0433\u0438\u0438 \u043f\u043e\u0441\u0442\u0440\u043e\u0435\u043d\u0438\u044f \u044d\u043a\u0441\u043f\u0435\u0440\u0438\u043c\u0435\u043d\u0442\u0430 \u0438 \u0441\u0442\u0440\u0430\u0442\u0435\u0433\u0438\u044f\u0445 \u0430\u043d\u0430\u043b\u0438\u0437\u0430 \u044d\u043a\u0441\u043f\u0435\u0440\u0438\u043c\u0435\u043d\u0442\u0430\u043b\u044c\u043d\u044b\u0445 \u0434\u0430\u043d\u043d\u044b\u0445, \u043e\u0434\u043d\u0430\u043a\u043e, \u043f\u0440\u0438\u043c\u0435\u043d\u044f\u0442\u044c \u043d\u043e\u0432\u044b\u0439 \u0434\u043b\u044f \u043c\u0435\u043d\u044f \u0441\u0442\u0435\u043a \u0442\u0435\u0445\u043d\u043e\u043b\u043e\u0433\u0438\u0439. \u0412 \u043f\u0440\u043e\u0446\u0435\u0441\u0441\u0435 \u043e\u0441\u0432\u043e\u0435\u043d\u0438\u044f \u044d\u0442\u0438\u0445 \u0442\u0435\u0445\u043d\u043e\u043b\u043e\u0433\u0438\u0439 \u044f \u0441\u0442\u0430\u043b\u043a\u0438\u0432\u0430\u044e\u0441\u044c \u0441 \u0440\u044f\u0434\u043e\u043c \u0442\u0440\u0443\u0434\u043d\u043e\u0441\u0442\u0435\u0439, \u043a\u043e\u0442\u043e\u0440\u044b\u0435 \u043f\u043e\u043a\u0430, \u043a \u0441\u0447\u0430\u0441\u0442\u044c\u044e, \u0443\u0434\u0430\u0435\u0442\u0441\u044f \u043f\u0440\u0435\u043e\u0434\u043e\u043b\u0435\u0432\u0430\u0442\u044c. \u0412\u043e\u0437\u043c\u043e\u0436\u043d\u043e, \u044d\u0442\u043e\u0442 \u043f\u043e\u0441\u0442 […]<\/p>\n","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[688],"tags":[],"class_list":["post-36784","post","type-post","status-publish","format-standard","hentry","category-administrirovanie"],"aioseo_notices":[],"aioseo_head":"\n\t\t\n\t\n\t\n\t\n\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\n","aioseo_head_json":{"title":"\ud83e\udd47Az Apache Airflow telep\u00edt\u00e9si tapasztalata Windows 10-en | ProHoster","description":"El\u0151sz\u00f3: a sors fintora folyt\u00e1n az akad\u00e9miai tudom\u00e1ny (orvostudom\u00e1ny) vil\u00e1g\u00e1b\u00f3l az inform\u00e1ci\u00f3s technol\u00f3gia vil\u00e1g\u00e1ba ker\u00fcltem, ahol fel kell haszn\u00e1lnom a k\u00eds\u00e9rlet fel\u00e9p\u00edt\u00e9s\u00e9r\u0151l \u00e9s elemz\u00e9si strat\u00e9gi\u00e1kr\u00f3l szerzett tud\u00e1somat.","canonical_url":"https:\/\/prohoster.info\/hu\/blog\/administrirovanie\/opyt-ustanovki-apache-airflow-na-windows-10","robots":"max-image-preview:large","keywords":"","webmasterTools":{"miscellaneous":""},"schema":null,"og:locale":"hu_HU","og:site_name":"ProHoster | \u041a\u0443\u043f\u0438\u0442\u044c \u043d\u0430\u0434\u0435\u0436\u043d\u044b\u0439 \u0445\u043e\u0441\u0442\u0438\u043d\u0433 \u0434\u043b\u044f \u0441\u0430\u0439\u0442\u043e\u0432 \u0441 \u0437\u0430\u0449\u0438\u0442\u043e\u0439 \u043e\u0442 DDoS, VPS VDS \u0441\u0435\u0440\u0432\u0435\u0440\u044b","og:type":"article","og:title":"\ud83e\udd47\u041e\u043f\u044b\u0442 \u0443\u0441\u0442\u0430\u043d\u043e\u0432\u043a\u0438 Apache Airflow \u043d\u0430 Windows 10 | ProHoster","og:description":"\u041f\u0440\u0435\u0430\u043c\u0431\u0443\u043b\u0430: \u0432\u043e\u043b\u0435\u044e \u0441\u0443\u0434\u044c\u0431\u044b \u0438\u0437 \u043c\u0438\u0440\u0430 \u0430\u043a\u0430\u0434\u0435\u043c\u0438\u0447\u0435\u0441\u043a\u043e\u0439 \u043d\u0430\u0443\u043a\u0438 (\u043c\u0435\u0434\u0438\u0446\u0438\u043d\u044b) \u044f \u043f\u043e\u043f\u0430\u043b\u0430 \u0432 \u043c\u0438\u0440 \u0438\u043d\u0444\u043e\u0440\u043c\u0430\u0446\u0438\u043e\u043d\u043d\u044b\u0445 \u0442\u0435\u0445\u043d\u043e\u043b\u043e\u0433\u0438\u0439, \u0433\u0434\u0435 \u043c\u043d\u0435 \u043f\u0440\u0438\u0445\u043e\u0434\u0438\u0442\u0441\u044f \u0438\u0441\u043f\u043e\u043b\u044c\u0437\u043e\u0432\u0430\u0442\u044c \u0441\u0432\u043e\u0438 \u0437\u043d\u0430\u043d\u0438\u044f \u043e \u043c\u0435\u0442\u043e\u0434\u043e\u043b\u043e\u0433\u0438\u0438 \u043f\u043e\u0441\u0442\u0440\u043e\u0435\u043d\u0438\u044f \u044d\u043a\u0441\u043f\u0435\u0440\u0438\u043c\u0435\u043d\u0442\u0430 \u0438 \u0441\u0442\u0440\u0430\u0442\u0435\u0433\u0438\u044f\u0445 \u0430\u043d\u0430\u043b\u0438\u0437\u0430.","og:url":"https:\/\/prohoster.info\/hu\/blog\/administrirovanie\/opyt-ustanovki-apache-airflow-na-windows-10","og:image":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:secure_url":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:width":350,"og:image:height":350,"article:published_time":"2019-10-31T19:13:47+00:00","article:modified_time":"2019-10-31T19:13:47+00:00","article:publisher":"https:\/\/www.facebook.com\/prohoster","article:author":"https:\/\/www.facebook.com\/prohoster"},"aioseo_meta_data":{"post_id":"36784","title":null,"description":null,"keywords":null,"keyphrases":null,"primary_term":null,"canonical_url":null,"og_title":null,"og_description":null,"og_object_type":"default","og_image_type":"default","og_image_url":null,"og_image_width":null,"og_image_height":null,"og_image_custom_url":null,"og_image_custom_fields":null,"og_video":null,"og_custom_url":null,"og_article_section":null,"og_article_tags":null,"twitter_use_og":false,"twitter_card":"default","twitter_image_type":"default","twitter_image_url":null,"twitter_image_custom_url":null,"twitter_image_custom_fields":null,"twitter_title":null,"twitter_description":null,"schema":{"blockGraphs":[],"customGraphs":[],"default":{"data":{"Article":[],"Course":[],"Dataset":[],"FAQPage":[],"Movie":[],"Person":[],"Product":[],"ProductReview":[],"Car":[],"Recipe":[],"Service":[],"SoftwareApplication":[],"WebPage":[]},"graphName":"","isEnabled":true},"graphs":[]},"schema_type":null,"schema_type_options":null,"pillar_content":false,"robots_default":true,"robots_noindex":false,"robots_noarchive":false,"robots_nosnippet":false,"robots_nofollow":false,"robots_noimageindex":false,"robots_noodp":false,"robots_notranslate":false,"robots_max_snippet":null,"robots_max_videopreview":null,"robots_max_imagepreview":"large","priority":null,"frequency":null,"local_seo":null,"seo_analyzer_scan_date":"2026-01-22 04:50:19","breadcrumb_settings":null,"limit_modified_date":false,"reviewed_by":null,"ai":null,"created":"2021-03-01 01:39:22","updated":"2026-01-22 04:50:19","focus_keyword":null,"additional_keywords":null,"truseo_locale":null},"gt_translate_keys":[{"key":"link","format":"url"}],"_links":{"self":[{"href":"https:\/\/prohoster.info\/hu\/wp-json\/wp\/v2\/posts\/36784","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/prohoster.info\/hu\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/prohoster.info\/hu\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/prohoster.info\/hu\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/prohoster.info\/hu\/wp-json\/wp\/v2\/comments?post=36784"}],"version-history":[{"count":0,"href":"https:\/\/prohoster.info\/hu\/wp-json\/wp\/v2\/posts\/36784\/revisions"}],"wp:attachment":[{"href":"https:\/\/prohoster.info\/hu\/wp-json\/wp\/v2\/media?parent=36784"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/prohoster.info\/hu\/wp-json\/wp\/v2\/categories?post=36784"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/prohoster.info\/hu\/wp-json\/wp\/v2\/tags?post=36784"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}