{"id":36784,"date":"2019-10-31T22:13:47","date_gmt":"2019-10-31T19:13:47","guid":{"rendered":"https:\/\/prohoster.info\/blog\/opyt-ustanovki-apache-airflow-na-windows-10\/"},"modified":"2019-10-31T22:13:47","modified_gmt":"2019-10-31T19:13:47","slug":"opyt-ustanovki-apache-airflow-na-windows-10","status":"publish","type":"post","link":"https:\/\/prohoster.info\/et\/blog\/administrirovanie\/opyt-ustanovki-apache-airflow-na-windows-10","title":{"rendered":"Apache Airflowi installimise kogemus Windows 10-s","gt_translate_keys":[{"key":"rendered","format":"text"}]},"content":{"rendered":"

Eel\u00f5igus<\/b>: saatuse tahtel akadeemilise teaduse (meditsiini) maailmast sattusin infotehnoloogia maailma, kus pean kasutama oma teadmisi eksperimentide \u00fclesehitamise metodoloogiast ja eksperimentaalsete andmete anal\u00fc\u00fcsi strateegiatest, rakendades samas endale uut tehnoloogiastikku. Nende tehnoloogiate omandamise k\u00e4igus olen kohtunud mitmete raskustega, millest \u00f5nneks olen seni \u00fcle saanud. See postitus v\u00f5ib olla kasulik neile, kes samuti alles alustavad Apache projektidega. <\/p>\n

Nii et l\u00e4hme asja juurde<\/b>. Inspiratsiooni saades artikkel <\/a><\/noindex> Juri Emelianovilt Apache Airflowi v\u00f5imaluste kohta anal\u00fc\u00fctiliste protseduuride automatiseerimisel, soovisin alustada etten\u00e4htud raamatukogude komplekti kasutamist oma t\u00f6\u00f6s. Neile, kes ei ole Apache Airflowiga veel tuttavad, v\u00f5ib olla huvitav v\u00e4ike \u00fclevaade artikkel <\/a><\/noindex> N. E. Bauman'i riiklikust raamatukogust. <\/p>\n

Kuna tavainstruktsioonid Airflowi k\u00e4ivitamiseks ei tundu Windowsi keskkonnas rakenduvat, on tarvis kasutada dockeri <\/a><\/noindex> minu juhtum oleks \u00fcleliigne, alustasin teiste lahenduste otsimist. \u00d5nneks polnud ma selle tee peal esimene, seega leidsin suurep\u00e4rase video\u00f5petuse<\/a><\/noindex> Apache Airflow'i installimisest Windows 10-s ilma Dockerit kasutamata. Kuid nagu sageli juhtub, esinevad soovitatud samme j\u00e4rgides raskused ja ma arvan, et mitte ainult minuga. Seet\u00f5ttu tahan r\u00e4\u00e4kida oma Apache Airflow'i installimise kogemusest, ehkki see s\u00e4\u00e4stab kellegi aega.
\n<\/a><\/noindex>
\nVaatame l\u00e4bi juhendi sammud (spoiler \u2014 5. samm l\u00e4ks k\u00f5ik h\u00e4sti):<\/p>\n

1. Windowsi alams\u00fcsteemi installimine Linuxi jaoks j\u00e4rgmise Linuxi distributsioonide installimise jaoks<\/b><\/p>\n

See on v\u00e4iksem probleem, nagu \u00f6eldakse: <\/p>\n

Juhtpaneel \u2192 Programmid \u2192 Programmid ja komponendid \u2192 Windowsi komponentide lubamine ja keelamine \u2192 Windowsi alams\u00fcsteem Linuxi jaoks<\/p>\n

2. Valitud Linuxi distributsiooni installimine<\/b><\/p>\n

Kasutasin rakendust Ubuntu<\/a><\/noindex>.<\/p>\n

3. pip-i installimine ja uuendamine <\/b><\/p>\n

sudo apt-get install software-properties-common\nsudo apt-add-repository universe\nsudo apt-get update\nsudo apt-get install python-pip<\/code><\/pre>\n
\n4. Apache Airflow'i installimine<\/b><\/p>\n
export SLUGIFY_USES_TEXT_UNIDECODE=yes\npip install apache-airflow<\/code><\/pre>\n
\n5. Andmebaasi algatamine<\/b><\/p>\n
Ja just siin algasid mu v\u00e4ikesed raskused. Juhis n\u00f5uab k\u00e4sku sisestada airflow initdb<\/code> ja minna j\u00e4rgmisele sammule. Kuid ma sain alati vastuseks airflow: k\u00e4sku ei leitud<\/code>. Loogiline oleks eeldada, et Apache Airflow'i installimise etapis tekkisid raskused ja vajalikud failid puuduvad. Veendudes, et k\u00f5ik on \u00f5igetes kohtades, otsustasin proovida m\u00e4\u00e4rata t\u00e4isp tee failini airflow (see peaks n\u00e4gema v\u00e4lja nii: T\u00e4isp\/:\/tee\/:\/failini\/airflow initdb<\/code>). Kuid imet ei juhtunud ja vastus oli sama airflow: k\u00e4sku ei leitud<\/code>. Proovisin kasutada suhtelist tee faili (.\/.local\/bin\/airflow initdb<\/code>), mis t\u00f5i kaasa uue vea ModuleNotFoundError: No module named json'<\/code>, mida saab v\u00e4ltida, uuendades raamatukogu werkzeug<\/i> (minu puhul versioonini 0.15.4):<\/p>\n
pip install werkzeug==0.15.4<\/code><\/pre>\n
\nRohkem werkzeug'i kohta saab lugeda siit<\/a><\/noindex>. <\/p>\n
P\u00e4rast seda lihtsat toimingut k\u00e4sk .\/.local\/bin\/airflow initdb<\/code> oli edukalt t\u00e4idetud. <\/p>\n
6. Airflow serveri k\u00e4itamine<\/b><\/p>\n
Sellega ei olnud raskused airflow'i kasutamisel veel l\u00e4bi. K\u00e4sk k\u00e4ivitamine .\/.local\/bin\/airflow webserver -p 8080<\/code> viis vea Sellist faili v\u00f5i katalooge ei eksisteeri<\/code>. T\u00f5en\u00e4oliselt oleks kogenud Ubuntu kasutaja kohe proovinud selliseid probleeme lahendada faili k\u00e4suga export PATH=$PATH:~\/.local\/bin\/<\/code> (st \u0442\u043e \u0435\u0441\u0442\u044c, \u0434\u043e\u0431\u0430\u0432ades to existing execution paths defined by the PATH variable, the directory \/.local\/bin\/), but this post is intended for those who primarily work with Windows and may not find such a solution obvious. <\/p>\n
After the manipulation described above, the command .\/.local\/bin\/airflow webserver -p 8080<\/code> was executed successfully.<\/p>\n
7. URL: localhost<\/noindex>:8080\/<\/b><\/p>\n
If everything went smoothly in the previous stages, you are ready to conquer analytical peaks.<\/p>\n
I hope the experience of installing Apache Airflow on Windows 10 described above will be helpful for beginners and accelerate their entry into the universe of modern analytics tools. <\/p>\n
Next time, I would like to continue the topic and share the experience of using Apache Airflow in the analysis of user behavior in mobile applications.
\n
Allikas: habr.com<\/a><\/p>","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"excerpt":{"rendered":"
\u041f\u0440\u0435\u0430\u043c\u0431\u0443\u043b\u0430: \u0432\u043e\u043b\u0435\u044e \u0441\u0443\u0434\u044c\u0431\u044b \u0438\u0437 \u043c\u0438\u0440\u0430 \u0430\u043a\u0430\u0434\u0435\u043c\u0438\u0447\u0435\u0441\u043a\u043e\u0439 \u043d\u0430\u0443\u043a\u0438 (\u043c\u0435\u0434\u0438\u0446\u0438\u043d\u044b) \u044f \u043f\u043e\u043f\u0430\u043b\u0430 \u0432 \u043c\u0438\u0440 \u0438\u043d\u0444\u043e\u0440\u043c\u0430\u0446\u0438\u043e\u043d\u043d\u044b\u0445 \u0442\u0435\u0445\u043d\u043e\u043b\u043e\u0433\u0438\u0439, \u0433\u0434\u0435 \u043c\u043d\u0435 \u043f\u0440\u0438\u0445\u043e\u0434\u0438\u0442\u0441\u044f \u0438\u0441\u043f\u043e\u043b\u044c\u0437\u043e\u0432\u0430\u0442\u044c \u0441\u0432\u043e\u0438 \u0437\u043d\u0430\u043d\u0438\u044f \u043e \u043c\u0435\u0442\u043e\u0434\u043e\u043b\u043e\u0433\u0438\u0438 \u043f\u043e\u0441\u0442\u0440\u043e\u0435\u043d\u0438\u044f \u044d\u043a\u0441\u043f\u0435\u0440\u0438\u043c\u0435\u043d\u0442\u0430 \u0438 \u0441\u0442\u0440\u0430\u0442\u0435\u0433\u0438\u044f\u0445 \u0430\u043d\u0430\u043b\u0438\u0437\u0430 \u044d\u043a\u0441\u043f\u0435\u0440\u0438\u043c\u0435\u043d\u0442\u0430\u043b\u044c\u043d\u044b\u0445 \u0434\u0430\u043d\u043d\u044b\u0445, \u043e\u0434\u043d\u0430\u043a\u043e, \u043f\u0440\u0438\u043c\u0435\u043d\u044f\u0442\u044c \u043d\u043e\u0432\u044b\u0439 \u0434\u043b\u044f \u043c\u0435\u043d\u044f \u0441\u0442\u0435\u043a \u0442\u0435\u0445\u043d\u043e\u043b\u043e\u0433\u0438\u0439. \u0412 \u043f\u0440\u043e\u0446\u0435\u0441\u0441\u0435 \u043e\u0441\u0432\u043e\u0435\u043d\u0438\u044f \u044d\u0442\u0438\u0445 \u0442\u0435\u0445\u043d\u043e\u043b\u043e\u0433\u0438\u0439 \u044f \u0441\u0442\u0430\u043b\u043a\u0438\u0432\u0430\u044e\u0441\u044c \u0441 \u0440\u044f\u0434\u043e\u043c \u0442\u0440\u0443\u0434\u043d\u043e\u0441\u0442\u0435\u0439, \u043a\u043e\u0442\u043e\u0440\u044b\u0435 \u043f\u043e\u043a\u0430, \u043a \u0441\u0447\u0430\u0441\u0442\u044c\u044e, \u0443\u0434\u0430\u0435\u0442\u0441\u044f \u043f\u0440\u0435\u043e\u0434\u043e\u043b\u0435\u0432\u0430\u0442\u044c. \u0412\u043e\u0437\u043c\u043e\u0436\u043d\u043e, \u044d\u0442\u043e\u0442 \u043f\u043e\u0441\u0442 […]<\/p>\n","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[688],"tags":[],"class_list":["post-36784","post","type-post","status-publish","format-standard","hentry","category-administrirovanie"],"aioseo_notices":[],"aioseo_head":"\n\t\t\n\t\n\t\n\t\n\t\n\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\n","aioseo_head_json":{"title":"\ud83e\udd47Apache Airflow'i installimise kogemus Windows 10-l | ProHoster","description":"Sissejuhatus: saatuse tahtel olen akadeemilisest teadusest (meditsiin) j\u00f5udnud infotehnoloogiate maailma, kus pean rakendama oma teadmisi eksperimendi koostamise metodoloogiast ja eksperimentaalsete andmete anal\u00fc\u00fcsi strateegiatest, samas, kui kasutan endale uut tehnoloogiate kogumit. Nende tehnoloogiate omandamise protsessis kohtan mitmeid raskusi, millega \u00f5nneks olen seni hakkama saanud. V\u00f5ib-olla on see postitus","canonical_url":"https:\/\/prohoster.info\/et\/blog\/administrirovanie\/opyt-ustanovki-apache-airflow-na-windows-10","robots":"max-image-preview:large","keywords":"","webmasterTools":{"miscellaneous":""},"schema":null,"og:locale":"et_EE","og:site_name":"ProHoster | \u041a\u0443\u043f\u0438\u0442\u044c \u043d\u0430\u0434\u0435\u0436\u043d\u044b\u0439 \u0445\u043e\u0441\u0442\u0438\u043d\u0433 \u0434\u043b\u044f \u0441\u0430\u0439\u0442\u043e\u0432 \u0441 \u0437\u0430\u0449\u0438\u0442\u043e\u0439 \u043e\u0442 DDoS, VPS VDS \u0441\u0435\u0440\u0432\u0435\u0440\u044b","og:type":"article","og:title":"\ud83e\udd47\u041e\u043f\u044b\u0442 \u0443\u0441\u0442\u0430\u043d\u043e\u0432\u043a\u0438 Apache Airflow \u043d\u0430 Windows 10 | ProHoster","og:description":"\u041f\u0440\u0435\u0430\u043c\u0431\u0443\u043b\u0430: \u0432\u043e\u043b\u0435\u044e \u0441\u0443\u0434\u044c\u0431\u044b \u0438\u0437 \u043c\u0438\u0440\u0430 \u0430\u043a\u0430\u0434\u0435\u043c\u0438\u0447\u0435\u0441\u043a\u043e\u0439 \u043d\u0430\u0443\u043a\u0438 (\u043c\u0435\u0434\u0438\u0446\u0438\u043d\u044b) \u044f \u043f\u043e\u043f\u0430\u043b\u0430 \u0432 \u043c\u0438\u0440 \u0438\u043d\u0444\u043e\u0440\u043c\u0430\u0446\u0438\u043e\u043d\u043d\u044b\u0445 \u0442\u0435\u0445\u043d\u043e\u043b\u043e\u0433\u0438\u0439, \u0433\u0434\u0435 \u043c\u043d\u0435 \u043f\u0440\u0438\u0445\u043e\u0434\u0438\u0442\u0441\u044f \u0438\u0441\u043f\u043e\u043b\u044c\u0437\u043e\u0432\u0430\u0442\u044c \u0441\u0432\u043e\u0438 \u0437\u043d\u0430\u043d\u0438\u044f \u043e \u043c\u0435\u0442\u043e\u0434\u043e\u043b\u043e\u0433\u0438\u0438 \u043f\u043e\u0441\u0442\u0440\u043e\u0435\u043d\u0438\u044f \u044d\u043a\u0441\u043f\u0435\u0440\u0438\u043c\u0435\u043d\u0442\u0430 \u0438 \u0441\u0442\u0440\u0430\u0442\u0435\u0433\u0438\u044f\u0445 \u0430\u043d\u0430\u043b\u0438\u0437\u0430 \u044d\u043a\u0441\u043f\u0435\u0440\u0438\u043c\u0435\u043d\u0442\u0430\u043b\u044c\u043d\u044b\u0445 \u0434\u0430\u043d\u043d\u044b\u0445, \u043e\u0434\u043d\u0430\u043a\u043e, \u043f\u0440\u0438\u043c\u0435\u043d\u044f\u0442\u044c \u043d\u043e\u0432\u044b\u0439 \u0434\u043b\u044f \u043c\u0435\u043d\u044f \u0441\u0442\u0435\u043a \u0442\u0435\u0445\u043d\u043e\u043b\u043e\u0433\u0438\u0439. \u0412 \u043f\u0440\u043e\u0446\u0435\u0441\u0441\u0435 \u043e\u0441\u0432\u043e\u0435\u043d\u0438\u044f \u044d\u0442\u0438\u0445 \u0442\u0435\u0445\u043d\u043e\u043b\u043e\u0433\u0438\u0439 \u044f \u0441\u0442\u0430\u043b\u043a\u0438\u0432\u0430\u044e\u0441\u044c \u0441 \u0440\u044f\u0434\u043e\u043c \u0442\u0440\u0443\u0434\u043d\u043e\u0441\u0442\u0435\u0439, \u043a\u043e\u0442\u043e\u0440\u044b\u0435 \u043f\u043e\u043a\u0430, \u043a \u0441\u0447\u0430\u0441\u0442\u044c\u044e, \u0443\u0434\u0430\u0435\u0442\u0441\u044f \u043f\u0440\u0435\u043e\u0434\u043e\u043b\u0435\u0432\u0430\u0442\u044c. \u0412\u043e\u0437\u043c\u043e\u0436\u043d\u043e, \u044d\u0442\u043e\u0442 \u043f\u043e\u0441\u0442","og:url":"https:\/\/prohoster.info\/et\/blog\/administrirovanie\/opyt-ustanovki-apache-airflow-na-windows-10","og:image":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:secure_url":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:width":350,"og:image:height":350,"article:published_time":"2019-10-31T19:13:47+00:00","article:modified_time":"2019-10-31T19:13:47+00:00","article:publisher":"https:\/\/www.facebook.com\/prohoster","article:author":"https:\/\/www.facebook.com\/prohoster"},"aioseo_meta_data":{"post_id":"36784","title":null,"description":null,"keywords":null,"keyphrases":null,"primary_term":null,"canonical_url":null,"og_title":null,"og_description":null,"og_object_type":"default","og_image_type":"default","og_image_url":null,"og_image_width":null,"og_image_height":null,"og_image_custom_url":null,"og_image_custom_fields":null,"og_video":null,"og_custom_url":null,"og_article_section":null,"og_article_tags":null,"twitter_use_og":false,"twitter_card":"default","twitter_image_type":"default","twitter_image_url":null,"twitter_image_custom_url":null,"twitter_image_custom_fields":null,"twitter_title":null,"twitter_description":null,"schema":{"blockGraphs":[],"customGraphs":[],"default":{"data":{"Article":[],"Course":[],"Dataset":[],"FAQPage":[],"Movie":[],"Person":[],"Product":[],"ProductReview":[],"Car":[],"Recipe":[],"Service":[],"SoftwareApplication":[],"WebPage":[]},"graphName":"","isEnabled":true},"graphs":[]},"schema_type":null,"schema_type_options":null,"pillar_content":false,"robots_default":true,"robots_noindex":false,"robots_noarchive":false,"robots_nosnippet":false,"robots_nofollow":false,"robots_noimageindex":false,"robots_noodp":false,"robots_notranslate":false,"robots_max_snippet":null,"robots_max_videopreview":null,"robots_max_imagepreview":"large","priority":null,"frequency":null,"local_seo":null,"seo_analyzer_scan_date":"2026-01-22 04:50:19","breadcrumb_settings":null,"limit_modified_date":false,"reviewed_by":null,"ai":null,"created":"2021-03-01 01:39:22","updated":"2026-01-22 04:50:19"},"gt_translate_keys":[{"key":"link","format":"url"}],"_links":{"self":[{"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/posts\/36784","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/comments?post=36784"}],"version-history":[{"count":0,"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/posts\/36784\/revisions"}],"wp:attachment":[{"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/media?parent=36784"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/categories?post=36784"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/prohoster.info\/et\/wp-json\/wp\/v2\/tags?post=36784"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}