{"id":36784,"date":"2019-10-31T22:13:47","date_gmt":"2019-10-31T19:13:47","guid":{"rendered":"https:\/\/prohoster.info\/blog\/opyt-ustanovki-apache-airflow-na-windows-10\/"},"modified":"2019-10-31T22:13:47","modified_gmt":"2019-10-31T19:13:47","slug":"opyt-ustanovki-apache-airflow-na-windows-10","status":"publish","type":"post","link":"https:\/\/prohoster.info\/pt\/blog\/administrirovanie\/opyt-ustanovki-apache-airflow-na-windows-10","title":{"rendered":"Experi\u00eancia de instala\u00e7\u00e3o do Apache Airflow no Windows 10","gt_translate_keys":[{"key":"rendered","format":"text"}]},"content":{"rendered":"

Pr\u00e9\u00e2mbulo<\/b>: por capricho do destino, do mundo acad\u00eamico (medicina) fui parar no mundo da tecnologia da informa\u00e7\u00e3o, onde utilizo meus conhecimentos sobre metodologia de experimenta\u00e7\u00e3o e estrat\u00e9gias de an\u00e1lise de dados experimentais, por\u00e9m aplicando um novo conjunto de tecnologias para mim. No processo de aprendizado dessas tecnologias, enfrento v\u00e1rias dificuldades que, felizmente, estou conseguindo superar por enquanto. Talvez esta postagem seja \u00fatil para aqueles que tamb\u00e9m est\u00e3o come\u00e7ando a trabalhar com projetos Apache. <\/p>\n

Ent\u00e3o, vamos ao ponto<\/b>. Inspirada o artigo <\/a><\/noindex> por Yuri Emelyanov sobre as possibilidades do Apache Airflow na automa\u00e7\u00e3o de procedimentos anal\u00edticos, tive vontade de come\u00e7ar a usar o conjunto de bibliotecas oferecido em meu trabalho. Para aqueles que ainda n\u00e3o est\u00e3o familiarizados com o Apache Airflow, pode ser interessante uma breve vis\u00e3o geral artigo <\/a><\/noindex> no site da Biblioteca Nacional N. E. Bauman. <\/p>\n

Como as instru\u00e7\u00f5es comuns para iniciar o Airflow aparentemente n\u00e3o s\u00e3o aplic\u00e1veis em ambientes Windows, e usar para resolver essa tarefa Docker <\/a><\/noindex> no meu caso seria desnecess\u00e1rio, comecei a procurar outras solu\u00e7\u00f5es. Para minha sorte, n\u00e3o sou a primeira a trilhar esse caminho, ent\u00e3o consegui encontrar um \u00f3timo v\u00eddeo-tutorial<\/a><\/noindex> sobre como instalar o Apache Airflow no Windows 10 sem o uso do Docker. Mas, como muitas vezes acontece, ao seguir os passos recomendados, surgem dificuldades que, suponho, n\u00e3o s\u00e3o apenas minhas. Portanto, gostaria de compartilhar minha experi\u00eancia na instala\u00e7\u00e3o do Apache Airflow, talvez isso economize um pouco do tempo de algu\u00e9m.
\n<\/a><\/noindex>
\nVamos passar pelos passos da instru\u00e7\u00e3o (spoiler \u2014 do 5\u00ba passo em diante, tudo correu bem):<\/p>\n

1. Instala\u00e7\u00e3o do Subsistema Windows para Linux para a posterior instala\u00e7\u00e3o de distribui\u00e7\u00f5es Linux<\/b><\/p>\n

Esse \u00e9 o menor dos problemas, como se diz: <\/p>\n

Painel de controle \u2192 Programas \u2192 Programas e Recursos \u2192 Ativar ou desativar recursos do Windows \u2192 Subsistema do Windows para Linux<\/p>\n

2. Instala\u00e7\u00e3o da distribui\u00e7\u00e3o Linux de sua escolha<\/b><\/p>\n

Eu utilizei o aplicativo Ubuntu<\/a><\/noindex>.<\/p>\n

3. Instala\u00e7\u00e3o e atualiza\u00e7\u00e3o do pip <\/b><\/p>\n

sudo apt-get install software-properties-common\nsudo apt-add-repository universe\nsudo apt-get update\nsudo apt-get install python-pip<\/code><\/pre>\n
\n4. Instala\u00e7\u00e3o do Apache Airflow<\/b><\/p>\n
export SLUGIFY_USES_TEXT_UNIDECODE=yes\npip install apache-airflow<\/code><\/pre>\n
\n5. Inicializa\u00e7\u00e3o do banco de dados<\/b><\/p>\n
E foi exatamente aqui que come\u00e7aram minhas pequenas dificuldades. As instru\u00e7\u00f5es pedem para inserir o comando airflow initdb<\/code> e prosseguir para o pr\u00f3ximo passo. No entanto, eu sempre recebia a resposta airflow: comando n\u00e3o encontrado<\/code>. \u00c9 l\u00f3gico supor que houve dificuldades na fase de instala\u00e7\u00e3o do Apache Airflow e simplesmente n\u00e3o h\u00e1 arquivos necess\u00e1rios. Ap\u00f3s confirmar que est\u00e1 tudo onde deveria estar, decidi tentar especificar o caminho completo para o arquivo airflow (deve ser assim: caminho\/completo\/para\/o\/arquivo\/airflow initdb<\/code>). Mas o milagre n\u00e3o aconteceu e a resposta foi a mesma airflow: comando n\u00e3o encontrado<\/code>. Eu tentei usar um caminho relativo para o arquivo (.\/.local\/bin\/airflow initdb<\/code>), o que resultou em um novo erro ModuleNotFoundError: No module named json'<\/code>, que pode ser superado atualizando a biblioteca werkzeug<\/i> (no meu caso, para a vers\u00e3o 0.15.4):<\/p>\n
pip install werkzeug==0.15.4<\/code><\/pre>\n
\nMais informa\u00e7\u00f5es sobre werkzeug podem ser lidas aqui<\/a><\/noindex>. <\/p>\n
Ap\u00f3s essa simples manipula\u00e7\u00e3o, o comando .\/.local\/bin\/airflow initdb<\/code> foi executado com sucesso. <\/p>\n
6. Iniciando o servidor Airflow<\/b><\/p>\n
Ainda n\u00e3o terminaram as dificuldades ao acessar o airflow. A execu\u00e7\u00e3o do comando .\/.local\/bin\/airflow webserver -p 8080<\/code> resultou em um erro No such file or directory<\/code>. Provavelmente, um usu\u00e1rio experiente do Ubuntu teria imediatamente tentado superar essas dificuldades de acesso ao arquivo, utilizando o comando export PATH=$PATH:~\/.local\/bin\/<\/code> (ou seja, adicionando ao caminho atual de busca de execut\u00e1veis, definido pela vari\u00e1vel PATH, o diret\u00f3rio \/.local\/bin\/), mas este post \u00e9 destinado a quem trabalha predominantemente com Windows e, possivelmente, n\u00e3o considera tal solu\u00e7\u00e3o \u00f3bvia. <\/p>\n
Ap\u00f3s a manipula\u00e7\u00e3o descrita acima, o comando .\/.local\/bin\/airflow webserver -p 8080<\/code> foi executado com sucesso.<\/p>\n
7. URL: localhost<\/noindex>:8080\/<\/b><\/p>\n
Se tudo correu bem nas etapas anteriores, voc\u00ea est\u00e1 pronto para conquistar os picos anal\u00edticos.<\/p>\n
Espero que a experi\u00eancia de instala\u00e7\u00e3o do Apache Airflow no Windows 10 descrita acima seja \u00fatil para novos usu\u00e1rios e acelere sua entrada no universo das modernas ferramentas de an\u00e1lise. <\/p>\n
Na pr\u00f3xima vez, gostaria de continuar o tema e compartilhar a experi\u00eancia de uso do Apache Airflow na an\u00e1lise de comportamento de usu\u00e1rios de aplicativos m\u00f3veis.
\n
Fonte: habr.com<\/a><\/p>","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"excerpt":{"rendered":"
\u041f\u0440\u0435\u0430\u043c\u0431\u0443\u043b\u0430: \u0432\u043e\u043b\u0435\u044e \u0441\u0443\u0434\u044c\u0431\u044b \u0438\u0437 \u043c\u0438\u0440\u0430 \u0430\u043a\u0430\u0434\u0435\u043c\u0438\u0447\u0435\u0441\u043a\u043e\u0439 \u043d\u0430\u0443\u043a\u0438 (\u043c\u0435\u0434\u0438\u0446\u0438\u043d\u044b) \u044f \u043f\u043e\u043f\u0430\u043b\u0430 \u0432 \u043c\u0438\u0440 \u0438\u043d\u0444\u043e\u0440\u043c\u0430\u0446\u0438\u043e\u043d\u043d\u044b\u0445 \u0442\u0435\u0445\u043d\u043e\u043b\u043e\u0433\u0438\u0439, \u0433\u0434\u0435 \u043c\u043d\u0435 \u043f\u0440\u0438\u0445\u043e\u0434\u0438\u0442\u0441\u044f \u0438\u0441\u043f\u043e\u043b\u044c\u0437\u043e\u0432\u0430\u0442\u044c \u0441\u0432\u043e\u0438 \u0437\u043d\u0430\u043d\u0438\u044f \u043e \u043c\u0435\u0442\u043e\u0434\u043e\u043b\u043e\u0433\u0438\u0438 \u043f\u043e\u0441\u0442\u0440\u043e\u0435\u043d\u0438\u044f \u044d\u043a\u0441\u043f\u0435\u0440\u0438\u043c\u0435\u043d\u0442\u0430 \u0438 \u0441\u0442\u0440\u0430\u0442\u0435\u0433\u0438\u044f\u0445 \u0430\u043d\u0430\u043b\u0438\u0437\u0430 \u044d\u043a\u0441\u043f\u0435\u0440\u0438\u043c\u0435\u043d\u0442\u0430\u043b\u044c\u043d\u044b\u0445 \u0434\u0430\u043d\u043d\u044b\u0445, \u043e\u0434\u043d\u0430\u043a\u043e, \u043f\u0440\u0438\u043c\u0435\u043d\u044f\u0442\u044c \u043d\u043e\u0432\u044b\u0439 \u0434\u043b\u044f \u043c\u0435\u043d\u044f \u0441\u0442\u0435\u043a \u0442\u0435\u0445\u043d\u043e\u043b\u043e\u0433\u0438\u0439. \u0412 \u043f\u0440\u043e\u0446\u0435\u0441\u0441\u0435 \u043e\u0441\u0432\u043e\u0435\u043d\u0438\u044f \u044d\u0442\u0438\u0445 \u0442\u0435\u0445\u043d\u043e\u043b\u043e\u0433\u0438\u0439 \u044f \u0441\u0442\u0430\u043b\u043a\u0438\u0432\u0430\u044e\u0441\u044c \u0441 \u0440\u044f\u0434\u043e\u043c \u0442\u0440\u0443\u0434\u043d\u043e\u0441\u0442\u0435\u0439, \u043a\u043e\u0442\u043e\u0440\u044b\u0435 \u043f\u043e\u043a\u0430, \u043a \u0441\u0447\u0430\u0441\u0442\u044c\u044e, \u0443\u0434\u0430\u0435\u0442\u0441\u044f \u043f\u0440\u0435\u043e\u0434\u043e\u043b\u0435\u0432\u0430\u0442\u044c. \u0412\u043e\u0437\u043c\u043e\u0436\u043d\u043e, \u044d\u0442\u043e\u0442 \u043f\u043e\u0441\u0442 […]<\/p>\n","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[688],"tags":[],"class_list":["post-36784","post","type-post","status-publish","format-standard","hentry","category-administrirovanie"],"aioseo_notices":[],"aioseo_head":"\n\t\t\n\t\n\t\n\t\n\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\n","aioseo_head_json":{"title":"\ud83e\udd47Experi\u00eancia de instala\u00e7\u00e3o do Apache Airflow no Windows 10 | ProHoster","description":"Pref\u00e1cio: por um capricho do destino, do mundo acad\u00eamico (medicina) passei para o mundo da tecnologia da informa\u00e7\u00e3o, onde tenho que usar meu conhecimento sobre metodologia de experimenta\u00e7\u00e3o e estrat\u00e9gias de an\u00e1lise.","canonical_url":"https:\/\/prohoster.info\/pt\/blog\/administrirovanie\/opyt-ustanovki-apache-airflow-na-windows-10","robots":"max-image-preview:large","keywords":"","webmasterTools":{"miscellaneous":""},"schema":null,"og:locale":"pt_PT","og:site_name":"ProHoster | \u041a\u0443\u043f\u0438\u0442\u044c \u043d\u0430\u0434\u0435\u0436\u043d\u044b\u0439 \u0445\u043e\u0441\u0442\u0438\u043d\u0433 \u0434\u043b\u044f \u0441\u0430\u0439\u0442\u043e\u0432 \u0441 \u0437\u0430\u0449\u0438\u0442\u043e\u0439 \u043e\u0442 DDoS, VPS VDS \u0441\u0435\u0440\u0432\u0435\u0440\u044b","og:type":"article","og:title":"\ud83e\udd47\u041e\u043f\u044b\u0442 \u0443\u0441\u0442\u0430\u043d\u043e\u0432\u043a\u0438 Apache Airflow \u043d\u0430 Windows 10 | ProHoster","og:description":"\u041f\u0440\u0435\u0430\u043c\u0431\u0443\u043b\u0430: \u0432\u043e\u043b\u0435\u044e \u0441\u0443\u0434\u044c\u0431\u044b \u0438\u0437 \u043c\u0438\u0440\u0430 \u0430\u043a\u0430\u0434\u0435\u043c\u0438\u0447\u0435\u0441\u043a\u043e\u0439 \u043d\u0430\u0443\u043a\u0438 (\u043c\u0435\u0434\u0438\u0446\u0438\u043d\u044b) \u044f \u043f\u043e\u043f\u0430\u043b\u0430 \u0432 \u043c\u0438\u0440 \u0438\u043d\u0444\u043e\u0440\u043c\u0430\u0446\u0438\u043e\u043d\u043d\u044b\u0445 \u0442\u0435\u0445\u043d\u043e\u043b\u043e\u0433\u0438\u0439, \u0433\u0434\u0435 \u043c\u043d\u0435 \u043f\u0440\u0438\u0445\u043e\u0434\u0438\u0442\u0441\u044f \u0438\u0441\u043f\u043e\u043b\u044c\u0437\u043e\u0432\u0430\u0442\u044c \u0441\u0432\u043e\u0438 \u0437\u043d\u0430\u043d\u0438\u044f \u043e \u043c\u0435\u0442\u043e\u0434\u043e\u043b\u043e\u0433\u0438\u0438 \u043f\u043e\u0441\u0442\u0440\u043e\u0435\u043d\u0438\u044f \u044d\u043a\u0441\u043f\u0435\u0440\u0438\u043c\u0435\u043d\u0442\u0430 \u0438 \u0441\u0442\u0440\u0430\u0442\u0435\u0433\u0438\u044f\u0445 \u0430\u043d\u0430\u043b\u0438\u0437\u0430.","og:url":"https:\/\/prohoster.info\/pt\/blog\/administrirovanie\/opyt-ustanovki-apache-airflow-na-windows-10","og:image":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:secure_url":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:width":350,"og:image:height":350,"article:published_time":"2019-10-31T19:13:47+00:00","article:modified_time":"2019-10-31T19:13:47+00:00","article:publisher":"https:\/\/www.facebook.com\/prohoster","article:author":"https:\/\/www.facebook.com\/prohoster"},"aioseo_meta_data":{"post_id":"36784","title":null,"description":null,"keywords":null,"keyphrases":null,"primary_term":null,"canonical_url":null,"og_title":null,"og_description":null,"og_object_type":"default","og_image_type":"default","og_image_url":null,"og_image_width":null,"og_image_height":null,"og_image_custom_url":null,"og_image_custom_fields":null,"og_video":null,"og_custom_url":null,"og_article_section":null,"og_article_tags":null,"twitter_use_og":false,"twitter_card":"default","twitter_image_type":"default","twitter_image_url":null,"twitter_image_custom_url":null,"twitter_image_custom_fields":null,"twitter_title":null,"twitter_description":null,"schema":{"blockGraphs":[],"customGraphs":[],"default":{"data":{"Article":[],"Course":[],"Dataset":[],"FAQPage":[],"Movie":[],"Person":[],"Product":[],"ProductReview":[],"Car":[],"Recipe":[],"Service":[],"SoftwareApplication":[],"WebPage":[]},"graphName":"","isEnabled":true},"graphs":[]},"schema_type":null,"schema_type_options":null,"pillar_content":false,"robots_default":true,"robots_noindex":false,"robots_noarchive":false,"robots_nosnippet":false,"robots_nofollow":false,"robots_noimageindex":false,"robots_noodp":false,"robots_notranslate":false,"robots_max_snippet":null,"robots_max_videopreview":null,"robots_max_imagepreview":"large","priority":null,"frequency":null,"local_seo":null,"seo_analyzer_scan_date":"2026-01-22 04:50:19","breadcrumb_settings":null,"limit_modified_date":false,"reviewed_by":null,"ai":null,"created":"2021-03-01 01:39:22","updated":"2026-01-22 04:50:19","focus_keyword":null,"additional_keywords":null,"truseo_locale":null},"gt_translate_keys":[{"key":"link","format":"url"}],"_links":{"self":[{"href":"https:\/\/prohoster.info\/pt\/wp-json\/wp\/v2\/posts\/36784","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/prohoster.info\/pt\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/prohoster.info\/pt\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/prohoster.info\/pt\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/prohoster.info\/pt\/wp-json\/wp\/v2\/comments?post=36784"}],"version-history":[{"count":0,"href":"https:\/\/prohoster.info\/pt\/wp-json\/wp\/v2\/posts\/36784\/revisions"}],"wp:attachment":[{"href":"https:\/\/prohoster.info\/pt\/wp-json\/wp\/v2\/media?parent=36784"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/prohoster.info\/pt\/wp-json\/wp\/v2\/categories?post=36784"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/prohoster.info\/pt\/wp-json\/wp\/v2\/tags?post=36784"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}