Dziwani kukhazikitsa Apache Airflow pa Windows 10

Yambani: mwa chifuniro cha tsoka, kuchokera ku dziko la sayansi ya maphunziro (mankhwala), ndinadzipeza ndekha m'dziko la zamakono zamakono, komwe ndikuyenera kugwiritsa ntchito chidziwitso changa cha njira yopangira kuyesera ndi njira zowunikira deta yoyesera, komabe, gwiritsani ukadaulo watsopano kwa ine. Podziwa bwino matekinolojewa, ndimakumana ndi zovuta zingapo, zomwe, mwamwayi, zagonjetsedwa. Mwina izi zitha kukhala zothandiza kwa iwo omwe akungoyamba kumene kugwira ntchito ndi ma projekiti a Apache.

Kotero, mpaka. Wowuziridwa zolemba Yuri Emelyanov za kuthekera kwa Apache Airflow pantchito yosinthira njira zowunikira, ndidafuna kuti ndiyambe kugwiritsa ntchito malaibulale omwe aperekedwa pantchito yanga. Iwo omwe sanadziwebe Apache Airflow atha kukhala ndi chidwi ndi mwachidule nkhani pa webusayiti ya National Library. N. E. Bauman.

Popeza malangizo anthawi zonse oyendetsa Airflow samawoneka ngati akugwira ntchito mu Windows, gwiritsani ntchito izi kuthetsa vutoli docker kwa ine zikanakhala zosafunikira, ndinayamba kufunafuna njira zina. Mwamwayi kwa ine, sindinali woyamba panjira iyi, kotero ndidakwanitsa kupeza chodabwitsa malangizo a kanema Momwe mungakhalire Apache Airflow Windows 10 osagwiritsa ntchito Docker. Koma, monga zimachitika nthawi zambiri, potsatira njira zomwe zikulimbikitsidwa, zovuta zimayamba, ndipo, ndikukhulupirira, osati kwa ine ndekha. Chifukwa chake, ndikufuna kunena za zomwe ndakumana nazo ndikukhazikitsa Apache Airflow, mwina zingapulumutse wina kwakanthawi.

Tiyeni tidutse masitepe a malangizo (wowononga - zonse zidayenda bwino pa gawo la 5):

1. Kuyika Windows Subsystem ya Linux kuti muyikenso magawo a Linux

Ili ndiye vuto laling'ono, monga akunena:

Control Panel → Mapulogalamu → Mapologalamu ndi Zinthu → Yatsani kapena kuzimitsa mawonekedwe a Windows → Windows Subsystem ya Linux

2. Ikani kugawa kwa Linux komwe mwasankha

Ndinagwiritsa ntchito Ubuntu.

3. Kuyika ndikusintha pip

sudo apt-get install software-properties-common
sudo apt-add-repository universe
sudo apt-get update
sudo apt-get install python-pip

4. Kuyika Apache Airflow

export SLUGIFY_USES_TEXT_UNIDECODE=yes
pip install apache-airflow

5. Kukhazikitsa kwa database

Ndipo apa ndipamene zovuta zanga zazing'ono zidayambira. Malangizo amafunikira kuti mulowetse lamulo airflow initdb ndi kupita ku sitepe yotsatira. Komabe, nthawi zonse ndinkalandira yankho airflow: command not found. Ndizomveka kuganiza kuti zovuta zidabuka pakukhazikitsa Apache Airflow ndipo mafayilo ofunikira sapezeka. Nditaonetsetsa kuti zonse zinali pomwe ziyenera kukhala, ndinaganiza zoyesera kufotokoza njira yonse yopita ku fayilo ya airflow (iyenera kuwoneka motere: Полный/путь/до/файла/airflow initdb). Koma chozizwitsacho sichinachitike ndipo yankho linali lomwelo airflow: command not found. Ndinayesa kugwiritsa ntchito njira yolowera ku fayilo (./.local/bin/airflow initdb), zomwe zinayambitsa cholakwika chatsopano ModuleNotFoundError: No module named json'zomwe zingagonjetsedwe pokonzanso laibulale chida (kwa ine mpaka mtundu 0.15.4):

pip install werkzeug==0.15.4

Mutha kuwerenga zambiri za werkzeug apa.

Pambuyo pakusintha kosavuta uku lamulo ./.local/bin/airflow initdb inamalizidwa bwino.

6. Kukhazikitsa seva ya Airflow

Uku sikumapeto kwa zovuta zofikira mpweya. Kuthamangitsa lamulo ./.local/bin/airflow webserver -p 8080 zinayambitsa cholakwika No such file or directory. Mwinanso, wogwiritsa ntchito Ubuntu wodziwa zambiri angayesere kuthana ndi zovuta zotere ndikupeza fayiloyo pogwiritsa ntchito lamulo export PATH=$PATH:~/.local/bin/ (ie, kuwonjezera /.local/bin/ ku njira yofufuzira yomwe ilipo PATH), koma positiyi idapangidwira iwo omwe amagwira ntchito makamaka ndi Windows ndipo sangaganize kuti yankho ili ndi lodziwikiratu.

Pambuyo pakusintha kwafotokozedwa pamwambapa, lamulo ./.local/bin/airflow webserver -p 8080 inamalizidwa bwino.

7.URL: localhost: 8080 /

Ngati zonse zidayenda bwino m'magawo am'mbuyomu, ndiye kuti mwakonzeka kugonjetsa nsonga zowunikira.

Ndikukhulupirira kuti zomwe tafotokozazi pakuyika Apache Airflow Windows 10 zidzakhala zothandiza kwa ogwiritsa ntchito novice ndipo zidzafulumizitsa kulowa kwawo m'chilengedwe cha zida zamakono zamakono.

Nthawi ina ndikufuna kupitiliza mutuwo ndikulankhula za zomwe zachitika pogwiritsa ntchito Apache Airflow m'munda wowunikira machitidwe a ogwiritsa ntchito mafoni.

Source: www.habr.com