Zizwa ngokufaka i-Apache Airflow ku-Windows 10

Isingeniso: ngentando yesiphetho, emhlabeni wesayensi yezemfundo (umuthi) ngizithole ngisezweni lobuchwepheshe bolwazi, lapho kufanele ngisebenzise ulwazi lwami lwendlela yokwakha isilingo namasu okuhlaziya idatha yokuhlola, noma kunjalo, sebenzisa isitaki sobuchwepheshe esisha kimi. Enqubweni yokubamba kahle lobu buchwepheshe, ngihlangabezana nenani lobunzima, ngenhlanhla, obunqotshiwe kuze kube manje. Mhlawumbe lokhu okuthunyelwe kuzoba usizo kulabo abasanda kuqala ukusebenza namaphrojekthi we-Apache.

Ngakho, iphuzu. Kugqugquzelwe izihloko U-Yuri Emelyanov mayelana nekhono le-Apache Airflow emkhakheni wokuzenzakalela kwezinqubo zokuhlaziya, bengifuna ukuqala ukusebenzisa isethi ehlongozwayo yemitapo yolwazi emsebenzini wami. Labo abangakajwayelani nhlobo ne-Apache Airflow bangase babe nentshisekelo ekubukezweni okufushane indatshana kusizindalwazi seNational Library. N. E. Bauman.

Njengoba imiyalelo evamile yokusebenzisa i-Airflow ibonakala ingasebenzi endaweni ye-Windows, sebenzisa lokhu ukuze uxazulule le nkinga idokodo esimweni sami kwakuzoba nzima, ngaqala ukufuna ezinye izixazululo. Ngenhlanhla kimi, ngangingeyena owokuqala kule ndlela, ngakho ngakwazi ukuthola emangalisayo imiyalelo yevidiyo Ungayifaka kanjani i-Apache Airflow Windows 10 ngaphandle kokusebenzisa i-Docker. Kodwa, njengoba kuvame ukwenzeka, lapho ulandela izinyathelo ezinconyiwe, kuvela ubunzima, futhi, ngiyakholwa, hhayi kimi kuphela. Ngakho-ke, ngingathanda ukukhuluma ngolwazi lwami lokufaka i-Apache Airflow, mhlawumbe izosindisa umuntu isikhashana.

Ake sidlule ezinyathelweni zemiyalelo (spoiler - konke kuhambe kahle esinyathelweni sesi-5):

1. Ukufaka i-Windows Subsystem ye-Linux ukuze kufakwe ukusabalalisa kwe-Linux

Lokhu okuncane kwezinkinga, njengoba bethi:

Iphaneli Yokulawula → Izinhlelo → Izinhlelo Nezici → Vula noma uvale izici ze-Windows → I-Windows Subsystem ye-Linux

2. Faka ukusabalalisa kwe-Linux ozikhethele yona

Ngisebenzise uhlelo lokusebenza Ubuntu.

3. Ukufakwa kanye nokubuyekeza ipayipi

sudo apt-get install software-properties-common
sudo apt-add-repository universe
sudo apt-get update
sudo apt-get install python-pip

4. Ukufaka i-Apache Airflow

export SLUGIFY_USES_TEXT_UNIDECODE=yes
pip install apache-airflow

5. Ukuqaliswa kwesizindalwazi

Futhi yilapho kwaqala khona ubunzima bami obuncane. Imiyalo idinga ukuthi ufake umyalo airflow initdb bese udlulela esinyathelweni esilandelayo. Nokho, ngangihlale ngithola impendulo airflow: command not found. Kunengqondo ukucabanga ukuthi kwavela ubunzima ngesikhathi sokufakwa kwe-Apache Airflow futhi amafayela adingekayo awatholakali. Ngemva kokuqinisekisa ukuthi yonke into ilapho okufanele ibe khona, nginqume ukuzama ukucacisa indlela ephelele yefayela lokugeleza komoya (kufanele libukeke kanje: Полный/путь/до/файла/airflow initdb). Kodwa isimangaliso asenzekanga futhi impendulo yayifana airflow: command not found. Ngizamile ukusebenzisa indlela ehlobene nefayela (./.local/bin/airflow initdb), okuholele ephutheni elisha ModuleNotFoundError: No module named json'okunganqotshwa ngokubuyekeza umtapo wolwazi ithuluzi (endabeni yami kuze kufike kunguqulo 0.15.4):

pip install werkzeug==0.15.4

Ungafunda kabanzi mayelana ne-werkzeug lapha.

Ngemva kwalokhu kukhwabanisa okulula umyalo ./.local/bin/airflow initdb iqedwe ngempumelelo.

6. Kwethulwa iseva ye-Airflow

Lokhu akukona ukuphela kobunzima bokufinyelela ukugeleza komoya. Ukusebenzisa umyalo ./.local/bin/airflow webserver -p 8080 kubangele iphutha No such file or directory. Mhlawumbe, umsebenzisi onolwazi lwe-Ubuntu angazama ngokushesha ukunqoba ubunzima obunjalo ngokufinyelela ifayela ngokusebenzisa umyalo export PATH=$PATH:~/.local/bin/ (okungukuthi, ukwengeza /.local/bin/ endleleni yokusesha ekhona ye-PATH), kodwa lokhu okuthunyelwe kuhloselwe labo abasebenza ngokuyinhloko nge-Windows futhi bangase bangacabangi ukuthi lesi sixazululo sisobala.

Ngemva kokukhwabanisa okuchazwe ngenhla, umyalo ./.local/bin/airflow webserver -p 8080 iqedwe ngempumelelo.

7.URL: localhost: 8080 /

Uma konke kuhambe kahle ezigabeni ezedlule, khona-ke usukulungele ukunqoba iziqongo zokuhlaziya.

Ngithemba ukuthi ulwazi oluchazwe ngenhla ekufakeni i-Apache Airflow Windows 10 kuzoba usizo kubasebenzisi abasaqalayo futhi kuzosheshisa ukungena kwabo endaweni yonke yamathuluzi esimanje wokuhlaziya.

Ngokuzayo ngithanda ukuqhubeka nesihloko futhi ngikhulume ngolwazi lokusebenzisa i-Apache Airflow emkhakheni wokuhlaziya ukuziphatha komsebenzisi kwezinhlelo zokusebenza zeselula.

Source: www.habr.com