Amava okufaka iApache Airflow Windows 10

Intshayelelo: ngokuthanda kwekamva, ukusuka kwihlabathi lezesayensi yezemfundo (unyango), ndazifumana ndisehlabathini lobugcisa bolwazi, apho kufuneka ndisebenzise ulwazi lwam lwendlela yokwenza umfuniselo kunye nezicwangciso zokuhlalutya idatha yovavanyo, nangona kunjalo, sebenzisa istaki setekhnoloji entsha kum. Kwinkqubo yokuqonda ezi teknoloji, ndidibana nobunzima obuninzi, obuthe, ngethamsanqa, kude kube ngoku. Mhlawumbi esi sithuba siya kuba luncedo kwabo baqala ukusebenza ngeeprojekthi ze-Apache.

Ngoko, kwinqanaba. Iphefumlelwe amanqaku U-Yuri Emelyanov malunga nobuchule be-Apache Airflow kwintsimi ye-automation yeenkqubo zokuhlalutya, ndandifuna ukuqalisa ukusebenzisa isethi ecetywayo yamathala eencwadi emsebenzini wam. Abo bangekaqhelani kwaphela neApache Airflow banokuba nomdla kushwankathelo olufutshane inqaku kwiwebhusayithi yeThala leeNcwadi leSizwe. N. E. Bauman.

Kuba imiyalelo yesiqhelo yokusebenzisa i-Airflow ayibonakali iyasebenza kwindawo yeWindows, sebenzisa oku ukusombulula le ngxaki idokhi kwimeko yam yayiza kuba yinto engafunekiyo, ndaqala ukukhangela ezinye izisombululo. Ngethamsanqa kum, bendingenguye owokuqala kule ndlela, ndiye ndakwazi ukufumana into emangalisayo imiyalelo yevidiyo Uyifaka njani iApache Airflow Windows 10 ngaphandle kokusebenzisa iDocker. Kodwa, njengoko kwenzeka rhoqo, xa ulandela amanyathelo acetyiswayo, kuvela ubunzima, kwaye, ndiyakholwa, kungekhona kum kuphela. Ke ngoko, ndingathanda ukuthetha ngamava am okufaka iApache Airflow, mhlawumbi iya kusindisa umntu ixesha elincinci.

Masihambe ngamanyathelo emiyalelo (spoiler - yonke into ihambe kakuhle kwinqanaba lesi-5):

1. Ukuhlohla i-Windows Subsystem ye-Linux yofakelo olulandelayo lonikezelo lwe-Linux

Le yeyona ngxaki incinci, njengoko besithi:

Iqela lenjongo yolawulo → Iinkqubo → Iinkqubo kunye neMiba → Vula okanye ucime iimpawu zeWindows → Isixokelelwano seWindows se Linux

2. Faka unikezelo lweLinux olukhethileyo

Ndisebenzise isicelo Ubuntu.

3. Ufakelo kunye nombhobho wokuhlaziya

sudo apt-get install software-properties-common
sudo apt-add-repository universe
sudo apt-get update
sudo apt-get install python-pip

4. Ukufakela iApache Airflow

export SLUGIFY_USES_TEXT_UNIDECODE=yes
pip install apache-airflow

5. Ukuqaliswa kwesiseko sedatha

Kwaye kulapho kwaqala khona ubunzima bam obuncinci. Imiyalelo ifuna ukuba ufake umyalelo airflow initdb kwaye udlulele kwinyathelo elilandelayo. Noko ke, ndandisoloko ndifumana impendulo airflow: command not found. Kusengqiqweni ukucinga ukuba kwavela ubunzima ngexesha lofakelo lweApache Airflow kwaye iifayile eziyimfuneko azifumaneki. Emva kokuqinisekisa ukuba yonke into yayilapho kufanele ukuba ibe khona, ndaye ndagqiba kwelokuba ndizame ukucacisa indlela epheleleyo yefayile yokuphuma komoya (kufuneka ijongeke ngolu hlobo: Полный/путь/до/файла/airflow initdb). Kodwa ummangaliso awuzange wenzeke kwaye impendulo iyafana airflow: command not found. Ndizamile ukusebenzisa indlela ezalanayo kwifayile (./.local/bin/airflow initdb), okukhokelele kwimpazamo entsha ModuleNotFoundError: No module named json'enokoyiswa ngokuhlaziya ithala leencwadi Isixhobo (kwimeko yam ukuya kuguqulelo 0.15.4):

pip install werkzeug==0.15.4

Unokufunda ngakumbi malunga ne-werkzeug apha.

Emva kolu qheliso lulula, umyalelo ./.local/bin/airflow initdb igqitywe ngempumelelo.

6. Ukuphehlelela i-Airflow server

Esi ayisosiphelo sobunzima bokufikelela kumoya. Ukwenza umyalelo ./.local/bin/airflow webserver -p 8080 kubangele impazamo No such file or directory. Mhlawumbi, umsebenzisi onamava we-Ubuntu angazama ngoko nangoko ukoyisa ubunzima obunjalo ngokufikelela kwifayile ngokusebenzisa umyalelo export PATH=$PATH:~/.local/bin/ (oko kukuthi, ukongeza / .local/bin/ kwindlela yokukhangela ekhoyo ye-PATH), kodwa esi sithuba sihloselwe abo basebenza ngokuyinhloko kunye neWindows kwaye bangacingi ukuba esi sisombululo sicacile.

Emva kokuguqulwa okuchazwe ngasentla, umyalelo ./.local/bin/airflow webserver -p 8080 igqitywe ngempumelelo.

7.URL: localhost: 8080 /

Ukuba yonke into ihambe kakuhle kwizigaba zangaphambili, ngoko ulungele ukoyisa iincopho zohlalutyo.

Ndiyathemba ukuba amava achazwe ngasentla ekufakeni i-Apache Airflow Windows 10 iya kuba luncedo kubasebenzisi be-novice kwaye iya kukhawulezisa ukungena kwabo kwindalo yonke yezixhobo zokuhlalutya zanamhlanje.

Ngexesha elizayo ndingathanda ukuqhubeka nesihloko kwaye ndithethe malunga namava okusebenzisa i-Apache Airflow kwintsimi yokuhlalutya ukuziphatha komsebenzisi kwezicelo zeselula.

umthombo: www.habr.com