Tseba ho kenya Apache Airflow ho Windows 10

Selelekela: ka thato ea qetello, ho tsoa lefats'eng la mahlale a thuto (meriana) ke iphumane ke le lefats'eng la theknoloji ea tlhahisoleseling, moo ke tlamehang ho sebelisa tsebo ea ka ea mokhoa oa ho etsa liteko le maano a ho sekaseka data ea liteko, leha ho le joalo, e sebetsa. pokello ea theknoloji e ncha ho 'na. Ha ke ntse ke tseba mekhoa ena ea theknoloji, ke kopana le mathata a mangata, ao, ka lehlohonolo, a seng a hlōtsoe ho fihlela joale. Mohlomong poso ena e tla ba molemo ho ba ntseng ba qala ho sebetsa le merero ea Apache.

Kahoo, ho fihlela ntlha. E bululetsoeng sehloho Yuri Emelyanov mabapi le bokhoni ba Apache Airflow tšimong ea ho iketsetsa mekhoa ea ho hlahloba, ke ne ke batla ho qala ho sebelisa lilaebrari tse reriloeng mosebetsing oa ka. Ba sa tsebeng ho hang Apache Airflow ba kanna ba khahloa ke kakaretso e khuts'oane sehlooho webosaeteng ea Laeborari ea Sechaba. N. E. Bauman.

Kaha litaelo tse tloaelehileng tsa ho tsamaisa Airflow ha li bonahale li sebetsa tikolohong ea Windows, sebelisa sena ho rarolla bothata bona docker tabeng ea ka e ne e tla ba e sa hlokahaleng, ke ile ka qala ho batla litharollo tse ling. Ka lehlohonolo ho 'na, ha se 'na oa pele tseleng ena, kahoo ke ile ka khona ho fumana e ntle litaelo tsa video Mokhoa oa ho kenya Apache Airflow ho Windows 10 ntle le ho sebelisa Docker. Empa, joalo ka ha ho etsahala hangata, ha ho latela mehato e khothaletsoang, mathata a hlaha, 'me, ke lumela, eseng bakeng sa ka feela. Ka hona, ke rata ho bua ka phihlelo ea ka ea ho kenya Apache Airflow, mohlomong e tla boloka motho nakoana.

Ha re feteleng ka mehato ea litaelo (spoiler - tsohle li tsamaile hantle mohatong oa 5):

1. Ho kenya Windows Subsystem bakeng sa Linux bakeng sa ho instola ka morao ho phano ea Linux

Ena ke mathata a manyane, joalo ka ha ba re:

Sehlopha sa Taolo → Mananeo → Mananeo le Likarolo → Bulela kapa ho tima likarolo tsa Windows → Windows Subsystem bakeng sa Linux

2. Kenya kabo ea Linux ea khetho ea hau

Ke sebelisitse kopo Botho.

3. Ho kenya le ho ntlafatsa pip

sudo apt-get install software-properties-common
sudo apt-add-repository universe
sudo apt-get update
sudo apt-get install python-pip

4. Ho kenya Apache Airflow

export SLUGIFY_USES_TEXT_UNIDECODE=yes
pip install apache-airflow

5. Ho qala ha database

Mme ke hona moo mathata a ka a manyane a qadileng teng. Litaelo li hloka hore u kenye taelo airflow initdb ebe o fetela mohatong o latelang. Leha ho le joalo, kamehla ke ne ke fumana karabo airflow: command not found. Hoa utloahala ho nahana hore mathata a ile a hlaha nakong ea ho kenya Apache Airflow mme lifaele tse hlokahalang ha li fumanehe. Ka mor'a ho etsa bonnete ba hore ntho e 'ngoe le e' ngoe e ne e le moo e lokelang ho ba teng, ke ile ka etsa qeto ea ho leka ho hlalosa tsela e feletseng ea faele ea moea (e lokela ho shebahala tjena: Полный/путь/до/файла/airflow initdb). Empa mohlolo oo ha oa ka oa etsahala ’me karabo ea tšoana airflow: command not found. Ke lekile ho sebelisa tsela e amanang le faele (./.local/bin/airflow initdb), e leng se lebisitseng phosong e ncha ModuleNotFoundError: No module named json'e ka hlōloang ka ho nchafatsa laebrari werkzeuge (tabeng ea ka ho fihlela ho mofuta oa 0.15.4):

pip install werkzeug==0.15.4

U ka bala ho eketsehileng ka werkzeug mona.

Ka mor'a mokhoa ona o bonolo oa ho laola taelo ./.local/bin/airflow initdb e phethiloe ka katleho.

6. Ho hlahisa seva sa Airflow

Sena ha se pheletso ea mathata a ho fihlella moea. Ho tsamaisa taelo ./.local/bin/airflow webserver -p 8080 e hlahisitse phoso No such file or directory. Mohlomong, mosebelisi ea nang le boiphihlelo oa Ubuntu o tla leka hanghang ho hlola mathata a joalo ka ho fihlella faele ka ho sebelisa taelo export PATH=$PATH:~/.local/bin/ (ke hore, ho eketsa /.local/bin/ ho tsela e teng ea PATH e phethisoang ea ho batla), empa poso ena e reretsoe bao haholo-holo ba sebetsang le Windows mme ba ka 'na ba se ke ba nahana hore tharollo ena e hlakile.

Ka mor'a ho qhekella ho hlalositsoeng ka holimo, taelo ./.local/bin/airflow webserver -p 8080 e phethiloe ka katleho.

7.URL: Localhost: 8080 /

Haeba ntho e 'ngoe le e' ngoe e tsamaile hantle ka mekhahlelo e fetileng, joale u se u itokiselitse ho hlōla litlhōrō tsa tlhahlobo.

Ke tšepa hore phihlelo e hlalositsoeng ka holimo ho kenya Apache Airflow Windows 10 e tla ba molemo ho basebelisi ba li-novice 'me e tla potlakisa ho kena ha bona bokahohleng ba lisebelisoa tsa morao-rao tsa analytics.

Nakong e tlang ke rata ho tsoela pele ka sehlooho le ho bua ka phihlelo ea ho sebelisa Apache Airflow tšimong ea ho hlahloba boitšoaro ba basebelisi ba lisebelisoa tsa mehala.

Source: www.habr.com