ProHoster > Blog > Utongi > Ziva nekuisa Apache Airflow pa Windows 10

Ziva nekuisa Apache Airflow pa Windows 10

Preamble: nechido chekupedzisira, kubva kunyika yesainzi yezvidzidzo (mushonga) ndakazviwana ndiri munyika yeruzivo tekinoroji, kwandinofanira kushandisa ruzivo rwangu rwenzira yekuvaka chiedzo uye nzira dzekuongorora data rekuyedza, zvisinei, shandisa. tekinoroji stack izvo zvitsva kwandiri. Mukuita kugona matekinoroji aya, ndinosangana nematambudziko akati wandei, ayo, nerombo rakanaka, kusvika parizvino akakundwa. Zvichida iyi positi ichabatsira kune avo vari kutangawo kushanda nemapurojekiti eApache.

Saka, kune iyo pfungwa. Kufemerwa zvinyorwa Yuri Emelyanov nezve kugona kweApache Airflow mumunda we automation yeanalytical maitiro, ini ndaida kutanga kushandisa yakarongwa seti yemaraibhurari pabasa rangu. Avo vasati vajairana neApache Airflow vanogona kufarira muchidimbu chinyorwa pawebhusaiti yeNational Library. N. E. Bauman.

Sezvo iyo yakajairwa mirairo yekumhanyisa Airflow isingaite muWindows nharaunda, shandisa izvi kugadzirisa dambudziko iri docker in my case yaizoshaya basa, ndakatanga kutsvaga dzimwe mhinduro. Sezvineiwo kwandiri, ndakanga ndisiri wekutanga munzira iyi, saka ndakakwanisa kuwana inoshamisa vhidhiyo murayiridzo Maitiro ekuisa Apache Airflow pa Windows 10 pasina kushandisa Docker. Asi, sezvinowanzoitika, kana uchitevera matanho anokurudzirwa, matambudziko anomuka, uye, ndinotenda, kwete kwandiri chete. Naizvozvo, ndinoda kutaura nezve chiitiko changu chekuisa Apache Airflow, pamwe ichachengetedza munhu nguva shoma.

Ngatifambei nematanho emirairo (spoiler - zvese zvakafamba zvakanaka padanho rechishanu):

1. Kuisa iyo Windows Subsystem yeLinux yekuzoiswa kunotevera kweLinux kugovera

Aya ndiwo mashoma ematambudziko, sezvavanotaura:

Control Panel β†’ Zvirongwa β†’ Zvirongwa uye Zvimiro β†’ Batidza kana kudzima maWindows maficha β†’ Windows Subsystem yeLinux

2. Isa kugovera kweLinux kwesarudzo yako

Ndakashandisa application Ubuntu.

3. Kuiswa uye kugadzirisa pip 

sudo apt-get install software-properties-common
sudo apt-add-repository universe
sudo apt-get update
sudo apt-get install python-pip

4. Kuisa Apache Airflow

export SLUGIFY_USES_TEXT_UNIDECODE=yes
pip install apache-airflow

5. Database kutanga

Uye apa ndipo pakatangira matambudziko angu madiki. Mirayiridzo inoda kuti iwe uise mutemo airflow initdb uye enda kune imwe nhanho inotevera. Zvisinei, ndaigara ndichiwana mhinduro airflow: command not found. Zvine musoro kufunga kuti matambudziko akamuka panguva yekuiswa kweApache Airflow uye mafaera anodiwa haasi kuwanikwa. Mushure mekuita chokwadi chekuti zvese zvaive pazvaifanira kunge zviri, ndakafunga kuedza kutsanangura nzira yakazara kune iyo airflow faira (inofanira kutaridzika seizvi: ΠŸΠΎΠ»Π½Ρ‹ΠΉ/ΠΏΡƒΡ‚ΡŒ/Π΄ΠΎ/Ρ„Π°ΠΉΠ»Π°/airflow initdb) Asi chishamiso chacho hachina kuitika uye mhinduro yakangofanana airflow: command not found. Ndakaedza kushandisa imwe nzira kune faira (./.local/bin/airflow initdb), izvo zvakakonzera kukanganisa kutsva ModuleNotFoundError: No module named json'iyo inogona kukundwa nekuvandudza raibhurari tool (munyaya yangu kusvika kuvhezheni 0.15.4):

pip install werkzeug==0.15.4

Unogona kuverenga zvakawanda nezve werkzeug pano.

Mushure meizvi nyore manipulation murairo ./.local/bin/airflow initdb rakapedzwa zvinobudirira.

6. Kutangisa Airflow server

Uku hakusi kupera kwematambudziko nekuwana mafambiro emhepo. Kumhanya kuraira ./.local/bin/airflow webserver -p 8080 zvakakonzera kukanganisa No such file or directory. Pamwe, ane ruzivo mushandisi weUbuntu aibva aedza kukurira matambudziko akadaro nekuwana iyo faira nekushandisa rairo export PATH=$PATH:~/.local/bin/ (kureva, kuwedzera /.local/bin/ kune iripo PATH executable yekutsvaga nzira), asi iyi post inotarisirwa kune avo vanonyanya kushanda neWindows uye vangasafunga kuti mhinduro iyi iri pachena.

Mushure mekunyengera kunotsanangurwa pamusoro apa, murairo ./.local/bin/airflow webserver -p 8080 rakapedzwa zvinobudirira.

7.URL: localhost: 8080 /

Kana zvese zvakafamba zvakanaka mumatanho apfuura, saka wagadzirira kukunda mapeaks ekuongorora.

Ndinovimba kuti chiitiko chakatsanangurwa pamusoro pakuisa Apache Airflow pa Windows 10 ichave inobatsira kune vashandisi vekutanga uye ichamhanyisa kupinda kwavo mune zvakasikwa zvemazuva ano analytics maturusi.

Nguva inotevera ini ndinoda kuenderera mberi nemusoro uye kutaura nezve ruzivo rwekushandisa Apache Airflow mumunda wekuongorora maitiro emushandisi emafoni ekushandisa.

Source: www.habr.com

Voeg